JP2000312336A - Video television device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To change the face image of a recorded video character into a user's own face, etc., to enjoy a recorded image by laminating the face image of a photographed character onto a recorded face image for changing the face images. SOLUTION: A video image is reproduced and displayed by a video display means 7, and a face image to be changed is manually designated by an image changing means 5. A video recording means 4 extracts the face image of a designated character and stores the face image data which are automatically and digitally analyzed into a recording medium such as a hard disk. Meanwhile, a photographed image is displayed by the means 7 and this displayed face is stored into a recording medium such as a hard disk of a video recording medium 4. Then the outline of the face image of a video character is manually designated via the means 5. On the basis of these face images of two characters, an image editing means 6 changes and synthesizes the desired face of a video character to be changed into the face image of a photographed character and performs the editing processing of the face image. The synthesized face image is stored in a recording medium of the means 4.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a television having a built-in video device, and more particularly to a digital video television device.

[0002]

2. Description of the Related Art Generally, as shown in FIG. 9, a conventional video television apparatus employs a video and a television which are individually or integrally provided. When the recorded video tape, DVD, or the like is inserted and played, the video is played back by the video playback means 2 and the recorded video is broadcast on the CRT of the video display means 7 of the television.
The sound is output by the amplifier and speaker of the video / audio means 8. On the other hand, in the case of recording the video of the television, the video of the video display means 7 and the audio of the video / audio means 8 are recorded on the video tape or the like inserted in the input means 1 by the video recording means 4. .

[0003]

However, in the conventional video television apparatus as described above, the user can enjoy the recorded video by playing it back, or record the television video and enjoy the video at a convenient time. I couldn't do that. On the other hand, besides just watching the video, you can also participate in the recorded video and act against the movie star, try to become the leading role, or join the sports video and join the famous player There is a problem that the feeling of playing sports or the like cannot be enjoyed by the conventional video television apparatus.

The present invention has been made in view of the above circumstances, and changes a face image of a person who wants to be a person in a recorded image to a face of one's own or a favorite idol star. It is an object of the present invention to provide a video television device that allows the user to enjoy a recorded video.

[0005]

According to a first aspect of the present invention, there is provided a video television apparatus, comprising: an input unit for inputting a recording; and a video reproducing unit for reproducing the input recording. Photographing means for photographing a face image of a person; recording the face image of the photographed person; extracting and digitally analyzing a face image of the person in the image of the image reproducing means; A video recording means for collecting and storing the image, a picture changing means for instructing a change of the face image of the person, and a face image of the person of the photographing means by the instruction of the image changing means, Image editing means for pasting and modifying the image, image display means for displaying the edited image of the image recording means and the image of the image reproduction means, and the image reproduction A video television apparatus characterized by comprising an audio device for outputting audio video stage and said image recording means.

According to a second aspect of the present invention, there is provided a video television apparatus, comprising: input means for inputting a first recording; video reproducing means for reproducing the input first recording;
A second input video reproducing unit for inputting and reproducing the recording of the second input;
Video recording means for extracting and digitally analyzing a face image of a person in the recorded video of the subject, collecting and storing the image as face image data, image changing means for instructing change and correction of the face image of the person, and this image changing means Image editing processing means for performing processing by changing the face image of the person of the first recording to the face image of the person of the second recording in accordance with the instruction of And a video display unit for displaying the video of the video reproduction unit, and an audio unit for outputting audio of the video of the video reproduction unit and the video recording unit.

[0007]

An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a basic configuration of a video television device according to the present invention.

This video television apparatus has a configuration in which a conventional digital video apparatus, a television, a personal computer, and a CCD are integrated. For example, the input means 1 reads input recording and audio and reproduces video. 2, and further receives the recorded video from the video recording means 4 and records and records the video on a video tape or the like. The video reproduction means 2 transmits the input recording and audio to the video display means 7 and the video / audio means 8 such as a television to reproduce the video,
It is also transmitted to the video recording means 4.

The photographing means 3 is a CCD or the like for photographing an original face for changing a face image of a person with respect to the image of the image reproducing means 2. Sent to. Next, the video recording means 4 records the video reproduced by the video reproducing means 2, and when an instruction to change the face image of a person in the video is given, the size, outline, Automatically digitally analyze shadows and the like, and save the analyzed face image data. Further, it transmits / receives signals to / from the image editing processing means 6 and transmits an image in which the face image of the person has been changed to the image display means 7 for broadcasting. In addition, there is a function of transmitting the audio of the video in which the face image of the person has been changed to the video / audio means 8 and outputting it.

On the other hand, the image changing means 5 is a mouse, a keyboard, or the like, and instructs to change or correct the face image of the person to be changed, and is connected to the image editing processing means 6. The image editing means 6 comprises a personal computer or the like. The image editing means 6 converts the face image data of the person analyzed by the video recording means 4 into a face image photographed by the photographing means 3. This performs image editing processing such as correcting and re-editing a face image in accordance with an instruction from.

Note that the signal flow indicated by the dotted arrow shows the case of recording, and the video recording means 4 records and records the video such as a television received by the video display means 7 and the video and audio means 8. There is also a function of recording on a recording medium such as a video tape inserted in the input means 1. Further, even a video in which the face image of the person has been changed can be recorded on a recording medium inserted in the input means 1.

Also, in the case where the video such as a television received by the video display means 7 and the video / audio means 8 is recorded and recorded by the video recording means 4 instead of the video recording inputted to the input means 1, The configuration is such that the face image of a person can be changed in the same manner as the recording input to the input means 1.

FIG. 2 shows a specific configuration of this video television apparatus.
As shown in the figure, the input means 1 is a DV marketed in general.
D, a video tape, a video recorded on a CD or the like, and an Internet or a CATV (cable TV) can be input. The input means 1 is connected to a video reproducing means 2. The video reproducing means 2 displays the recorded video inputted to the input means 1 on a screen of a television, liquid crystal, CRT or the like of a video display means 7, similarly to a conventional video device. And the audio of the recorded video is amplified by the amplifier of the video / audio means 8 and output by the speaker.

Further, the video reproducing means 2 is connected to the video recording means 4 and transmits the recorded video inputted to the input means 1 to the video recording means 4. On the other hand, the video recording means 4 has a CC
D, a video camera, a digital camera, etc., are connected to a photographing unit 3 that can photograph an image. Further, the video recording means 4 automatically and digitally analyzes the face image of the photographed person and the face image of the person in the video recorded by the video reproducing means 2 and collects the face image data. There is a function, and the analyzed face image data is stored in a recording medium such as a hard disk or a cache memory.

Further, the video recording means 4 is connected to an image editing processing means 6 for transmitting and receiving a signal of the image editing processing, and is also connected to the video display means 7 and the video / audio means 8 so that the image editing processing is performed. The screen display and audio output of the recorded video can be performed.

On the other hand, the image editing processing means 6 is a kind of function of a personal computer or the like, and is connected to the image changing means 5.
The image changing means 5 is a mouse, a keyboard, a voice input device, or the like, and instructs the image editing processing means 6 to change, correct, execute, or the like. Further, the image editing processing means 6 reads the size, outline, shadow, and the like of the face and head of the person based on the digitally analyzed face image data of the video recording means 4, and When the face is pasted, an image editing process is performed in which the face image of the person of the recorded video input by the input means 1 is combined with the face, head size, contour, shading, and the like to be combined and changed. In addition, when there is a change, correction, or the like in accordance with an instruction from the image changing unit 5, a change correction process is performed.

FIG. 3 shows an external appearance image of the video television apparatus according to claim 1 of the present invention.
The functions of a CD, a television, a video, a personal computer, and the like are integrally configured.

The operation of the video television apparatus configured as described above will be described with reference to FIGS. First, FIG. 4 shows an embodiment of a screen displayed on the image display means 7 of FIG. 1 according to claim 1, wherein the upper part of the screen in FIG. The recorded video reproduced by the reproducing means 2 is displayed.
On the other hand, the face image of the person photographed by the photographing means 3 shown in FIG.
Displayed in the section. The image of the CCD displayed in section A is such that the person photographed by the CCD approximates the face direction, facial expression, etc., in accordance with the face image of the person in the input recorded video at the top of the screen. By photographing and saving while adjusting the image, it is possible to modify the image by pasting it on the input recorded video on the upper part of the screen without modifying the face image.

If it is desired to correct the CCD image displayed in the area A, the face image of the area A is copied to the area B and corrected manually. In the modification of FIG. 4, the glasses are removed,
The eyes are corrected slightly larger, and the corrected face image can also be manually changed by pasting it on the face image of a person in the input recorded video on the upper part of the screen. Similarly, when a face photograph of an idol star or the like is input by the photographing means 3, the face direction or the like can be corrected and manually changed to be pasted on the face image of the person in the recorded video.

On the other hand, at the bottom of the screen in FIG.
Functions such as correction selection and face direction change are functions of a normal personal computer or the like, and a function for easily correcting a face image is arranged so that an instruction can be given by a mouse or a keyboard.

Next, FIG. 5 relates to claim 1 of the present invention.
5 is a flowchart illustrating an example of an operation that operates in conjunction with an instruction in the screen display example of FIG. 4.

In FIG. 5, a video image such as a movie of a role that the player wants to play is input to the input means 1 (ST1).
Next, the video image is reproduced and displayed on the upper stage of the screen of the image display means 7 (ST2). Then, it is confirmed whether to change the face image of the person in the displayed video image (ST3). If the face image of the person is to be changed, a video image is displayed frame by frame (ST4). Then, the face image to be changed is manually specified by the image changing means 5 (ST5). Then, the video recording means 4 extracts the face image of the designated person and automatically performs digital analysis to collect image data (ST6). Then, the digitally analyzed face image data is stored in a recording medium such as a hard disk (ST7). Then, the process proceeds to step ST8.

On the other hand, it is confirmed by the photographing means 3 whether there is a photographing input (ST21). If there is no shooting input, wait until there is a shooting input. When a photographing input is made, the photographed video is displayed on the video display means 7 (S
T22). Next, when the person's face in the photographed video is himself, as shown in the example of the screen shown in FIG.
Your face is displayed in the section, so that the facial expression, face direction, etc., approximate to the face of the person you want to change to your face in the input video image displayed at the top of the screen If you are OK, save yourself. In the case where the face of the person in the photographed video is not a self but a photograph of an idol star, etc., the CCD image is copied to part B of the corrected image in FIG. Is manually corrected by the image changing means 5 so that the expression, face direction, and the like of the person to be changed are approximated, and the face is stored in a recording medium such as a hard disk of the video recording means 4 (ST23). . Then, in FIG. 5, it is determined whether or not the saved photographed face image is to be pasted on a person in the input video image (ST24).
If it is to be pasted, it is necessary to change only the face portion of the person's face in the input video image displayed in the upper part of the screen of FIG. Designated manually by the change means 5 (ST2
5). Then, the process proceeds to step ST8.

Next, in FIG. 5, in step ST8,
On the basis of the face images of the two persons in steps ST7 and ST25, the image editing processing means 6 changes the face of the person in the video image to be changed to the face image of the photographed person, synthesizes the faces, and performs editing processing. (ST8). Then, the video image synthesized by changing the face of the person is stored in the recording medium of the image recording means 4 (ST9).

Next, it is confirmed whether or not to change the image of the next frame of the input video image (ST10). If the next image is to be changed, the process returns to step ST3, and is repeated until the change is sequentially completed. When the image change is completed and there is no change in the next image, it is confirmed whether or not a video image synthesized by changing the face of the person is displayed on the image display means 7 (ST11). If not displayed, the process ends. When displaying, the synthesized video image is displayed (ST41), and the audio of the synthesized video image is also displayed.
It is output by the video / audio means 8 (ST42). And it ends.

On the other hand, in FIG. 5, when it is desired to watch only the television image without reproducing the video image, by selecting the television image, only the television image is input as in the conventional television (ST12). Then, the television image is broadcast on the image display means 7 (ST13).

In FIG. 5, if there is no change in the video image input in step ST3, a normal video image is displayed on the image display means 7 as in a conventional video device.
(ST31), and the audio of the video image is also output by the video / audio means 8 (ST32). And it ends.

FIG. 6 shows a second embodiment according to the present invention.
FIG. 14 is a diagram illustrating a basic configuration of a video television device according to another embodiment.

It should be noted that FIG. 1 of claim 1 and FIG. 6 of claim 2
6 is provided with a second input video reproducing means 3A in FIG. 6 instead of the photographing means 3 in FIG. 1. FIG. 1 has one video function, while FIG. 6 has two video functions. There is that. The function of the second input video reproducing means 3A is that the photographing means 3 of FIG. 1 changes the input recorded face image based on the captured face image, whereas the second video image A face image of a person is extracted, and the input recorded face image is changed based on the extracted face image.

This video television apparatus has a structure in which two conventional digital video apparatuses, a television and a personal computer are integrated. For example, the input means 1 reads the input recording and audio and reads the video. The transmission to the reproduction means 2 and the reception of the recorded video from the video recording means 4 and the recording and recording on a video tape or the like. The video reproduction means 2 transmits the input recording and audio to the video display means 7 and the video / audio means 8 such as a television to reproduce the video,
It is also transmitted to the video recording means 4.

The second input video reproducing means 3A is a second video device or the like, which reproduces a video of the video reproducing means 2 by recording another video video for changing a face image of a person, The face image for extracting the face is extracted from the second video image and transmitted to the image recording means 4.
Next, the video recording means 4 records the video reproduced by the video reproducing means 2, and when an instruction to change the face image of a person in the video is given, the size, outline, Facial expressions,
Automatically digitally analyze shadows and the like, and save the analyzed face image data. Further, it transmits / receives signals to / from the image editing processing means 6 and transmits an image in which the face image of the person has been changed to the image display means 7 for broadcasting. In addition, there is a function of transmitting the audio of the video in which the face image of the person has been changed to the video / audio means 8 and outputting it.

On the other hand, the image changing means 5 is a mouse, a keyboard, or the like, and instructs to change or correct the face image of the person to be changed, and is connected to the image editing processing means 6. Further, the image editing processing means 6 is constituted by a personal computer or the like, and based on the face image data of the person digitally analyzed by the video recording means 4, processing for changing to the face image input by the second input video reproducing means 3A, Image editing processing such as correcting and re-editing a face image in accordance with an instruction from the image changing means 5 is performed.

The signal flow indicated by the dotted arrow indicates the case of recording, and the video recording means 4 records and records the video such as a television received by the video display means 7 and the video / audio means 8. There is also a function of recording on a recording medium such as a video tape inserted in the input means 1. Further, even a video in which the face image of the person has been changed can be recorded on a recording medium inserted in the input means 1.

Also, in the case where the video such as a television received by the video display means 7 and the video / audio means 8 is recorded and recorded by the video recording means 4 instead of the video recording inputted to the input means 1, The configuration is such that the face image of a person can be changed in the same manner as the recording input to the input means 1.

FIG. 7 shows an example of a screen display of the video display means 7 according to the configuration of FIG. In the uppermost part of the screen in FIG. 7, the recorded video input to the input means 1 and reproduced by the video reproducing means 2 is displayed as the recording of the input means 1 in the same manner as displayed on the upper part of the screen of FIG. Is done.

On the other hand, in the middle part of the screen shown in FIG. 7, the recorded video input to the second input video reproducing means 3A is displayed as the recording of the second input video reproducing means 3A. In the lower part of the screen of FIG. 7, the face image of the person recorded by the input unit 1 or the face image of the person in the second input video reproducing unit 3A, which is manually designated by the image changing unit 5, is displayed. But,
The recorded image is displayed in the C section.

If it is desired to correct the face image displayed in the section C, the face image of the section C is copied to the section D and corrected manually. In the modification example of FIG. 7, the face of the person recorded by the second input video reproducing means 3A is displayed in the section C, copied to the section D, and corrected by adding hair and ears. The face images of the sections C and D can be manually pasted to the face image of a person in the recorded video of the input means 1 and changed.

On the other hand, functions such as recording selection, correction selection, and face direction change at the lower part of the screen in FIG. 7 are functions of a normal personal computer or the like, and functions for easily correcting a face image are arranged. Etc. can be instructed.

FIG. 8 shows a second embodiment according to the present invention.
9 is a flowchart illustrating an example of an operation that operates in conjunction with an instruction in the screen display example of FIG. 7.

In FIG. 8, a video image such as a movie of a role that the user wants to play is input to the input means 1 (ST1).
Next, the video image is reproduced and displayed on the uppermost stage of the image display means 7 (ST2). Then, it is confirmed whether to change the face image of the person in the displayed video image (ST
3). If the face image of the person is to be changed, a video image is displayed frame by frame (ST4). The face image to be changed is manually designated by the image changing means 5 (ST).
5). Then, the video recording means 4 extracts the face image of the designated person and automatically performs digital analysis to collect image data (ST6). Then, the digitally analyzed face image data is stored in a recording medium such as a hard disk (ST7). Then, the process proceeds to step ST8.

On the other hand, the second input video reproducing means 3 shown in FIG.
A, a second video image of a favorite idol star or athlete is input to A (ST2).
1). Then, in FIG. 8, the second input video reproducing means 3A reproduces the input second video video and records it in the video recording means 4 while displaying the second input video in the middle of the screen of the video display means 7. The second video image is displayed as the recording of the means 3A (ST22). Next, it is confirmed whether a face image of a person is extracted from the second video image (ST23). If there is no face image to be extracted, the process proceeds to step ST22 again to display the next screen of the second video image. If there is a face image of a person to be extracted, the process proceeds to step ST24, and the face image to be extracted by the image changing means 5 is manually designated (ST24).

Next, the video recording means 4 extracts the face image of the designated person, automatically digitally analyzes the face, head size, contour, facial expression, shadow, etc. of the face image, and performs the analysis. The collected face image data is collected (ST25). Then, the digitally analyzed face image data is stored in a recording medium such as a hard disk (ST26).

Next, the digitally analyzed second video image of the person's face image is displayed in the lower part of the screen of FIG. 7 as a recorded image in the C section. If there is a correction of the face image of the part C, the face image of the part C is copied to the part D and displayed, and corrected manually by the image changing means 5 (ST2).
7). Next, it is determined whether the face image displayed in the portion C or the portion D in FIG. 7 is to be pasted on the face image of the first video image recorded by the input unit 1 at the top of the screen and changed or not (S).
T28). If it is to be pasted on the face image of the first video image, the face image of the person in the first video image is manually specified by the image changing means 5 (ST29). Then, the process proceeds to step ST8.

Next, in step ST8 in FIG.
On the basis of the face images of the two persons in steps ST7 and ST29, the image editing processing means 6 replaces the face of the person of the first video image to be changed with the face of the person input by the second input image reproducing means 3A. The image is changed to an image and synthesized, and an editing process is performed (ST8). Then, the video image synthesized by changing the face of the person is stored in the recording medium of the image recording means 4 (ST9).

Next, it is confirmed whether to change the image of the next frame of the input video image (ST10). If the next image is to be changed, the process returns to step ST3, and is repeated until the change is sequentially completed. When the image change is completed and there is no change in the next image, it is confirmed whether or not a video image synthesized by changing the face of the person is displayed on the image display means 7 (ST11). If not displayed, the process ends. When displaying, the synthesized video image is displayed (ST41), and the audio of the synthesized video image is also displayed.
It is output by the video / audio means 8 (ST42). And it ends.

On the other hand, in FIG. 8, when the user wants to watch only the television image without reproducing the video image, the user selects the television image and inputs only the television image as in the conventional television (ST12). Then, the television image is broadcast on the image display means 7 (ST13).

Further, in FIG. 8, when there is no change in the video image input in step ST3, a normal video image is displayed on the image display means 7 as in a conventional video device.
(ST31), and the audio of the video image is also output by the video / audio means 8 (ST32). And it ends.

Therefore, according to the configuration of the above-described embodiment, a face image of a person in a conventional video image is changed to a face of oneself or a face of a favorite idol star or a sports player. This allows you to create your own video image. This means that by participating in video footage and acting against movie stars, becoming the main character, and changing the person in the video footage to your favorite idol star, You can feel like directing a movie director, or you can create and enjoy your own video image, such as participating in sports images and playing with famous players.

It should be noted that, in the above embodiment, claims 1 and 2
Although the description has been made separately, a configuration in which both are combined may be adopted.

In the above-described embodiment, the video television apparatus has been described. However, as another application field, for example, a game software or the like is input to the input means 1 to change a face image of a person in the game software. It is equivalent to a game device, and is not particularly limited to a video television device.

Further, the video television apparatus of the present invention comprises input means, video reproducing means, photographing means, video recording means, image changing means, image editing processing means, video display means, video / audio means. However, the present invention is not particularly limited to these components. In addition, the present invention can be variously modified and implemented without departing from the gist.

[0052]

As described above, according to the present invention, the following effects can be obtained. According to the first aspect of the present invention, by changing the face of the user photographed by a CCD or the like by expressing it with an expression more than that of the actor of the video image, as compared with the related art,
You can make your own video image that you are the protagonist, and you can enjoy the image more. In addition, by changing the face of the singer to his / her own face with respect to the image of the singer singing on the stage, there is an effect that it is possible to make the singer feel as if he or she is singing on the stage.
Furthermore, by changing the player's face in a video image of a game such as boxing or professional wrestling to his / her own face and playing it back, there is an effect that an illusion that oneself is actually playing the game can be given. .

Next, according to the second aspect of the present invention, the recording of the first video image of a movie or the like that the user wants to watch is performed, while the recording of the second video image in which the favorite actor is shown is performed. The face can be extracted and the face image of the person in the first video image can be changed, so even if the story of the video is the same, if the actor's face is different, a story with a different image can be produced. There is an effect that production can be expected.

[Brief description of the drawings]

FIG. 1 is a diagram showing a basic configuration of claim 1 to which the present invention is applied.

FIG. 2 is a block diagram of an embodiment showing a specific configuration of the video television apparatus according to claim 1 according to the present invention.

FIG. 3 is an external view of the apparatus according to the first embodiment of the present invention.

FIG. 4 is a diagram showing a screen display example according to claim 1 of the apparatus of the present invention.

FIG. 5 is a flowchart for explaining the operation of the device of the present invention corresponding to claim 1;

FIG. 6 is a diagram showing a basic configuration of claim 2 to which the present invention is applied.

FIG. 7 is a diagram showing a screen display example according to claim 2 of the apparatus of the present invention.

FIG. 8 is a flowchart for explaining the operation of the device of the present invention corresponding to claim 2;

FIG. 9 is a diagram illustrating an example of a configuration of a conventional video television device. DESCRIPTION OF SYMBOLS 1 ... Input means, 2 ... Video reproduction means, 3 ... Photographing means, 4 ...
Video recording means, 5 ... Image change means, 6 ... Image editing processing means, 7 ... Video display means, 8 ... Video audio means, 3A ... Second
Input video playback means.

Claims (2)

[Claims] In a video television apparatus, an input means for inputting a recording, a video reproducing means for reproducing the input recording, a photographing means for photographing a face image of a person, and a face image of the photographed person Video recording means for recording and digitally analyzing a face image of a person in the video of the video reproduction means, and collecting and storing the face image data.
Image changing means for instructing a change and modification of a face image of a person; Image editing processing means, a video display means for displaying the edited video of the video recording means and the video of the video reproduction means, and outputting audio of the video of the video reproduction means and the video recording means. A video television apparatus comprising: 2. A video television apparatus, comprising: input means for inputting a first recording; video reproducing means for reproducing the input first recording; and a second input for inputting and reproducing a second recording. Video reproducing means, and video recording means for extracting and digitally analyzing a face image of a person from the input second video and the video of the first video recorded by the video reproducing means, and collecting and storing the same as face image data Image changing means for instructing change and correction of the face image of a person; and changing the face image of the person of the first recording to the face image of the person of the second recording by the instruction of the image changing means. Image editing processing means for performing processing; video display means for displaying the edited video of the video recording means and the video of the video reproduction means; and audio of the video of the video reproduction means and the video recording means. Output voice And a video television device.