JP2004363772A - Camera and method for morphing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera and a method for morphing that enable a user oneself to freely select an image to be morphed and speedily and easily set processing conditions. <P>SOLUTION: The user is able to select an image to newly be photographed and an image which is already recorded. When a photograph is taken, a composition assistant frame is used to easily match the size and position of a main subject between two images to be morphed. The composition assistant frame and basic markers of morphing processing are recorded while related to the images, and then the user can speedily and easily set conditions by reference to recorded information as to other images to be morphed. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a morphing camera and a morphing method, and more particularly to a morphing camera that displays a morphed image.
[0002]
[Prior art]
Software is known that performs morphing on a personal computer (hereinafter referred to as a PC) or the like to create an intermediate still image by deforming and complementing two still images or to reproduce a moving image of a deformation between still images. In these software, an image taken by a digital camera or an image recorded on a recording medium is taken into a PC or the like, and the taken image is morphed. Such software is generally one in which the size and position of an image are adjusted separately by image editing software or the like when performing morphing.
[0003]
Also, portable toys that perform morphing processing are known (see, for example, Patent Document 1). The portable toy described in Patent Document 1 is prepared in advance by, for example, fetching a program or image for performing a morphing process from the parent machine, and the above image is displayed according to conditions such as the timing of the key operation of the user and the time width. The morphing process is automatically performed and displayed.
[0004]
There is also known an entertainment apparatus that generates and displays various facial expression images of game characters by morphing processing (see, for example, Patent Document 2). In the entertainment device described in Patent Document 2, facial expression images of characters set with control points for morphing are prepared in advance, and these images are morphed according to the progress of the game, the player's operation, and the like. By doing so, the facial expression of the character displayed on the screen can be changed without preparing images for all facial expressions.
[0005]
[Patent Document 1]
JP 2000-115062 A (FIGS. 3, 17, and 18)
[0006]
[Patent Document 2]
JP 2001-319242 A (FIGS. 4 and 8)
[0007]
[Problems to be solved by the invention]
However, in the conventional software as described above, setting of the morphing conditions is complicated and time consuming, such as taking an image from a digital camera to a PC when performing morphing, or adjusting the size and position of the image separately by image editing software. It is necessary.
[0008]
In addition, in portable toys and entertainment devices such as those disclosed in Patent Document 1 and Patent Document 2, images to be morphed are limited to those prepared in advance by a manufacturer or a service provider. It is difficult for the user himself to select.
[0009]
The present invention has been made in view of the above circumstances, and provides a morphing camera and a morphing method in which a user can freely select an image to be morphed and can perform morphing by setting processing conditions quickly and easily. The purpose is to do.
[0010]
[Means for Solving the Problems]
In order to achieve the above object, a morphing camera according to claim 1 outputs an object as a through image and outputs an image as a captured image by inputting a shooting instruction, and an image display for displaying the through image or the captured image. Means, frame display control means for displaying a composition auxiliary frame on the image display means to assist the size and position of the main subject to be photographed, and a captured image photographed or zoomed using the composition auxiliary frame. On the other hand, a marker setting means for setting a reference marker used for generating a morphing image, a recording means for recording the set reference marker as additional information together with a photographed image in which the reference marker is set, and recording in the recording means The two captured images set with the reference markers are set based on the reference markers of the respective captured images. It is characterized with the image generating means for generating a morphing image formed by combining a means for displaying the morphing image on the image display means, further comprising a Te.
[0011]
In the morphing camera according to the first aspect, the user can perform morphing by quickly and easily matching the size and position of the main subject between the two images photographed freely, and can display the morphing image.
[0012]
A morphing camera according to a second aspect is the morphing camera according to the first aspect, further comprising frame setting means for setting at least one of a position and a size of the composition auxiliary frame.
[0013]
In the morphing camera according to the second aspect, by setting the size and position of the composition frame in accordance with the image, the size and position of the main subject can be easily matched between the two images to be morphed.
[0014]
The morphing camera according to claim 3 is the morphing camera according to claim 1 or 2, wherein the recording unit adds the composition auxiliary frame together with a photographed image photographed or zoomed using the composition auxiliary frame. It is characterized by recording as information.
[0015]
In the morphing camera according to the third aspect, when the morphing is repeatedly performed based on the image recorded in the recording unit, it is not necessary to reset the composition auxiliary frame for each morphing.
[0016]
A morphing camera according to a fourth aspect is the morphing camera according to the third aspect, wherein the display control means causes the display device to display a composition auxiliary frame based on additional information recorded in the recording means. It is said.
[0017]
In the morphing camera according to the fourth aspect, the size and position of the main subject of another image can be easily matched to the image recorded in the recording unit based on the composition assisting frame.
[0018]
The morphing method according to claim 5 displays a composition assistance frame for assisting the size and position of the main subject on the image display means for displaying the photographed image, and the composition assistance frame and the size of the main subject of the photographed image. A step of acquiring a first image by relatively adjusting the height and position, a step of setting a reference marker to be used for a morphing process for the first image, and a step of using the first image when acquiring the first image A step of displaying a through image of the subject on the image display means together with the composition auxiliary frame, and photographing the size and position of the main subject of the through image in accordance with the size and position of the composition auxiliary frame; Two images, a step of setting a reference marker for the second image, and the first image and the second image are displayed on each image. And generating a morphing image obtained by synthesizing based on the reference marker that has been set, and displaying the morphing image on the display device, the relative.
[0019]
In the morphing method according to the fifth aspect, the morphing can be performed by quickly and easily matching the size and position of the main subject between two freely photographed images.
[0020]
The morphing camera according to claim 6 is the morphing method according to claim 5, wherein the step of setting a reference marker for the second image includes the reference marker set for the first image and the The method includes the steps of: displaying a second image on a display device; and setting a morphing reference marker for the second image based on the displayed reference marker.
[0021]
In the morphing method according to the sixth aspect, the reference marker for the second image can be set quickly and easily based on the reference marker set for the first image.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of a morphing camera and a morphing method according to the present invention will be described in detail with reference to the accompanying drawings.
[0023]
FIG. 1 shows a configuration of a digital camera 10 to which this exemplary embodiment is applied. The digital camera 10 is controlled by a central processing unit (hereinafter referred to as CPU) 12 to acquire image data (photographing), set image size (digital zoom), frame and marker settings, and morph processing as shown below. Etc.
[0024]
The imaging unit 14 includes a lens, a CCD, and the like (not shown) and outputs image data of a photographed image obtained by photographing the subject. Image data output from the imaging unit 14 is recorded on the recording medium 22 via a media interface (hereinafter, the interface is referred to as I / F) 20.
[0025]
The image data recorded on the recording medium 22 is displayed as an image on a liquid crystal monitor (hereinafter referred to as LCD) 18 via the display control unit 42. The recording medium 22 is configured to be detachable from the digital camera 10.
[0026]
The operation unit 16 includes a release button, a power button, a cross key, and the like (not shown), and is configured to allow the user to input instructions such as shooting, image selection, digital zoom, frame and marker setting.
[0027]
The digital zoom processing unit 24 enlarges or reduces the size of the image by digital zoom according to a user instruction input via the operation unit 16 and control of the CPU 12.
[0028]
The mode switching unit 26 switches the processing mode according to a user instruction input via the operation unit 16 or under the control of the CPU 12. As shown in FIG. 2, the processing mode includes an image setting mode, a photographing mode, and a morphing mode. The morphing mode further includes a marker setting mode and a morphing operation mode.
[0029]
The frame generation unit 28 generates a frame that is a reference for determining the size of the image, and the frame control unit 30 sets the position and size of the frame.
[0030]
The marker generation unit 32 generates a marker serving as a reference point for the morphing process, and the marker control unit 34 sets the position of the marker.
[0031]
The image synthesis unit 36 synthesizes an image based on the image data output from the imaging unit 14 or an image based on the image data recorded on the recording medium 22 with a frame and a marker.
[0032]
The image switching unit 38 sets whether to display on the LCD 18 an image in which frames and markers are not combined or a combined image.
[0033]
The morphing processing unit 40 generates a morphed image based on the two set images and the marker settings for those images.
[0034]
The display control unit 42 controls the imaging unit 14, the frame control unit 30, the marker control unit 34, the image composition unit 36, the image switching unit 38, the morphing processing unit 40, and the like, and images and frames output by these components, A marker or the like is displayed on the LCD 18.
[0035]
Next, the operation of the present embodiment will be described.
[0036]
First, an overview of the morphing process in the digital camera 10 will be described. When the power of the digital camera 10 is turned on, processing is started according to the flow shown in FIG.
[0037]
First, in step 100, the processing mode is set to the image setting mode, and the process proceeds to step 102. In step 102, the first image (hereinafter referred to as image 1) of the two images to be morphed is set. The image 1 can be set from a newly taken image and an image already recorded on the recording medium 22 (described later).
[0038]
Note that an image captured by the digital camera 10 may be recorded on the recording medium 22, or an image separately captured by the user may be recorded.
[0039]
In the next step 104, the processing mode is set to the morphing mode, the process proceeds to step 106, the processing mode is set to the marker setting mode in the morphing mode, and then the process proceeds to step 108.
[0040]
In step 108 and the next step 110, a frame is displayed and set. First, in step 108, as shown in the example of FIG. 7A, the image 1 (the image of the person 1 in the present embodiment) and the frame are superimposed and displayed on the LCD 18. The position of the frame is an initial position set in advance.
[0041]
In step 110, the position of the frame is set. As shown in the example of FIG. 7B, this process is a process of setting the positions of the four lines constituting the frame based on a user instruction input via the operation unit 16. In FIG. 7B, a frame is set according to the contour of the face of the person 1.
[0042]
In this embodiment, the case where the frame is composed of four lines is described. However, the frame is not limited to such a configuration, and may be a circle, an ellipse, a quadrangle, or the like. Good.
[0043]
In the next step 112 to step 116, the marker is displayed and set. First, in step 112, as shown in FIG. 9A, the image 1 and the marker are superimposed on the LCD 18 and displayed. The position of the displayed marker is an initial position set in advance.
[0044]
In step 114, the marker position is set. This process is a process of setting the marker displayed at the initial position to a position based on a user instruction input via the operation unit 16 as shown in FIG. 9B.
[0045]
In the next step 116, it is determined whether or not all markers have been set. This determination can be performed by a user instruction input via the operation unit 16. If the determination is affirmative, the process proceeds to step 118. If the determination is negative, display and setting of the marker are repeated in steps 112 and 114.
[0046]
FIG. 9E shows a state where some markers (markers 1 to 6) are set, and FIG. 9F shows a state where all markers (markers 1 to 14 in the present embodiment) are set. . Each marker is set according to the eyes, nose, both ends and center of the mouth of the person 1, and the top, bottom, left and right of the face contour.
[0047]
In this embodiment, a star-shaped marker is shown as an example of the marker. However, the marker may have a circular shape or a rectangular shape, and a linear or curved marker may be used. Also good.
[0048]
In step 118, the image, the marker, and the frame information are recorded in association with each other for the image 1 for which the marker setting has been completed. By recording the image, the marker, and the frame information in association with each other in this way, it is not necessary to repeat the setting of the marker and the frame every time morphing is performed using the same image.
[0049]
In the next step 120, it is determined whether or not to set the second image (hereinafter referred to as image 2) of the two images to be morphed. This determination can be made based on a user instruction input via the operation unit 16. If the determination is affirmative, the process proceeds to step 122, the processing mode is set to the image setting mode, and then the process proceeds to step 124. If the determination is negative, this processing routine is terminated.
[0050]
In step 124, image 2 is set. The image 2 can be set from a newly taken image and an image already recorded on the recording medium 22 (described later), like the image 1.
[0051]
In the next step 126, the processing mode is set to the morphing mode and the process proceeds to step 128. The processing mode is further set to the marker setting mode and the process proceeds to step 130.
[0052]
In step 130 to step 134, a marker for image 2 is set. First, in step 130, as shown in FIG. 10B, the image 2 (in this embodiment, the image of the person 2) and the marker set for the image 1 are displayed so as to overlap each other.
[0053]
In step 130, since the marker set for image 1 is displayed, the marker may not be set appropriately for image 2. Therefore, in step 132, the marker position is set for the image 2. This process can be performed based on a user instruction input via the operation unit 16.
[0054]
When the marker positions are set, it is determined in step 134 whether or not all marker positions have been set. If the determination is affirmative, the process proceeds to step 136. If the determination is negative, the process returns to step 132 to repeat the marker setting.
[0055]
FIG. 10C shows a state in which some markers (markers 1 to 3) are set for the image 2, and FIG. 10F shows a state in which all markers (markers 1 to 14) are set. . Each marker is set according to the eyes, nose, both ends and center of the mouth of the person 2, and the top, bottom, left, and right of the contour of the face.
[0056]
In step 136, the image 2 for which the marker setting has been completed is recorded in association with the image and the marker information is recorded, and the process proceeds to step 138 to set the processing mode to the morphing operation mode.
[0057]
In step 140, a morphing image is generated based on image 1, image 2, and marker information set for these images. The generation of the morphing image based on the marker information can be performed by a conventionally known method.
[0058]
In the next step 142, the morphing image generated in step 140 is displayed on the LCD 18 (see FIG. 11). Note that FIG. 11 shows a case where a morphing image in which the composition ratio of image 1 and image 2 is 50% is displayed, but the composition ratio of image 1 and image 2 is not limited to 50%. Morphing images synthesized at different ratios may be displayed.
[0059]
Further, by generating a plurality of morphing images synthesized at different ratios, the plurality of images can be continuously reproduced and displayed as moving images. As shown in the example of FIG. 12, the display of such a morphing image starts from the image 1 (FIG. 12A) and goes through the intermediate state (FIGS. 12B to 12F) to the image 2 (FIG. 12). 12 (g)) may be displayed (in the direction of the white arrow), or may be displayed from the image 2 to reach the image 1 (in the direction of the black arrow). These displays can be freely repeated as the user operates the playback start button A1, the playback start button A2, the scroll bar B, the playback stop button C, and the like displayed on the LCD 18 via the operation unit 16. it can.
[0060]
In the next step 144, it is determined whether or not morphing information is recorded. If the determination is affirmative, the routine proceeds to step 146, where the image 1, image 2 and morphing information are recorded, and then this processing routine is terminated. The morphing information includes information indicating which images are to be morphed (image 1 and image 2 in this embodiment) and information for performing morphing from these images.
[0061]
By recording the morphing information in this way, it is possible to repeatedly perform morphing without saving the image generated by morphing, and at this time, it is possible to omit the setting time of the image, the marker, and the like.
[0062]
On the other hand, if the determination in step 144 is negative, the process proceeds to step 148 to determine whether or not to reset the image. This determination can be made based on the support input of the user via the operation unit 16. If the determination is affirmative, the routine proceeds to step 150.
[0063]
In step 150, it is determined whether or not to reset image 1. If the determination is affirmative, the process returns to step 100 to set the processing mode to the image setting mode, and then the image 1 is set (step 102). If the determination is negative, the process returns to step 122 and the processing mode is set to the image setting mode. Is set (step 124).
[0064]
On the other hand, if the determination in step 148 is negative, the processing routine is terminated without recording the morphing information.
[0065]
Next, details of the image 1 setting process in step 102 of the above-described processing routine will be described with reference to FIG.
[0066]
First, in step 200, it is determined whether or not a captured image is selected as the image 1. This determination can be made based on a user instruction input via the operation unit 16. If the determination is affirmative, the process proceeds to step 202 and the processing mode is set to the photographing mode, and then the process proceeds to step 204. After selection, go to step 208.
[0067]
In step 204, photographing is performed to obtain image data of the photographed image.
[0068]
In step 208, an image is displayed on the LCD 18. When the shooting process of step 204 is performed, a shot image is displayed. When a recorded image is selected in step 206, the selected image is displayed.
[0069]
In the next step 210, it is determined whether or not the image 1 is selected again. This determination can be made based on a user instruction input via the operation unit 16. If the determination is affirmative, the process returns to step 200. If the determination is negative, the process proceeds to step 212.
[0070]
In step 212, it is determined whether or not to adjust the size of the image. If the determination is affirmative, the process proceeds to step 214, and as shown in the example of FIG. 6, the image size is adjusted by digital zoom based on the user's instruction input. This processing routine is terminated without adjusting the size, and the process returns.
[0071]
Next, details of the image 2 setting process in step 124 of the above-described processing routine will be described with reference to FIG.
[0072]
First, in step 300, it is determined whether or not a captured image is selected as the image 2. This determination can be made based on a user instruction input via the operation unit 16. If the determination is affirmative, the process proceeds to step 302 and the processing mode is set to the shooting mode, and then the process proceeds to step 304. After selection, go to step 312.
[0073]
In step 304, an image (person 2 in the present embodiment) and a frame are displayed on the LCD 18, as shown in FIG. The frame to be displayed is a frame set for image 1 (person 1 in the present embodiment). By displaying the frame, the user can easily adjust the sizes of the image 1 and the image 2 at the time of shooting.
[0074]
In the next step 306, shooting conditions are set based on user instruction input. This instruction input may include adjustment of the image size by digital zoom, as shown in FIG.
[0075]
In step 308, shooting is performed based on the shooting conditions set in step 306, and the process proceeds to step 314.
[0076]
In step 312, the image and the frame are displayed on the LCD 18. When the photographing process is performed in step 308, the photographed image is displayed. When the recorded image is selected in step 310, the selected image is displayed.
[0077]
In the next step 314, it is determined whether or not to select the image 2 again. This determination can be made based on a user instruction input via the operation unit 16. If the determination is affirmative, the process returns to step 300, and if the determination is negative, the process proceeds to step 316.
[0078]
In step 316, it is determined whether or not to adjust the size of the image. If the determination is affirmative, the process proceeds to step 318, and as in the case of the image 1 (see FIG. 6), after adjusting the size of the image by digital zoom based on the user's instruction input, this processing routine is set and the process returns. And the process routine is terminated without returning the image size.
[0079]
In the present embodiment, the case where a frame set for image 1 is displayed when image 2 is captured is described. However, a predetermined frame is displayed when image 1 is captured. You may do it.
[0080]
Further, in the present embodiment, the case where the subject is a different person between the image 1 and the image 2 is described. However, in the morphing camera and the morphing method according to the present invention, the image 1 and the image 2 have the same person. May be. For example, a morphing image may be generated by setting images having different expressions of the same person, such as an angry face and a laughing face.
[0081]
In this embodiment, the case of performing morphing on a person image is described. However, in the morphing camera and the morphing method according to the present invention, an image to be morphed is not limited to a person, and two images are displayed. One or both may be images other than a person. Thus, in the digital camera 10, the user can morph various images and enjoy morphed images.
[0082]
As described above, in the digital camera 10 to which the present embodiment is applied, two images to be morphed can be freely set from the already recorded image and the newly taken image, and the frame or marker can be set. Morphing conditions can be set quickly and easily using a digital zoom or the like. In addition, since frame and marker settings and morphing information are recorded in association with images, there is no need to reset conditions each time morphing is performed.
[0083]
As described above, in the digital camera 10, the user can freely set an image to be morphed and can quickly and easily set the morphing conditions.
[0084]
【The invention's effect】
As described above, according to the present invention, a user can freely select an image to be morphed, and morphing can be performed by setting processing conditions quickly and easily.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a digital camera according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a processing mode of a digital camera according to an embodiment of the present invention.
FIG. 3 is a flowchart showing an outline of a morphing process according to an embodiment of the present invention.
FIG. 4 is a flowchart showing image 1 setting processing according to an embodiment of the present invention.
FIG. 5 is a flowchart showing an image 2 setting process according to an embodiment of the present invention.
FIG. 6 is an image diagram showing image size adjustment according to one embodiment of the present invention.
FIG. 7 is an image diagram showing frame position setting according to one embodiment of the present invention.
FIG. 8 is an image diagram showing image size adjustment using a frame according to one embodiment of the present invention.
FIG. 9 is an image diagram showing marker settings for image 1 according to one embodiment of the present invention.
FIG. 10 is an image diagram showing marker setting for an image 2 according to one embodiment of the present invention.
FIG. 11 is a diagram illustrating a display example of a morphing image according to the embodiment of the present invention.
FIG. 12 is a diagram illustrating another display example of the morphing image according to the embodiment of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Digital camera, 14 ... Imaging part, 18 ... LCD, 24 ... Digital zoom processing part, 28 ... Frame generation part, 30 ... Frame control part, 32 ... Marker generation , 34... Marker control unit, 36... Image composition processing unit, 40... Morphing processing unit, 42... Display control unit, A 1, A 2. Bar, C ... Playback stop button

Claims (6)

Imaging means for outputting the subject as a through image and outputting it as a photographed image by photographing instruction input;
Image display means for displaying the through image or the captured image;
Frame display control means for displaying a composition auxiliary frame on the image display means in order to assist the size and position of the main subject to be photographed;
Marker setting means for setting a reference marker to be used for morphing image generation with respect to a photographed image photographed or zoomed using the composition auxiliary frame;
A recording unit that records the set reference marker as additional information together with the captured image in which the reference marker is set;
Image generating means for generating a morphing image formed by combining two captured images set with the reference marker recorded in the recording means based on the reference marker of each captured image;
Means for displaying the morphing image on the image display means;
A morphing camera comprising: The morphing camera according to claim 1, further comprising a frame setting unit that sets at least one of a position and a size of the composition auxiliary frame. The morphing camera according to claim 1, wherein the recording unit records the composition auxiliary frame as additional information together with a photographed image photographed or zoomed using the composition auxiliary frame. The morphing camera according to claim 3, wherein the display control unit causes the display device to display a composition auxiliary frame based on additional information recorded in the recording unit. A composition auxiliary frame for assisting the size and position of the main subject is displayed on the image display means for displaying the photographed image, and the size and position of the main subject of the photographed image are relatively adjusted. Obtaining a first image by:
Setting a reference marker to be used for morphing processing for the first image;
Displaying a through image of the subject on the image display means together with the composition auxiliary frame used at the time of obtaining the first image;
Photographing the size and position of the main subject of the through image in accordance with the size and position of the composition auxiliary frame, and obtaining a second image;
Setting a reference marker for the second image;
Generating a morphing image obtained by combining the first image and the second image based on a reference marker set for each image;
Displaying the morphing image on a display device;
Morphing method including. The step of setting a reference marker for the second image includes the step of displaying the reference marker set for the first image and the second image on a display device, and the displayed reference marker. A morphing method according to claim 5, further comprising: setting a morphing reference marker for the second image based on

Images