JPH11196362A - Image pickup device and picked image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily obtain the desired size of in image and a photograph whose size is regulated by providing a frame image storing means, a frame image reproducing means and an image composition means and reproducing and composting a frame which preliminarily registers an object that is picked up on a storing means. SOLUTION: This device picks up the image of a desired mask pattern and fetches it to a DRAM 13. A CPU 21 writes image data in a work area of the DRAM 13, performs background processing, cuts it and performs binarization processing and after that, a signal generator 16 makes it video data and shows it on an LCD 20 through a VRAM 17. An image generating/registering means cuts it out as a mask pattern after a user confirms it and registers it on a mask pattern memory 14B. The cut image and the mask pattern read from the memory 14B are shown on the LCD 20 with them overlapped. After a cut image generating/registering means registers an image on image memory 14A when the positions are adjusted so that a desired image part can be overlapped on the mask pattern, prescribed composition processing is performed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus for picking up an image of a subject and a method for processing a picked-up image, and is particularly suitable for application to a digital still camera, but is not limited thereto.

[0002]

2. Description of the Related Art In recent years, a digital camera capable of converting a subject image converted into an electric signal by an image pickup device such as a CCD into digital data (hereinafter referred to as image data) and recording it on a recording medium to reproduce the image as desired by a user. Have been developed and are becoming popular in the market as image recording / reproducing devices for the masses and image input devices such as personal computers. Many of such digital cameras include a display device that displays a subject image at the time of shooting and also displays a reproduced image at the time of reproduction.

[0003]

In order to process the captured image data stored in the digital camera, the captured image data is stored in an information processing device such as a personal computer, and the stored captured image data is subjected to image processing. Processing is performed using an application program.

[0004] However, when processing captured image data using an existing application program for image processing, the processing operation is extremely complicated. For example, a desired portion in a captured image is cut out and combined with another image. I couldn't do that easily.

An object of the present invention is to provide an image pickup apparatus and an image processing method suitable for cutting out a desired portion in a picked-up image and pasting the cut-out image to another image.

[0006]

In order to achieve the above object, an image pickup apparatus according to a first aspect of the present invention stores an image pickup means for picking up an object, and a frame image to be synthesized with the image picked up by the image pickup means. Frame image storage means, frame image reproduction means for reproducing a desired one from among the frame images stored in the frame image storage means as a reproduction frame image, and generation of a composite image obtained by synthesizing the captured image and the reproduction frame image And synthesizing means.

[0007] The image pickup apparatus according to the first aspect of the present invention includes a picked-up image storing means for storing picked-up images picked up by the pick-up means, and a desired one from picked-up images stored in the picked-up image storing means. An image capturing / reproducing unit that reproduces a reproduced image may be provided, and the synthesizing unit may be configured to generate a composite image in which the reproduced captured image reproduced by the captured image reproducing unit and the reproduced frame image are combined.

[0008] Each of the imaging devices according to the first aspect of the present invention may further include display means for displaying a composite image.

[0009] Each of the imaging devices according to the first aspect of the invention may be configured to further include adjusting means for adjusting the relative position of the captured image in the composite image.

Each of the imaging devices according to the first aspect of the present invention may further include a mask image storage unit configured to store a mask image for masking the captured image, and a generation unit configured to combine the captured image with the mask image to generate a frame image. Means may be further provided.

Further, each of the imaging devices according to the first aspect of the present invention may further include a composite image storage unit for storing a composite image.

[0012] Also, an image pickup apparatus according to a second aspect of the present invention is an image pickup means for picking up an object and outputting a picked-up image, a picked-up image storage means for storing a picked-up image output from the pick-up means, and storing a plurality of patterns. A pattern storage unit, a pattern selection unit that selects a desired one from a plurality of patterns stored in the pattern storage unit, and a pattern stored in the captured image storage unit using the pattern selected by the pattern selection unit. It is characterized by having a cutout image generating means for cutting out a corresponding portion of a taken image to generate a cutout image, and an image synthesizing means for synthesizing the cutout image generated by the cutout image generating means with a desired image.

[0013] The imaging apparatus according to a third aspect of the present invention is an imaging device that captures an image of a subject and outputs a captured image, a captured image storage device that stores a captured image output from the imaging device, and a captured image storage device. Pattern generation means for generating a pattern from the stored image, pattern storage means for storing the pattern generated by the pattern generation means, and image data stored in the captured image storage means using the pattern stored in the pattern storage means. A cut-out image generating unit that cuts out a corresponding portion of the captured image to generate a cut-out image, and an image combining unit that combines the cut-out image generated by the cut-out image generating unit with a desired image.

[0014] In the imaging apparatus according to the third aspect of the present invention, the pattern generating means generates a pattern by extracting a contour in the captured image.

Further, in the image pickup apparatus according to the third aspect of the present invention, the image pickup apparatus further comprises a designating means for designating a photographing distance.
The pattern may be generated by extracting an image portion corresponding to the shooting distance specified by the specifying means in the captured image.

In the imaging apparatus according to the third aspect, the pattern generation means may generate a pattern by binarizing the captured image.

In the imaging apparatus according to the third aspect, the pattern generation means may generate a pattern by calculating a luminance component of the captured image.

According to a fourth aspect of the present invention, there is provided an image pickup device for picking up an image of a subject, a picked-up image storage unit for storing a picked-up image output from the image pickup unit, a drawn data input unit for inputting drawn data, Pattern generating means for generating a pattern from the drawing data input by the input means, pattern storing means for storing the pattern generated by the pattern generating means, and storing the captured image using the pattern stored in the pattern generating means A cut-out image generating unit configured to cut out a corresponding portion of the captured image stored in the unit to generate a cut-out image; and an image combining unit configured to combine the cut-out image generated by the cut-out image generating unit with a desired image. Features.

Further, in the imaging apparatus according to the fourth aspect, the drawing means draws using a cursor or a pointing device.

According to a fifth aspect of the present invention, there is provided an image pickup device for picking up an object and outputting a picked-up image, a display means for displaying a picked-up moving image output from the image pickup means, and an image cutout pattern for storing an image cutout pattern. Storage means, display control means for synthesizing and displaying the image clipping pattern stored in the image clipping pattern storage means on the captured moving image displayed on the display device, key input means, and output from the imaging means. A still image storage unit for storing a still image to be captured, and a key operation unit operated while the captured moving image and the cutout image pattern are displayed on the display unit by the display control unit. Storage control means for storing the captured still image.

Further, in the imaging apparatus according to the fifth aspect of the invention, the storage control means generates a cutout still image by cutting out a corresponding portion of the shot still image using the image cutout pattern displayed on the display means. The cutout still image is stored in the captured still image storage means.

Further, the imaging apparatus according to the fifth aspect of the present invention further comprises a reproducing means for reproducing the captured still image stored in the captured still image storage means, and an image cutout pattern stored in the image cutout pattern storage means. A cut-out image generating unit that cuts out a corresponding portion of the captured still image reproduced by the reproducing unit to generate a cut-out image, and an image combining unit that synthesizes the cut-out image generated by the cut-out image generating unit with a desired image. May be provided.

According to a sixth aspect of the present invention, there is provided an imaging means for imaging a subject and outputting a captured image, a captured still image storage means for storing a captured still image output from the imaging means, and a captured moving image output from the imaging means , A pattern storage unit for storing a pattern, and a cutout image generated by cutting out a corresponding portion of the captured image stored in the captured image storage unit using the pattern stored in the pattern storage unit. A cut-out image generating unit, a display control unit for combining and displaying the cut-out image generated by the cut-out image generating unit on the captured moving image displayed on the display device, a key input unit, and a display unit. When the key input means is operated while the captured moving image and the cutout image are displayed on the means, the captured still image is stored in the captured still image storage means. A storage control unit, and having a.

Further, in the imaging apparatus according to the sixth aspect, the storage control means stores the captured still image and the cut-out image displayed on the display means in the captured still image storage means.

Further, the imaging apparatus according to the sixth aspect of the present invention further comprises a movement instructing means for instructing the display control means to move the cutout image displayed on the captured moving image to a desired position in a display screen. It may be provided.

According to a seventh aspect of the present invention, there is provided an imaging device for imaging a subject and outputting a captured image, a captured image storage device for storing a captured image output from the imaging device, and a captured image storage device. Display means for displaying a captured image, pattern storage means for storing a pattern, display control means for displaying a pattern stored in the pattern storage means on a captured image displayed on the display means, and display control means Moving means for moving a pattern displayed on the captured image to a desired position in the display screen, and cutting out a corresponding portion of the captured image using the pattern moved by the moving means to generate a cutout image A clipped image generating unit; and an image combining unit that combines the clipped image generated by the clipped image generating unit with a desired image.

According to a ninth aspect of the present invention, there is provided a method for processing a captured image, comprising: obtaining a captured image by capturing an object; storing the captured image; generating a pattern from the stored captured image; , A step of cutting out a corresponding portion of the stored captured image using the stored pattern to generate a cutout image, and a step of combining the generated cutout image with a desired image. It is characterized by the following.

[0028]

DESCRIPTION OF THE PREFERRED EMBODIMENTS <Example of Circuit Configuration> FIG. 1 is a block diagram showing an example of the configuration of a digital camera as an embodiment of the imaging apparatus of the present invention. And is connected to the camera body 42 via the.

The lens block 41 includes the imaging lenses 1 and C
A CD (Charge Coupled Device) 2 and an amplifier (digital data) are configured to be supplied to a timing generator.

The timing generator 12 has a terminal 3
The drive circuit 5 is controlled via the control circuit 2 to drive the CCD 2.
The timing generator 12 also writes the image data supplied from the A / D conversion circuit 4 to the DRAM 13.
The image data written in the DRAM 13 is yellow (Ye),
It has cyan (Cy) and green (Gr) color components.

In the DRAM 13, in addition to an area for temporarily storing image data, a work area (work area) for image processing when executing the image processing of the present invention is secured.
The image data written in the DRAM 13 is read out at a constant cycle and supplied to the signal generator 16 when one frame of image data is ready. Also, DRAM1
The image data written in 3 is compressed by the compression / expansion circuit 15 and written into the flash memory 14 (captured image storage means) and stored (recorded).

In the flash memory 14, in addition to an area for recording image data of a photographed image, an area for a cut-out image memory 14A (cut-out image storage means) for recording a cut-out image, and a mask pattern memory 14B for recording a mask pattern (Mask pattern storage means). Further, the area for the cut-out image memory 14A and the area for the mask pattern memory 14B are stored in another recording medium,
For example, it may be provided in a ROM or a memory card.

The signal generator 16 takes out one frame of image data from the DRAM 13 at a constant cycle, and sequentially performs white balance adjustment and color calculation processing on the YUV data (luminance signal Y, color difference signals RY, B). −
Y) is generated and stored in the VRAM 17. The signal generator 16 also stores the YU stored in the VRAM 17.
V data is read out and output to the D / A conversion circuit 18,
After the A / A conversion, the data is output to the liquid crystal display 20 via the amplifier 19 and displayed on the LCD. The video signal output from the amplifier 19 can be output to an external device (not shown).

With the above configuration, the liquid crystal display (LC
D) 20 can display a subject image via the CCD 2 at the time of shooting (through image display), and can display a reproduced recorded image at the time of image reproduction. The subject image displayed at the time of shooting is displayed as a moving image through the imaging lens 1 (that is, a monitor image (hereinafter, referred to as a through image) according to the movement of the subject or the digital camera 100). 20 can also be used as a finder.

In FIG. 1, a transparent position detection sensor (not shown) may be provided on the screen of the liquid crystal display unit 20. As the position detection sensor, for example, a light detection element for detecting specific light or a touch electrode can be used. When a light detection element is used as the position detection sensor, the user can point on the screen by using an input pen that emits specific light (for example, infrared light) as an input means, thereby detecting light at the pointed position. The device becomes active. The CPU 21 detects the coordinates of the photodetector in the active state, and the position and range (shape) of the image pointed to.
You can know. When a touch electrode is used, when the user touches the screen with a touch pen or a fingertip, the electrode of the touched portion is turned on. CPU 21
Can detect the position and range (shape) of the pointed image by detecting the coordinates of the touch electrode turned on.

The CPU 21 executes various processes according to programs stored in the ROM 22 or the flash memory 14. The RAM 23 appropriately stores programs and data necessary for the CPU 21 to execute various processes. The key input unit 24 includes various input keys and buttons as shown in FIG. 2. When operated by a user, the key input unit 24 outputs a state signal of the corresponding key or button to the CPU.
21. In addition to the key input unit 24, a pointing device such as an input pen or a touch pen may be added.

The I / O port 25 executes data input / output interface processing between the CPU 21 and an external device.

The lens block 41 or the camera body 42 may be provided with a distance measuring means (not shown) for measuring the distance to the subject. As the distance measuring means, in addition to the mechanical means, for example, when the digital camera has an autofocus mechanism, the focal length f of the imaging lens 1 obtained by the autofocus operation, the imaging lens 1 and the CCD 2
From the distance a to the subject and the distance b to the subject from the moving distance of the imaging lens 1. Further, the distance measuring means can be constituted by using an infrared light receiving / emitting device.

<Example of Configuration of Key Input Unit> FIG. 2 shows a key input unit 2 provided in a digital camera to which the present invention is applied.
FIG. 4 is a diagram showing an example of the arrangement of four representative keys and buttons.
In FIG. 2, the frame button 61 is a clipped image memory 14A.
The operation key 62 is operated when the cursor displayed on the liquid crystal display 20 is moved in the up, down, left, and right directions, when the cutout image is read out from the user.
The release button 63 is operated when recording a photographed image in the flash memory 14, and the play button 64 is operated when a stored image (photographed image,
This operation is performed when a reproduction mode for reproducing an image registered in advance, a monochrome image, an image registered in an IC card, and the like) is set.

A recording button 65 is operated when setting a recording mode for recording a photographed image in the flash memory 14, a mask button 66 is operated when reproducing a mask pattern (image), and an up / down key 67.
Is operated when moving the cursor displayed on the liquid crystal display 20 up or down, or when giving an instruction to start execution of a function specified by the program, and the like.
8 is a cursor or pointing device (for example,
CPU2 sends a notification such as the start of drawing input by touch pen)
This operation is performed when the operation is performed on the number 1 or the like.

<Processing Mode> FIG. 3 is an explanatory diagram showing an example of the configuration of the processing mode of the digital camera of FIG. 1. The processing mode of the digital camera includes a normal shooting mode consisting of a recording mode and a reproducing mode, a close-up shooting, and the like. The switching between the normal mode and the special shooting mode is performed by switching a processing mode switch (not shown).

When the processing mode is switched to the normal mode, first, the mode transits to the recording mode. The recording mode includes an imaging mode for photographing a subject and displaying a through image, a through image combining mode, and a recording and saving mode for recording a desired through image or a combined image on a recording medium (the flash memory 14 in the embodiment). Contains.

When the play button 64 is pressed in the normal mode, first, the mode transits to the play mode. The reproduction mode includes a reproduction / display mode for reproducing and displaying a recorded image recorded in the flash memory 14, a recorded image composition mode, and image data (composed image data) transmitted to an external device via the I / O port 25. Is included in the output mode.
The mode to which the mode has been changed by the key operation or the button operation of the processing mode changeover switch and the key input unit 24 by the operator is determined by a mode determining means (configured by a program in the embodiment). The mode determining means checks the key and button state signals sent from the key input unit 24 to the CPU 21 and transits to the corresponding mode processing circuit or program.

<Operation of Digital Camera in Each Mode> Next, the operation of the digital camera in FIG. 1 in each mode will be described.

[Operation in Recording Mode] When the processing mode is changed to the recording mode, first, the mode is changed to the imaging mode. In the imaging mode, one frame of image data periodically taken from the CCD 2 is displayed on the liquid crystal display 20 as a through image. When the mask button 66 or the frame button 61 is pressed in the imaging mode, a through image synthesis mode is set,
A desired image can be used as a mask pattern, an image and a desired mask pattern or a cut-out image can be combined and displayed, and image combining can be performed. When the up / down key 67 is pressed, a guide frame for photographing can be displayed. In addition, when the release button 63 is pressed, the recording mode is set, and a desired through image or a combined image can be recorded in the flash memory 14.

(1) Display of photographed and through images In the recording mode, when the user presses the recording button 65, C
The PU 21 sends a photographing instruction signal to control the timing generator 12 so as to capture a subject image. When the timing generator 12 receives the photographing instruction signal from the CPU 21, it drives the drive circuit 5 via the terminal 32,
The image signal converted by the CCD 2 is captured. C
Since an optical image of a subject to which the user points the imaging lens 1 is formed on the CD 2 via the imaging lens 1, the CCD 2
Is driven by the drive circuit 5, and the image signal photoelectrically converted by the CCD 2 is input to the A / D conversion circuit 4 via the amplifier 3. The A / D conversion circuit 4 A / D converts the input image signal into image data, and supplies the image data to the timing generator 12 via the terminal 31. The timing generator 12 receives the input image data (Ye, Cy, G
r) is stored in the DRAM 13. CPU 21 is DRAM
The image data once stored in the memory 13 is read out and supplied to the signal generator 16. Signal generator 1
Numeral 6 adjusts the white balance of the image data, encodes the video data, and encodes the video data (YUV data).
Is generated and temporarily stored in the VRAM 17. The signal generator 16 reads the video data drawn in the VRAM 17 and supplies the video data to the D / A conversion circuit 18.
The D / A conversion circuit 18 performs D / A conversion on the video data, outputs the video data to the liquid crystal display 20 via the amplifier 19, and displays the liquid crystal display. Thus, the liquid crystal display 2
At 0, an image (through image) monitored by the user via the imaging lens 1 is displayed. The user can check the subject by looking at the image displayed on the liquid crystal display 20. Note that video data for a through image to be displayed on the liquid crystal display 20 can be easily generated as described above. For example, since luminance data and chrominance data are generated using only the Ye component of the image data stored in the DRAM 13, an image that changes every moment through the imaging lens 1 using these data (ie, , Through images), and quickly update the LCD display 2
0 can be displayed.

(2) Synthesis of Through Image In the shooting mode, when the user presses the mask button 66 or the frame button 61, the mode becomes the through image synthesis mode.
When the mask button 66 is pressed, a desired portion as a mask pattern is cut out from the through image and registered in the mask pattern memory 14B, or a desired portion of the through image and a desired mask pattern are combined to synthesize the desired portion. Can be created. When the frame button 61 is pressed, the cut-out image memory 14A
The desired cutout image recorded in the image can be pasted and combined. Note that the digital camera 1 in the through image synthesis mode
00 will be described later (FIG. 4, Examples 1-3,
7, 8-10).

(3) Display of Guide Frame When the up / down key 67 is pressed in the image capturing mode, a guide frame for photographing such as a driver's license or a passport photograph can be displayed. The display operation of the guide frame will be described later (Embodiment 7).

(4) Recording and Saving of Images On the other hand, when the recording button is operated by operating the release button 63 in the recording mode, the CPU 21 causes the image data stored in the DRAM 13 (the image data synthesized in the image synthesis mode to be synthesized). (Including image data) to the signal generator 16 to generate (encode) video data more accurately using all of the Ye, Cy, and Gr components.
Then, the image is displayed on the liquid crystal display 20 as a still image. Further, the CPU 21 supplies the video data to the compression / expansion circuit 15 and, for example, JPEG (Joint Photog).
The compression process is performed by the method of (Raphic Experts Group).
The compressed video data is recorded (written) in the flash memory 14. At the time of recording and saving, information relating the mask pattern, the composite image and its background image (in this case, the recorded image) on the flash memory 14 (for example, the image number of the composite image and the background image, the type and image of the mask pattern) The number may be written in the link table 50 provided on the flash memory 14 in association with the image number of the cutout image. The storage position of each image or mask pattern may be written instead of the image number.

[Operation in Playback Mode] In the normal mode,
When the play button 64 is pressed, the mode is set to the play / display mode, in which the recorded image recorded in the flash memory 14 is read, reproduced and displayed on the liquid crystal display 20. Also,
Each time the play button is pressed, the next recorded image is read and reproduced and displayed on the liquid crystal display 20, so that the user can obtain a desired reproduced image. The display image may be fast-forwarded when the play button is kept pressed, and a fast-forward mode in which the image at that time is displayed when the finger is released from the play button may be added. When the mask button 66 or the release button 63 is pressed in the reproduction / display mode, a recording image synthesizing mode is set, and a mask pattern is generated from a desired reproduction image in the recording image, or a desired mask pattern or a cutout image is superimposed on the recording image. It can be displayed or a desired cut-out image can be pasted and combined with the recorded image.

(1) Reproduction and Display of Recorded Image When the user operates the reproduction button 64 of the key input unit 24 to set the reproduction / display mode, the CPU 21 executes the operation for one image written in the flash memory 14. The video data is read and supplied to the compression / expansion circuit 15. The compression / decompression circuit 15 decompresses the video data and supplies it to the signal generator 16. The signal generator 16 adds a synchronization signal or the like to the received video data, draws the video data once in the VRAM 17, reads out the video data drawn in the VRAM 17, and
To supply. The D / A conversion circuit 18 performs D / A conversion of the video data and outputs the D / A signal to the liquid crystal display 2 via an amplifier 19.
Output to 0 for display. Thus, the image recorded in the flash memory 14 can be displayed on the liquid crystal display 20. As described above, unlike the through image, this display image is an image captured by performing more accurate processing, and therefore is displayed as a clearer image than the through image.

(2) Composition of Recorded Image In the reproduction / display mode, when the mask button 66 or the release button 63 is pressed, the mode becomes the recorded image composition mode. When the mask button 66 is pressed, a desired mask from the recorded image is set as a mask pattern. A pattern can be generated, a recorded image and a desired pattern can be superimposed and displayed, and a desired recorded image and a desired pattern can be pasted and synthesized. When the release button 63 is pressed, the mask pattern generated from the recorded image is stored in the mask pattern memory 14B.
Or the generated cut-out image is registered in the cut-out image memory 14A, or the composite image flash memory 1
4 can be registered. Link table 50
If information relating the mask pattern or cut-out image to the composite image and its background image is recorded, the information is updated when recording and saving. The operation in the recording image synthesis mode will be described later (FIG. 4, Example 4).
６，6, Examples 9 and 10).

<Image processing means> The image processing means 100
The image processing in the normal mode is executed. The image processing means 100 can be constituted by a hardware circuit, but in this embodiment, the image processing means 100 is constituted by a program. Some of the modules of the image processing means 100 may be configured by a hardware circuit, and other modules may be configured by a program. Each module of the image processing means 100 constituted by a program is recorded in the ROM 22 or the flash memory 14, and is controlled by the CPU 21 under the control of the control program.
The image processing processing of the present embodiment is realized by execution control. FIG. 4 is a block diagram showing a configuration example of the image processing means 100. The image processing means 100 includes a through-image synthesis processing means 110, a recorded image synthesis processing means 120, and a guide frame display processing means 130.

[Through image synthesizing processing means] The through image synthesizing processing means 110 includes a processing method judging means 111 for judging an image processing method when the mode is switched from the imaging mode to the through image synthesizing mode under the recording mode; A pattern generation / registration unit 112 for extracting a desired mask pattern from the mask pattern memory 14B, and superimposing and displaying the through image and the desired mask pattern, and performing desired cutting from the superimposed and displayed through image and the desired pattern A cut-out image generation / registration unit 113 for generating an image and registering the cut-out image in the cut-out image memory 14A; Image combining means 11
4 is included.

The processing method judging means 111 is activated when the mode is changed from the mode judging means to the live view synthesizing processing means 110, and the CPU 21 judges the operation result (state signal) of the user received from the key input section 24, and If the operation result of the user is the depression of the mask button 66, the pattern generation / registration unit 112 is activated, and if the frame button 61 is depressed, the cutout image generation / registration unit 113 is activated.
If the release button is depressed, through-image combining means 11
Start 4

As an option, when the link table 50 is provided in the flash memory 14, information registered in the link table 50, for example, an image number indicating the relationship between the background image and the composite image, or the background image and the cut-out image or the mask pattern The processing information providing means 115 for generating pointer information or the like indicating the relationship may be incorporated in the subsequent stage of the through-image synthesizing means.

The pattern generating / registering means 112 has a binarized pattern generating means 1121 and a luminance component processing pattern generating means 1122. The pattern generation / registration unit 112 is used when the user finds a desired subject image as a mask pattern in the imaging mode or draws a pattern to be registered as a mask pattern on paper or a board (for example, FIG. 8A). When the user presses the mask button 66 at a desired angle while viewing the image, the processing method determination unit 111 activates the through image (a pattern candidate image).
Into the DRAM 13 and the binary pattern generating means 11
21 is activated, the captured pattern candidate image is binarized, and the binarized pattern (FIG. 8B) is displayed on the liquid crystal display 20. In this case, up / down key 6
7 is pressed, the luminance component processing pattern generating means 1122
Is started, the luminance component of the pattern candidate image is taken in by predetermined bits (8 bits in the embodiment), and the luminance component is changed,
The extracted pattern (FIG. 8B ') is displayed on the liquid crystal display 20. Here, when the release button 63 is pressed, the extracted pattern is stored in the mask pattern memory 14.
B is registered (recorded) in Example B (Example 1).

A pattern generating means 1125 for performing a contour extraction process for detecting and extracting a contour of a subject to extract a desired pattern of the subject image as a mask pattern.
The pattern generation / registration unit 112 may be configured to include

A pattern generating means 1125 for extracting a pattern by moving the cursor on the screen of the liquid crystal display unit 20 by the user using the movement key 62 and tracing the contour of a desired subject image as a mask pattern is included. The pattern generation / registration unit 112 may be configured as described above. Also,
In FIG. 1, a transparent position detection sensor (not shown) is provided on the screen of the liquid crystal display unit 20 as input means in addition to the keys and buttons of the key input unit 24 shown in FIG. When a pointing device (not shown) or a finger can be used, the pattern generating unit 1125 may be configured to trace the contour of the subject image in the through image and extract the mask pattern as a mask pattern (implementation). Example 8).

The mask pattern to be registered is a figure,
It may be a pattern or a frame (for example, a photographing frame indicating the size of an image, such as a photographing frame of a size for a car driver's license or a photographing frame of a size for a passport photograph). Various general subjects such as objects, animals, plants, buildings, signage, and other attached facilities, landscapes, and natural phenomena may be used, as long as they can be photographed and can be extracted as mask patterns. Note that, for a plurality of subjects included in such a general image, a portion corresponding to the distance can be extracted during reproduction to generate a mask pattern. In this case, at the time of shooting, the pattern generation / registration unit 112 is configured to include a distance data storage unit 1126 that obtains the distance from the distance measuring unit to the subject at a plurality of points in the captured image and stores the distance together with the image data (implementation). Example 9). It is desirable that the measured distance data be written in a link table 50 described later.

The pattern generating means 1125 is configured so that the user moves the cursor on the screen of the liquid crystal display unit 20 using the move key 62 to draw a locus, and cuts the drawn figure as a mask pattern. Is also good. Also,
When a transparent position detection sensor (not shown) is provided on the screen of the liquid crystal display unit 20 and can be designated by a pointing device (not shown) such as a touch pen or a finger, the user can The pattern generation unit 1125 may be configured to draw a figure while pointing on the screen of the liquid crystal display unit 20 and cut out the drawn figure as a mask pattern. When the position detection sensor is constituted by a contact type detection sensor such as a touch electrode, a figure drawn by a user touching the screen with a finger can be cut out (Example 10).

The cut-out image generating / registering means 113 cuts out a desired portion of the through image with the desired mask pattern registered in the mask pattern memory 14B and registers (stores) it in the cut-out image memory 14A (Embodiment 2). .

In this case, the user selects a desired one from the mask patterns displayed on the screen. When a desired portion of the through image is cut out with the selected mask pattern, the mask pattern and the through image are combined on a screen and displayed on the liquid crystal display 20 to display the through image (or
(Mask pattern). However, since such a screen display (hereinafter, referred to as a preview screen display) takes time, the cut-out image generation / registration means 113 includes a display coordinate determination means for performing the preview display at high speed in order to speed up the preview display. (Example 11).

The through-image synthesizing unit 114 synthesizes the cut-out image registered in the cut-out image memory 14A with a desired image among the through-images in the imaging mode, and registers (records) it in the flash memory 14 (third embodiment). ). in this case,
The user can move the camera to move the through image so that the cutout images overlap at a desired angle. Also, the displayed cutout image can be moved without moving the camera so as to overlap a desired portion on the through image.

In this case, the user selects a desired one from the cutout images displayed on the screen. In addition, when the selected cut-out image is embedded in a desired portion of the through-image and synthesized, the cut-out image and the through-image are displayed on the screen to perform positioning. In order to speed up such preview screen display, the through-image synthesis 114 can be configured to include a display coordinate determination unit that performs preview display at high speed, similarly to the cutout image generation / registration unit 113 (Example 11). ).

Also, a through image synthesizing means includes a resolution determining means for automatically determining the resolution when the synthesized image is compressed and registered in the flash memory 14 from the resolution of the cut-out image and the resolution of the through image. 114 can be configured (Example 12).

[Recorded image synthesizing means] The recorded image synthesizing means 120 includes a processing method judging means 121 for judging an image processing method when the mode is switched from the reproduction / display mode to the recorded image synthesizing mode in the reproduction mode. Extracting / generating a mask pattern from a recorded image to generate a mask pattern memory 1
Mask Pattern Generation / Registration Unit 122 Registered in 4B
A cut-out image generating / registering unit 123 for superimposing a desired pattern on the recorded image and cutting out the recorded image superimposed and displayed with a desired mask pattern to generate a cut-out image; The image is superimposed and displayed
A recording image synthesizing unit 124 for attaching a desired cut-out image to a desired recording image is included. As an option,
Information registered in the link table 50 when the link table 50 is provided in the flash memory 14, for example, an image number indicating the relationship between the background image and the composite image, pointer information indicating the relationship between the background image and the cutout image or the mask pattern, and the like. May be incorporated in the subsequent stage of the recorded image synthesizing means 124.

The processing method judging means 121 is activated when the mode is changed from the mode judging means to the recorded image synthesizing means 120, and the CPU 21 judges the operation result (state signal) of the user received from the key input section 24, and If the operation result of the user is that the mask button 66 is depressed, the pattern generation / registration means 122 is activated, if the frame button 61 is depressed, the cutout image generation / registration means 123 is activated, and if the release button is depressed, the recorded image synthesis means is activated. Activate 124.

The pattern generating / registering means 122 has a binarized pattern generating means 1221 and a luminance component processing pattern generating means 1222. Here, the binarized pattern generation unit 1221 and the luminance component processing pattern generation unit 12
22 has the same configuration and function as the above-described binarized pattern generation unit 1121 and luminance component processing pattern generation unit 1122, and is therefore configured as a common module, and the pattern generation / registration unit 112 or the pattern generation / registration unit 122 It is preferable that the module branch to the module when activated, and return to the pattern generation / registration unit 112 or the pattern generation / registration unit 122 as soon as the processing is completed.

The pattern generation / registration means 122 performs reproduction /
From the recorded images played back and displayed in display mode,
When the user finds an image desired as a mask pattern and presses the mask button 66, the processing method determination means 12
1 and writes the image into the work area provided in the DRAM 13 and branches to the binarized pattern generating means 1221. When the processing is completed, the binarized pattern is returned and extracted (FIG. 16C). ) To the liquid crystal display 2
Display at 0. In this case, when the up / down key 67 is pressed, the process branches to the luminance component processing pattern generating means 1222, and after the process is completed, returns to the extracted pattern (FIG. 16).
(C ′)) is displayed on the liquid crystal display 20. Here, when the release button 63 is pressed, the extracted pattern is registered (recorded) in the mask pattern memory 14B (Example 4).

The above-mentioned pattern generation / registration means 1
Similarly to 12, the pattern generation / registration unit 122 is configured to include a pattern generation unit 1225 that performs a contour extraction process of detecting and extracting a contour of a subject and extracting a pattern of a desired subject image as a mask pattern. Is also good. In addition, the pattern generation unit 1225 may be configured to generate a mask pattern by extracting a matching image portion based on distance data stored when a user specifies a distance during reproduction (embodiment). 9). Further, similarly to the above-described pattern generation / registration unit 112, the user moves the cursor on the screen of the liquid crystal display unit 20 using the movement key 62 to draw a locus, and extracts the drawn figure as a mask pattern. You may comprise so that the pattern generation means 1225 may be included. Similarly, as input means,
When a transparent position detection sensor is provided on the screen of the liquid crystal display unit 20 and is configured to be able to be designated by a pointing device, the user draws a figure while pointing on the screen of the liquid crystal display unit 20, The pattern generation unit 1225 may be configured to cut out a drawn figure as a mask pattern. In the case where the position detection sensor is configured by a contact-type detection element, the same applies to the point that the user can cut out a figure drawn by touching the screen with a finger (Example 10).

The mask pattern to be registered is a figure, a pattern, a frame (for example, a photographing frame having a size of a photograph for a car driver's license or a size for a passport photograph, as in the case of the pattern generating / registering means 112 described above). , An object, an animal, a natural phenomenon, etc., as long as it can be extracted as a mask pattern.

The cut-out image generation / registration means 123 registers a desired portion of a desired image in the recorded image reproduced by the mask pattern registered in the mask pattern memory 14B in the cut-out image memory 14A (the embodiment). 5). In this case, the user designates and selects a desired pattern from the mask patterns displayed on the screen. Also,
When a desired portion of the print image is cut out with the selected mask pattern, the mask pattern and the print image are combined and displayed on a screen, and positioning is performed. To speed up such preview screen display, a cut-out image generation / registration unit 11
Similarly to the third embodiment, the cutout image generation / registration unit 123 can be configured to include a display coordinate determination unit that performs preview display at high speed (Example 11).

The recorded image synthesizing means 124 synthesizes a desired cutout image registered in the cutout image memory 14A with a desired portion of a desired image of the reproduced recorded images.
The data is recorded in the flash memory 14 (Embodiment 6).

Further, the user can move the displayed cut-out image so that the cut-out image overlaps a desired portion on the reproduced image as the background. Conversely, the reproduced image serving as the background can be moved so that the cut-out images overlap at a desired angle. In this case, the user selects a desired one from the cutout images displayed on the screen. When the selected cutout image is pasted on a desired portion of the recorded image and combined, the cutout image and the recorded image are displayed on the screen and positioned. In order to speed up such preview screen display, the recorded image synthesizing unit 124 can be configured to include a display coordinate determining unit that performs preview display at high speed, similarly to the through image synthesizing unit 114 (Embodiment 11). .

The recorded image synthesizing means includes a resolution determining means for automatically determining the resolution when the synthesized image is compressed and registered in the flash memory 14 from the resolution of the cut-out image or the resolution of the recorded image. 124 can be configured (Example 12).

[Guidance Frame Display Processing Means] The guidance frame display processing means 130 displays, on the liquid crystal display 20, a guide frame pattern such as an ID photo guide frame registered in the mask pattern memory in the imaging mode, and displays the ID photo. When photographing, the photographer adjusts the camera angle so that the image of the photographed person falls within the displayed guide frame, and performs photographing / recording, so that an image of a desired size can be obtained. It is desirable to record the size information in the link table 50 in association with the image at the time of recording so that the desired size can be printed at the time of printing.

<Link Table> FIG. 5 is an explanatory diagram showing an example of the structure of the link table. The link table 50 is information for associating the composite image with its background image (recorded image in this case) on the flash memory 14, that is, It is possible to record the image number of the composite image and the background image, the type and image number of the pattern, the image number of the cutout image, and the like. In FIG. 5, (A) shows an example of a link table in which a combined image, a background image, and a clipped image are associated with each other when a combined image is recorded in the flash memory 14 after pasting and combining. The image number of the image, the image number of the background image in the image number column 512, and the number of the clipped image stored in the clipped image memory 14A are recorded in the clipped image number column 513.

(B) shows an example of a link table for registering information for associating a synthesized image with a background image and a cutout image without recording the synthesized image after pasting and synthesizing. 1-513-n (n ≧
In 1), the number of the cutout image synthesized with the background image of the image number recorded in the image number column 512 is recorded.

(C) is an example of a link table in which information for associating a cut-out image used for generating a cut-out image with a background image (a synthesized image may be used as a background image) and a mask pattern image is registered. In the mask pattern number column 514, the number of the mask pattern used when generating the cutout image of the cutout image number recorded in the cutout image number column 513 among the mask patterns recorded in the mask pattern memory 14B Is recorded. Further, in the composite position column 515, position information (coordinate values) of the background image in which the mask pattern is positioned on the background image when the cutout image is generated is recorded.

When the pattern generation / registration unit 122 is configured to include the image distance data storage unit 1226, a plurality of distance columns are provided for one image, and the distance data to the designated subject is set. Is configured to be recorded. Further, a print size field for designating the size of a print image at the time of image printing may be provided, and a value of the print size or a code corresponding to the print size may be recorded.

<Embodiment> FIG. 6 is an explanatory diagram of an example of synthesizing an image and a cut-out image (paste synthesizing process) in the through image synthesizing mode or the recorded image synthesizing mode. FIG.
The image in (A) is a through image displayed on the liquid crystal display 20 in the imaging mode or a recorded image reproduced in the reproduction mode. It is also assumed that a cutout image as shown in FIG. 6B is stored in the DRAM 13 or is registered in the cutout image memory 14A in advance. In this case, in the pasting and combining process, the image of FIG. 6A and the cutout image shown in FIG.
A composite image shown in (C) is generated. Hereinafter, embodiments of the through image synthesis mode and the recorded image synthesis mode will be described.

[Embodiment 1]: Pattern Generation / Registration Process (Generation / Registration of Mask Pattern from Through Image) This embodiment is an embodiment of the pattern generation / registration unit 112, and is executed under the through image synthesis mode. This is an example in which a desired mask pattern is extracted from an image by background processing and registered in the mask pattern memory 14B. FIG. 7 is a flowchart showing one embodiment of the pattern generation / registration processing operation, and FIG. 8 is an explanatory diagram of the pattern generation / registration process based on the flowchart of FIG. In FIG. 7, an image as shown in FIG. 8A (a heart mark drawn on paper or a board in this example) desired by the user as a mask pattern in the imaging mode.
Is photographed, a subject image (heart mark) is once taken into the DRAM 13 and displayed as a through image (T1).

Next, the CPU 21 writes the image data once stored in the DRAM 13 into the work area of the DRAM 13 by moving the camera and operating the mask button 66 at a desired angle while watching the through image (T2).

Here, the CPU 21 checks whether or not the user has operated the up / down key 67.
If the is operated, the process proceeds to T7 (T3). If the is not operated, the subject image (image data) written in the work area is cut off by background processing and then binarized ( T4).

After the binarization processing, the signal generator 16
Converts the binarized image data into video data and outputs
After drawing on the VRAM 17, the video data drawn on the VRAM 17 is read out, output to the liquid crystal display 20 and displayed. As a result, a through image is displayed on the liquid crystal display 20 as a result of processing the patterning candidate image monitored by the user via the imaging lens 1 into a binary pattern. The user can confirm the pattern (FIG. 8B) by viewing the image displayed on the liquid crystal display 20 (T5).

Here, the CPU 21 checks whether or not the user has operated the release button 63. If the release button 63 has been pressed, the process proceeds to T12, and if not, the process returns to T3 (T6). Up-down key 6 at T3
In the case where 7 has been operated, it is checked whether a luminance component changing operation has been performed. The presence or absence of the luminance component change operation is determined by whether the plus and minus up-down keys are pressed simultaneously or only one of them, and when pressed simultaneously, it is determined that the change operation has not been performed, and the process proceeds to T9. If pressed, it is determined that a change operation has been performed, and the process proceeds to T8 (T8).
7).

At T7, the up / down key 67 (+)
Is pressed, the luminance value is shifted by a predetermined value (in this embodiment, one by one) to a higher value, and when the up-down key 67 (-) is pressed, the luminance value is shifted by a predetermined value (one in this embodiment). ). Therefore, the up-down key 67
By operating the (+) or the up-down key 67 (-), the luminance value of the pattern can be changed (T8). The luminance component of the pattern candidate image written in the work area of the DRAM 13 is fetched and processed by 8 bits,
It is patterned (T9).

Each time the up / down key 67 is operated once, the signal generator 16 converts the brightness-processed image data into video data, draws it on the VRAM 17,
The video data drawn in the RAM 17 is read out and output to the liquid crystal display 20 for display. As a result, a through image is displayed on the liquid crystal display 20 as a result of processing the patterning candidate image monitored by the user via the imaging lens 1 into a brightness processing pattern. The user can confirm the pattern (FIG. 8B ′) by looking at the image displayed on the liquid crystal display 20 (T10).

Here, the CPU 21 checks whether or not the user has operated the release button 63. If the release button 63 has been operated, the process proceeds to T12, and if not, the process returns to T7 (T11). . When the release button 63 is pressed at T6 or T11, that is, when a desired mask pattern (FIG. 8B or 8B) is obtained, the CPU 21 displays the pattern displayed at that time. Is extracted as a mask pattern and registered in the mask pattern memory 14B (T12). The luminance component processing pattern image obtained in T10 becomes a pattern in which the periphery of the pattern is blurred as shown in FIG. 8B ′, and a blurred cutout as shown in FIG. An image (cutout image) can be obtained.

According to this embodiment, the drawn picture can be photographed and extracted / registered as a mask pattern, so that the registration of the mask pattern can be made extremely simple. In addition, since a favorite pattern can be designed and registered, an image based on the design pattern can be
For example, trial production of a trademark or a company emblem can be easily performed. Also,
In the above description, an example was described in which a drawn picture was photographed and extracted / registered as a mask pattern. However, the present invention is not limited to this. Among them, it is also possible to extract and pattern what the user wants to pattern, or to pattern a figure directly drawn and input.

The former is an example in which a contour of a subject is detected and extracted to perform a contour extraction process to extract a desired subject image pattern as a mask pattern. Example of extracting a pattern by tracing the outline of the image to be processed. A transparent position detection sensor is arranged on the screen,
An example of extracting a pattern by tracing the outline of a through image with a pointing device such as a touch pen (Example 8) can be given. As an example of the latter, the user moves a cursor on the screen and moves the cursor. Example in which a drawn figure is input and extracted as a mask pattern (Example 9). A transparent position detection sensor is provided on the screen,
Examples include, but are not limited to, an example in which a figure is drawn on a screen with a pointing device such as a touch pen and extracted as a mask pattern.

[Second Embodiment]: Cutout Image Generation / Registration Process (Generation / Registration of Cutout Image from Through Image and Mask Pattern) This embodiment is an embodiment of the image generation / registration unit 113, In this example, a through image and a registered mask pattern are appropriately combined in an image combining mode to form a cutout image, which is then cut out and registered. FIG. 9 is a flowchart showing one embodiment of the cutout image generation / registration processing operation. FIGS. 10 and 11 are explanatory diagrams of the cutout image generation / registration process based on the flowchart of FIG. Hereinafter, a case will be described as an example where the user uses a subject image as shown in FIG. 10A as a cutout image.

In FIG. 9, a subject as shown in FIG. 10A desired by the user as a cut-out image is photographed in the imaging mode, and the subject image is once taken into the DRAM 13 and displayed as a through image (U1). Here, the CPU 21 checks whether or not the mask button 66 has been operated (S2).

When the user presses the mask button 66, the CPU
21 reads out the mask pattern stored in the mask pattern memory 14B, draws it on the VRAM 17 via the signal generator 16, reads out the mask pattern drawn on the VRAM 17, reads the mask pattern via the D / A conversion circuit 18 and the amplifier 19, It is displayed on the display 20. Thereby, for example, the mask pattern as shown in FIG. 10B is superimposed on the through image as shown in FIG. 10A and the liquid crystal display 20 as shown in FIG.
Will be displayed. In this case, the mask pattern is positioned at the center of the screen (U3).

Here, when the mask button 66 is further pressed, the next mask pattern is read out and superimposed on the through image, so that the user can check whether or not the mask pattern displayed on the liquid crystal display 20 is the desired one. If it is determined that the mask pattern is not the desired one, the mask button 66 is pressed until the desired mask pattern appears, and the mask pattern and the through image are combined and superimposed and displayed (U4).

When a desired mask pattern is displayed in U4, the user looks at the through image superimposed on the mask pattern in U4 (for example, the desired portion of the through image is the same as the mask pattern at the center of the screen). If it is determined that the position of the through image needs to be corrected (because it does not overlap), the user moves the camera and adjusts the angle so that the desired portion of the through image overlaps the mask pattern in the center of the screen. As described above, when it is not necessary to correct the position of the through image, the release button is pressed (U5). CPU
21 checks whether the user has pressed the release button 63 (U6), and if the release button 63 has been pressed,
An image portion displayed on the liquid crystal display 20 (FIG. 1)
0 (D)) and registers it in the clipped image memory 14A (U7). In step U5 of FIG. 9, the user moves the camera to correct the position of the through image so that the desired portion of the through image overlaps the mask pattern at the center of the screen. However, the user moves step U5. Key 62
(Or, an input means such as a pointing device) may be operated to move the mask pattern.

As described above, the cut-out image memory 14A
When the cutout image created by the user himself is registered in, the combining process (Examples 3 and 5) described later can be performed. FIG. 10B shows a binarized pattern. In this case, the cutout image has clear boundaries as shown in FIG. 10D. On the other hand, in the above embodiment, FIG.
FIG. 11 uses a luminance processing pattern as shown in FIG.
When a cut-out image as shown in (D) is generated, a cut-out image with a blurred boundary can be obtained. Further, in step U7 in FIG. 9, the image portion displayed on the liquid crystal display 20 is cut out and registered. However, at the time of shooting, the cut-out image is not registered as a cut-out image, and the cut-out image generation / registration process is performed during reproduction. You may do so.

[Embodiment 3] Paste synthesis processing (synthesis of a through image and a clipped image) This embodiment is an example of the through image synthesis processing unit 114, and performs the processing of the through image in the through image synthesis mode. This is an example of combining cutout images registered in the cutout image memory 14A.

FIG. 12 is a flowchart showing one embodiment of the pasting / combining processing operation of the digital camera of FIG. 1, and FIGS. 13 and 14 are explanatory diagrams of the pasting / combining process based on the flowchart of FIG. FIG. 12 (A)
Then, the user shoots a desired subject in the imaging mode, takes the subject image into the DRAM 13, and displays a through image (V1).

Next, when the user presses the frame button 61 (V2), the CPU 21 reads out the first cut-out image from the cut-out images recorded in the cut-out image memory 14A and supplies it to the signal generator 16, where the VRAM is read.
17 is drawn. Since the through image captured at V1 is already drawn in the VRAM 17, as a result,
In the VRAM 17, an image obtained by synthesizing the through image and the reproduction cutout image is drawn. This composite image is read by the signal generator 16, D / A converted by the D / A conversion circuit 18, output to the liquid crystal display 20 via the amplifier 19, and is output to a predetermined position of the liquid crystal display 20 (in the embodiment, (Center). As a result, for example, a composite image as shown in FIG. In FIG. 13A, reference numeral 21 denotes a through image, and reference numeral 22 denotes a through image.
Is a cutout image, and 23 is an example of a background image (V3).

The user looks at the composite image 20 shown in FIG. 13A displayed on the liquid crystal display 20, and determines whether or not the displayed clipped image 22 is a desired clipped image. If the clipped image 22 being displayed is not the desired clipped image, the process returns to V2. The user keeps pressing the frame button 61 until the composite image with the desired cutout image is displayed. As a result, the CPU 21 reads out the next cut-out image recorded in the cut-out image memory 14A, and displays the composite image at a predetermined position on the liquid crystal display 20 using the above V3 in the same manner as described above. When the composite image with the desired cut-out image is displayed, the process proceeds to V5 (V4).

The user looks at the image displayed in the above V4 (for example, when the layout of the pasted image 22 is not preferable as shown in FIG. 13A in the composition), the position of the through image 21 is determined. If you determine that you need to make corrections,
When the user moves the camera and adjusts the angle, FIG.
As shown in (B), a desired portion of the through image 21 is made to overlap the cutout image 22 at the center of the screen. If it is not necessary to correct the position of the through image 21, the release button is pressed (V5).

When a desired composite image is obtained in V5, the user selects whether or not to record it in the flash memory 14 (V6). As a result of the selection, if the composite image is recorded in the flash memory 14, when the user further operates the release button 63 (V7),
The CPU 21 reads out the composite image data currently drawn in the VRAM 17 and records it in the flash memory 14 as one of the recording images (V8). If the synthesized image is not recorded in the flash memory 14 as a result of the selection in V6, the synthesized image is simply displayed on the liquid crystal display 20 in this case.

Note that in step V5 of FIG.
Although the user moves the camera to correct the position of the through image 21 so that a desired portion of the through image overlaps the pasted image 22, the user moves the cursor to the cursor moving key 62 (or pointing) at step V5. The cutout image may be moved by operating input means such as a device. In this case, if it is necessary to correct the position of the cut-out image in step V5 as shown in FIG. 12B, the user operates a moving key corresponding to a predetermined direction among the moving keys 62 (V5). '), The CPU 21 moves / displays the cutout image in the direction corresponding to the operated move key 62, returns to V5 (V5 "), and returns to V5".
5 as a result of the selection in step 5 (OK as a result of the correction operation by V5 ′, V5 ″)
In this case, the processing can be shifted to V6.

FIGS. 13 (A ') and 13 (B') show an example in which the cutout image is moved. In FIG. 13 (A '), the position of the cutout image 22 at the center overlaps the background and the background is not visible. In this example, the cutout image 22 is moved to the upper left by operating the move key 62 as shown in FIG.

Further, in the present embodiment, the composite image data is recorded as one of the recorded images in the flash memory 14 as described in the above V8, but the present invention is not limited to this, and the link table 50 (FIG. ) May be provided in the flash memory 14 so that, when a composite image is recorded, the information is registered in the link table 50 with a meaning different from the recorded image. Instead of recording the composite image, only the information is registered in the link table 50, and when the composite image is displayed or output to an external device, the composite image is reproduced based on the information registered in the link table 50. May be configured. Note that FIG.
Is a composite image with the binarized pattern. In this case, the boundary of the clipped image 22 is clear. On the other hand, in the above-described embodiment, if the cutout image 22 ′ formed by the synthesized image with the luminance processing pattern as shown in FIG. 14 is used, a synthesized image with a blurred boundary with the cutout image can be obtained.

[Embodiment 4]: Pattern Generation / Registration Process (Generation / Registration of Mask Pattern from Recorded Image) In Embodiment 1 described above, a desired mask pattern was extracted from a through image and registered, but a mask pattern was recorded from a recorded image. Can be extracted and registered. This embodiment is an embodiment of the pattern generation / registration unit 122, in which a desired portion is extracted as a mask pattern from a reproduced desired recorded image and registered in the mask pattern memory 14B in the recorded image combining mode. It is.

FIG. 15 is a flowchart showing one embodiment of the pattern generation / registration processing operation, and FIG.
FIG. 14 is an explanatory diagram of a pattern generation / registration process based on the flowchart of FIG. In FIG. 15, the user operates the play button 64 to set the play mode, and plays and displays the first recorded image. The user can operate the mask button 66 to reproduce an image including the subject to be used as the mask pattern and display the reproduced image on the liquid crystal display 20. For example, a reproduced image as shown in FIG. 16A (in this example,
The image of the picture on which the pattern is drawn) is
Will be displayed. Further, the CPU 21 displays a frame-shaped cursor 171 at a predetermined position on the screen by a predetermined operation (W
1).

Next, when the user positions the cursor 171 so as to surround the desired image 172 while viewing the reproduced image and operates the mask button 66, the CPU 21 causes the video data (compressed data) recorded in the flash memory 14 to be read. ), The data corresponding to the portion surrounded by the frame of the cursor 171 is read and supplied to the data compression / expansion circuit 15. Then, the decompressed video data (FIG. 16B) is written into the work area of the DRAM 13 (W2). If the desired image is larger than the cursor 171 at W1, the cursor 171 can be enlarged by pressing the up / down key 67 (+) to surround the desired image. If the desired image is too small compared to the cursor 171, the size of the frame can be adjusted by pressing the up / down key 67 (−) to reduce the cursor 172.

Here, the CPU 21 checks whether or not the user has operated the up / down key 67 (W3). If the user has operated the up / down key 67, the process shifts to W7. After the subject image (image data) written in is cut out, binarization processing is performed (W
4). After the binarization process, the signal generator 16 converts the binarized image data into video data and renders the video data on the VRAM 17, then reads out the video data rendered on the VRAM 17 and outputs the video data to the liquid crystal display 20 for display. As a result, the liquid crystal display 20 displays the result of processing the reproduced patterning candidate image into a binary pattern. The user can confirm the pattern (FIG. 16C) by viewing the image displayed on the liquid crystal display 20 (W5).

Here, the CPU 21 checks whether or not the user has operated the release button 63. If the release button 63 has been operated, the process proceeds to W12, and if not, the process returns to W3 (W6). . When the up / down key 67 is operated in the above W3, it is checked whether or not the luminance component changing operation is performed.
If so, the process proceeds to W8 (W7). In the above W7,
When the luminance component changing operation is performed, when the up-down key 67 (+) is pressed, the luminance value is shifted by a predetermined value (in this embodiment, one by one) to a higher value, and the up-down key 67 (-) is pressed. Then, the luminance value is shifted by a predetermined value (in this embodiment, one by one) to a lower value. Therefore, the up-down key 67 (+) or the up-down key 67
By operating (-), the luminance value of the pattern can be changed (W8).

The luminance component of the pattern candidate image written in the work area of the DRAM 13 is fetched and processed into 8 bits to form a pattern (W9). Up / down key 67 is 1
Each time the signal generator 16 is operated, the signal generator 16 converts the luminance component processed image data into video data and
7, the video data drawn in the VRAM 17 is read out, output to the liquid crystal display 20, and displayed. As a result, the result of processing the desired patterning candidate image read from the flash memory 14 by the user into the luminance component processing pattern is displayed on the liquid crystal display 20. The user can confirm the pattern (FIG. 16C ′) by looking at the image displayed on the liquid crystal display 20 (W10).

Here, the CPU 21 checks whether or not the user has operated the release button 63. If the release button 63 has been operated, the process proceeds to W12, and if not, the process returns to W7 (W11). . When the release button 63 is pressed by the above W6 or W11, that is, when a desired mask pattern (FIG. 16 (C) or (C ′)) is obtained, the CPU 21 masks the displayed pattern image. The pattern is registered in the mask pattern memory 14B (W12).

According to this embodiment, the luminance component processed pattern image obtained in W10 becomes a pattern in which the periphery of the pattern boundary is blurred as shown in FIG. It is possible to obtain a blurred cutout image (cutout image). Further, according to the present embodiment, a recorded image can be reproduced and extracted / registered as a mask pattern, so that a photographed, recorded and stored image can be taken out at a desired time and a mask pattern can be created by a simple operation. .

In this embodiment, step W1 is performed as shown in FIG.
A frame type cursor 171 as shown in FIG.
In step 2, the portion surrounded by the cursor 171 in the reproduced image is extracted, but the present invention is not limited to this. As such an alternative embodiment, a point cursor is displayed in step W1, and in step W2, the user operates the movement key 62 to move the cursor on the screen to trace the outline of a desired portion of the reproduced image and trace the image. Example of extracting the closed area pattern, where a transparent position detection sensor is placed on the screen,
An example in which a contour of a desired portion of a reproduced image is traced by a pointing device such as a touch pen and a traced closed region is extracted as a pattern (Eighth Embodiment). The distance data of a plurality of subjects included in the image is recorded together with the image data, and the image is reproduced and the distance is specified to identify a certain portion in the reproduced image,
An example in which it is extracted (Example 9), and an example in which a user moves a cursor on a screen using a movement key and traces the contour of a subject image to perform a contour extraction process to extract a pattern.

[Embodiment 5]: Recorded image synthesizing process (combination of recorded image and cutout image) In this embodiment, the recorded image recorded in the flash memory 14 and the cutout image memory 14A are stored in advance in the recorded image synthesizing mode. This is an example of recording image synthesis by a recording image synthesizing unit 124 that synthesizes a clipped image with a registered frame.

FIG. 17 is a flowchart showing one embodiment of the recorded image synthesizing processing operation of the present invention, and FIG.
FIG. 4 is an explanatory diagram of a synthetic image generation process based on the flowchart of FIG. In FIG. 17, the user reads the recorded image to be synthesized from the flash memory 14 and displays the image on the liquid crystal display 20. In this operation, the playback mode is set by operating the playback button 64, and the first recorded image is played back and displayed.
The desired image is reproduced / displayed by operating the up / down key 67 (reproduction / display mode). Thereby, for example, a reproduced image as shown in FIG. 18A is displayed on the liquid crystal display 20 (S
1).

Next, when the user operates the frame button 61 (S2), the CPU 21 causes the cut-out image memory 14 to operate.
A predetermined cutout image is read out from the cutout image recorded in A, supplied to the signal generator 16, and
The image is drawn on the RAM 17. The VRAM 17 already has the S
Since the recorded image reproduced in step 1 is drawn, as a result, an image in which the reproduced image and the reproduced cut-out image are combined is drawn in the VRAM 17. The synthesized image is read out by the signal generator 16, D / A converted by the D / A conversion circuit 18, output to the liquid crystal display 20 via the amplifier 19, and displayed. Thereby, for example, a composite image as shown in FIG. 18B is obtained (S3).

The user looks at the composite image displayed on the liquid crystal display 20 and selects whether or not the displayed image is a desired cut-out image. If the displayed image is not the desired cutout image, the process returns to S2 and the frame button 61 is operated again. Thereby, the CPU 2
1 reads out the next cut-out image recorded in the cut-out image memory 14A and reads out the S in the same manner as described above.
In step 3, the composite image is displayed on the liquid crystal display 20. The user keeps pressing the frame button 61 until the composite image with the desired clipped image is displayed, and if the composite image with the desired clipped image is displayed, the process proceeds to S5 (S4).

The user looks at the composite image and looks at the frame (frame).
Select whether it is necessary to correct the position of the image inside. As a result of the selection, if it is necessary to correct the image in the frame, the process proceeds to S6, and if not, the process proceeds to S8 (S5). If it is necessary to correct the position of the image in the frame in S5, the user operates a moving key corresponding to a predetermined direction among the moving keys 62 (S5).
6), the CPU 21 moves / displays the reproduced image in the direction corresponding to the operated move key 62, and returns to S5 (S5).
7). For example, when the movement key 62 is operated to instruct a leftward and downward movement while the composite image shown in FIG. 18B is displayed, as shown in FIG. The displayed image moves to the lower left. As described above, when the user operates the movement key 62, the background image (the reproduced recorded image) can be moved within the frame and positioned at a desired position. In addition,
The cutout image may be moved instead of the background image.

If it is determined that it is not necessary to correct the image in the frame as a result of the selection in S5 (position correction (S6,
If the result of S7) is OK, the user selects whether or not to record the composite image currently displayed on the liquid crystal display 20 in the flash memory 14 (S8). As a result of the selection, if the composite image is to be recorded in the flash memory 14, the process proceeds to S9; otherwise, the process is terminated. In this case, the composite image is simply displayed on the liquid crystal display 20. S8 above
As a result of the selection made in step (1), when the composite image is to be recorded in the flash memory 14, when the user further operates the release button 63 (S9), the CPU 21
7, the composite image data currently drawn is read and recorded in the flash memory 14 as one of the recorded images (S10).

In this embodiment, as described in S10, the composite image data is recorded as one of the recording images. However, the present invention is not limited to this, and the link table 50 (FIG. 5) may be stored in a flash memory. 14, when the composite image is recorded, the information may be registered in the link table 50 with the meaning of an image different from the recorded image, and a link may be used instead of recording the composite image. When only such information is registered in the table 50, the link table 50 is used when displaying a composite image or outputting the composite image to an external device.
May be configured to reproduce a composite image based on the information registered in.

[Embodiment 6]: Cutout image generation / registration processing (generation of cutout image from recorded image and mask pattern)
(Registration) In the synthesizing process, the frame-attached clipped image recorded in advance in the clipped image memory 14A is read as appropriate, and a desired image is selected from a plurality of clipped images. A cut-out image can also be generated using the stored recorded image. In the present embodiment, a cut-out image generation / registration process by a cut-out image generation / registration unit 123 that cuts out an image by appropriately synthesizing a print image and a pre-registered mask pattern in a print image synthesis mode and registers the cut-out image. FIG.

FIG. 19 is a flowchart showing one embodiment of the cut-out image generation / registration processing operation, and FIG.
It is explanatory drawing of the cutout image generation / registration process based on the flowchart of FIG. In FIG. 19, the user operates the play button 64 to set the reproduction mode, reproduces and displays the first recorded image, and operates the up / down key 67 to reproduce the image desired to be a cutout image. It is displayed on the display 20. Thereby, for example, FIG.
Is displayed on the liquid crystal display 20 (S21).

Next, when the user operates the mask button 66, the CPU 21 reads the mask pattern stored in the mask pattern memory 14B and draws it on the VRAM 17 via the signal generator 16 (S22).
The mask pattern drawn on the VRAM 17 is read and displayed on the liquid crystal display 20 via the D / A conversion circuit 18 and the amplifier 19. Thereby, for example, FIG.
A mask pattern as shown in (B) is displayed on the liquid crystal display 20. At this time, the CPU 21 displays a cursor so as to overlap the mask pattern (S23).

Here, the user selects a desired mask pattern from the mask patterns displayed on the liquid crystal display 20.
That is, a cursor (a frame-shaped cursor in the example in the figure) as shown in FIG. 20B is operated on the desired mask pattern by operating the movement key 62. Then, the mask button 66 is operated again to confirm the selection (S2).
4). The CPU 21 sends only the mask pattern selected in S24 to the VRAM 17, and draws the mask pattern superimposed on the reproduced image selected in S21. Thereby, for example, as shown in FIG. 20C, the reproduced image of FIG. 20A and the selected mask pattern of FIG. 20B are superimposed and displayed on the liquid crystal display 20 (S25).

Next, if the user determines that it is necessary to correct the position of the mask pattern by looking at the image superimposed and displayed in S25, the flow shifts to S27; otherwise, the flow shifts to S29 ( S26). If it is determined in S26 that the position of the mask pattern needs to be corrected, the user operates the move key 62 (S27) to move the mask pattern. For example, when an upward key among the move keys 62 is operated in the state of FIG. 20C, the mask pattern is moved upward as shown in FIG. 20D (S28). When a composite image obtained by combining the desired mask pattern and the recording image is obtained in S26 or S28,
The user operates the release button 63 to register this composite image as a cut-out image in the flash memory (S29). At this time, the CPU 21 operates the synthesized image (the image in FIG. 20D) displayed on the liquid crystal display 20.
Is cut out and recorded in the cut-out image memory 14A as a cut-out image (pattern frame + image) (S30).

As described above, the cut-out image memory 14
When the cutout image created by the user himself is registered in A,
The cut-out image synthesizing process can be performed by the same operation (see the fifth embodiment) as described in the flowchart of FIG. That is, when the frame button 61 is operated a predetermined number of times in S2 of FIG. 17, the image shown in FIG. 20D is read from the clipped image memory 14A and reproduced, and is reproduced on the liquid crystal display 20 in S3. Therefore, if the recorded image to be combined with the cutout image is reproduced and displayed in advance in S1, the cutout image created by the user can be combined with another recorded image as shown in FIG.
Also, the image synthesized by this operation is operated by operating the release button 63 as described in S9.
Can be recorded.

As described above, in the fifth and sixth embodiments, the image recorded in the flash memory 14 and the clipped image registered in the clipped image memory 14A in advance can be synthesized. It can be newly generated by appropriately combining the recorded image and the mask pattern. As described above, the recorded image can be easily processed (combined).

[Embodiment 7] FIG. 21 is a flow chart showing an example of taking an ID photograph by an ID photo frame as an embodiment of the guide frame display processing of the digital camera of FIG. 1. FIG. It is explanatory drawing of the ID photograph taking process based on a flowchart. In FIG. 21, when the user operates the up / down key 67, the CPU 21 reads the mask pattern stored in the mask pattern memory 14B, draws the mask pattern on the VRAM 17 via the signal generator 16, and draws the guide frame pattern drawn on the VRAM 17. Is read and displayed on the liquid crystal display 20 via the D / A conversion circuit 18 and the amplifier 19. As a result, for example, the liquid crystal display 2 serves as a guide frame 81 (in this example, a guide frame for a driver's license photograph) as shown in FIG.
Displayed as 0. In this case, the guide frame 81 is positioned at the center of the screen (X1).

Here, when the up / down key 67 is further operated, the next guide frame is read and displayed, so that the user determines whether or not the guide frame displayed on the liquid crystal display 20 is a desired one. If it is not the desired guide frame, the guide frame is displayed by operating the up / down key 67 until the desired guide frame appears (X2). When a desired guidance frame is displayed in X2, the user is the subject 82 (FIG. 2).
2 (B)) through image 82 ′ (FIG. 22 (C),
Check if (D)) is properly in the guide frame in the center of the screen (X3). If it is properly in the guide frame, press the release button 63. If not, adjust the camera angle. Then, the desired through image is properly contained in the guide frame at the center of the screen (X4).

The CPU 21 operates the release button 63
Is checked (X5), and when the release button 63 is pressed, the subject image 83 (FIG. 22 (E)) displayed on the liquid crystal display 20 is cut out and photographed in the flash memory 14. (X
6). It should be noted that a through image may be recorded as it is without clipping at the time of photographing, and then may be clipped from a reproduced image later (that is, used as a guide for photographing). In the above description, the guide frame is for photographing, but may be any of mask patterns. Further, the mask pattern and the cut-out image may be registered in advance in a recording medium such as a flash memory by a maker or the like. As a result, since the guide frame can be displayed at the time of photographing, the size of the image can be made substantially constant, or a photograph for certification or the like having a predetermined size can be easily taken.

[Eighth Embodiment] Example of Contour Extraction Using Pointing Device or Cursor FIG. 23 is an explanatory diagram showing an example of mask pattern generation by contour extraction.

FIG. 23A shows a reproduced recorded image, which corresponds to the reproduced image selected by the user in step W1 of the flowchart in FIG. FIG.
Corresponds to step W2 of the flowchart of FIG. 7, and shows a state in which after the desired image 91 (in this example, a bear) is displayed, the outline of the face of the image 91 is traced with the touch pen as indicated by the symbol 92. When the specification of the extraction range with the touch pen is completed and the user operates the release button 63, the CPU
21 obtains a closed space from the coordinates (xi, yj) of the locus of the touch pen. Then, the image data stored in the work area is offset from the portion other than the closed region 93 (W3), and then binarized (W4). FIG.
(C) corresponds to step W5 of the flowchart in FIG. 15, and displays the result of processing into the binarized pattern displayed on the liquid crystal display 20. When the user operates the release button 63, a desired mask pattern (FIG. 23)
As a result of (D)), the pattern image 95 is registered as a mask pattern in the mask pattern memory 14B (W12).

In this embodiment, the reproduced recorded image is traced with the touch pen. However, the same operation as in the above case can be performed by operating the cursor movement key 62 to trace the face outline of the image 91 with the cursor. To obtain a mask pattern. In this embodiment, the contour is extracted by tracing the contour of the reproduced image.
By performing contour extraction based on the flowchart of the above, a desired mask pattern can be obtained as in the case of a recorded image.

[Embodiment 9] Example of pattern generation based on distance designation There is a case where a user looks at a signboard in a townscape and wants to make a pattern. The number of signboards in the field of view is not limited to one, and the signboard may be viewed from the front to the back in a narrow field of view. In such a case, many signboards enter the same field of view of the camera at a distance.

In this embodiment, objects at different distances within the same visual field are used as patterning candidates to form one recorded image.
This is an example in which it is reproduced to enable a mask patterning operation for each subject.

When the digital camera has an auto-focus mechanism, the auto-focus mechanism operates so that the camera focuses on a point of interest (in most cases, the center of the finder), and the focus is determined. You. Here, the distance between the subject and the imaging lens 1 is a, and the imaging lens 1 and CC
Assuming that the distance of D2 from the surface is b and the focal length of the lens is f, 1 / a + 1 / b = 1 / f holds. Here, when the imaging lens 1 is moved by ± Δx (Δx <b << a), 1
/ (A−Δx) + 1 / (b + Δx) = 1 / f or 1 / (a + Δx) + 1 / (b−Δx) = 1 / f. Since b << a, 1 of the first term on the left side / (A +
ΔX) ≒ 1 / a, so that 1 / a + 1 / (b ±
Δx) = 1 / f (Equation 1) holds.

Since the moving distance Δx of the lens at the time of focusing by the auto focus control is known, the distance a between the subject and the imaging lens 1 can be calculated from the above equation (1). Therefore, if the camera is finely moved and the camera is finely moved so that the pattern candidates in the same field of view are sequentially focused on the finder and focused, the distance between each pattern candidate and the lens is obtained. Can be. Further, the distance between each pattern candidate and the lens can be obtained as long as the image pickup apparatus does not include the autofocus mechanism but includes the distance measuring mechanism.

FIG. 24 is a flowchart showing an example of a pattern generation operation based on a distance designation. FIG. 24A shows the operation of the distance data storage means 1126 at the time of photographing, and FIG. 24B shows the operation at the time of reproduction (at the time of patterning). It is. The subject which is a patterning candidate in the same field of view and the imaging lens 1
Is obtained (j = 1 to n) and temporarily stored in the distance data storage area of the DRAM 13 (Y1).

If the user presses the release button 63 to take a picture, the flow shifts to Y3; otherwise, Y
It returns to 1 (Y2). When the photographing is performed in Y2, each distance data of the image is read from the distance data storage area of the DRAM 13 and stored in the distance column of the link table 50 simultaneously with the recording of the image data (Y
3). At the time of reproduction, a desired reproduced image is displayed (Y4), and distance data of the image is taken out from the link table 50 and displayed together with the reproduced image (Y5). When the user operates the move key 62 to specify one of the distances displayed by the cursor (Y6) and presses the release button 63 (Y7), the subject image at that distance is extracted (Y6).
8) is displayed (Y9).

When the user presses the mask button 66 (Y1
0), the displayed subject image is subjected to mask patterning processing (T3 to T11 in FIG. 7) such as binarization processing and contour extraction processing (Y11) and registered as a mask pattern (Y12). If the extracted subject image includes other images at the same distance in addition to the pattern candidates, the above-described contour extraction processing (Eighth Embodiment) is performed by operating the movement key 62 (Y13). (Y14).

When the contour extraction processing has been performed, the image other than the pattern candidates is offset and the process proceeds to the mask patterning processing (Y11) (Y15). Also, by repeating such an operation, a plurality of mask patterns can be obtained from the same image. Note that a distance may be designated at the time of displaying a through image, a subject image at that distance may be extracted, and registered as a mask pattern.

[Embodiment 10] Example of drawing input by cursor or pointing device When the direct button 68 is pressed in the through image synthesizing mode or the recorded image synthesizing mode, the locus drawn on the screen by the cursor or the pointing device (or the designated point is displayed). (Connected figures) can be input as a pattern, and after the extraction processing, can be registered as a mask pattern.

FIG. 25 is a flowchart showing an example of the operation of the pattern generating means 1125, and FIG. 26 is an explanatory diagram of masking a pattern drawn by a cursor. When the direct button 68 is pressed in the through image synthesizing mode (Z1), the CPU 21 controls the timing generator 12 to cut off the supply of image data to the signal generator 16, and the liquid crystal display 20 displays FIG. A drawing input start instruction message and a cursor 310 as shown in (A) are displayed (Z2).

When the user operates the movement key 62 to continuously move the cursor, the locus 311 of the cursor movement
Is displayed (FIG. 26B) (Z3), and the coordinates (xi, yj) on the trajectory are sequentially taken into the work area of the DRAM 13 (Z4). At this time, if the cursor is moved by pressing the down key 67 (-), the trajectory of the cursor is not displayed, and the trajectory coordinates during that time are not taken into the work area (Z5). In this case, when the cursor is moved so as to overlap the displayed locus, the line segment can be deleted (FIG. 26C) (Z6). When the up key 67 (+) is pressed, the display of the trace of the cursor is started, and the capture of the trace coordinates into the work area is restarted (Z7).

After repeating the above Z5 and Z6 to form a drawing figure 300 consisting of closed areas connected by continuous lines,
When the release button 63 is pressed (Z8), a straight line shaping icon 301 for straightly shaping a straight continuous line, icons 302 and 303 for smoothing a curved continuous line, and a fixed shape. Figure (for example, circle 30
4, rectangle 305, ellipse 306, triangle 307, etc.) are shown together with the drawn figure (FIG. 26 (E)) (Z9).

The user operates the movement key 62 to move the sections PQ @ (xa, yb), (xc, y) on the drawing 300.
d) After specifying で with the cursor (FIG. 26 (E)), when a desired icon is specified, the section is shaped in the form of the specified icon (FIG. 26 (F)). If a standard graphic is desired, the user can point to an internal region (one point in both closed regions) of the graphic 300 and then point to a desired icon to obtain a standard graphic (Z10).

After the shaping, the up / down key 67 is operated to enlarge / reduce the figure. FIG. 26G shows a reduced pattern 300 ′ (Z1).
1, Z12). When the user presses the release button 63, the graphic on the screen is extracted as a pattern (Z13, Z1).
4). When the pattern is extracted, a mask patterning process (see steps T3 to T11 in FIG. 7) is performed (Z1).
5) After completion of the mask patterning process, it is registered in the mask pattern memory 14B (Z16).

[Embodiment 11] Example of preview image display (example in which boundary of mask pattern is blurred) In this embodiment, a registered mask pattern is displayed (U3 in FIG. 9, X1 in FIG. 21), Moving display of image (Fig. 1
2, step V3 in FIG. 17, step S3 in FIG. 17, step S21 in FIG. 19), and background image display (T1, FIG. 9, U1, FIG. 12, step V1, and step W in FIG. 15).
This is an example of speeding up the preview display performed before the combining process, such as step S1) of FIG.

In image synthesis, a storage area (work area) for one screen (one frame) is provided in the DRAM 13.
At the time of screen display, image data for one image displayed at that time is read from a memory (a mask pattern memory 14B for a mask pattern, a clipped image memory 14A for a clipped image, and a flash memory 14 for a recorded image). It is issued and stored in the work area.

Here, assuming that the coordinates of the upper left position of the screen of the liquid crystal display 20 are (0, 0), first, data corresponding to the screen coordinates (0, 0) is stored at the position (0, 0) of the work area. The screen coordinates (xi, yj:
Data corresponding to i = 0 to n-1 and j = 0 to m-1) is written to the position (xi, yj) of the work area, and then data for one image is written.

Here, the coordinates of each data written in the work area are defined as follows for the sake of explanation. Coordinates of mask pattern data: M (xi, yj) Coordinates of cut-out image data: C (xi, yj) Coordinates of background image data: B (xi, yj) Display coordinates (coordinates of data in work area after synthesis processing) ): W (xi, yj), and data is represented by 8 bits.

In this case, for example, when a mask pattern is displayed on a cut-out source image (background image) in order to select a mask pattern, a background image combining process of the selection candidate mask pattern and the cut-out source image is performed. Done. At this time, the coordinates of the display position of the mask pattern are calculated as follows: W (xi, yj) = M (xi, yj) × B (xi, y)
j) + (255−M (xi, yj) × C (xi, y
j)) / 255. Here, the numerical value 255 is luminance.

When a cut-out image is generated by cutting out a background image as a cut-out source image using a mask pattern, a cut-out candidate image is generated / displayed by combining the mask pattern and the background image while moving the background image. When the user selects a desired one from the clipping candidate images, the clipping image can be clipped (extracted) as a clipping image. In this case, the display coordinates of the clipping candidate image are calculated by the coordinate calculation of the image synthesis processing. W (xi, yj) = {M (xi-p, yj-q) .times.B
(Xi, yj) + (255-M (xi-p, yj-
q)) × C (xi-p, yj-q)} / 255.

In this embodiment, the display coordinates determination module is incorporated in the pattern generation means 1125 (or 1225) and the cutout image generation registration means 113 (123) for calculating the display coordinates. In order to speed up the calculation and display the image at a high speed, the display coordinate determination module is configured to perform the coordinate calculation in each case separately for each image as described below.

When the mask pattern is selected, the display coordinates of the mask pattern are set such that when the luminance of M (xi, yj) is smaller than a certain threshold value, W (xi, yj) = C (xi, yj) M (xi, yj) When the luminance is larger than a certain threshold, it is calculated as W (xi, yj) = B (xi, yj), and this processing is performed for the entire work area of one screen (i = 0 to n−1, j = 1). To m-1).
Based on this result, the pattern generation registration unit 112 (1
22) and the mask pattern is displayed on the liquid crystal display 20 by the cutout image generation / registration means 113 (123). In this embodiment, the threshold value is set to 128. According to the coordinate calculation, the mask pattern can be displayed several times faster than the synthesis speed (coordinate calculation speed) in the normal image synthesis process.
In this case, the boundary between the mask pattern and the background becomes clear, but there is no problem even if the boundary is clear for preview display, not actual synthesis.

When the cutout image is selected, the display coordinates of the cutout image are set as follows: when the luminance of M (xi, yj) is smaller than a certain threshold value, W (xi, yj) = C (xi + p, yj + q) M (xi, yj) When the brightness of the image is larger than a certain threshold value, it is calculated as W (xi, yj) = B (xi, yj), and this processing is performed for all the areas of the work area for one screen (i = 0 to n−1, j = 1 to m-1).
Based on this result, the pattern generation registration unit 112 (1
At 22), the cutout image is displayed on the liquid crystal display 20. Here, p and q are vertical and horizontal movement amounts (the number of dots). In this embodiment, the threshold value is set to 128. According to the above coordinate calculation, the cut-out image can be displayed several times faster than the synthesis speed (coordinate calculation speed) during the normal image synthesis processing.

When the background image is displayed, the display coordinates of the background image (through image or reproduced recorded image) are raw data, that is, the coordinates of the through image or reproduced recorded image are written in the work area as they are. That is, W (xi, yj) = B (xi, yj), and this processing is performed on the entire work area of one screen (i = 0 to n-1, j = 1 to m-1). Based on this result, the pattern generation / registration unit 112 (12
2) Cutout image generation / registration means 113 (123), through image synthesis means 114, or recorded image synthesis means 12
At 4, the background image is displayed on the liquid crystal display 20.

When the pasting position is selected (when the image is moved), the display coordinates of the cutout image are vertical p dots and horizontal q dots, and the moving amounts from the center of the pasting position are r and s. When the luminance of M (xi-r, yj-p) is smaller than a certain threshold, the luminance of W (xi, yj) = C (xi + pr, yj-q + s) and the luminance of M (xi-r, yj = p) are obtained. When it is larger than a certain threshold value, it is calculated as W (xi, yj) = B (xi + pr, yj-q + s), and this processing is performed for all the areas of the work area for one screen (i = 0 to n-1, j = 1 to m-1).
Based on the result, the cutout image generation / registration unit 113
At (123), the cutout image is positioned at the pasting position and displayed on the liquid crystal display 20. In this embodiment, the threshold value is set to 128. According to the above coordinate calculation, the cut-out image can be displayed several times faster than the synthesis speed (coordinate calculation speed) during the normal image synthesis processing.

[Embodiment 12] Example of Automatic Determination of Resolution of Synthetic Image Since the image data capacity is large and the memory capacity is limited, when the image is recorded in the memory, JPEG compression processing is performed on the image (data). The recorded image (data) is subjected to decompression processing during reproduction and reproduced. In the image compression processing, when the resolution is increased, the compression ratio is increased, but the processing time is longer, so that the recording speed is slower. When the resolution is lower, the compression ratio is lower, but the processing time is shorter, so the recording speed is faster. Digital cameras are usually designed so that the user can select the resolution.However, the resolution of the cropped image or background image of the image to be processed differs depending on the use of the product, so the resolution of the composite image Options are diverse.

In the present embodiment, it is assumed that the resolution is adjusted to the lowest resolution in order to record the synthesized image quickly, and the resolution of the cutout image memory 14A and the resolution of the image recorded in the background image buffer (DRAM 13) are compared by the automatic resolution determining means. And determine the lower resolution as the resolution of the composite image,
Based on the determined resolution, the compression / expansion circuit 15 compresses the composite image and records it in the flash memory 14.

The coordinate calculation at the time of combining the cut-out image and the background image is different from the display coordinates in the case of the preview display. That is, the coordinates at the time of the synthesizing process are as follows: W (xi, yj) = M (xi-r, yj-s) × B (x
i, yj) + (255−M (xi−r, yj−s) × C
(Xi + pr, yj + q-s)) / 255, and the processing is performed on the entire work area (i = 0 to n-1, j = 1 to m-1) for one screen. Perform Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and it goes without saying that various modifications can be made.

[0165]

According to the imaging apparatus of the first invention,
A framed image with a frame is registered in a storage unit such as a flash memory, and a captured image of a subject is combined with a desired one of the registered frame images to easily obtain a framed composite image. it can. In addition, since a frame image can be displayed as a guide frame at the time of photographing, the size of the image can be made substantially constant, and a photograph for certification or the like having a predetermined size can be easily photographed (claim 1).

Further, the imaging apparatus of the first invention can be provided with a storage means such as a flash memory for storing the captured image and a reproducing means for reproducing the stored captured image. The composition processing can be easily performed on the image (claim 2).

Further, the imaging device of the first invention can be provided with a display means for displaying a composite image, so that the user can see the result of the composite in real time and decide whether to redo or record. , Can be determined easily and quickly.

Further, the image pickup apparatus according to the first aspect of the present invention can be provided with adjusting means for adjusting the relative position of the picked-up image in the composite image, so that the position of the picked-up image and the frame image can be adjusted while looking at the display screen. Can be easily performed (claim 4).

Further, the imaging apparatus according to the first aspect of the invention can include a mask image storage unit for storing a mask image and a generation unit for generating a frame image by combining the captured image and the mask image. The user can synthesize and register a desired frame image by himself / herself in addition to the previously registered frame image (claim 5). Further, since the image pickup apparatus according to the first aspect of the present invention can be provided with a composite image storage unit for storing a composite image, a favorite composite image can be easily recorded and stored (claim 6).

According to the imaging apparatus of the second invention, the pattern is registered in advance in a storage means such as a flash memory, and the desired captured image is combined with a desired one of the registered patterns. By generating a cut-out image in which a portion is cut out, it is possible to easily obtain an image obtained by combining the cut-out image with a desired image. Accordingly, image processing such as simply pasting an image in the form of a certain pattern onto another image can be performed by an extremely simple operation as compared with a conventional image processing apparatus such as a personal computer. Item 7).

According to the imaging apparatus of the third invention and the captured image processing method of the eighth invention, a pattern is generated from a stored image stored in a storage means such as a flash memory by imaging, and a desired captured image is generated. The generated pattern is synthesized to generate a cutout image in which a synthesized portion is cut out, and an image obtained by synthesizing the cutout image with a desired image can be easily obtained. This allows the user to take out a pattern from the captured image, synthesize it with a desired image, cut it out, and paste it into another image, using an extremely simple operation compared to a conventional image processing device. (Claims 8 and 22).

Further, the image pickup apparatus of the third invention can be provided with a means for extracting a contour in a picked-up image and generating a pattern. In this case, the pattern can be easily extracted. 9).

In the imaging apparatus according to the third aspect of the present invention, a designating means for designating a photographing distance can be provided, so that a pattern can be generated by extracting an image portion corresponding to the photographing distance. ).

Further, in the imaging device according to the third aspect of the present invention, since a binarized pattern of the captured image can be generated,
Mask processing for cutting out another image is simplified (claim 11).

In the imaging device according to the third aspect, a pattern can be generated by calculating the luminance component of the captured image. This makes it possible to easily obtain a clipped image with a blurred boundary.

The imaging apparatus according to a fourth aspect of the present invention generates a pattern by drawing input, combines a desired captured image with the generated pattern, and generates a cutout image obtained by cutting out a synthesized portion.
It is possible to easily obtain an image obtained by synthesizing the cut-out image with a desired image. Thus, image processing such as combining a pattern drawn by a user himself with a desired image, cutting out the image, and pasting the image easily into another image is performed with an extremely simple operation as compared with a conventional image processing apparatus. (Claim 13).

Further, in the imaging apparatus according to the fourth aspect of the present invention, since drawing can be performed using a cursor or a pointing device, the input operation can be simplified for the user, and a new pattern can be input as a memo. There is no resistance to use (claim 14).

The imaging apparatus according to a fifth aspect of the present invention combines and displays a through image displayed in an imaging mode and an image clipping pattern, and performs a key operation at a desired timing to freeze a through image displayed as a moving image. The image can be stored in a storage device such as a flash memory.
That is, according to the present invention, since the image cutout pattern is displayed on the through image, it is possible to perform shooting by properly adjusting the angle to fit the subject desired by the user in the cutout pattern. ).

In the imaging apparatus according to the fifth aspect of the present invention, a cut-out still image can be generated / recorded by cutting out a corresponding portion of the shot still image by using the image cut-out pattern displayed at the time of shooting. It is possible to obtain a new effect that can be stored in a clipped image in a state in which a subject is well contained in a clipped pattern, which is not provided in the above-described conventional image processing apparatus (claim 16).

Further, since means for reproducing an image stored in the image pickup apparatus of the fifth invention can be provided, a cut-out image is generated by cutting out a pattern storing the reproduced image and a desired image is formed. An image obtained by synthesizing the cutout image can be easily obtained. This makes it possible to reproduce the recorded image after shooting and recording in a state in which the subject desired by the user fits well in the cutout pattern and cut out the cutout pattern using the cutout pattern. (Claim 17).

In the imaging apparatus according to the sixth aspect of the present invention, the stored image is cut out using the stored pattern to generate a cut-out image, and the cut-out image can be combined with the displayed through image. Therefore, the user can take a picture when the positional relationship between the displayed cut-out image and the through image becomes desired by adjusting the angle. It is possible to obtain an advantageous effect (claim 18).

In the imaging apparatus according to the sixth aspect of the present invention, a still image of a cut-out image and a through image which are combined and displayed at the time of shooting can be stored, so that the positional relationship between the cut-out image and the through image is desired. The combined image in the state of can be recorded (claim 19).

In the imaging apparatus according to the sixth aspect of the present invention, the cut-out image displayed on the through-the-lens image can be moved by the movement instructing means, so that the alignment at the time of composition can be easily performed. .

In the imaging apparatus according to the seventh aspect of the present invention, the stored pattern can be moved on the captured image displayed on the screen. Therefore, a desired image portion is cut out by the pattern to generate a cutout image. It is possible to easily obtain an image obtained by combining a clipped image with a desired portion of the image (claim 21).

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a digital camera as one embodiment of a photographing device of the present invention.

FIG. 2 is a diagram illustrating a configuration example of a key input unit illustrated in FIG. 1;

FIG. 3 is an explanatory diagram of a processing mode of the digital camera shown in FIG.

FIG. 4 is a block diagram illustrating a configuration example of an image processing unit.

FIG. 5 is an explanatory diagram showing a configuration example of a link table.

FIG. 6 is an explanatory diagram of a synthesis example of a captured image and a clipped image.

FIG. 7 is a flowchart illustrating an example of a pattern generation / registration processing operation.

FIG. 8 shows a pattern generation /
FIG. 4 is an explanatory diagram of a registration process.

FIG. 9 is a flowchart illustrating an example of a cut-out image generation / registration processing operation.

10 is an explanatory diagram of a cutout image generation / registration process based on the flowchart shown in FIG. 9;

FIG. 11 is an explanatory diagram of a cutout image generation / registration process based on the flowchart shown in FIG. 9;

FIG. 12 is a flowchart illustrating an example of a cut-out image synthesizing operation of the digital camera illustrated in FIG. 1;

13 is an explanatory diagram of a cut-out image synthesizing process based on the flowchart shown in FIG.

14 is an explanatory diagram of a cut-out image synthesizing process based on the flowchart shown in FIG.

FIG. 15 is a flowchart illustrating an example of a pattern generation / registration processing operation.

16 is an explanatory diagram of a pattern generation / registration process based on the flowchart shown in FIG.

FIG. 17 is a flowchart illustrating an example of a pasting and combining processing operation of the digital camera illustrated in FIG. 1;

FIG. 18 is an explanatory diagram of a synthetic image generation process based on the flowchart shown in FIG.

FIG. 19 is a flowchart illustrating an example of a cut-out image generation / registration processing operation.

20 is an explanatory diagram of a cutout image generation / registration process based on the flowchart shown in FIG.

FIG. 21 is a flowchart illustrating an example of taking an ID photo by using an ID photo frame as an embodiment of the guide frame display processing operation of the digital camera shown in FIG. 1;

FIG. 22 is an explanatory diagram of an ID photographing process based on the flowchart shown in FIG. 21;

FIG. 23 is an explanatory diagram showing an example of mask pattern generation by contour extraction.

FIG. 24 is a flowchart illustrating an example of a pattern generation operation based on distance designation.

FIG. 25 is a flowchart illustrating an operation example of a pattern generation unit based on a drawn pattern.

FIG. 26 is an explanatory diagram of mask pattern formation of a pattern drawn based on the flowchart shown in FIG. 25;

[Explanation of symbols]

Reference Signs List 1 imaging lens (imaging means) 2 CCD (imaging means) 14 flash memory (captured image storage means, captured still image storage means) 14A cutout image memory (frame image storage means, image cutout pattern storage means) 14B mask pattern memory (mask) Image storage means,
16 pattern generator (display control means, storage control means) 20 liquid crystal display (display means) 21 CPU (display control means, storage control means) 24 key input section (key input means) 112, 122 pattern generation / registration Means (pattern generation means) 113, 123 Cutout image generation / registration means (cutout image generation means) 114 Through image synthesis means (image synthesis means, display control means) 124 Recorded image synthesis means (image synthesis means, display control means)

Claims (22)

[Claims] An image capturing unit that captures an image of a subject; a frame image storing unit that stores a frame image to be combined with a captured image captured by the image capturing unit; and a frame image stored in the frame image storing unit. An image capturing apparatus comprising: a frame image reproducing unit that reproduces a desired image from a reproduced frame image as a reproduced frame image; and a synthesizing unit that generates a synthesized image obtained by synthesizing the captured image and the reproduced frame image. 2. A captured image storing means for storing a captured image captured by the image capturing means, and an image reproducing means for reproducing a desired one of the captured images stored in the captured image storing means as a reproduced image. 2. The imaging apparatus according to claim 1, wherein the synthesizing unit generates a synthesized image obtained by synthesizing the reproduced captured image reproduced by the captured image reproducing unit and the reproduced frame image. 3. 3. The imaging device according to claim 1, further comprising a display unit that displays the composite image. 4. The imaging apparatus according to claim 2, further comprising an adjustment unit configured to adjust a relative position of the captured image in the composite image. 5. The image processing apparatus according to claim 1, further comprising: a mask image storing unit that stores a mask image that masks the captured image; and a generating unit that combines the captured image and the mask image to generate the frame image. The imaging device according to any one of claims 1 to 4, wherein 6. The imaging apparatus according to claim 1, further comprising a composite image storage unit that stores the composite image. 7. An imaging means for imaging a subject and outputting a captured image, a captured image storage means for storing a captured image output from the imaging means, a pattern storage means for storing a plurality of patterns, and the pattern storage Pattern selecting means for selecting a desired pattern from a plurality of patterns stored in the means, and a corresponding portion of the captured image stored in the captured image storing means using the pattern selected by the pattern selecting means An image pickup apparatus comprising: a cut-out image generating unit that cuts out a cut-out image to generate a cut-out image; and an image combining unit that combines the cut-out image generated by the cut-out image generating unit with a desired image. 8. An image pickup means for picking up an image of a subject and outputting a picked-up image, a picked-up image storage means for storing a picked-up image output from said pick-up means, and a pattern from a stored image stored in said picked-up image storage means. A pattern generation unit for generating a pattern, a pattern storage unit for storing a pattern generated by the pattern generation unit, and a captured image stored in the captured image storage unit using a pattern stored in the pattern storage unit An image pickup apparatus comprising: a cut-out image generating unit that cuts out a corresponding part of (1) to generate a cut-out image; and an image combining unit that combines the cut-out image generated by the cut-out image generating unit with a desired image. 9. The imaging apparatus according to claim 8, wherein the pattern generation unit generates a pattern by extracting a contour in the captured image. 10. A pattern generating means for designating a photographing distance, wherein the pattern generating means generates a pattern by extracting an image portion corresponding to the photographing distance designated by the designating means in the captured image. The imaging device according to claim 8, wherein: 11. The imaging apparatus according to claim 8, wherein the pattern generation unit generates a pattern by binarizing the captured image. 12. The imaging apparatus according to claim 8, wherein said pattern generation means generates a pattern by calculating a luminance component of a captured image. 13. An imaging unit for imaging a subject, a captured image storage unit for storing a captured image output from the imaging unit, a drawing data input unit for inputting drawing data, and an input from the drawing data input unit. Pattern generation means for generating a pattern from the drawn data, pattern storage means for storing the pattern generated by the pattern generation means, and storage in the captured image storage means using the pattern stored in the pattern generation means Clipping image generating means for generating a clipped image by cutting out a corresponding portion of the captured image, and image synthesizing means for synthesizing the clipped image generated by the clipped image generating means with a desired image. Imaging device. 14. The imaging apparatus according to claim 13, wherein said drawing means performs drawing using a cursor or a pointing device. 15. An image capturing means for capturing an image of a subject and outputting a captured image; a display means for displaying a captured moving image output from the image capturing means; an image clipping pattern storing means for storing an image clipping pattern; Display control means for synthesizing and displaying the image cutout pattern stored in the cutout pattern storage means on the captured moving image displayed on the display device; key input means; An image-captured still image storage means for storing an image; and, when the key input means is operated while a captured moving image and a cutout image pattern are displayed on the display means by the display control means, the image-captured still image storage means And a storage control means for storing the captured still image. 16. The storage control unit generates a cut-out still image by cutting out a corresponding portion of the captured still image using an image cut-out pattern displayed on the display unit, and generates the cut-out still image by using the image capture still image. 16. The imaging device according to claim 15, wherein the image is stored in an image storage unit. 17. A reproducing unit for reproducing a captured still image stored in the captured still image storage unit, and a reproduction unit that reproduces the captured still image using the image cutout pattern stored in the image cutout pattern storage unit. Clipping image generating means for generating a clipped image by clipping a corresponding portion of the captured still image, and image synthesizing means for synthesizing the clipped image generated by the clipped image generating means with a desired image. The imaging device according to claim 15, wherein: 18. An imaging means for imaging a subject and outputting a captured image, a captured still image storage means for storing a captured still image output from the imaging means, and a captured moving image output from the imaging means. Display means, a pattern storage means for storing a pattern, and a cutout image generated by cutting out a corresponding portion of the captured image stored in the captured image storage means using the pattern stored in the pattern storage means. A cutout image generating unit, a display control unit for combining and displaying the cutout image generated by the cutout image generating unit on a captured moving image displayed on the display device, a key input unit, and the display control unit When the key input device is operated while the captured moving image and the cutout image are displayed on the display device, the captured still image recording Imaging apparatus characterized by comprising: a storage control means for storing the captured still image to the means. 19. The imaging apparatus according to claim 18, wherein the storage control unit stores the captured still image and the cutout image displayed on the display unit in the captured still image storage unit. 20. A moving instruction means for instructing a movement of the cutout image displayed on the captured moving image to a desired position in a display screen by the display control means. 19. The imaging device according to 18. 21. An imaging unit for imaging a subject and outputting a captured image, a captured image storage unit for storing a captured image output from the imaging unit, and displaying a captured image stored in the captured image storage unit A display unit that stores a pattern, a pattern storage unit that stores a pattern, a display control unit that displays a pattern stored in the pattern storage unit on a captured image displayed on the display unit, A moving unit for moving the pattern displayed on the captured image to a desired position in the display screen; and generating a cutout image by cutting out a corresponding portion of the captured image using the pattern moved by the moving unit. A cut-out image generating unit that performs the cutting operation, and an image combining unit that combines the cut-out image generated by the cut-out image generating unit with a desired image. Imaging device according to claim Rukoto. 22. A step of capturing a subject to obtain a captured image; a step of storing the captured image; a step of generating a pattern from the stored captured image; a step of storing the pattern; A step of generating a cutout image by cutting out a corresponding portion of the stored picked-up image using a pattern that has been stored, and a step of combining the cutout image with a desired image. Method.