JP2000261722A - Device and method for compositing image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image interested by a user without lowering availability by compositing an image according to a background image selected by the user among plural sets of background images where a subject image photographed by a camera is stored and a position, an angle and a size and printing it. SOLUTION: Subject image data fetched from an image inputting part 254 is stored in a memory 252. The memory 252 also stores an instruction to be issued to a CPU 251 and an instruction group to be a control means for a composite image preparing device as a program. Further, it stores processing data for the CPU 251. A pattern memory 255 stores background image data to be overlapped on a subject image and plural sets of preliminarily defined composite position information about positions, sizes and angles in compositing the subject image in a background image. When the subject image is photographed, the subject image is composited according to the plural sets of synthetic position information stored in the memory 255 and it is displayed on a monitor 203.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image synthesizing apparatus and method for synthesizing a digital image of a subject and another digital image such as a landscape photograph and outputting the digital image to an output medium such as a sticker, a postcard or a floppy disk. Things.

[0002]

2. Description of the Related Art Conventionally, in an image printing apparatus installed in a street, a storefront, a game center, or the like, a frame selected by a user from a plurality of frame images (heart mark, character, landscape image, etc.) prepared in advance. The image is combined with the subject image captured by the camera, and printed out and provided to the user.

When using the image printing apparatus, a user first selects a desired frame image from a plurality of prepared frame images. When the frame image is selected, the selected frame image and the user who is the subject photographed by the camera are simultaneously displayed on the monitor screen.
The user moves while watching the monitor screen to determine his / her position in the frame image. After the position is determined, the subject is photographed, and the subject image and the frame image are combined and printed out.

[0004] Japanese Unexamined Patent Publication No. Hei 10-186473 discloses a method in which a plurality of different foreground frames and background frames are prepared in order to create a deep and interesting composite image. The subject image is sandwiched between the foreground frame image and the background frame image to synthesize the images.

[0005]

However, in the conventional image printing apparatus, the subject image can be displayed only in front of or behind the selected frame image. In Japanese Patent Application Laid-Open No. 10-186473, the prepared foreground frame and the background frame are images having different patterns. Therefore, there is a problem that a subject image cannot be synthesized at an arbitrary depth position in one background image.

Further, in the conventional image printing apparatus, the user, who is the subject, moves while watching the monitor image, thereby determining the combined arrangement of the subject images in the frame image.

Therefore, the composition position of the subject image in the frame image can be moved only within a limited range.
The size of the subject image can also be synthesized only in a predetermined size.

[0008] To solve these problems, Japanese Patent Application No. 10-374.
In Japanese Patent No. 879, the background image is divided and stored for each element in the depth direction, so that the user can arbitrarily specify the composite position, angle, and size of the subject image.

However, the user can arbitrarily specify the combined position, angle, and size of the subject image, and the user specifies the position, angle, and size while looking at the screen and thinking. For this reason, there has been a problem that the usage time for one use is significantly increased, and the daily operation rate of the apparatus is reduced.

An object of the present invention is to provide an image synthesizing apparatus and method capable of obtaining an interesting synthetic image without lowering the operation rate.

[0011]

In order to achieve the above object, the present invention provides a camera for photographing a subject, background image storage means for storing a plurality of sets of background images prepared in advance, and storage of the background image. A background image selecting means operated when the user selects an arbitrary background image from the background images stored in the means, and a subject image photographed by the camera is selected by the background image selecting means. A subject image combining position in which a plurality of sets of predetermined information on the position, angle, and size to be combined in the background image are stored.
Angle / size storage means, and a plurality of sets of subject images captured by the camera, stored in the subject image synthesis position / angle / size storage means in the background image selected by the background image selection means. Image processing means for synthesizing according to position, angle, and size; synthetic image selecting means for displaying a plurality of sets of synthesized images and operating when a user selects a desired synthesized image; Output means for printing the composite image selected by the means.

Each of the background images in the background image storage means is composed of a plurality of background image groups obtained by separating background components existing in the background image in accordance with the position in the depth direction.
The information on the image combining position stored in the subject image combining position / angle / size storage means includes information on the position in the depth direction in addition to the combining position on the plane.

The image synthesizing method according to the present invention, when synthesizing a subject image taken by the camera into a background image selected by the background image selecting means and outputting the synthesized image, outputs the subject image synthesizing position, angle, Combining according to a plurality of sets of positions, angles and sizes stored in the size storage means, displaying the combined plurality of combined images and waiting for selection by a user,
The selected composite image is output.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a functional block diagram showing an embodiment of an image synthesizing apparatus according to the present invention. As shown in FIG. 1, a camera (digital camera) 2 for photographing an object 1 and a plurality of cameras prepared in advance are provided. Background image storage means 3 for storing a set of background images;
A background image selection unit 4 operated when a user selects an arbitrary background image from the background images stored in the background image storage unit 3 and a subject image captured by the camera 2 A subject image combining position / angle / size storage unit (hereinafter referred to as a combining position) that stores a plurality of predetermined sets of information on the position / angle / size to be combined with the background image selected by the background image selecting unit 4. 5) and a position stored in the subject image position / angle / size storage means 5 in the background image selected by the background image selecting means 4; Image processing control means 6 for synthesizing by angle and size
A plurality of sets of synthesized images synthesized by the image processing control means 6, and a user selects a desired set of images; a synthesized image selecting means 7;
An output unit 8 is provided which waits for a user's selection operation by the user and, when the user performs the selection operation, outputs the selected image to a printout or a floppy disk. In this case, the background image of each set in the background image storage unit 3 is divided and stored for each element in the depth direction, and the image processing control unit 6 determines not only the position on the plane in the background image but also the depth direction. It is possible to combine subject images at a plurality of positions.

Here, the background image stored in the background image storage means 3 and the data of the synthesis position, angle and size stored in the synthesis position storage means 5 are stored in a storage medium storing these as one set. It can be prepared in a form and acquired from this storage medium, or can be directly input from an input device attached to the present apparatus. By employing a configuration using a recording medium, a background image according to the installation location or use environment of the apparatus can be used very easily, and updating can be facilitated. It should be noted that a configuration in which the information is acquired from the server computer using a communication line such as the Internet instead of the recording medium may be adopted.

FIG. 2 is a side view showing an embodiment of the image synthesizing apparatus. A space capable of accommodating a plurality of subjects 201 is provided inside the housing 21. And the subject 20
On the front side of 1, a camera 2 for photographing the subject 201,
The control device 20 including the touch panel 206 in the background image storage means 3 and the selection means 4 in FIG. 1 and the image processing control means 6, the background image storage means 3 and the combined position storage means 5 in FIG.
5. A video printer 204 corresponding to the output means 8 is provided. As the camera 2, for example, a CCD camera is used, and its field of view is set so that an image of the whole body from the head to the feet of one or more subjects 201 who have entered the housing can be taken. The touch panel 206 is provided on the surface of a display screen of the monitor 203 that displays a composite image, a guidance message, and the like.

FIG. 3 is a block diagram showing a configuration of a functional portion of the image synthesizing apparatus shown in FIG.
PU 251, memory 252, I / O control unit 253, image input unit 254, pattern memory 255, image processing unit 25
6, an image output unit 257 is provided, and an I / O control unit 253 is provided.
Is connected to a touch panel 206. In addition, a video printer 204 and a monitor (display) 203 are connected to the image output unit 257. Touch panel 2
Reference numeral 06 denotes a signal which is arranged on the screen surface of the monitor 203 and outputs a position signal indicating the position when touched or pressed on an arbitrary position on the display screen. In this embodiment,
It is used for selecting various operation menus, selecting a background image, and designating a desired set of a plurality of sets of synthesized images synthesized at positions having different synthesis positions, angles, and sizes. Also,
As the camera 2, for example, a CCD camera is used.
The image input unit 254 converts image data captured by the camera 2 from an analog signal to a digital signal by an A / D converter (not shown). The CPU 251 performs a process of extracting a contour portion of the subject image from the captured image from the camera 2, synthesizing the contour portion with the background image stored in the pattern memory 255, and printing out to the video printer 204. The memory 252 stores the subject image data fetched from the image input unit 254, and also stores, as a program, a command issued to the CPU 251 and a command group serving as control means of the composite image creating apparatus. The processing data of the CPU 251 is also temporarily stored as a work memory. The pattern memory 255 includes a plurality of sets of background image data to be superimposed on the subject image and a plurality of sets of positions (positions on the plane, positions in the depth direction), sizes, and angles when the subject image is combined with the background image. Is stored. This combined position information will be described later.

Under the control of the CPU 251, the image processing section 256 executes a contour extraction process of the subject image from the subject image data fetched from the image input section 254. Then, among the background images stored in the pattern memory 255, the selected background image selected by the user (subject) by the touch panel operation and the contour-extracted subject image are combined according to the combined position information stored in the pattern memory 255. A plurality of sets are combined and displayed on the monitor 203.

An image output unit 257 displays the image synthesized by the image processing unit 256 on a monitor screen and causes the video printer 204 to print out the image.

FIG. 4 is a diagram showing the structure of one set of background image data stored in the pattern memory 255. FIGS. 5 and 6 show positions at which a subject image can be combined with one set of background images. It is a diagram showing a plurality of sets of background image data and data of a combination position configured in this way stored in a pattern memory 255 in advance. 1 as shown in FIG.
When there are a plurality of background images 401, in the present invention, as shown in FIG. 4, a plurality of background components in one background image are determined by a human according to the distance from the front in the depth direction. Divide (separate) into images. That is, in the example of FIG.
The foreground background components 402 and 403 are separated as a first separated background image 411, and the background component 404 located immediately behind the separated background components 404 and 403 is further separated into a second separated background image 412.
As the background component 405 in the same manner.
Is the third separated background image 413, the background component 406 is the fourth separated background image 414, and the background component 407 is 5
The image is separated as the separation background image 415 of the first sheet. in this case,
The number of separation is arbitrary. The pattern memory 255 includes background images 411 to 411 obtained by separating the data of one background image 401.
415 is stored as a background image group. When synthesizing the subject image 410 with the background image, according to a plurality of sets of combined position information having different combined positions, angles, and sizes, the separated background image is separated by the position, angle, and size designated by the combined position information of each set. The subject image 410 is synthesized in such a manner that the subject image is sandwiched between two consecutive separated background images. FIG. 5 is a diagram illustrating an example of a position where the subject image 410 is combined. 502 indicates that the subject image 410 is to be combined with the background component 405, and 503 indicates the subject on the left side of the background component 403. An image 410 is synthesized, and 504 is a background component 405 and a background image element 404.
And that the subject image 410 is synthesized between
Reference numeral 5 indicates that a subject image 410 is to be synthesized behind the background component 403.

In the present invention, instead of allowing the user to select such a combining position (including the size and angle), if the subject image 410 is photographed, the pattern memory 25 is set in advance.
5, a plurality of sets of combined images are created by combining the subject images 410 in accordance with the plurality of sets of combined position information stored in 5, and the created combined images are displayed on the monitor 203;
The user is allowed to select a desired one from among them. In other words, if the user selects data such as the synthesis position, size, and angle, the operation time for that becomes longer,
The device occupancy time per user is prolonged, and the operation rate is reduced. Therefore, data such as a combining position, a size, and an angle are prepared in advance, the subject image 410 is combined according to the prepared data, and a desired one is selected from the combined images. It is.

FIG. 6 shows the storage format of the combined position, angle, and size data of the subject image. Insertion of the subject image 410 in the depth direction is performed for each of the names 601 of the combined patterns 502 to 505 in FIG. Position 602, position 60 on a plane
3, data of the rotation angle 604 and the enlargement / reduction magnification 605 are set. Here, the “third sheet” at the depth direction insertion position 602 indicates that the subject image 410 is sandwiched in the depth direction behind the second background component 404 and synthesized. Further, the rotation angle 604 means that the upright image of the subject 410 is 0 degree and the inverted image is 180 degrees.
It represents a rotation angle in degrees. In this case, the rotation direction is clockwise or counterclockwise, and is predetermined. The enlargement / reduction magnification 605 indicates an enlargement or reduction magnification when the subject image 410 is synthesized.
In this case, “1 ×” can be determined, for example, as follows. A value S indicating an enlargement ratio or a reduction ratio, which is a magnification ratio with respect to the entire range photographed by the camera 2, is determined in advance for each background image, and an image obtained by scaling the entire photographed range at this magnification ratio S is determined. The whole area of the background image is set to the same size image. The size of the subject image extracted along the subject contour from the whole-size full-size image thus scaled is set as the subject full-size image. Therefore, when the value of the enlargement / reduction 605 shown in FIG. 6 is, for example, “2.0 ×”, the same-size image of the subject is enlarged to “2.0 ×” in each of the vertical and horizontal directions. In this case, the image of the same size of the subject is reduced to “0.5 ×” in both the vertical and horizontal directions.

FIG. 7 is a flowchart showing the operation of the present invention. First, the user is caused to select a desired background image from a plurality of background images displayed on the touch panel 206 (step 701). Next, the user is caused to determine a pose, and an image of a subject is taken by the camera 2 (step 70).
2). Next, the contour of the subject is extracted from the photographed subject image 410 (step 703). Next, the extracted subject outline image is combined with the background image selected in step 701 (step 704). The image to be synthesized at this time is not one set, but according to the data stored in advance as the data of the subject image combining position, angle, and size, as illustrated in FIG. (Including the depth direction) at different angles and sizes to create a plurality of sets of composite images. A method of synthesizing a subject at an arbitrary angle and size at an arbitrary position including a depth direction is realized by a method disclosed in Japanese Patent Application No. 10-374879 previously filed by the applicant of the present invention.

Next, a plurality of sets of synthesized images synthesized in step 704 are displayed on the monitor 203 (step 70).
5). The display of the composite image may be performed entirely on one screen, or may be displayed on a plurality of screens classified according to the position, angle, and size of the subject image.

The user selects a desired image from a plurality of displayed composite images (step 706). next,
The image selected by the user in step 706 is printed and output from the video printer 204 (step 70).
7).

The procedure of displaying the composite image in step 705 and selecting the print image in step 706 is sequentially performed by selecting the size of the subject image, selecting the insertion position in the depth direction, selecting the position on the plane, and selecting the angle. A method of narrowing down may be used. That is, first, a plurality of sets of composite images having different sizes of the subject images are created and displayed, and if a composite image of a desired size is selected from among them, then, the insertion position in the depth direction is changed. A plurality of different sets of composite images are created and displayed. If a composite image at a desired insertion position is selected from among them, then a plurality of sets of composite images with different insertion positions on a plane are created and displayed. Then, when a composite image at a desired insertion position is selected from among them, next, a plurality of sets of composite images having different angles of the subject image are created and displayed, and a composite image at a desired angle is selected from among them. It may be a procedure of making the user select. Here, the order of size selection / depth direction insertion position selection / position on plane / angle selection is arbitrary.

FIG. 8 and FIG. 9 show a procedure of selecting the size in order, selecting the insertion position in the depth direction, selecting the position on the plane, and selecting the angle.

First, of the composite images created in step 704 of FIG. 7, those having different subject image sizes are displayed on the screen. If there is more than one of the same size,
One of the composite images to be displayed is displayed, and each composite image to be displayed is the same as the element other than the size of the subject image (the position of insertion of the subject image in the depth direction, the position on the plane, and the angle) as much as possible (step 801). ). If there is no difference in size, the process proceeds to step 803 without performing this step. The user selects an image having a desired size of the subject image from the displayed images (step 802).

Next, among the composite images having the same size as the size of the subject image selected in step 802, those having different insertion positions in the depth direction are displayed on the screen. If there are multiple items with the same insertion position in the depth direction,
In each of the composite images to be displayed, elements (positions and angles on the plane of the subject image) other than the insertion position in the depth direction of the subject image are displayed as much as possible (step 803). If there is no different insertion position in the depth direction, the process proceeds to step 805 without performing this step.

The user selects an image having a desired insertion position in the depth direction from the displayed images (step 80).
4). Next, among the composite images having the size of the subject image selected in step 802 and the insertion position in the depth direction selected in step 804, those having different positions on the plane are displayed on the screen. If there are a plurality of objects having the same position on the plane, one of them is displayed, and the same elements (angles of the subject image) other than the position on the plane are displayed as much as possible (step 805). If there is no different position on the plane, this step is not performed and step 8
Proceed to 07.

The user selects an image having a desired plane position from the displayed images (step 806). Next, an image having the size of the subject image selected in step 802, the insertion position in the depth direction selected in step 804, and the position on the plane selected in step 806 (these differ only in the angle of the subject image) It is displayed on the screen (step 807). If there is no object having a different angle, the process proceeds to step 809.

The user selects an image having a desired subject image angle from the displayed images (step 80).
8). The image selected as described above is printed and output by the printer (step 809).

[0033]

As described above, according to the present invention, the background image is divided into elements in the depth direction in advance, and a plurality of sets of the composite position, angle, and size of the subject image are prepared in advance.
The operation time for synthesizing the subject images is shortened, and an interesting synthetic image can be provided to the user while increasing the operation rate of the apparatus.

[Brief description of the drawings]

FIG. 1 is a functional configuration block diagram illustrating an embodiment of an image composition device of the present invention.

FIG. 2 is a side view showing an embodiment of the image synthesizing apparatus of the present invention.

FIG. 3 is a block diagram showing an embodiment of a functional portion of the image synthesizing apparatus of the present invention.

FIG. 4 is an explanatory diagram showing a method of storing a background image.

FIG. 5 is an explanatory diagram illustrating an example of a subject image in which a combining position, an angle, and a size are different.

FIG. 6 is a diagram illustrating an example of a storage format of data for creating the composite image of FIG. 5;

FIG. 7 is a flowchart illustrating an image synthesis processing procedure.

FIG. 8 is a flowchart illustrating another embodiment of displaying a composite image and selecting a print image.

FIG. 9 is a flowchart showing a continuation of FIG. 8;

[Explanation of symbols]

1, 201 subject, 2 camera, 3 background image storage means, 4 background image selection means, 5 subject image synthesis position
Angle / size storage means, 6 image processing control means, 7 synthetic image selection means, 8 output means, 203 monitor, 20
6 ... Touch panel, 204 ... Video printer, 205 ...
Control device, 251, CPU, 252, memory, 255,
Pattern memory 256 image processing unit 257 image output unit

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04N 5/765 H04N 5/781 510F 5/781 F-term (reference) 2H104 AA19 BC48 5C023 AA11 AA37 AA38 BA11 CA01 DA01 DA04 DA08 5C052 FA02 FA03 FA04 FA09 FB01 FC06 FE01

Claims (3)

[Claims] An image synthesizing apparatus for synthesizing and outputting a subject image and a background image, comprising: a camera for photographing a subject; a background image storage means for storing a plurality of sets of background images prepared in advance; A background image selecting means operated when a user selects an arbitrary background image from background images stored in a background image storing means; and a subject image photographed by the camera, by the background image selecting means. The position to combine in the selected background image
A subject image combining position / angle / size storage unit storing a plurality of sets of information on angles / sizes predetermined; a subject image taken by the camera; a background image selected by the background image selecting unit; A plurality of sets of positions stored in the subject image combining position / angle / size storage means
Image processing means for synthesizing according to the angle and size; synthesized image selecting means for displaying a plurality of synthesized images synthesized and operating when a user selects a desired synthesized image; and An image synthesizing apparatus, comprising: output means for printing a selected synthesized image. 2. The image processing apparatus according to claim 1, wherein each of the background images in the background image storage unit is composed of a plurality of background image groups obtained by separating background components existing in the background image in accordance with the position in the depth direction. 2. The image synthesizing apparatus according to claim 1, wherein the information on the image synthesizing position stored in the angle / size storage means includes information on the position in the depth direction in addition to the synthesizing position on the plane. 3. An image synthesizing method for synthesizing and outputting a subject image and a background image, comprising: a camera for photographing a subject; a background image storing means storing a plurality of sets of background images prepared in advance; A background image selecting means operated when a user selects an arbitrary background image from background images stored in a background image storing means; and a subject image photographed by the camera, by the background image selecting means. The position to combine in the selected background image
A subject image combining position / angle / size storage unit storing a plurality of sets of information on angles / sizes predetermined; a subject image taken by the camera; a background image selected by the background image selecting unit; A plurality of sets of positions stored in the subject image combining position / angle / size storage means
Image processing means for synthesizing according to the angle and size; synthesized image selecting means for displaying a plurality of synthesized images synthesized and operating when a user selects a desired synthesized image; and Output means for printing the selected synthesized image, and when synthesizing and outputting the subject image taken by the camera into the background image selected by the background image selecting means, the subject image synthesis position / angle / Compositing according to a plurality of sets of positions, angles, and sizes stored in the size storage means, displaying the combined plurality of combined images, waiting for selection by a user, and outputting the selected combined image. An image synthesizing method characterized by the following.