JPH04347778A - Video photograph printing device - Google Patents

Abstract

PURPOSE:To extract a background part and to convert the background part into a desired color. CONSTITUTION:A video image pickup part 3 which image-picks up a subject including a background, and a video printer part 7 which photograph-prints image data that is work-processed are provided. An image processing means includes means 6-8 which divide and extract image data on the background part from original image data, a means 9 which divides the background part from original image data based on extracted image data, means 22 and 23 converting image data on the divided background part into background image data which is previously designated and means 20, 21 and 24 which synthesize and edit background image data on the converted background part and image data on a non-background image part.

Description

[Detailed description of the invention]

0001

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video photo printing apparatus that extracts a background portion and converts the background portion into a desired color.

0002

2. Description of the Related Art A device for printing out a photo print for ID using a full-color video printer based on a facial photograph image signal captured by a video image capturing device;
For example, a video ID photo system disclosed in Japanese Unexamined Patent Publication No. 63-316275 is known. FIG. 5 is an explanatory diagram of the configuration of the video ID photo system disclosed in the publication.

In the figure, a photograph of the face of a person 51, who is a subject, is taken by a color TV camera 52.
G and B video image signals are obtained. This signal is converted into a digital signal by the A/D conversion circuit 53 and temporarily stored in the frame memory 54. Reference numeral 65 denotes an image processing circuit that performs calculations to remove blemishes in printed colors due to irregular spectral absorption elements of coloring materials applied to full-color video printers. 56 is a controller for the entire system, and 57 is a keyboard for its operation. A full-color video printer 58 is configured to print a full-color facial photograph based on the above calculation results.

[0004] In such a video ID photo printing device, not only the face photograph part but also the graphic image electrically generated by the controller 56 part,
It is desirable to be able to compose and edit text information edited from fonts and print it out. What is more important is that the captured video image is stable and of good quality; It is also important that the preparation and operation of the equipment for obtaining the desired results be simple.

By the way, color TV cameras, stereo video cameras, and the like used as video imaging devices are manufactured on the premise that images are viewed on a video monitor cathode ray tube. When creating prints using a video printer based on such video image signals, the image quality usually changes unstably, so it is necessary to perform several test prints to create prints with the desired image quality. However, it was necessary to adjust the camera and lighting each time a test print was made.

[0006]

Problems to be Solved by the Invention The poor image quality is particularly noticeable in facial colors and background areas. While defects in facial color are noticeable on an individual ID card basis, irregularities in background parts are noticeable when multiple ID cards are viewed. Further, when the background part has appropriate color and density, it brings out the face part and gives a good impression of the ID card as a whole, but in the opposite case, it deteriorates the image quality and impression of the ID card.

[0007] When facial images are taken by a professional, the above adjustments can be made carefully to stabilize the image, but when images are taken on an unusual basis for card creation, the above-mentioned adjustments are possible. It was nearly impossible to stabilize the image quality of the background area.

[0008] The present invention was made to solve the above problem, and provides a video photo printing device that can obtain printed images of excellent image quality by automatically converting the background part to a preferred color. is intended to provide.

[0009]

[Means for Solving the Problems] The video photo printing apparatus of the present invention includes a video image capturing unit that images a subject including the background, and original image data of the subject including the background captured by the video image capturing unit. In the video photo printing apparatus, the video image converting section converts the image data of the background portion from the original image data into the video image converting section, which includes a video image converting section that processes the image data, and a video printer section that prints the photo based on the processed image data. means for separating and extracting the background portion from the original image data based on the extracted image data; means for converting the image data of the separated background portion into prespecified background image data; The present invention is characterized in that it includes means for synthesizing and editing the background image data of the background portion and the image data of the non-background image portion.

The present invention is also characterized in that it has a coordinate storage means in which coordinate values corresponding to the background area are stored in advance, and that the image data of the background portion is divided based on the original image data of the coordinates specified by the coordinate storage means. It is.

[0011]Furthermore, there is provided a scanning means for scanning the original image data in a predetermined direction from a predetermined background area of the original image data, and the scanned image data is within a predetermined range. Another feature is that the image data is regarded as image data of the background part, and the obtained image data is converted into background image data.

0012

[Operation] By configuring as described above, the background portion and the non-background portion can be separated on the image data, and the background portion can be converted into predetermined background image data, for example, a predetermined color. Further, by dividing the image data of the background portion based on the image data of the coordinate values corresponding to the background area, divided image data of the background portion can be easily obtained. Further, by scanning the original image data and regarding data within a predetermined image data value as background area data, extraction color conversion of the background area becomes easier.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. (First example)

FIG. 1 is a block diagram showing the configuration of the first embodiment. In the figure, 1 is a person who is the subject. 2 is the background behind the person. For example, 3 is a color TV camera for photographing the upper body of a person. 4 is color T
An AD converter that converts each color analog signal of the image at the time of shooting, which is the output of the V camera 3, into R, G, and B digital signals. 5 is a frame memory for temporarily recording the signal data as a frame image. 6 is a DA converter that converts the digital signal from the frame memory 5 into an analog video signal. 7 is a full-color printer that outputs ID card prints. 8 is a first monitor TV for monitoring images recorded in the frame memory 5; 9 is a controller that controls the entire system.

Reference numeral 10 denotes a second monitor TV for temporarily monitoring images during control status and image processing. 11 is a keyboard used by the operator to instruct the system to operate and to enter numerical values; Reference numeral 12 denotes a mouse controller used for indirectly selecting or instructing the operator's operation instructions and image portions. 13 is a calculation unit that performs various image processing calculations under the control of the controller 9; 14 is a memory that temporarily stores data during calculation. and an externally connected auxiliary memory 15 such as a floppy disk, hard disk, or magneto-optical disk for storing image data and control programs.
This constitutes a basic system, and the following elements are added to constitute the device.

[0016] A coordinate specifying operation section 16 allows an operator to manually specify the position of a background portion in order to extract information about the background portion from a photographed image. A background color detection unit 17 detects the color data of the image at the coordinates. Each color data r0, g0, b detected by the background color detection unit 17
A background color memory 18 for storing 0 is provided.

Reference numeral 19 denotes a background region separation section which separates and outputs an image region portion meeting the same color data condition as the background color data from the image data of a person including the background stored in the frame memory 5. Reference numeral 20 denotes a non-background region separation section which extracts the remaining image data from the frame memory 5 after image separation by the background region separation section 19 . 21 is a non-background area image memory that stores the image data. Reference numeral 22 denotes a background specified color memory that stores color data specified for the background prepared in advance. Reference numeral 23 denotes a background color conversion unit that converts the color data of the background area portion output from the background area separation unit 19 into color data specified in advance at 22. Reference numeral 24 is composed of an image synthesis section that synthesizes a color-converted background image and a non-background image of a person and outputs the synthesized image so as to be recorded in the frame memory 5 again. Each of the above sections is connected to the controller 9 via a signal bus. It is configured to be connected and controlled by The operation of the embodiment configured in this way will be described next.

First, the color TV camera 3 detects the person 1.
A photo image of the upper body including the face is taken. At that time,
Photographing is performed using a monochrome background part 2 to make the person easier to see. At this time, the color TV camera 3 has the white balance adjusted, the lens aperture adjusted, and the focus adjusted in advance.

Analog video signals R, G, and B captured by the color TV camera 3 are converted into digital signals by the AD converter 4 and sequentially recorded in the frame memory 5. Next, the digital data recorded in the frame memory 5 is sequentially converted into a video signal and outputted while being synchronized.
Read to the A converter 6, and convert the analog RG to the DA converter 6.
Convert to B signal. When the signal is input to the first monitor TV8, an image of the upper body of the person can be monitored. While watching this TV image, the lighting and camera are adjusted so that a facial image can be properly taken.

To record a face image to be used on an ID card, the image data being photographed is loaded into the frame memory 5, as described above. Therefore, in order to freeze the face image recorded on the frame memory 5, the operator:
The keyboard 11 is operated to output a standstill control signal from the controller 9 to the frame memory 5. In response to this operation, the controller 9 stops the sequential write data address counter of the frame memory and disables writing so that the frame memory can be frozen. However, if the read address side continues its operation at this time, the image data recorded in the frame memory 5 will be converted from DA to the first monitor TV 8 regardless of whether or not the freeze operation is performed.
You can view videos or still images of camera images.

[0021] To record and save a still image of a person's face,
The image data recorded in the frame memory 5 is transferred to the auxiliary memory 15 and recorded therein. The operation is as follows: First, the controller 9 reads pixel unit data of RGB color image data on the frame memory 5, and sequentially transfers it to the auxiliary memory 15 via the data bus.

The auxiliary memory 15 sequentially records this data on a recording medium. Here, in order to make it easier to read later, the operator inputs the file name data from the keyboard 11.
Image information data and the like are input, and these data converted into ASCII code, for example, are recorded in the auxiliary memory 15 via the controller 9.

When reading out the recorded and saved face image data, enter the file name of the image you want to read on the keyboard 11.
When the operator inputs a key, the controller 9 uses the file name data to search for desired image data from the auxiliary memory 15 and read it out. The read data is sequentially written into the frame memory 5 via the data bus for each pixel of each color and output as one image using the same process as in the case of imaging. It can be viewed as an image on the CRT of monitor TV8.

Image data for ID card printing requires data such as characters, CG images, etc. in addition to facial images. Character data and the like are input by an operator key-inputting a name, ID number, etc. from the keyboard 11, and the calculation unit 13 performs vector font creation processing, etc., as necessary. The character data is also recorded in the auxiliary memory 15 and saved in a file format so that it can be associated with the facial image. In addition, CG images such as graphic images can be prepared in advance by recording image data created with a dedicated device in the auxiliary memory 15, or captured and recorded in the same way as facial image data by taking a graphic image using the color TV camera 3. do. It is also possible to create a CG image on the frame memory 5 by running a CG creation program within the system, and then record and save it in the auxiliary memory 15.

The images thus prepared are combined and edited on the frame memory 5, and the combined image data made into one screen is used as an image for an ID card. The image data is converted into a video signal by a DA converter 6 and input to a full color video printer 7. Further, when printing is started in response to an instruction signal from the controller 9, an image for an ID card is printed. Next, the basic operations performed within the system for converting the background into a prespecified color will be explained.

To convert the color of the background part of the image of the person 1 and the background part 2 taken by the color TV camera 3, only the background part image recorded in the frame memory 5 is extracted. , by converting the color data of this part. In this embodiment, this conversion is performed using a background color conversion method that converts the background color to a predetermined color, and the converted image is output on the full-color video printer 7 or the first monitor TV 8. The image in the frame memory 5 at the time of this conversion process is a still (frozen) image at the time of photography, or an image obtained by reading out an image recorded in the auxiliary memory 15 that was recorded and saved after the image was captured.

[0027] In order to extract the background part of an image, the color data of the background part in the image is read, and the pixel part having the same or similar color as that data is recognized as the background part 2 and separated. . For this purpose, it is first necessary to read the color data of the background portion 2. To do this, the address on the frame memory 5 of the background portion to be extracted is specified using the coordinate specifying operation section 16. By setting this address, the R, G, and B data of the background portion in the frame memory 5 are read out as r0, g0, and b0. This operation is performed by displaying an instruction mark such as a cursor on the screen of the first or second monitor TV 8 or 10 for the extraction portion of the background specified by the operator, and by correlating the display with the address of the frame memory 5. , the coordinate specifying operation unit 16 is used to move the cursor. Furthermore, the cursor can be moved similarly using the mouse controller 12.

The operator moves the cursor to the background part to be extracted, and if it is determined to be the extraction point, presses the coordinate specifying operation section 16.
Alternatively, by pressing a button on the mouse controller 12, the background color detection unit 17 reads out the R, G, B data at that address on the frame memory 5, and the data r0
, g0, b0 are recorded in the background color memory 18. Next, based on this data, a portion of the same color or similar color data is selected and detected from the frame memory 5, the image of that portion is separated by the background area separation unit 19, and the background color conversion unit 2
Output to 3. Therefore, the color data of this image portion is sequentially converted into specified color data prepared in advance in the background specified color memory 22 and output to the image composition section 24.

On the other hand, the image data left after background image separation is taken out from the frame memory 5 by the non-background area separation unit 20, stored in the non-background area image memory 21, outputted to the image synthesis unit 24, and then sent to the background color conversion unit 23. Composite with the background image part from. The image data is written into the frame memory 5 again by a control signal from the controller 9.

With the above operations, the color of only the background portion can be converted to a prespecified color without changing the non-background portion of the image, such as a person. This is done every time a person is photographed or every time the full color video printer 7 prints. However, if the shooting conditions are the same or the background color in the image does not change even if the person taking the picture is changed, the operation up to recording in the background color memory 18 is performed only once, and the operations after background area separation are performed. It is also possible to perform only this every time a photograph is taken or every time a print is made. Next, another background region separation method will be explained.

[0031] In order to make a portrait stand out as an ID image, a simple monotone wall is often used as the background. The photographed image is generally as shown in FIG. 2(a). A is the background part and B is the person part.

In this image, the background area is A and the non-background area is B. There are several methods of separation. The first method is to separate the area into two based on the difference in color values, since there is a clear difference between the color r, g, and b values of part A and the color of part B. The second method is to recognize and separate the differences between portions A and B from the difference in pixel density changes in the scanning direction in the image. For example, as shown in Fig. 2(b), by taking the difference (differentiation) in the image density of scanning line C, it is possible to distinguish between the human part in the variable part, that is, part B, and the background part, that is, part A, in the non-variable part. Ru. As a third method, the boundary between portions A and B in an image always becomes a dark image due to the characteristics of light reflected from the surface of a person under illumination. Even with white clothes, at the boundary between A and B, the reflected light is weak due to the roundness of the person, resulting in a black boundary line. For example, as shown in Figure 2(c), trace this black boundary line downward from the top left of the screen (D), proceed to the right along the bottom edge (E), follow the border line of the person, and reach the bottom edge (F). There is also a method of separating parts A and B by making a loop, such as proceeding further to the right (G), proceeding upward from the bottom right (H), and tracing from the upper right corner to the left (I).

In this embodiment, the first method is used. In a general image, even if a monotone wall is used as the background part 2, the amount of color variation Δr,
Δg and Δb are generated. For example, the color of part A is r0 ±
Takes the value of Δr, g0 ±Δg, b0 ±Δb. However, the color fB (r, g, b) of section B is usually very different from the color of section A.

Using this color characteristic, the color fA of part A is
(r0 ±Δr, g0 ±Δg, b0 ±Δb) and B
The color fB (r, g, b) of each part of the image is compared and determined, and the region of color fA is separated as the background part from the human image including the background part. (Second Embodiment) A block diagram of the second embodiment is shown in FIG.

The configuration of this embodiment is such that the function of the manual coordinate designation operation unit 16 described in the first embodiment is replaced with the function of a fixed coordinate designation unit 25 that stores predetermined coordinates. .

The basic idea of this embodiment is that while in the first embodiment the operator manually specified the position of the background part in order to extract information on the background part, the background part is imaged. By specifying a predetermined background part coordinate position, information about the background part at this position can be automatically extracted. For example, in the image shown in Figure 4(a),
The fixed coordinate position is set to be around the x mark in the background part A, which is slightly away from the person B. With this setting, information on the background portion can be extracted without positioning the background detection point x on the face of the person during photographing. In addition, the operator can check where the background detection point x mark is located in the image being photographed on the first monitor T.
It is necessary to display it so that it can be monitored on V8. Therefore, the controller 9 writes the data to the frame memory 5 in synchronization with the vertical synchronization of the video signal so that the address field for the coordinates on the frame memory 5 is output with a small x mark and output as white or black, for example.
Display on the first monitor TV 8 during monitoring.

In this case, when the image in the frame memory 5 is frozen, control is performed so that the x mark is not written. That is, before freezing, the data is written to the frame memory so that an x mark is displayed, and during phrase, the data marked with an x mark is not written to the frame memory 5.

The operation of the embodiment device after fixed coordinate designation is as follows:
This is carried out in the same manner as the method shown in the first embodiment, in which the information on the background part is automatically read, the background area is separated, and the conversion process is automatically performed to the conversion color specified in the background specified color memory 22. After being combined with the partial image and transferred to the frame memory 5, the ID image is output to the full-color video printer 7 and printed as an ID image. In the operation of this embodiment, the image information of the background portion can be automatically obtained by providing the fixed coordinate specifying section 25, so that processing can be made faster. (Third Embodiment) In this embodiment, the function of the manual coordinate specifying operation section 16 described in the first embodiment is automated.

As described in the explanation of the first embodiment, FIG.
) Examining the variation in image density on one scanning line C above, Figure 2
As shown in (b), it is possible to know the range of the background part with little variation. Therefore, the range of the background part (Fig. 2(a)
There are two such ranges on the scanning line C of ), but since either of them is acceptable, the midpoint of one of the ranges) is found, and the color of the background portion at this point is extracted. The following operations are performed in the same manner as in the first embodiment. (Fourth example)

This embodiment is another embodiment in which background color conversion is performed without using specific coordinate information for specifying the background part, and based on the fact that the background part is continuous, the background part is As long as it is continuous, color conversion is performed for that part.

The operation of the background color conversion process according to this embodiment will be explained with reference to FIG. 4(b). In the figure, points A and D clearly belong to the background portion. All of the pixels on line segment AB and line segment DC may belong to the background portion, or some may belong to the person portion. Therefore, first, pixels on line segments AB and DC are scanned to find out how far from points A and D belong to the background portion. First, a color difference value x for determining the continuity of the background is determined in advance. This value x may be, for example, the sum of the level differences for each color of the RGB signals, and there is a method of setting it to a value that allows the image to be considered continuous if the color difference between two pixels is this much.

[0042] Find the color difference value of two adjacent pixels, and if this color difference value is equal to or smaller than x, it is considered that the background part continues, and if it is larger than x, it is the end of the background part. I judge that. The pixels at the end of the background portion determined by this judgment are defined as points E and F, respectively.

All pixels on the line segments from point A to point E and from point D to point F are scanned as follows using a similar continuity determining means. In this scanning, the pixel of interest moves sequentially and scans each horizontal line. Scanning is first performed from the top of the AE to the right, and once that is completed, scanning is performed from the point on the DF to the left. The following judgment process is performed each time during such scanning.

(a) Compare the color of the pixel of interest with the color of the pixel next to it. The neighbor refers to the right neighbor when scanning starts from a pixel on line segment AE, and the left neighbor when scanning starts from a pixel on line segment DF. (b) As a result of the comparison, if the color difference is greater than x, the color of the pixel of interest is replaced with a previously designated background color, and then the color conversion operation for this line is completed. On the other hand, if the color difference is smaller than or equal to the predetermined degree, the next operation (c) is performed. (c) Replace the color of the pixel of interest with the specified background color, and then repeat the operation from (b) for the adjacent pixel. Through the above operations, the color of the pixels in the background portion is replaced with the pre-specified background color from top to bottom and further from left and right to the center as long as the background portion continues. It should be noted that the present invention is not limited to the above-mentioned embodiments, and can be implemented with modifications without changing the gist. In each of the above embodiments, the ID
Although the one for cards has been described, the purpose of use is not particularly limited. Furthermore, in the above embodiments, the image data was described as full-color, but monochrome images can also be used.

[0045]

[Effects of the Invention] When printing a photo, the background part is converted to a preferred density and color, resulting in an image with excellent image quality, and it is not necessary to delicately adjust the illumination and color of the background part when taking an image. Effects can be obtained. Particularly, great effects can be obtained when creating photo prints for ID cards, etc.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of a first embodiment of the present invention.

FIGS. 2(a), 2(b), and 2(c) are explanatory diagrams of a method for extracting a background portion from an image, respectively.

FIG. 3 is a block configuration diagram of a second embodiment.

FIGS. 4(a) and 4(b) are explanatory diagrams illustrating a background portion extraction method in a second embodiment and a fourth embodiment, respectively.

FIG. 5 is a block diagram of a conventional video photo system.

[Explanation of symbols]

1...Person 2...Background part 3...Color TV camera 4...A/D converter 5...Frame memory 6...D/A converter 7...Full color video printer
8...First monitor TV 9...Controller 10...Second monitor TV
11... Keyboard 12... Mouse controller 13... Arithmetic unit
14...Memory 15...Auxiliary memory 16...Coordinate specification operation unit 17...Background color detection unit 18...Background color memory 19...Background area separation unit 20...Non-background area separation unit 21...Non-background area image memory
22...Background specified color memory 23...Background color conversion unit 24...Image composition unit
25...Fixed coordinate specification section

Claims (3)

[Claims] 1. A video image capturing unit that captures an image of a subject including a background; a video image converting unit that processes original image data of the subject including the background captured by the video image capturing unit; In the video photo printing apparatus, the video image converting section includes a means for separately extracting image data of a background portion from the original image data, and a means for separately extracting image data of a background portion from the original image data, and a means for separately extracting image data of a background portion from the original image data. means for separating the background portion from the original image data based on the image data; means for converting the image data of the separated background portion into prespecified background image data; and means for separating the background image data and non-background image of the converted background portion. 1. A video photo printing device comprising means for combining and editing partial image data. 2. The present invention is characterized in that it has a coordinate storage means in which coordinate values corresponding to the background area are stored in advance, and the image data of the background portion is divided based on the original image data of the coordinates specified by the coordinate storage means. 2. The video photo printing apparatus according to claim 1. 3. Scanning means for scanning the original image data in a predetermined direction from a predetermined background area of the original image data, wherein the scanned image data is within a predetermined range. 2. The video photo printing apparatus according to claim 1, wherein the image data is regarded as image data of a background portion and the obtained image data is converted into background image data.