JP3822370B2 - Image capture device and method - Google Patents

Description

[0001]
【Technical field】
The present invention relates to an image capturing apparatus and method for capturing a target image and transforming the captured target image.
[0002]
BACKGROUND OF THE INVENTION
An apparatus for photographing a subject and printing an image representing the subject image on a sticker or the like has been put into practical use. In such an apparatus, when a subject image obtained by photographing is deformed, the deformed image cannot be confirmed until it is printed and output.
DISCLOSURE OF THE INVENTION
An object of the present invention is to enable a user to check a target image after deformation when the target image is captured and deformed.
[0003]
The image capturing device according to the present invention includes a setting unit that sets at least one of an image deformation method and an image deformation part, a target image capturing unit that captures a target image, and a target image captured by the target image capturing unit. An image deformation processing means for executing at least one of image deformation processing based on the image deformation method set by the means and image deformation processing of the image deformation portion, and a target image after deformation by the image deformation processing means is displayed. A display device is provided.
[0004]
The present invention also provides a method suitable for the above apparatus. In other words, this method sets at least one of an image deformation method and an image deformation location, captures the target image, and converts the captured target image into an image deformation process based on the set image deformation method and an image deformation process of the image deformation location. At least one of the image deformation processes is executed, and the deformed target image is displayed.
[0005]
According to the present invention, the upper body of the subject such as an image transformation method (for example, when photographing the whole body of the subject, a method of transforming the subject image so that the whole body of the subject image is thick, or a method of transforming the subject image so that the whole body of the subject image is narrowed) When photographing a subject, a method of deforming the face portion of the subject to be thick, a method of deforming the face portion of the subject to be thin, a method of flipping the subject image to the left and right, etc. When photographing the whole body of the subject, transform the image of the face part, transform the image of the torso part, transform the image of the lower body part, or when photographing the upper body of the subject, A part (such as deforming eyes, nose, mouth, eyebrows, ears, etc.) is set.
[0006]
A target image (the target image may be the user himself / herself or a photograph brought by the user) is captured by photographing. For the captured image, deformation by the set image deformation method or deformation of the set image deformation portion is executed. The deformed image is displayed on the display device. The user can check the transformed target image by looking at the image displayed on the display device. The confirmed deformed image is printed.
[0007]
When the deformation method is determined in advance, the deformation location may be set. When the deformation location is determined in advance, the deformation method may be set. Of course, it goes without saying that both the deformation method and the deformation location may be set.
[0008]
In addition to transforming the captured image, the color represented by the captured image may be changed. When changing the color, the color of the entire captured image may be changed, or the color of a part of the captured image may be changed.
[0009]
[Explanation of Examples]
FIG. 1 is a perspective view of an image capturing device 1 according to this embodiment.
[0010]
The image capturing device 1 is a device that captures a subject image representing a user (subject), deforms and displays part or all of the subject image, and prints it.
[0011]
The image capturing device 1 is provided with a video camera 2 at a substantially central portion above the front surface thereof. The user stands in front of the image capturing device 1 toward the video camera 2. A user is photographed by the video camera 2.
[0012]
A monitor display device 3 is provided below the video camera 2. A subject image photographed by the video camera 2 is displayed on the display screen of the monitor display device 3 as a moving image.
[0013]
A speaker 4 for outputting operation guidance by voice is provided on the right side of the monitor display device 3. The user operates the image capturing device 1 according to the sound output from the speaker 4. On the upper surface and both side surfaces of the image capturing device 1 are provided fluorescent lamps 14 for irradiating light to the user who is photographed by the video camera 2.
[0014]
An operation unit 12 protruding from the front surface is formed at a substantially central portion of the front surface of the image capturing device 1. As will be described later, the operation unit 12 includes a left button 4, a right button 5, an OK button 6 to be pressed by the user when making a decision, and a selection cancel button. A cancel button 8 is formed. In addition, a coin return button 13 is also formed on the operation unit 12.
[0015]
Below the operation unit 12, a coin insertion slot 9 is formed for inserting coins as a usage fee when the user uses the image capturing device 1.
[0016]
A coin return slot 10 is provided below the front surface of the image capturing device 1. The coins inserted into the coin insertion slot 9 when the coin return button 13 is pressed before the subject image is printed are returned from the coin return slot 10.
[0017]
On the right side of the coin return port 10, a print discharge port 11 for discharging a print obtained by photographing is provided.
[0018]
The various buttons 5, 6, 7, and 8 described above are mechanical buttons, but may be formed as a touch panel on the monitor display device 3. Furthermore, a display device may be newly provided separately from the monitor display device 3, and a touch panel for giving commands from the above-described buttons 5, 6, 7 and 8 to the new display device may be formed.
[0019]
FIG. 2 is a block diagram showing a part of the electrical configuration of the image capturing device 1.
[0020]
The overall operation of the image capturing device 1 is controlled by the computer device 20. The computer device 20 includes a memory for storing an operation program, data representing a deformed portion, and other necessary data. .
[0021]
When a coin is inserted from the coin insertion slot 9 (see FIG. 1), it is given to the coin machine 27 and the inserted coin is held. The amount of coins inserted is counted by the coin counter 28.
[0022]
When a coin of an amount necessary for using the image capturing device 1 is inserted, the video camera 2 starts photographing the user standing in front of the image capturing device 1. A video signal representing the user is given from the video camera 2 to the capture circuit 21 and converted into digital image data. Digital image data representing the user's image is input to the computer device 20, and image transformation processing is performed if necessary. The digital image data is temporarily stored in a memory built in the computer device 20.
[0023]
Digital image data representing a user image is read from a memory built in the computer device 20 and input to the monitor display device 3 via the capture circuit 21. An image representing the user is displayed on the display screen of the monitor display device 3.
[0024]
A signal indicating the depression of the button included in the operation unit 12 is input to the computer device 20 via an I / O (Input / output) device 25. In the computer device 20, processing (image deformation processing, image freeze processing, etc.) based on the input signal is performed. Further, as will be described later, when the user presses the OK button 7 when printing is displayed on the monitor display device 3, the printer 22 connected to the SCSI (Small Computer System Interface) is used to change the deformed user. Images will be printed.
[0025]
A sound circuit 24 is connected to the computer device 20, and the sound output from the speaker 4 is controlled by the sound circuit 24. Also, the light emission of the fluorescent lamp described above is controlled by the computer device 20 via the I / O device 25. Further, the image capturing device 1 is provided with a test switch, a service switch, and a maintenance switch 26 for maintaining the image capturing device 1 by a maintenance man. Signals indicating the settings of these switches 26 are input to the computer device 20 via the I / O device 25.
[0026]
Further, the scanner 29 may be provided in the image capturing device 1. An image represented by a photograph or the like can be captured into the image capturing device 1 by the scanner 29. A signal representing an image is output from the scanner 29 and input to the computer device 25 via the SCSI 23, and the captured image can be transformed. However, a film scanner may be provided so that an image recorded on the film can be read, or a memory card reader or FD (Floppy Disk) drive is provided to store images stored in the memory card. An image represented by data or an image stored in the FD may be read.
[0027]
3 and 4 are flowcharts showing the processing procedure of the image capturing device 1. FIG. FIG. 5 is a flowchart illustrating a processing procedure for selecting a deformation method and a deformation location, and FIG. 6 is a flowchart illustrating a processing procedure for a deformed image. 7 to 14 show an example of the display screen of the monitor display device 3 of the image capturing device 1.
[0028]
When the image capturing device 1 is turned on, the processing shown in FIGS. 3 and 4 starts.
[0029]
First, when the power is turned on, the operation program of the computer device 20 is started (step 41). It is monitored whether the maintenance switch is turned on (step 42). When the maintenance switch is turned on (YES in step 42), maintenance processing of the image capturing device 1 is executed by the maintenance man (step 43).
[0030]
When the operation program of the image capturing device 1 is activated, a screen for prompting coin insertion is displayed on the display screen of the monitor display device 3. When the user inserts a coin corresponding to the usage fee from the coin insertion slot 9 and confirms the insertion by the coin counter 28 (YES in step 44), the display screen of the monitor display device 3 shows the screen shown in FIG. Such an image deformation method selection screen is displayed (step 61 in FIG. 5).
[0031]
The image deformation method selection screen includes buttons (areas) A1, A2, and A3 for selecting an image deformation method. The button A1 is a button selected by the user when the captured image is transformed beautifully. The button A2 is a button that is selected by the user to interestingly deform the captured image (for example, increase the degree of deformation). The button A3 is a button that is selected by the user in order to synthesize the background image.
[0032]
The selectable buttons are blinking (indicated by hatching in FIG. 7). When the OK button 7 is pressed by the user, the image transformation method represented by the blinking button is determined (step 62 in FIG. 5). In the example shown in FIG. 7, the button A1 is blinking. Thus, when the OK button 7 is pressed while the button A1 is blinking, the image deformation method is determined so as to clean the captured image. When the OK button is pressed, the display screen of the image display device 3 is switched to the deformation location selection screen shown in FIG. 8 (step 63 in FIG. 5).
[0033]
As shown in FIG. 7, when the right button 5 or the left button 6 is pressed while the button for determining the image deformation method is blinking, buttons other than the buttons displayed on the image deformation method selection screen are displayed. Appears on the image transformation method selection screen. The image transformation method determined by the newly appearing button can be selected and determined.
[0034]
In the image deformation method selection screen, the area A4 below the buttons A1, A2 and A3 shows the image deformation contents of the blinking button. For example, when the button A1 is blinking, the button A1 is selected by the user when the captured image is to be cleaned. It is shown that deformation processing of the captured image is performed. Needless to say, when a button other than the button A1 is blinking, an explanation showing the image deformation content set by the blinking button is displayed in the area A4.
[0035]
The deformation location selection screen shown in FIG. 8 includes a plurality of areas A5, A6, and A7 indicating the deformation locations of the captured image. In these areas A5, A6 and A7, sample images showing the deformed portions are shown. A region A5 represents a sample image in which the eyebrows are deformed, a region A6 represents a sample image in which the chin is deformed, and a region A7 represents a sample image in which the eyes are deformed.
[0036]
The area A5 is an area selected by the user when transforming the image of the eyebrows among the captured images. The area A6 is an area selected by the user when deforming the chin image among the captured images. Region A7 is a region selected by the user when deforming the eye image of the captured image. By pressing the left button 5 and the right button 6, an area other than the image area indicating the deformation location displayed on the deformation location selection screen appears on the screen.
[0037]
The frame F moves to the left area when the left button 5 is pressed, and moves to the right side when the right button 7 is pressed. When the OK button 7 is pressed by the user, the part of the image of the deformed portion represented by the area surrounded by the frame F when the OK button 7 is pressed among the captured images is deformed ( FIG. 5, step 64). But you may enable it to select a some deformation | transformation location.
[0038]
When the OK button 7 is pressed, how the selected deformed part is deformed is continuously displayed by frame advance using the sample image (see FIG. 9, step 65 in FIG. 5). When the OK button 7 is pressed by the user (YES in step 66 in FIG. 5), an alignment screen is displayed on the display screen of the image display device 3 as shown in FIG. 10 (step 46). Here, it is assumed that “eye” is selected as the deformed portion as shown in the region A7.
[0039]
The alignment screen includes a shooting display area A8. In this shooting display area A8, an image of the user shot by the video camera 2 is displayed. A deformation location A9 is also displayed in the photographing display area A8. The deformation location A9 is set so that the eye portion of the user image displayed in the shooting display area A8 is displayed. A frame is formed at the deformed portion A9 so that the user can recognize the deformed portion.
[0040]
The position of the deformed portion A9 may be moved by the user. Further, the size of the deformed portion A9 may be changed so that the size can be increased or decreased. It can deal with the face of individual users.
[0041]
When the deformed portion of the image representing the user (in this example, the eye of the user's image) is positioned at the deformed portion A9 of the photographing display area A8 on the alignment screen, the OK button 7 is pressed by the user. Then, the display screen of the monitor display device 3 is switched to the shooting screen shown in FIG. The shooting screen includes a shooting display area A10, and an image representing the user is displayed in the shooting display area A10. After a certain period of time, the video signal output from the video camera 2 is taken into the computer device 20 as digital image data as subject image data representing the user's image (step 47).
[0042]
Of the digital image data fetched into the computer device 20, the image data of the selected deformed portion is subjected to image deformation processing with the degree of deformation being changed (step 48).
[0043]
Thereafter, a deformation confirmation screen including a deformation confirmation image display area A11 is displayed on the monitor display device 3 as shown in FIG. Digital image data representing the user's deformed image is provided to the monitor display device 3 via the capture circuit 21, so that the deformation confirmation image display area A11 includes images of a plurality of frames having different degrees of deformation (users obtained by photographing ) Is displayed by frame advance (see FIG. 13, step 81 in FIG. 6). During the deformation process (enlargement by pixel interpolation, reduction by pixel thinning, etc.), the screen may be switched so as to notify the user that the deformation process is in progress.
[0044]
When the user presses the OK button 7 (YES in step 82 in FIG. 6), the deformed image one frame before the deformed image displayed in the deformation confirmation image display area A11 when the OK button 7 is pressed is The image selected by the user is determined (step 49, step 83 in FIG. 6). Since the deformed image is displayed by frame advance, the image desired by the user is determined as the image selected by the user even if the user delays pressing. Of course, it goes without saying that the deformed image displayed in the deformation confirmation image display area A11 when the OK button 7 is pressed may be an image determined by the user. When the OK button is pressed (step 84 in FIG. 6), a deformed image to be printed is determined (step 85 in FIG. 6).
[0045]
When the deformed image is determined, a frame selection screen for selecting a frame for decorating the deformed image is displayed. The user determines a frame while viewing the frame selection screen displayed on the monitor display device 3 (step 50).
[0046]
When the frame is determined, the monitor display device 3 displays a finish confirmation screen shown in FIG. An image to be printed is displayed in the confirmation area A12 (step 51). Thereby, the user can confirm the deformed image actually printed before the printing.
[0047]
When the user confirms the deformed image to be printed and the OK button 7 is pressed, the image confirmed by the user is printed by the printer 22 (step 52). On the monitor display device 3, a reprint confirmation screen appears. When another sheet is printed, the OK button 7 is pressed, and when another sheet is not printed, the cancel button 8 is pressed.
[0048]
Thereafter, an end screen is displayed on the monitor display device 3, and the process returns to step 42. Until the coin is inserted into the image capturing device, a screen saver screen may be displayed on the monitor display device 3. Needless to say, when the power is turned off, the image capturing device 1 is shut down.
[0049]
Before the deformed image is actually printed, it is possible to check the state of the deformed image (FIG. 9) and the state of the printed image (FIG. 14).
[0050]
The image that informs the user that the image of the deformed portion in FIG. 9 has been deformed may be a user image captured using the video camera 2, or image data stored in the memory of the computer device 20 in advance. You may use the image represented by these. When the user is notified of the state of the deformed image using the photographed user's image, a quick display is required. Therefore, an image obtained by thinning out the user's image obtained by photographing will be used.
[0051]
In the image transformation process, an image processing description file describing the transformation process of image data is created in advance and stored in a memory built in the computer device 20 as described below, and the image processing description file is referred to. It is also possible to perform image deformation processing.
[0052]
FIG. 14 shows the file structure of the image processing description file.
[0053]
The image processing description file includes Header, Default output, Layer List, Layer Data, Layer Specific Data, and the like.
[0054]
FIG. 15 shows details of the header. The header stores header information such as management information and data representing the version number of the image processing description file.
[0055]
FIG. 16 shows details of Default output. Default output includes data that indicates the size of the image (width and height) when the deformed image is printed and output, output type data that indicates the print paper, and the output direction is vertical or horizontal. Data indicating the direction and data indicating the background color of the deformed image to be printed are stored.
[0056]
FIG. 17 shows the details of the Layer List. The Layer List stores layer information (Layer Info) and data representing the number of layer information (number of layers) (in the example shown in FIG. 14, five types of layer information are stored).
[0057]
In the layer information, a pointer to Layer Data and a layer name (in this case, a deformation layer for image deformation processing, the layer names of deformation 1 to deformation 5 indicating different deformation locations are stored. 1 is for deforming the “eye” portion, the deformation layer 2 is for deforming the “chin” portion, the deformation layer 3 is for deforming the “eyebrows” portion, and the deformation layer 4 Is for deforming the “nose” portion, and the deformation layer 5 is for deforming the “mouth” portion.), Display order (when displaying a plurality of deformed images superimposed, the display priority ), A replaceable / impossible flag (a flag indicating whether a sample image is stored in advance and can be replaced with the stored sample image), and a replacement number.
[0058]
FIG. 18 shows the details of Layer Data and Layer Specific Data (layer-dependent information). Although FIG. 18 shows two layer data and two layer specific data, it goes without saying that five layer data and five layer specific data are stored in the image processing description file.
[0059]
Layer Data includes pointers to layer-dependent information, transparency mask pointers (pointers to transparency mask data that indicates the degree of color transparency of the superimposed deformed images when multiple deformed images are displayed overlaid), and deformation A position information pointer representing the position information of the image is included.
[0060]
In Layer Specific Data, data indicating the category of the layer (in this case, a deformed layer), the format of the captured image, the pointer to the captured image, and the maximum and minimum values of the layer parameters are stored. The layer parameter here represents the degree of deformation. The maximum and minimum values of the layer parameters can be changed, and the degree of deformation can be changed by changing the maximum and minimum values of these layer parameters.
[0061]
When such an image processing description file is stored in the memory of the computer device, the captured image is deformed as follows (step 48 in FIG. 4).
[0062]
FIG. 20 is a flowchart showing the procedure of the image transformation process.
[0063]
Prior to the image transformation process, a transformation layer selection process is executed (step 70). As described above, the image deformation location is selected using the image deformation location selection screen as shown in FIG. A deformation layer corresponding to the selected image deformation location is selected (step 70). When “eye” is selected by the user as the deformation location, the deformation layer 1 is selected (step 71). When “chin” is selected by the user as the deformation location, the deformation layer 2 is selected (step 72). When “eyebrows” is selected as the deformation location, the deformation layer 3 is selected (step 73). If “nose” is selected as the deformation location, the deformation layer 4 is selected (step 74). If “mouth” is selected as the deformation location, the deformation layer 5 is selected (step 75).
[0064]
In any case, when the deformation layer is selected, the previously stored sample image and the captured user image are replaced. In the captured image, the location specified by the selected deformation layer is deformed with the degree of deformation determined by the layer parameter (step 76). The deformed image is displayed on the display screen of the monitor display device 3 as described above (see FIG. 13).
[0065]
The degree of deformation may be changed for each deformation layer. For example, the deformation layer 1 is set to be deformed at the maximum deformation level, the deformation layer 2 is set to be deformed at the next maximum deformation level, and the deformation layer 3 is set to a standard deformation level. The deformation layer 4 is set to be deformed at a certain degree, the deformation layer 4 is set to be deformed to a slight degree, and the deformation layer 5 is set to be deformed at a minimum deformation degree. The degree of deformation can be selected by selecting a deformation layer. When the degree of deformation is changed for each deformation layer, it is necessary to generate an image processing description file corresponding to the deformation portion and store it in the memory of the computer device 20.
[0066]
FIGS. 21 and 22 are flowcharts showing a processing procedure when generating image data representing a sample image displayed on the display screen of the monitor display device 3 when the user selects a deformed portion.
[0067]
FIG. 21 is a diagram for generating image data representing a sample image when the image data representing the sample image is stored in the image capturing device 1.
[0068]
The image processing description file is stored in the memory of the computer device 20 (step 91). Thereafter, it is determined whether or not the sample image is created by the image capturing device 1 itself (step 92).
[0069]
When a sample image is created by the image capturing device 1 itself (YES in step 92), for example, image data for generating a sample image is read by a scanner (step 95). A sample image is generated using the read image data (step 96). Data representing the generated sample image is stored in the memory of the computer device 20 (step 97). The processing of step 96 and step 97 is repeated (step 98) until the creation of the sample image for all stored image processing description files, that is, the sample image representing all deformable portions is completed. The sample image may be a different image for each deformed portion. When a sample image is created by the image capturing device 1 itself, a different sample image can be displayed for each image capturing device 1.
[0070]
When a sample image is not created by the image capturing device 1 (NO in step 92), predetermined sample image data is read (step 93) (will be input via the I / O device 25), and the read sample image The data is stored in the internal memory of the computer device 20 (step 94).
[0071]
FIG. 22 is a flowchart showing a processing procedure for storing image data representing a sample image in the image capturing device 1 when the sample image is selected.
[0072]
As shown in FIG. 8, it is determined whether or not image data representing a sample image has already been stored in the memory of the computer device 20 when a deformed portion is selected (step 101). If the image data representing the sample image is not stored in the internal memory of the computer device 1 (NO in step 101), the image data for generating the sample image is read into the image capturing device (step 103). It is confirmed whether there is a parameter for setting the degree of deformation of the deformed portion (step 104).
[0073]
If there is a parameter, a display screen is displayed on the display screen of the monitor display device 3 to prompt the input of the parameter (step 105). Thereafter, for example, parameters are input by a maintenance man. A sample image having a degree of deformation is generated according to the input parameters (step 107). When there is no input parameter (NO in step 104), a sample image is generated with a predetermined degree of deformation (step 107). The generated sample image is displayed on the display screen of the monitor image display device 3 (step 108). The processing from step 104 to step 108 is repeated until sample images for all image processing description files are generated (step 109). When sample image data representing a deformed portion is generated when the deformed portion is selected, low-quality image data will be used for the sample image for quick display.
[0074]
Also, high-quality image data is used so that a high-quality print image can be obtained when a synthesized image is printed, and image data for prompt display when displayed on the display screen of the monitor display device 3. It is advisable to use image data with a small amount of image data by thinning out.
[Brief description of the drawings]
FIG. 1 is a perspective view of an image capturing device.
FIG. 2 is a block diagram illustrating an electrical configuration of the image capturing device.
FIG. 3 is a flowchart illustrating a processing procedure for image deformation.
FIG. 4 is a flowchart illustrating a processing procedure for image deformation.
FIG. 5 is a flowchart showing a deformation method and a processing procedure for a deformed portion.
FIG. 6 is a flowchart showing a processing procedure for selecting a deformed image.
FIG. 7 is an example of a display screen.
FIG. 8 is an example of a display screen.
FIG. 9 shows a state of an image to be deformed.
FIG. 10 is an example of a display screen.
FIG. 11 is an example of a display screen.
FIG. 12 is an example of a display screen.
FIG. 13 shows how an image is displayed by frame advance.
FIG. 14 is an example of a display screen.
FIG. 15 shows an image processing description file.
FIG. 16 shows a Header.
FIG. 17 shows Default output.
FIG. 18 shows a Layer List.
FIG. 19 shows Layer Data and Layer Spesific Data.
FIG. 20 is a flowchart illustrating a processing procedure of image deformation processing.
FIG. 21 is a flowchart showing sample image generation processing;
FIG. 22 is a flowchart showing sample image generation processing;
[Explanation of symbols]
1 Image capture device
2 Video camera
3 Monitor display device
6 OK button
20 Computer equipment
22 Printer

Claims (2)

By selecting the image transformation method to be applied from among a plurality of types of image transformation method, and selects the image transformation portion to be applied from among a plurality of types of image transformation point, the image transformation method and an image deformation箇plants Setting means for setting,
Target image capturing means for capturing the target image by photographing,
An image deformation process based on the image deformation method set by the setting unit is applied to the target photographed image captured by the target image capturing unit , and the degree of deformation of the image deformation point set by the setting unit is changed. An image deformation processing means that executes step by step while changing, and a display device that displays the target captured image that has been stepwise deformed while changing the degree of deformation by the image deformation processing means,
An image capturing device comprising: By selecting the image transformation method to be applied from among a plurality of types of image transformation method, and selects the image transformation portion to be applied from among a plurality of types of image transformation point, the image transformation method and an image deformation箇plants Set,
Capture the target image by shooting,
An image deformation process based on the set image deformation method is executed on the captured target captured image in stages while changing the degree of deformation on the set image deformation point .
Display the target image that has been deformed step by step while changing the degree of deformation.
Image capture method.

Images