JP5458951B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing method for creating a cutout image based on a photographed image.

  An apparatus that converts a captured image into a picture-like image is known (see, for example, Patent Document 1 below).

JP 2004-213598 A

  However, in the case of such a conventional apparatus, the photographed image is only converted into a picture-like image by a predetermined image processing, and there is a problem that it is not interesting.

  The present invention has been made in view of these conventional problems, and an object of the present invention is to provide an image processing apparatus and an image processing method capable of creating a cut-out image that sufficiently reflects the viewer's intention.

In order to solve the above-described problem, an image processing apparatus according to the invention of claim 1 is provided:
Image storage means for storing captured images;
Designating means for designating the type of cutout to be created from among a plurality of types of cutouts of squeezing, hinata, squirrel, and nestling for the captured image stored in the image storage means. When,
When the type of the cutout to be created is designated from the types of cutouts by the designation unit, a cutout style image corresponding to the designated type of the cutout is based on the photographed image stored in the image storage unit. Creating means to create
With
As the type of the cutout picture in the specifying means,
The curl is a representation whose shape is represented by a line cut black on a white background,
The sunata is represented by a white background cut out on a black background,
The shadow is a representation whose shape is represented by a white-cut surface on a white background,
The nesting is characterized in that the shape is represented by a white line on a black background.

An image processing apparatus according to a second aspect of the present invention is the image processing apparatus according to the first aspect,
The creating means includes
Contour extracting means for extracting the contour of the photographed image stored in the storage means;
Based on the contour line representing the contour extracted by the contour extraction means, a fill processing means for applying a fill portion that becomes a cutout portion;
It is characterized by having.

An image processing apparatus according to claim 3 is the image processing apparatus according to claim 1,
The creating means includes
A connecting line specifying means for specifying a connecting line;
When a connecting line is specified by the connecting line specifying means, an image creating means with connecting lines that creates a cutout-like image with the specified connecting line based on the photographed image stored in the image storing means;
It is characterized by having.

An image processing apparatus according to a fourth aspect of the present invention is the image processing apparatus according to the second aspect ,
The filling processing means includes linearization processing means for straightening the convex and concave portions of the contour line and performing filling based on the linearized diagram.

An image processing apparatus according to claim 5 is the image processing apparatus according to claim 1,
It is characterized by comprising display control means for displaying the cutout style image created by the creating means.

An image processing method according to a sixth aspect of the present invention includes:
An image storage means for storing a captured image, a display unit and an image processing apparatus an image processing method definitive to which has a for displaying the captured images stored in the image storage means,
A cutout type display control step for displaying a plurality of types of cutouts among the types of cutouts of cutout, hinata, beard, and cutout on the display unit,
From the types of cutouts displayed in the cutout type display control step, designation means for designating the type of cutout to be created is designated for the photographed image stored in the image storage means. Then, a creation step of creating a cutout-like image corresponding to the designated type of cutout based on the captured image stored in the image storage unit;
With
As the type of cutout in the cutout type display control step,
The curl is a representation whose shape is represented by a line cut black on a white background,
The sunata is represented by a white background cut out on a black background,
The shadow is a representation whose shape is represented by a white-cut surface on a white background,
The nesting is characterized in that the shape is represented by a white line on a black background.

The image processing method according to the invention of claim 7 is the image processing method of claim 6,
The creating step includes
A contour extracting step for extracting a contour of the photographed image stored in the image storage means;
Based on the contour line representing the contour extracted by this contour extraction step, a fill processing step for applying a fill portion that becomes a cutout portion;
It is characterized by having.

An image processing method according to an invention of claim 8 is the image processing method of claim 6,
The creating step includes
When the connecting line is specified by the connecting line specifying means for specifying the connecting line, the cut-out image with the specified connecting line is created based on the photographed image stored in the image storage means. Creating an image with connecting lines;
It is characterized by having.

An image processing method according to the invention of claim 9 is the image processing method of claim 7,
The filling processing step includes a linearization processing step in which the convex and concave portions of the contour line are linearized and painting is performed based on the linearized diagram.

An image processing apparatus according to a tenth aspect of the present invention is the image processing method according to the sixth aspect,
A display control step of displaying the cutout image created by the creating step is provided.

  According to the present invention, a cutout style image can be reliably and easily created from a captured image.

  Further, according to the present invention, when the viewer specifies the type of cutout to be created, a cutout style image corresponding to the specified type of cutout can be automatically created based on the photographed image. .

  Furthermore, according to the present invention, when a connecting line is specified, a cutout-like image with the specified connecting line can be created based on the photographed image.

It is a figure which shows the external appearance of the digital camera and display apparatus which concern on one embodiment of this invention. It is a block block diagram which shows the outline of an electrical structure with the digital camera and a display apparatus. It is a memory block diagram of RAM. It is a flowchart which shows the painting style image creation process sequence in one embodiment of this invention. (A) is a flowchart which shows the procedure of a connecting line cutting picture creation process in FIG. 4, (B) is a flowchart which shows the procedure of the connecting line addition process in FIG. 5 (A). It is a figure which shows the example of a display of a picked-up image. It is a figure which shows the example of a display of the outline extraction result of a picked-up image. (A)-(C) are figures which show an example of the process etc. which linearize the outline of a picked-up image. It is a figure which shows the example of a display at the time of displaying the list of the kind of cutout picture. It is a figure which shows the example of a display when a user selects "Kagakukuri" from the kind of cutout. It is a figure which shows the example of a display when a user selects "Hinata" from the kind of cutout. It is a figure which shows the example of a display when a user selects "Kage" from the kind of cutout. It is a figure which shows the example of a display when a user selects "Hina takukuri" from the kind of cutout. It is a figure which shows the example of a display which accelerates | stimulates selection of the cutting picture with a connecting line. It is a figure which shows the example of a display of the cutout image with a frame. It is a figure which shows the example of a display of the cutout style image with a connecting line.

Hereinafter, embodiments of the present invention will be described.
FIG. 1 is a rear view showing the appearance of a digital camera 1 and a display device 100 according to an embodiment of the present invention.
On the back of the digital camera 1, a menu key 2, a mode dial 3, a display unit 4, a cursor key 5, a SET key 6, and the like are provided. A shutter key 8 and a power button 9 are provided on the upper surface. Further, on the front side, an imaging unit 10 including an imaging lens described later is provided. A photographed image or the like photographed by the digital camera 1 is stored in a later-described RAM 22 or memory card 24 incorporated therein.
On the other hand, on the surface of the display device 100, a display unit 13 for displaying a photographed image or the like stored in the attached memory card 24 is provided. Display device 100 is controlled by remote control device 101.

FIG. 2 is a block configuration diagram showing an outline of an electrical configuration of the digital camera 1 and the display device 100.
The digital camera 1 includes an imaging unit 10 and a CPU 11. The former imaging unit 10 includes a CCD. The latter CPU 11 compresses / decompresses an image captured by the CCD, and generates an image file in a format that conforms to a predetermined format, for example, a unified standard DCF (Design Rule for Camera File system) or JPEG (Joint Photographic Expert Group). An image processing function for playback is provided.

  An optical image of the subject is formed on the light receiving surface of the CCD constituting the imaging unit 10 through the imaging lens, the focus lens, and the diaphragm. The focus lens is held by a driving mechanism such as an AF motor, and a focusing signal that moves back and forth on the optical axis when a driving signal output from the AF driver is supplied to the driving mechanism by a control signal from the CPU 11. Do. The diaphragm is driven by a drive signal generated by the diaphragm drive unit based on a control signal from the CPU 11 and adjusts the amount of light of the subject image incident on the CCD.

  Further, a TG (Timing Generator) that generates a timing signal is connected to the CPU 11, and a V driver (vertical driver) drives the CCD based on the timing signal generated by this TG. An analog imaging signal corresponding to the brightness of the signal is output and sent to the unit circuit.

  The unit circuit includes a CDS that holds an imaging signal output from the CCD, a gain adjustment amplifier (AGC) that is an analog amplifier to which the imaging signal is supplied from the CDS, and an analog imaging that is amplified and adjusted by the gain adjustment amplifier. It comprises an A / D converter (AD) that converts the signal into a digital signal. The output signal of the CCD is sampled with the black level matched here and sent to the CPU 11 as a digital signal. The gain adjustment amplifier (AGC) amplifies the imaging signal supplied from the CDS with an amplification factor corresponding to the ISO sensitivity.

  In addition to the input unit 21 including the key group including the shutter key 8, the display unit 4, the RAM 22, the ROM 23, and the memory card 24 are connected to the CPU 11.

  The RAM 22 is a working memory, and the memory card 24 is an image recording memory. An imaging signal, which is a digital signal sent from the CCD to the CPU 11, is temporarily stored in the RAM 22, subjected to various image processing by the CPU 11, and finally recorded as compressed image data in the memory card 24. Is done. The memory card 24 is of a card type that is detachable from the camera body.

  A captured image or the like recorded on the memory card 24 is read by the CPU 11 as necessary, and is converted into a digital video signal or an analog video signal through processes such as expansion processing, addition of a luminance signal and a color signal, and a display unit. 4 is displayed. In addition, on the display unit 4, an image periodically captured in the recording mode is displayed as a through image.

  The ROM 23 is a program ROM in which various operation programs necessary for control of each unit and data processing in the CPU 11 are recorded. That is, the ROM 23 stores various data such as a program diagram indicating a combination of ISO sensitivity and shutter speed corresponding to an appropriate exposure value at the time of photographing together with the program.

  The CPU 11 performs AE control by controlling the charge accumulation time of the CCD, which is the shutter speed, the degree of opening of the diaphragm, and the gain of the gain adjustment amplifier (AGC) of the unit circuit, and drives the focus lens according to a predetermined program. AF (auto focus) control and AWB (auto white balance) control are performed. The memory card 24 stores captured images and the like.

  In the RAM 22, a picture-like conversion data area 221 shown in FIG. 3 is provided. In the painting style conversion data area 221, a first storage unit 222, a second storage unit 223, a third storage unit 224, and a fourth storage unit 227 are provided. The third storage unit 224 is divided into a filled image storage unit 225 and a coordinate storage unit 226.

  The first storage unit 222 stores captured images. The second storage unit 223 stores a contour image extracted from the captured image. Further, the third storage unit 224 stores a filled image obtained by linearizing the contour line of the contour image and painting the region surrounded by the contour line in black, and the coordinate storage unit 226 stores the filled image. The position coordinates indicating the coordinate position of the filled image are stored. The fourth storage unit 227 is a storage area used when generating a final picture-like image after being converted based on the captured image.

The position coordinates in the coordinate storage unit 226 include a plurality of coordinates that can specify the position in the contour image, such as the coordinates of all the dots in the entire area of the contour image, the coordinates of the contour, and the coordinates of a plurality of points. Any coordinates can be used.
On the other hand, the display device 100 has the same configuration as that of the digital camera 1 except for the photographing unit 10.

  In the present embodiment having the above-described configuration, the digital camera 1 executes the painting-like image creation process shown in the flowchart of FIG. 4 by the CPU 11 executing the process according to the program stored in the ROM 23.

  That is, when the user carries the digital camera 1 and, for example, presses the shutter key 8 under a scene where a sleeping cat is present as a subject, the CPU 11 starts a shooting process, and the shooting unit detects the sleeping cat. The captured image 6a is acquired. The acquired captured image 6 a is stored in the first storage unit 222 in the RAM 22.

  Next, the CPU 11 executes a captured image display process to display the captured image 6a of the sleeping cat captured on the display unit 4 (step S101). As a result, the captured image 6 a shown in FIG. 6 is displayed on the display unit 4.

  Subsequently, the CPU 11 extracts a contour from the captured image 6a (step S102). When extracting the contour for each subject, as shown in FIG. 7, the region is divided into similar color hues or the like according to similar luminance or color difference signals from the luminance signal and color difference signal of the photographed image 6aZ. A contour line L serving as a boundary line is extracted, and a portion surrounded by the contour line L is detected as one extraction region.

  Further, the extracted image for each subject is stored as a contour image 7A in the contour image storage unit 225 of the second storage unit 223, and the position coordinates in each contour image 7A are stored in the coordinate storage unit 226 of the second storage unit 223. To remember. Thereby, as shown in FIG. 3, the contour image storage unit 225 of the second storage unit 223 stores the contour image 7A of the sleeping cat, and the coordinate storage unit 226 stores the position coordinates of the contour image 7A. (X1, y1)... Are stored.

Next, the CPU 11 executes a painting process (step S103). This fill process includes various additional processes including a straight line process for straightening the uneven part of the contour line in addition to the black paint process for the entire black part of the contour line such as shadows. Apply.
This additional process is a process for cutting the cutting efficiency when cutting a picture or connecting adjacent picture parts using a cutter such as scissors. In this process, for example, as shown in FIG. 8B, the concavo-convex vertices 81, 82, 83, 84 are connected with lines, and the portion surrounded by the connected lines and the outline is filled with black. Performing a filling process as shown in FIG. 8C by performing a process, a process of adding a connecting line 85 for connecting adjacent diagrams, a process of adding a parallel line 86 parallel to a thin contour line, etc. Can do.

Next, the CPU 11 proceeds to a process of displaying a list of types of cutouts (step S104).
FIG. 9 is a diagram illustrating a display example when a list of types of cutout images is displayed. As shown in this figure, a message section 90 that prompts the user to select the type of cutout is displayed as “Please select the type of cutout you want to make”, while the type of cutout is displayed at the lower position. Items 9A to 9D (or type icons) may be displayed.

  Next, after displaying the list of cutout types, the CPU 11 determines whether or not the selection switch 21a in the input unit 21 for the user to select the cutout type has been operated (step S105). ).

  Next, when determining that the selection switch 21a has been operated, the CPU 11 executes a cutout style conversion process according to the type of cutout selected by operating the selection switch 21a (step S106).

10 to 13 show a cutout created by executing this cutout style conversion process.
That is, FIG. 10 is a display example of a cutout-style image 10A of a sunflower created when the item “Kakukuri (black line)” is selected by operating the selection switch 21a.
FIG. 11 is a display example of a cutout-style image 11A of a sunflower created when the item “Hinata (white surface)” is selected by operating the selection switch 21a.
FIG. 12 is a display example of a cutout-style image 12A of a sunflower created when the item “Shadow (black surface)” is selected by operating the selection switch 21a.
FIG. 13 shows a display example of a cutout-style image 13A of a sunflower created when the item “Drawn in the sun (white line)” is selected by operating the selection switch 21a.

“Kakukuri (black line)” shown in FIG. 10 is expressed by a representation in which the shape is represented by a line that is left uncut on a white background.
“Hinata (white surface)” shown in FIG. 11 is represented by a surface cut out white on a black background, and the background portion of the contour portion of the image of the extracted “sleeping cat” is entirely covered. It is expressed in terms of “black surface”, which is “Kurakage”, and a white background with a black surface.
“Shadow (black surface)” shown in FIG. 12 is expressed in a way of representing a shape by a surface cut out white on a white background.
“Hina takukuri (white line)” shown in FIG. 13 is expressed by a representation in which the shape is framed by a white line on a black background.
The CPU 11 converts the images into cut-out style images 10A, 11A, 12A, and 13A shown in FIGS. 10 to 13 based on one captured image 6a so as to represent each expression.

Next, the CPU 11 proceeds to a process for displaying a connecting line selection screen (step S107).
FIG. 14 is a diagram illustrating a display example when the connecting line selection screen is displayed. As shown in this figure, while displaying a message part 14A prompting the user whether or not to add a connecting line to the cutout, "Would you like to make a cutout with a connecting line?" Selection items 14B and 14C (or an icon) indicating “Yes” or “No” to add a connecting line are displayed at the positions.

  Next, after displaying the connecting line selection screen, the CPU 11 determines whether or not the selection switch 21a in the input unit 21 for selecting the addition of the connecting line has been operated by the user (step S108).

  Next, when the CPU 11 determines that the selection switch 21a has been operated, the CPU 11 executes a cutout creation process with a connecting line according to the addition of the connecting line selected by the operation of the selection switch 21a (step S109). ).

The connecting line cutout creation process executes a process according to the flowchart of FIG.
That is, first, a frame addition process is performed on the cutout image (step S110). In this frame addition process, for example, as shown in FIG. 15, a frame 150 is added at the outer peripheral position of the cutout image so as to surround the cutout image.

Next, a connecting line addition process between the added frame 150 and the cutout image is performed (step S111). For example, as shown in FIG. 16, the connecting line adding process is a process of adding a plurality of connecting lines 161 to 165 for connecting the cutout image 10 </ b> A and the added frame 150. It is.
In the connecting line adding process for adding the connecting line, for example, as shown in FIG. 5B, the distance between the cutout image 10A and the added frame 150 is measured. Further, the diagonal position of the added frame 150 is calculated and obtained (step S112). Next, based on such measurement or calculation, a plurality of connecting lines 161 to 165 for connecting the cutout image 10A and the added frame 150 are added (step S113).
In the case shown in FIG. 16, two connecting lines 161 to 164 connecting the left and right frame portions of the added frame 150 and the cutout image are cut off, and the lower frame portion of the added frame 150 is cut off. However, the present invention is not limited to this example, the number of connecting lines can be increased or decreased as appropriate, and the positions of connecting lines are also limited to this example. Absent.

  According to the embodiment as described above, a cutout-like image desired by the viewer is automatically and easily created based on the photographed image and displayed on the display unit 4. Picturesque images can be viewed quickly and easily.

  Further, the displayed cutout-like image is stored in the memory card 24, and if the stored memory card 24 is attached to the display device 100, the cutout-like image can be viewed on the display unit 13 of the large screen. You can also.

  In the present embodiment, the case where the present invention is applied to a digital camera is shown. However, the present invention is not limited to a digital camera, and may be applied to other devices such as a mobile phone as long as it includes a photographing unit. Also good.

1 Digital Camera 4 Display Unit 10 Imaging Unit 11 CPU
24 memory card

Claims (10)

Image storage means for storing captured images;
Designating means for designating the type of cutout to be created from among a plurality of types of cutouts of squeezing, hinata, squirrel, and nestling for the captured image stored in the image storage means. When,
When the type of the cutout to be created is designated from the types of cutouts by the designation unit, the cutout style image corresponding to the type of the cutout is designated as a photographed image stored in the image storage unit. Creation means to create based on,
With
As the type of the cutout picture in the specifying means,
The curl is a representation whose shape is represented by a line cut black on a white background,
The sunata is represented by a white background cut out on a black background,
The shadow is a representation whose shape is represented by a white-cut surface on a white background,
The image processing apparatus according to claim 1, wherein the pattern is a representation in which a shape is framed with a white line on a black background. The creating means includes
Contour extracting means for extracting the contour of the photographed image stored in the storage means;
Based on the contour line representing the contour extracted by the contour extraction means, a fill processing means for applying a fill portion that becomes a cutout portion;
The image processing apparatus according to claim 1, further comprising: The creating means includes
A connecting line specifying means for specifying whether to add a connecting line;
When it is specified by the connecting line specifying means that a connecting line is to be added, a cutout-like image with the specified connecting line is created based on the photographed image stored in the image storing means. Image creation means;
The image processing apparatus according to claim 1, further comprising: 3. The image processing apparatus according to claim 2 , wherein the filling processing means includes a straightening processing means for straightening the convex and concave portions of the contour line and performing filling based on the linearized diagram. .   The image processing apparatus according to claim 1, further comprising a display control unit that displays the cutout style image created by the creating unit. An image storage means for storing a captured image, a display unit and an image processing apparatus an image processing method definitive to which has a for displaying the captured images stored in the image storage means,
A cutout type display control step for displaying a plurality of types of cutouts among the types of cutouts of cutout, hinata, beard, and cutout on the display unit,
From the kind of cutouts displayed by the cutout type display control step for photographic images stored in the image storage unit, the type of cutouts to be created is specified, is the designated Creating a cutout image corresponding to the type of cutout based on the captured image stored in the image storage means;
With
As the type of cutout in the cutout type display control step,
The curl is a representation whose shape is represented by a line cut black on a white background,
The sunata is represented by a white background cut out on a black background,
The shadow is a representation whose shape is represented by a white-cut surface on a white background,
The image processing method according to claim 1, wherein the pattern is a representation in which a shape is framed with a white line on a black background. The creating step includes
A contour extracting step for extracting a contour of the photographed image stored in the image storage means;
Based on the contour line representing the contour extracted by this contour extraction step, a fill processing step for applying a fill portion that becomes a cutout portion;
The image processing method according to claim 6, further comprising: The creating step includes
When it is specified that a connecting line is to be added by the connecting line specifying means for specifying whether to add a connecting line, the cut-out image with the specified connecting line is stored in the image storage means. A step of creating an image with a connecting line to be created based on the captured image,
The image processing method according to claim 6, further comprising:   8. The image processing method according to claim 7, wherein the filling processing step includes a linearization processing step of linearizing the convex and concave portions of the contour line and performing filling based on the linearized diagram. .   The image processing method according to claim 6, further comprising a display control step of displaying the cutout style image created by the creation step.