JP2020048117A - Image providing system - Google Patents

Abstract

To obtain a clear composite image consisting of a person image of a photographed image and a background image.SOLUTION: An image providing system 10 comprises: a photographing apparatus 2 for photographing a person P to be photographed and generating a photographed image 30; and an image processing unit 22 for cutting out a person image 31 except a background 32 out of the photographed image 30 and combining a selected background image 33 and the person image 31 to obtain a composite image 35. A failure region 36 in the composite image 35 is specified by a pen tool 50. A corrected composite image generating unit 23 completely removes the background 32 out of the composite image 35 to obtain a clear corrected composite image 35A.SELECTED DRAWING: Figure 1A

Description

  The present invention relates to an image providing system that provides a photographed image to a user.

  2. Description of the Related Art Conventionally, there is known an image providing system for photographing an ID photograph or the like to be attached to a resume and providing the photograph to a user. Such an image providing system shoots a person, prints and outputs photographs of various sizes according to the purpose. In a conventional image providing system, a person is photographed while sitting in front of a single background. Therefore, to change the background color of a photograph, it was necessary to replace the background.

  Also, there is known an apparatus that synthesizes a background image with a person image by image processing using chroma key synthesis and prints out the image (for example, see Patent Document 1). The user can select a desired image from various background images prepared in advance.

  In the chroma key synthesis, a person part and a background part in a captured image are separated, and only the person part is cut out. Then, the synthesized image is generated by synthesizing the person portion of the photographed image and the background image. In this case, the background of the photographed image is removed, but the background in the photographed image generally has the same color, but not all have the same lightness. If the brightness is different, the background cannot be reliably removed by image processing, and the clear background image cannot be obtained because the original background remains in the synthesized image.

Japanese Patent No. 4217066

  An embodiment of the present disclosure has been made in view of such a point, and has as its object to provide an image providing system capable of obtaining a clear synthesized image by reliably removing a background from a captured image. And

  An embodiment of the present disclosure captures an image of a background and a subject, generates a captured image including a background and a person image, a storage unit storing a plurality of background images, and receives a background image selection instruction. An instruction receiving unit, and image processing for cutting out the person image from the photographed image except for the background and chroma-key combining the background image selected and instructed via the instruction receiving unit with the person image to create a combined image And a display unit for displaying a plurality of background images and the composite image, wherein the display unit includes a defect region input unit that specifies a defect region in the background image of the composite image, and the defect region input unit A corrected combined image generation unit that corrects the combined image to generate a corrected combined image based on the input information is provided, and the corrected combined image generated by the corrected combined image generation unit is It is displayed on the radical 113, an image providing system.

  An embodiment of the present disclosure is a storage unit that stores a plurality of background images, an instruction receiving unit that receives a background image selection instruction, and cuts out the person image except the background from a captured image including a background and a person image. An image processing unit that creates a composite image by chromakeying the background image and the person image selected and instructed via the instruction reception unit, and a display unit that displays the composite image, wherein the display unit is A corrected composite image that includes a defect area input unit that specifies a defect area in the background image of the composite image, and that corrects the composite image to generate a corrected composite image based on information input to the defect area input unit. An image providing system, further comprising a generation unit, wherein the corrected composite image generated by the corrected composite image generation unit is displayed on the display unit.

  An embodiment of the present disclosure is an image providing system, wherein the corrected combined image generation unit removes a background remaining in a defective area input by the defective area input unit.

  An embodiment of the present disclosure is the image providing system, wherein the defect area input unit specifies the defect area by drawing an outline of the defect area, and the defect area is displayed on the display unit.

  An embodiment of the present disclosure is an image providing system in which the defective area input unit specifies the defective area by solid-painting the entirety of the defective area, and the defective area is displayed on the display unit. .

  An embodiment of the present disclosure is an image providing system connected to the corrected combined image generation unit and connected to a printer that prints the corrected combined image on a print.

  According to the embodiment of the present disclosure, a clear synthesized image can be obtained by reliably removing the background from the captured image.

FIG. 1A is a schematic configuration diagram of an image providing system according to the present embodiment. FIG. 1B is a schematic diagram showing a captured image, a combined image, and a corrected combined image. FIG. 2 is a schematic configuration diagram of the arithmetic and control unit according to the present embodiment. FIG. 3 is a functional block diagram realized by executing the image processing program according to the present embodiment. FIG. 4 is a flowchart illustrating the operation of the image providing system according to the present embodiment. FIGS. 5A, 5B, and 5C are diagrams showing specific operations of the image providing system according to the present embodiment. FIGS. 6A, 6B, 6C, 6D, 6E, and 6F show examples of the monitor screen. FIGS. 7A, 7B, and 7C are diagrams illustrating an example of correcting a composite image. FIGS. 8A, 8B, and 8C are diagrams showing another example of correcting a composite image. FIG. 9 is a diagram illustrating a state in which a failure occurs in the composite image. FIGS. 10A, 10B, and 10C are views showing a state where the monitor screen is enlarged.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1A shows a schematic configuration of an image providing system 10 according to the present embodiment. FIG. 1B is a diagram showing a captured image, a composite image, and a corrected composite image. The image providing system 10 includes: a photographing device 2 that photographs a subject P to generate a photographed image 30 including a background 32 and a person image 31; an arithmetic control device 1 that performs image processing on the photographed image 30; And a printer 5 for printing a print (photograph). The image providing system 10 cuts out the person image 31 from the photographed image 30 except for the background 32, creates a composite image 35 in which the person image 31 and the background image 33 are combined, and removes a defective area 36 of the combined image 35. The correction is performed to create a corrected composite image 35A (see FIGS. 1A and 1B).

  It should be noted that the image providing system 10 does not necessarily have to have the above configuration, and the image providing system 10 can be configured from at least the arithmetic and control unit 1. In this case, the image providing system 10 includes the photographing device 2 or the printer 5. It is not necessarily required.

  The imaging device 2 is, for example, a digital camera, and includes a lens, a shutter, a CMOS sensor, an A / D converter, and the like. When the photographing device 2 photographs the subject P, the CMOS sensor receives the photographing light converged by the lens through the shutter and photoelectrically converts the optical image formed on the light receiving surface. Output as an image signal. Then, the A / D converter performs A / D conversion on the image signal output from the CMOS sensor to generate captured image data. The photographed image data generated by the photographing device 2 can be sent to the arithmetic and control unit 1 via a medium such as a memory.

  Further, the image providing system 10 includes a touch panel 3 that receives various instructions from the photographed person P or the store staff S and displays a preview image.

  The touch panel 3 has the functions of a captured image 30, a background image 33, a composite image 35, a display unit 3A for displaying a corrected composite image 35A, an instruction receiving unit 3B, and a defect area input unit 3C.

  Specifically, the touch panel 3 displays operation buttons, and when the operation button is pressed, receives an operation instruction corresponding to the operation button. For example, the touch panel 3 receives an instruction on the use of an image from the user (the subject P) or the staff S. The use of the image corresponds to the image size (photo size) to be printed on the print by the printer 5, and is, for example, a driver's license, a passport, a resume, and the like. In addition, the touch panel 3 can display at least one candidate for the background image 33 and receive an instruction to select the background image 33 from the user P or the staff S. Further, the touch panel 3 can receive an instruction such as a color, a brightness, a pattern, or a gradation for the user P to customize the background image 33. Further, the touch panel 3 can receive a print start instruction of the printer 5 from the user P or the staff S. In addition, the touch panel 3 can enlarge and display a portion touched by a user when displaying a preview image described later.

  The arithmetic and control unit 1 is connected to the photographing device 2, the touch panel 3, and the printer 5, and controls each unit and exchanges data.

  FIG. 2 shows a hardware configuration of the arithmetic and control unit 1. The arithmetic and control unit 1 has a CPU (central processing unit) 11, a main memory 12, a disk device 13, and an input / output unit 14. Each part of the arithmetic and control unit 1 is connected via a bus 15.

  The disk device 13 stores in a database 17 an image processing program 16 executed by the CPU 11 and a background image to be synthesized with the portrait image. The database 17 records a plurality of background image data having different colors and patterns.

  The disk device 13 is, for example, a hard disk drive. Note that the image processing program 16 may be stored in a ROM or a magnetic tape (both not shown) instead of the disk device 13.

  The CPU 11 loads the image processing program 16 in the disk device 13 into the main memory 12, and executes the image processing program 16.

  With the execution of the image processing program 16, areas for storing captured image data, person image data, background image data, composite image data, and corrected composite image data are secured on the main memory 12.

  FIG. 3 is a functional block diagram realized by the CPU 11 executing the image processing program 16. By executing the image processing program 16, the selection unit 21, the image processing unit 22, and the corrected combined image generation unit 23 are realized. An image processing program execution unit 20 that is realized by executing the processing program 16 is formed.

  The selection unit 21 selects and extracts the background image data in the database 17 from the disk device 13 and outputs the background image data to the touch panel 3 as background image candidate data. Further, when receiving a background image selection instruction from the user P or the staff S via the touch panel 3, the selection unit 21 passes the background image data selected by the user to the image processing unit 22.

  The image processing unit 22 combines the human image 31 in the captured image generated by the imaging device 2 with the background image 33 received from the selection unit 21 using a process based on chroma key synthesis to create a composite image 35. I do. Specifically, the image processing unit 22 determines the color difference between the person in the captured image and the background color (wallpaper color), removes the background 32 from the captured image 30 having the human image 31 and the background 32, and Image 31 is cut out. The color difference determined here is a hue difference, a saturation difference, or a combination of a hue difference and a saturation difference. Then, the image processing unit 22 superimposes the background image 33 received from the selection unit 21 and the cut-out human image 31 to perform image composition to create a composite image 35.

  The composite image 35 created in this way is displayed on the display unit 3A of the touch panel 3. As shown in FIG. 1B, the background 32 is removed from the photographed image 30, and the person image 31 is cut out. Then, a composite image 35 is obtained by superimposing the selected background image 33 on the person image 31. In this case, the background 32 of the captured image 30 has the same color, but the brightness is not always uniform. Specifically, as shown in FIG. 9, the background 32 has the same color, but has a dark color at a place 32a near the person image 31, a bright color at a place 32c far from the person image 31, and an intermediate place. 32b has an intermediate brightness.

  Therefore, for example, when the image processing is performed on the basis of the place 32a to remove the background 32, when the image processing is performed on the basis of the place 32c to remove the background 32, or when the image processing is performed on the basis of the place 32b, the background 32 is removed. In each case, the background 32 cannot be completely removed over the entire area.

  As described above, when the background 32 cannot be completely removed over the entire area and the remaining portion of the background 32 remains, the synthesized image 35 generated by the image processing unit 22 causes the synthesized image 35 generated by the remaining portion of the background 32. As a result, a defective area 36 including uneven color is generated.

  According to the present embodiment, the user P or the staff S specifies the defect area 36 from the composite image 35 displayed on the touch panel 3 by the defect area input unit 3C including a pen tool described later. Thus, based on the information input from the defective area input unit 3C, the corrected combined image generation unit 23 of the arithmetic and control unit 1 completely removes the remaining portion of the background 32 remaining in the combined image 35. Thus, the defective area 36 caused by the remaining portion of the background 32 can be completely erased.

  The image processing unit 22 reduces or enlarges the photographed image 30 generated by the photographing device 2, the created composite image 35, and the corrected composite image 35A to a size corresponding to the preview display on the display unit 3A of the touch panel 3. Can be. Further, the image processing unit 22 can reduce or enlarge the created corrected composite image 35A to a size corresponding to a photograph size to be printed by the printer 5.

  Note that, when a print start instruction of the printer 5 is received from the user P or the staff S via the touch panel 3, print image data is output from the arithmetic and control unit 1 to the printer 5.

  The printer 5 shown in FIG. 1 performs color conversion and sharpness processing on the print image data received from the arithmetic and control unit 1. Then, the printer 5 prints the photographed image of the subject P on a sheet and outputs it. The printing method of the printer 5 is not particularly limited, and an ink-jet method, a sublimation-type thermal transfer method, a fusion-type thermal transfer method, or the like can be used.

  Next, the operation of the image providing system according to the present embodiment will be described with reference to the flowchart shown in FIG.

  First, as shown in FIG. 4 and FIG. 5A, the user P places an order for a photo with the staff S of the shop, and the operation of the image providing system starts. Next, the staff S photographs the user P using the photographing device 2, and a photographed image 30 is obtained (see FIG. 5B).

  Thereafter, as shown in FIG. 5C, a preview screen of the captured image 30 appears on the display unit 3A of the touch panel 3, and the arithmetic and control unit 1 generates a composite image 35 from the captured image 30, and corrects the composite image 35. As a result, a corrected composite image 35A is obtained. The corrected composite image 35A is printed by the printer 5 to produce a printed print 5A. The user P confirms the printed print 5A and informs the staff S that the generated corrected composite image 35A is a completed image. Thereafter, the user P can access the arithmetic and control unit 1 by using, for example, the portable terminal P1 to obtain the data of the corrected combined image (see FIG. 5D).

  Next, the operation of the image providing system 10 will be described in detail.

  A photographed image 30 obtained by photographing the user P by the photographing device 2 includes a person image 31 and a background 32. The data of the captured image 30 is sent to the arithmetic and control unit 1 via a medium such as a memory, and the captured image 30 is sent from the arithmetic and control unit 1 to the touch panel 3 and displayed on the display unit 30A of the touch panel 3.

  In this case, a preview screen of the plurality of captured images 30 is displayed on the display unit 30A of the touch panel 3 (FIG. 6A).

  Next, the user P selects a desired photographed image 30 from the plurality of photographed images 30 on the touch panel 3. In this case, when the user P touches a desired captured image 30, the instruction of the user P is received by the instruction receiving unit 3 </ b> B of the touch panel 3.

  Note that if there is no desired photographed image 30 in the photographed image 30 on the touch panel 3, the user P requests the staff S to photograph again, photographs again with the photographing device 2, and repeats the above-described procedure.

  Next, the user P selects a layout condition 40 for displaying the captured image 30 from the plurality of layout conditions 40 displayed on the touch panel 3 (FIG. 6B).

  In this case, when the user P presses the desired layout condition 40 displayed on the touch panel 3, the instruction of the user P is received by the instruction receiving unit 3 </ b> B of the touch panel 3.

  Next, as shown in FIG. 6C, the user P touches the edit item 41 displayed on the touch panel 3 to perform necessary edit work on the captured image 30. At this time, the instruction of the user P is received by the instruction receiving unit 3B of the touch panel 3.

  Examples of such an edit item 41 include an edit item of a color conversion process or a beautiful skin process performed on a captured image.

  Next, the user P performs chroma key synthesis on the captured image. Specifically, a background image candidate 43 is displayed on the touch panel 3, and the user P selects a desired background image 33 from the background image candidates 43 (see FIG. 6D).

  In this case, the user P touches a desired background image 33 from the background image candidates 43 on the touch panel 3. Thus, an instruction from the user P to select the background image 33 is received by the instruction receiving unit 3B of the touch panel 3.

  When the user P touches the touch panel 3 and selects a desired background image from the instruction receiving unit 3B, the selecting unit 21 of the arithmetic and control unit 1 extracts the background image data from the database 17. Further, the image processing unit 22 removes the background 32 from the photographed image 30 including the person image 31 and the background 32 by using a process based on chroma key synthesis, cuts out the person image 31, and extracts the person image 31 and the selected background image. 33 to create composite image data. Further, the image processing section 22 creates preview image data from the composite image data. Here, the background image used for the composite image is any one of the background images extracted by the selection unit 21.

  Next, the display unit 3A of the touch panel 3 displays a preview screen of the composite image 35 created by the image processing unit 22.

  When the user P accepts the composite image 35 displayed on the touch panel 3, the user P presses the enter button on the touch panel 3. On the other hand, if the composite image 35 is not accepted, the background image candidate 43 is displayed again on the touch panel 3 and the above-described procedure is repeated.

  Next, the user P or the staff S performs correction on the composite image 35 to obtain a corrected composite image 35A. Specifically, as shown in FIG. 6E, the user P or the staff S searches for a defective area 36 from the composite image 35 displayed on the touch panel 3.

  Next, the user P or the staff S touches and selects the pen tool 50 displayed on the touch panel 3. In this case, the pen tool 50 includes a pen tool type icon 51 and a pen tool thickness icon 52, and the user P or staff S selects the pen tool type icon 51 and the pen tool thickness icon 52, and selects the pen tool. Using the icon of the pen tool 50 whose type and pen tool thickness have been selected, the defective area 36 in the composite image 35 is specified.

  In this case, as shown in FIGS. 7A, 7B, and 7C, in the background image 33 in the composite image 35 displayed on the touch panel 3, a defect area 36 including uneven color near the human image 31 is formed. Can be found.

  At this time, the user P or the staff S selects the type of the pen tool and the thickness of the pen tool on the touch panel 3 to obtain a desired pen tool 50 (see FIG. 7A). Next, the pen tool 50 is moved while touching the touch panel 3 to draw an outline 38 surrounding the defective area 36 with the pen tool 50.

  The outline 38 surrounding the defective area 36 drawn by the pen tool 50 is displayed on the touch panel 3. At this time, the pen tool 50 functions as a defective area input unit 3C for specifying the defective area 36, and information from the pen tool 50 is sent to the arithmetic and control unit 1.

  Next, the corrected combined image generation unit 23 of the arithmetic and control unit 1 reliably removes the remaining portion of the background 32 remaining in the combined image 35.

  As a result, the defective area 36 caused by the remaining portion of the background 32 can be completely removed (see FIG. 7C).

  As described above, according to the present embodiment, the corrected combined image generation unit 23 performs the correction for removing the defective area 36 from the combined image 35 displayed on the touch panel 3, so that the corrected corrected combined image 35 </ b> A is corrected. Can be generated (see FIG. 1B).

  Next, a preview screen of the corrected combined image 35A generated by the corrected combined image generation unit 23 is displayed on the touch panel 3. If the user P does not agree with the preview screen of the corrected composite image 35A, he corrects the composite image 35 using the pen tool 50 again to remove the defective area 36 of the composite image 35, and creates a corrected composite image 35A.

  Thereafter, the above procedure is repeated.

  Next, as described above, the corrected composite image 35A is printed by the printer 5 to produce a printed print 5A (see FIGS. 5C and 6F). Thereafter, after confirming the printed print 5A, the user P can access the arithmetic and control unit 1 through the portable terminal P1 to obtain the data of the corrected composite image 35A (see FIG. 5D).

  In the above-described embodiment, the pen tool 50 is moved on the touch panel 3 and the outline 38 surrounding the defective area 36 is drawn by the pen tool 50. However, the pen tool 50 is not limited to this. The defective area 36 may be specified by moving and moving the entire area of the defective area 36 with the pen tool 50 to form a solid area 39 (see FIGS. 8A, 8B, and 8C).

  8A, 8B, and 8C, when the entire area of the defective area 36 is solid-painted by the pen tool 50, the solid-painted area 39 obtained by the solid painting is displayed on the touch panel 3. Alternatively, when the defective area 36 of the composite image 35 is specified using the pen tool 50, the preview screen of the composite image 35 is enlarged from 100% to 150% by operating the instruction receiving unit 3B of the touch panel 3, for example. (See FIGS. 10A and 10B).

  Further, the preview screen of the composite image 35 may be further enlarged to 200% (see FIG. 10C).

  By enlarging the preview screen of the composite image 35 in this way, the defective area 36 of the composite image 35 can be easily and accurately specified using the pen tool 50.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying constituent elements in an implementation stage without departing from the scope of the invention. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiment. Further, components of different embodiments may be appropriately combined.

REFERENCE SIGNS LIST 1 arithmetic and control unit 2 imaging device 3 touch panel 3A display unit 3B instruction receiving unit 3C fault area input unit 5 printer 11 CPU
Reference Signs List 12 Main memory 13 Disk device 14 Input / output unit 15 Bus 16 Image processing program 17 Database 20 Image processing program execution unit 21 Selection unit 22 Image processing unit 23 Corrected composite image generation unit 30 Captured image 31 Person image 32 Background 33 Background image 35 Synthesis Image 35A Corrected composite image 36 Defect area 38 Outline 39 Solid area 40 Layout condition 41 Edit item 50 Pen tool 51 Pen tool type

Claims (6)

An imaging device that captures a background and a subject, and generates a captured image including a background and a person image,
A storage unit storing a plurality of background images,
An instruction receiving unit that receives an instruction to select a background image,
An image processing unit that cuts out the person image excluding the background from the photographed image, and creates a composite image by chroma keying the background image and the person image selected and instructed via the instruction receiving unit,
A display unit for displaying a plurality of background images and the composite image,
The display unit includes a defect area input unit that specifies a defect area in the background image of the composite image, and generates a corrected composite image by correcting the composite image based on information input to the defect area input unit. An image providing system, further comprising: a corrected combined image generation unit that performs a correction combined image generation unit that displays the corrected combined image generated by the corrected combined image generation unit on the display unit. A storage unit storing a plurality of background images,
An instruction receiving unit that receives an instruction to select a background image,
Image processing for cutting out the person image from the photographed image including the background and the person image except for the background, and chromakey-synthesizing the background image and the person image selected and instructed via the instruction receiving unit to create a combined image Department and
A display unit for displaying the composite image,
The display unit includes a defect area input unit that specifies a defect area in the background image of the composite image, and generates a corrected composite image by correcting the composite image based on information input to the defect area input unit. An image providing system, further comprising: a corrected combined image generation unit that performs a correction combined image generation unit that displays the corrected combined image generated by the corrected combined image generation unit on the display unit.   The image providing system according to claim 1, wherein the corrected combined image generating unit removes a background remaining in the defective area input by the defective area input unit.   The image providing system according to claim 1, wherein the defect area input unit specifies the defect area by drawing an outline of the defect area, and the defect area is displayed on the display unit.   The image providing system according to any one of claims 1 to 3, wherein the defect area input unit specifies the defect area by solid-painting the entire area of the defect area, and the defect area is displayed on the display unit. .   The image providing system according to any one of claims 1 to 5, wherein a printer that is connected to the corrected combined image generation unit and prints the corrected combined image on a print is connected.