JP6547355B2 - Printed product manufacturing device - Google Patents

Description

  BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a print production apparatus for producing a print having a face image printed thereon.

  There is known a box-type photographing device for photographing a license photo, a passport, a certification photograph for attaching to a resume and the like. The photo shooting device shoots a person and prints out and outputs photos of various sizes according to the application. There is also known an apparatus for outputting a photograph in which a background image is combined with a human image by processing using chroma key combination.

  In the conventional photographing apparatus, the attention point at the time of photographing is displayed on the screen, the voice guidance flows, the height and the height of the eye, and the like so that the lighting environment at the time of photographing and the position / attitude of the user become optimum. A guide seal, which serves as an index for aligning the position of the head, is affixed to the housing.

  However, in such a conventional photographing apparatus, it is difficult for the user to accurately determine whether the posture is correct before photographing, and the user confirms the preview of the photographed image. , I was aware that the posture was tilted or the position was off the front. Therefore, it is necessary to retake the picture and to edit the photographed image (position movement and rotation processing), which takes time and effort.

Patent No. 4217066

  The present invention has been made in view of the above-described conventional situation, and has an object to provide a print product manufacturing apparatus that detects the posture of a user and presents the detection result to the user.

  According to an aspect of the present invention, there is provided a printed object manufacturing apparatus for photographing a subject and generating a photographed image, chroma key processing is performed on the photographed image, and a background color portion and a human portion in the photographed image are displayed. An image processing unit that discriminates and cuts out a person image from the photographed image and combines the person image and the background image to create a combined image, a printer that prints and outputs the combined image on the print object, and the chroma key And a posture determination unit that determines the posture of the subject using a binary image that distinguishes between a background color portion and a human portion generated at the time of processing.

  In the printed product manufacturing apparatus according to one aspect of the present invention, the posture determination unit determines the posture of the subject based on a distribution of pixels corresponding to the human portion in the binary image. It is a thing.

  In the printed product manufacturing apparatus according to one aspect of the present invention, the posture determination unit determines, for each pixel row in the vertical direction of the binary image, of the pixels corresponding to the person portion, pixels located at the uppermost in the vertical direction. The position is detected, and the center position of the shoulder line or the body of the subject is detected based on a change in the case where the detected pixel position is plotted in the horizontal direction.

  The printed product manufacturing apparatus according to one aspect of the present invention is characterized in that the shoulder line detected by the posture determination unit and the horizontal line are displayed on a display unit.

  The printed product manufacturing apparatus according to one aspect of the present invention is characterized in that the central position of the body detected by the posture determination unit and the central position of the photographed image are displayed on a display unit.

  According to the present invention, the user can correct the posture before shooting by detecting the posture of the user and presenting the detection result. Therefore, it is possible to reduce the number of retakes and to reduce the workload of editing captured images.

BRIEF DESCRIPTION OF THE DRAWINGS It is a schematic block diagram of the printed matter production apparatus which concerns on embodiment of this invention. It is a schematic block diagram of the arithmetic and control unit concerning the embodiment. It is a functional block diagram realized by running an image processing program concerning the embodiment. (A) is a figure which shows an example of a picked-up image, (b) is a figure which shows an example of a binary image. (A)-(c) is a figure which shows the example of a detection of the pixel coordinate in a binary image. (A)-(c) is a graph of the detected pixel coordinate. (A)-(c) is a figure which shows the example of the display screen after attitude | position / position detection. It is a flowchart explaining the printed matter production method concerning the embodiment. It is a flowchart explaining the printed matter production method by a modification. It is a figure which shows the example of a detection of the pixel coordinate in a binary image.

  Hereinafter, embodiments of the present invention will be described based on the drawings.

  FIG. 1 shows a schematic configuration of a print product manufacturing apparatus according to the present embodiment. The print production apparatus captures an image of a person (user) P and generates a captured image data, an arithmetic control unit 1 that performs image processing on the captured image data, and a print (photograph) , A strobe 6 that emits light to the user P when the imaging device 2 captures the user P, and a speaker 7 that outputs sound. This print product manufacturing apparatus prints and outputs a composite image obtained by combining a human image and a background image on a print product. The wallpaper on the back side of the user P in the print preparation apparatus is a color suitable for chroma key composition, for example, blue or yellowish green.

  The print product manufacturing apparatus includes a touch panel (instruction reception unit and display unit) 3 that receives various instructions from the user P and displays a photographed image. The touch panel 3 displays the operation button, and when the operation button is pressed, the operation instruction corresponding to the operation button is received. For example, the touch panel 3 can display a plurality of background images and can receive an instruction for selecting a background image from the user. The touch panel 3 can also receive a print start instruction of the printer 5 from the user. The print product manufacturing apparatus has a live view shooting function, and displays a composite image on the touch panel 3 in (almost) real time.

  Further, the print product manufacturing apparatus is provided with a charging unit (not shown) that accepts money paid by the user P for the print product and pays out change.

  The imaging device 2 is, for example, a digital camera, and includes a lens, a shutter, a CMOS sensor, an A / D converter, and the like. When the photographing device 2 photographs the user P, the CMOS sensor receives the photographing light converged by the lens via the shutter, and photoelectrically converts the optical image formed on the light receiving surface, and the image signal Output as Then, the A / D converter A / D converts the image signal output from the CMOS sensor to generate photographed image data. The photographing device 2 outputs photographed image data to the arithmetic and control unit 1.

  The arithmetic and control unit 1 is connected to the photographing device 2, the touch panel 3, the printer 5, the flash 6, the speaker 7, and the charging unit, and controls each unit and transfers data.

  The hardware configuration of the arithmetic and control unit 1 is shown in FIG. The arithmetic and control unit 1 includes a CPU (central processing unit) 11, a main memory 12, a disk device 13, and an input / output unit 14. Each part of the arithmetic and control unit 1 is connected via a bus 15.

  The disk device 13 stores an image processing program 16 executed by the CPU 11 and background image data 17 to be combined with a human image.

  The disk device 13 is, for example, a hard disk drive. The image processing program 16 may be stored not in the disk device 13 but in a ROM or a magnetic tape (both not shown).

  The CPU 11 loads the image processing program 16 in the disk device 13 into the main memory 12 and executes the image processing program 16.

  As the image processing program 16 is executed, an area for storing photographed image data, binary image data, person image data, background image data, composite image data and the like is secured on the main memory 12.

  FIG. 3 shows a functional block diagram realized by the CPU 11 executing the image processing program 16. Execution of the image processing program 16 implements the selection receiving unit 21, the image processing unit 22, the posture determination unit 23, and the notification unit 24.

  The selection receiving unit 21 takes out data 17 of a plurality of background images from the disk device 13 and displays the data 17 on the touch panel 3. The selection receiving unit 21 receives a selection instruction of a background image from the user via the touch panel 3. The selection receiving unit 21 passes the background image data selected by the user to the image processing unit 22.

  The image processing unit 22 combines the person image in the photographed image generated by the photographing device 2 with the background image received from the selection receiving unit 21 using processing by chroma key composition to create synthesized image data. . Specifically, the image processing unit 22 determines the color difference between the person in the captured image and the background color, and cuts out the human image from the captured image. The color difference determined here is a hue difference, a saturation difference, or a combination of a hue difference and a saturation difference. Then, the image processing unit 22 performs image combination by superimposing the background image received from the selection receiving unit 21 and the clipped person image.

  The image processing unit 22 reduces the generated composite image data to a size corresponding to the preview display on the touch panel 3 and generates preview image data. The preview image data is output to the touch panel 3 through the input / output unit 14 and displayed. A live view display in real time is performed by continuously performing shooting (image acquisition), chroma key processing, and display of a preview image by the shooting device 2.

  In chroma key processing in the image processing unit 22, a binary image is generated to distinguish between a background color portion and a human portion in a captured image. For example, in the chroma key process for the photographed image 41 shown in FIG. 4A, a binary value (black and white 2) in which the human portion 42 is represented by black pixels and the background color portion 43 is represented by white pixels as shown in FIG. A value) image 44 is generated.

  The posture determination unit 23 determines whether the posture of the user P satisfies a predetermined standard, based on the distribution of pixels (black pixels) corresponding to the human part in the binary image. Here, the posture of the user P is the inclination of the shoulder of the user P and the position of the user P.

  The posture determination unit 23 determines whether the shoulder of the user P is inclined. Specifically, a line (shoulder line) connecting the left and right shoulders of the user P is detected, and it is determined whether or not the angle formed by the detected shoulder line with respect to the horizontal line is equal to or less than a predetermined value.

  Further, the posture determination unit 23 determines whether the user P is positioned in front of the imaging device 2. Specifically, the center position of the body of the user P is detected, and it is determined whether or not the deviation between the detected center position of the body and the center position in the horizontal direction (left and right direction) of the captured image is equal to or less than a predetermined value. Do.

  A method of detecting the shoulder line of the user P and the center position of the body will be described. The above-described binary image is one in which a large number of pixels are arranged in the horizontal direction and the vertical direction. The posture determination unit 23 scans the pixels in the binary image from the top to the bottom for each column, and records the position (coordinates) at which the black pixel is first detected. In other words, in the pixel column in the vertical direction, the position of the uppermost black pixel is detected and recorded.

  FIGS. 5A to 5C show an example of detecting the coordinates of the top black pixel in each pixel row from the binary images 44a, 44b and 44c. The binary image 44a is a binary image in the case of the correct posture. The binary image 44b is an example of a binary image when the shoulder is inclined. The binary image 44c is an example of a binary image when the user P is not located in front.

  The posture determination unit 23 plots the black pixel coordinates of each detected pixel row in the horizontal direction to form a graph. For example, graphs as shown in FIGS. 6A to 6C are generated from the binary images 44a, 44b and 44c, respectively.

  From the structure of the human body, the maximum value of the black pixel coordinates corresponds to the top of the head of the user P and can be regarded as the central position of the user P's body. The posture determination unit 23 detects the central position of the body of the user P from the maximum value of the black pixel coordinates. For example, in FIGS. 6A to 6C, the coordinate C is detected as the center position of the user P's body.

  In the identification photo etc., place your hand on the knee and shoot. Since the arm is located forward from the shoulder, in the binary image, almost no black pixels exist outside the shoulder (in the left-right direction). Therefore, the detected black pixel coordinates greatly change at positions corresponding to the left and right shoulders. In addition, the black pixel coordinates to be detected also change significantly at the left and right ends of the head.

  For example, as shown in FIGS. 6A to 6C, the black pixel coordinates largely change at the coordinates HR and HL corresponding to the left and right ends of the head. In addition, black pixel coordinates largely change at coordinates SR and SL corresponding to the left and right shoulders. The posture determination unit 23 detects the positions of the left and right shoulders of the user P based on the feature of such coordinate change.

  For example, in a graph of black pixel coordinates, a place where the coordinate position greatly changes is detected, and two places of the left and right ends thereof are set as the positions of left and right shoulders. A large change in coordinate position means, for example, that the absolute value of the derivative becomes equal to or greater than a predetermined value. The posture determination unit 23 detects the shoulder line of the user P from the black pixel coordinates at the positions of the left and right shoulders. For example, the shoulder line L is detected from the graphs of FIGS. 6 (a) to 6 (c).

  The posture determination unit 23 determines that the posture is correct when the center position of the body of the user P is at the center position of the image and the shoulder line L is horizontal as shown in FIG. 6A. On the other hand, as shown in FIG. 6B, when the shoulder line L is inclined at a predetermined angle or more with respect to the horizontal line, the posture determination unit 23 determines that the shoulder is inclined. Further, as shown in FIG. 6C, when the center position of the body is not at the center position of the image, that is, it is not positioned in front of the photographing device 2, the posture determination unit 23 assumes that the body position is shifted. judge.

  The notification unit 24 notifies the user P of the determination result of the posture determination unit 23. For example, when it is determined that the posture is correct, “OK” is displayed on the touch panel 3 as shown in FIG. 7A.

  When it is determined that the shoulder is inclined, as shown in FIG. 7 (b), the touch panel 3 displays that the shoulder is inclined, outputs a voice from the speaker 7, and detects the shoulder of the detected user P. The line L1 and the correct shoulder line (horizontal line) L2 are displayed. The user P can adjust the shoulder height while looking at the displayed lines L1 and L2.

  When it is determined that the position of the body is shifted, as shown in FIG. 7C, the touch panel 3 displays that the position of the body is shifted, and outputs sound from the speaker 7, and The center line C1 of the detected body of the user P and the center line C2 of the image to be the front of the photographing device 2 are displayed. The user P can adjust the position of the body while looking at the displayed lines C1 and C2.

  When the image processing unit 22 receives a print approval instruction of a print image from the user via the touch panel 3, the image processing unit 22 reduces the composite image data to a size corresponding to the size of the photo to be printed by the printer 5, and generates print image data. Do. The print image data is output from the arithmetic and control unit 1 to the printer 5.

  The printer 5 performs color conversion and sharpness processing on the print image data received from the arithmetic and control unit 1. Then, the printer 5 prints and outputs a photographed image of the user P on a sheet. The printing method of the printer 5 is not particularly limited, and an inkjet method, a sublimation thermal transfer method, a melting thermal transfer method, or the like can be used.

  Next, a method for producing a print product using such a print product production apparatus will be described using the flowchart shown in FIG.

  The user P operates the touch panel 3 to instruct the use, the size, and the like of the photograph to be printed, and performs the deposit process (step S101). A plurality of selectable background images are displayed on the touch panel 3, and the user P selects any one background image (step S102).

  The photographing device 2 starts photographing (image acquisition) of the user P (step S103). The image processing unit 22 cuts out the human image from the captured image using the processing by chroma key composition and combines it with the background image to create composite image data (step S104).

  The posture determination unit 23 determines the posture of the user P using the binary image generated in the chroma key process of step S104 (step S105). As described above, the posture determination unit 23 scans the pixels of the binary image from top to bottom for each column, and detects and graphs the coordinates (positions) of the top black pixels. Then, the central position and the shoulder line of the body of the user P are detected from the maximum value of the coordinates of the black pixel in the graph and the change of the coordinates.

  If the posture of the user P is correct (Yes in step S106), the composite image is displayed on the touch panel 3 (step S108). When the posture of the user P is not correct (Step S106_No), an alert is displayed on the touch panel 3 together with the composite image (Steps S107 and S108).

  For example, when the shoulder is inclined, the detected shoulder line of the current user P and the correct horizontal shoulder line are displayed on the touch panel 3. Further, when the body of the user P is not located in front of the photographing device 2, the detected center line of the body of the user P and the correct central line which is the front of the photographing device 2 are displayed on the touch panel 3 . If the shoulder is tilted and the body is not located in front of the photographing device 2, the detected present user P's shoulder line, the correct horizontal shoulder line, the detected present user P's body center line, and the photographing The correct center line which is the front of the device 2 is displayed on the touch panel 3. The user P can adjust the posture by confirming the displayed alert.

  The notification unit 24 may give an instruction to set the correct posture. For example, the touch panel 3 displays an instruction such as “slightly raise the right shoulder” or “closes slightly to the right”, or outputs an audio from the speaker 7. This allows the user to easily understand how to move.

  Steps S103 to S108 are continuously repeated until the user P issues an instruction to take a print image, and live view display is performed. When the user P receives an instruction to shoot a print image (Yes at step S109), the flash 6 emits light to the user P, and the photographing device 2 photographs the user (step S110). If a predetermined time has elapsed since the start of live view display, the process may proceed to step S110 even if there is no photographing instruction from the user P.

  The image processing unit 22 cuts out the person image from the photographed image using the processing by chroma key combination, and combines it with the background image to create combined image data (step S111). The synthesized image is displayed on the touch panel 3 as a preview (step S112).

  When the user P desires re-shooting (Step S113_No), the user P presses the re-shooting button on the touch panel 3. Thus, the process returns to step S103.

  When the preview image displayed on the touch panel 3 is accepted (step S113_Yes), the user P presses the determination button on the touch panel 3. The image processing unit 22 creates print image data from the composite image data. Then, the printer 5 receives the print image data from the arithmetic and control unit 1, prints the composite image on a sheet, and outputs it (step S114).

  In addition, in step S110, shooting may be performed a plurality of times, a plurality of preview images may be displayed on the touch panel 3, and an image that the user P likes most may be selected. In addition, before printing, the user P may be able to perform image correction processing as needed.

  As described above, according to the present embodiment, by presenting the determination result by the posture determination unit 23 on the screen, the user P can adjust the posture before photographing the print image. In addition, since the shoulder line and the center line of the body are displayed, it can be easily understood how to adjust. Since the image for printing is taken after adjusting the posture in this way, the number of retakes can be reduced. In addition, the amount of work of editing the photographed image (position movement and rotation processing) can be reduced.

  In the above embodiment, an example in which the print product manufacturing apparatus has the live view display function has been described, but the live view display function may be omitted. In this case, the posture of the user P in the captured image is determined, the preview image is displayed, and the determination result is displayed. This makes it possible to prevent the printout of an image in which the shoulder is tilted or misaligned.

  A method of producing a print product by the print product producing apparatus having no live view display function will be described with reference to a flowchart shown in FIG.

  The user P operates the touch panel 3 to instruct the use, size, etc. of the photograph to be printed, and performs the deposit process (step S201). A plurality of selectable background images are displayed on the touch panel 3, and the user P selects any one background image (step S202).

  The photographing device 2 photographs the user P and generates photographed image data (step S203). When the photographing device 2 performs photographing, the strobe 6 irradiates the user P with light. Shooting is performed several times.

  The image processing unit 22 cuts out the human image from the captured image using the processing by chroma key composition and combines it with the background image to create composite image data (step S204).

  The posture determination unit 23 determines the posture of the user P using the binary image generated in the chroma key process of step S204 (step S205).

  When the posture of the user P is correct (step S206_Yes), the preview image of the composite image is displayed on the touch panel 3 (step S208). If the posture of the user P is not correct (Step S206_No), an alert is displayed on the touch panel 3 together with the preview image (Steps S207 and S208).

  In step S203, a plurality of preview images are displayed on the touch panel 3 because a plurality of times of imaging are performed. A posture determination result is displayed for each preview image. For example, “posture OK” is displayed on the preview image with the correct posture. In the preview image whose posture is not correct, determination results such as “shoulder inclination” and “center shift” are displayed.

  When the user P desires re-shooting (Step S 209 _No), the user P presses the re-shooting button on the touch panel 3. Thus, the process returns to step S203.

  When there is one of the “posture OK” preview images displayed on the touch panel 3 for which print output is desired (step S 209 _Yes), the user P selects a preview image for which print output is desired, and presses the determination button. The image processing unit 22 creates print image data from composite image data of the selected image. Then, the printer 5 receives the print image data from the arithmetic and control unit 1, prints the composite image on a sheet, and outputs it (step S210).

  As described above, by displaying the result of the posture determination on the preview image of the photographed image, the user P can select an image in the correct posture and print out the image.

  In the above embodiment, the pixels in the binary image are scanned from top to bottom in each row, and the position (coordinates) at which the black pixel is first detected is recorded. However, as shown in FIG. The pixels in the value image may be scanned from right to left and left to right row by row, and the positions (coordinates) at which black pixels are first detected may be recorded and graphed.

  As shown in FIG. 10, the black pixel coordinates largely change at the coordinates SR1 and SL1 corresponding to the left and right shoulders. The posture determination unit 23 detects heights Y1 and Y2 of the left and right shoulders of the user P based on the feature of such coordinate change. If the heights Y1 and Y2 are the same (the same degree), it can be determined that the shoulder line is (almost) horizontal.

  In the above embodiment, a binary (black and white binary) image in which the human part is represented by black pixels and the background color part is represented by white pixels is used for the binary image generated by chroma key processing in the image processing unit 22. It may be a binary (black and white binary) image in which the portion is represented by white pixels and the background color portion is represented by black pixels. In this case, the posture determination unit 23 determines whether the posture of the user P satisfies a predetermined standard, based on the distribution of white pixels corresponding to the human portion in the binary image.

  In the above embodiment, the instruction is given such that the position of the body of the user P is located at the center and the shoulder line is horizontal, but the print product manufacturing apparatus is installed at a tourist spot etc. If it is intended to produce a composite memorial photo, different instructions may be given. For example, the position of the body of the user P or a shoulder line may be detected, and an instruction may be given to move to a position suitable for a frame image, or an instruction may be given to tilt the body more. By giving such an instruction, it is possible to guide the user to take a more moving picture.

  The method of detecting the position of the body of the user P and the inclination of the shoulder are not limited to those described above. For example, a plurality of human-shaped patterns may be prepared in advance and detected by pattern matching with a photographed image. In addition, the face recognition function may be used to detect the positions of the neck and shoulders from the face position information of the captured image. The position of the neck corresponds to the central position of the body.

  The present invention is not limited to the above embodiment as it is, and at the implementation stage, the constituent elements can be modified and embodied without departing from the scope of the invention. In addition, various inventions can be formed by appropriate combinations of a plurality of constituent elements disclosed in the above embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components in different embodiments may be combined as appropriate.

1 arithmetic control device 2 photographing device 3 touch panel 5 printer 6 strobe 7 speaker

Claims (3)

A photographing device for photographing a subject and generating a photographed image;
Chroma-key processing is performed on the captured image, a background color portion and a human portion in the captured image are determined, a human image is cut out from the captured image, and the composite image is created by combining the human image and the background image. An image processing unit,
A printer for printing the composite image on a print and outputting it;
A posture determination unit that determines the posture of the subject using a binary image that distinguishes between a background color portion and a human portion generated during the chroma key processing;
Equipped with
The posture determination unit determines the posture of the subject based on the distribution of pixels corresponding to the human part in the binary image, and for each pixel row in the vertical direction of the binary image, Among the pixels corresponding to the human part, the position of the pixel located at the top in the vertical direction is detected, and the shoulder line or the body of the subject is obtained based on the change when the detected pixel position is plotted in the horizontal direction. A printed product manufacturing apparatus characterized by detecting a central position of the image. The printed matter manufacturing apparatus according to claim 1 , wherein the shoulder line detected by the posture determination unit and the horizontal line are displayed on a display unit. The printed object manufacturing apparatus according to claim 1 , wherein the central position of the body detected by the posture determination unit and the central position of the photographed image are displayed on a display unit.

Images