JP4286702B2 - Image printing system, apparatus and image printing method - Google Patents

Description

The present invention relates to an image printing system, an apparatus, and an image printing method .

2. Description of the Related Art Conventional digital image printing systems such as ID photo photographic devices and automatic photo photographic devices typified by Print Club (registered trademark), a person who is a photographic subject picks up a subject with an imaging means such as a camera, and seals the photograph taken. Or the like (see, for example, Patent Document 1).
JP-A-11-266419

  However, in the above-described conventional digital image printing system, since the imaging range is determined in accordance with the wide angle of the camera in which the imaging range with the camera lens is fixed, the subject person moves back and forth. However, there is a situation in which the user has to take an image while adjusting the imaging angle and the like, which makes the user troublesome.

The present invention has been made in view of the above-described conventional circumstances, and an object thereof is to provide an image printing system, an apparatus, and an image printing method capable of capturing an image without taking time and effort from a user.

The present invention includes an imaging means for acquiring a captured image by imaging a subject, a face region detection unit for detecting a face area included in prior Symbol captured image, based on the detected face area, included in the captured image the existence range detection means for detecting the existence range of a person, there is provided a adjustment control means for adjusting at least one of the angle and zoom of the image pickup means in accordance with the detected existence range, the The face area detection means includes candidate area detection means for extracting a candidate area of a human face included in the captured image, and a determination means for determining the face area based on features included in the candidate area, The determination means determines an area in which an eye area is detected among the candidate areas as the face area, and the adjustment control means is outermost in the left-right direction when there are a plurality of face areas. face Is intended to send a signal that the center of the midpoints of the eye region respectively included in the frequency adjusting the angle of view of the imaging means such that the center of the captured image on the imaging means.

With this configuration, the imaging means is adjusted according to the person's presence range, so that it is possible to take an image without requiring the user to take time. In addition, a candidate area for a human face included in the captured image can be extracted, and the face area can be determined based on the area of the candidate area where the eye area is detected, and the presence of the person can be determined based on the determined area. A range can be determined. In addition, when a plurality of persons are subjects, the angle of view can be adjusted so that the person who is the subject can be captured appropriately.

The adjustment control unit adjusts the zoom of the imaging unit based on a ratio between the width of the existence range and the width of the captured image.

  With this configuration, it is possible to capture a person who is a subject in an appropriate size.

According to the present invention, it is possible to provide an image printing system, an apparatus, and an image printing method capable of capturing an image without requiring a user to take time.

(First embodiment)
FIG. 1 is an external view of a digital image printing system for explaining a first embodiment of the present invention. As shown in FIG. 1, the digital image printing system according to the first embodiment includes a display input unit 1, an imaging unit 2, an illumination unit 3, a data communication unit 4, a charge input unit 5, and a receipt taking-out unit. 6 and a printed matter take-out unit 7.

  The display input unit 1 is configured to include, for example, a touch panel, and performs operation guidance display and user operation input. Note that a display unit and an input unit may be provided separately. The imaging unit 2 is a digital camera or the like, for example, and images a person or the like that is a subject. In this embodiment, a case where a color digital camera is used will be described as an example. The illumination unit 3 includes a flash that emits light during imaging, auxiliary illumination, and the like.

  The data communication unit 4 is at least one of a multimedia reader that captures an image from a storage medium, a scanner that captures an image from a photo, an infrared data communication device that can capture image data via infrared communication with a mobile phone, and the like. It is configured with one. The charge input unit 5 inputs and returns charges. The printed matter takeout unit 6 is a portion for taking out an image captured by the image capturing unit 2 or an image captured by the data communication unit 4 and printed on a print medium. The receipt taking-out unit 7 is a part for taking out a receipt indicating receipt of a fee.

  FIG. 2 is a block diagram showing a schematic configuration of the digital image system of the present embodiment. As shown in FIG. 2, the digital image system according to this embodiment includes a control unit 10, an image printing unit 11, and a receipt printing unit 12 as an internal configuration.

  The control unit 10 controls the operation of the entire digital image system, and is mainly composed of a processor and a memory that operate according to a predetermined program. The image printing unit 11 prints the image captured by the imaging unit 2 or the image captured by the data communication unit 4 on a print medium, and the printed material is output to the printed material outlet 6. The receipt printing unit 12 prints the receipt, and the printed receipt is output to the receipt pickup 7.

  Moreover, the remote controller 13 may be installed as needed. The remote controller 13 is connected to the main body by wire or wireless, and performs a user's hand operation such as releasing a shutter during imaging. In the case of wireless communication, for example, the infrared communication device included in the data communication unit 4 described above may be shared. The remote controller 13 can capture an image without missing a photo opportunity. In particular, it is effective when the user needs to move away from the main body in order to take an image with a plurality of people and it is difficult to reach the operation means such as the input unit provided in the main body.

  Further, the digital image printing system of the present embodiment may be connected to a management center (not shown) via a network, and the control unit 10 may periodically transmit the captured image of the imaging unit 2 to the management center as a security image. Since the digital image printing system has a configuration that includes an imaging unit and can automatically capture images, it can be used for crime prevention by regularly capturing images using the imaging unit that is originally provided. Further, in addition to periodic imaging, a sensor or the like may be provided, and imaging may be performed using a sensing signal of the sensor.

  FIG. 3 is a flowchart illustrating a procedure for adjusting the imaging unit according to the digital image printing system of the present embodiment, and FIG. 4 is a conceptual diagram illustrating image processing in the adjustment of the imaging unit.

  First, the user selects an image registration method from the initial screen displayed on the display input unit 1. As an image registration method, when an instruction to register an image captured by the imaging unit 2 is input, a color digital image is input from the imaging unit 2 to the control unit 10 (step S301). FIG. 4A shows an example of an input color digital image. The color digital image 401 includes persons 402 and 403.

  The input color digital image is displayed on the display input unit 1. In addition, the image selection method may be selected along with the selection of the image registration method. In this case, the control unit 2 superimposes the selected background image on the image input from the imaging unit 2. And display.

  Next, the controller 10 detects a human face candidate region from the input color digital image (step S302). In the present embodiment, a skin color area portion included in a color digital image is set as a candidate area. As shown in FIG. 4B, areas 411, 412, and 421 to 425, which are skin color areas, are extracted from the color digital image 401 as candidate areas.

  Note that pixels detected as skin color may be mixed as noise depending on clothes worn by a person, a background region, and the like. As a countermeasure against this noise, an image in which a person is not captured is stored in advance prior to skin color area extraction, and a difference between the image and the input image is obtained to obtain a changed portion, that is, a person portion. May be extracted, and the skin color region may be extracted for only that portion. Further, for example, an area from which noise has been removed may be detected as a candidate area by performing an expansion / contraction process on the image (binary image) from which the skin color area has been extracted.

  Then, the control unit 10 determines whether or not the detected candidate area is a human face area (step S303). In this determination operation, first, a determination region is set and cut out at the center of the candidate region detected in step S302. FIG. 4B shows a case where the determination area 413 for the candidate area 411 is set. In the determination area, the control unit 10 extracts a luminance signal component from hue, saturation, and luminance that are color elements, and performs face area determination by grayscale image processing. Then, the part where the horizontal edge component appearing in the vicinity of the eyes is detected is set as an eye candidate, and the area where the combination of the left and right eye candidates and the area having no edge component is detected is determined as the face area.

  If there is another candidate area for which the face area determination process has not been performed (YES in step S304), the determination process in step S303 is performed for the candidate area. Then, if there is no other candidate area for which the confirmation process has not been performed, that is, if the face area confirmation process has been performed for all candidate areas (NO in step S304), the person range is determined based on the confirmed face area. Detection is performed (step S305). Based on the detected person range, adjustment control is performed on at least one of the angle of view and zoom of the imaging unit 2 (step S306).

  Here, person range detection and imaging unit adjustment control will be described. If there is one face area determined in step S304, the swing angle is calculated so that the position of the face area is at the center of the camera angle of view, and the ratio (W The zoom amount is obtained so that / Ew becomes a predetermined value K1.

  As shown in FIG. 4B, when there are a plurality of determined face areas, positions 431 and 432 between the eyes of the outermost face area in the left and right directions of the determined face areas, respectively. Then, the midpoint position 433 of these positions 431 and 432 is obtained. The center of the camera swing angle is set to 433, and the ratio (W / Bw) of the interval Bw between the positions 431 and 432 between the lateral size W of the image and the eyes of the outermost face region becomes a predetermined value K2. Determine the zoom amount. Then, control data is transmitted to the camera control unit, and panning and zooming of the imaging unit 2 are performed.

  Here, the horizontal size W of the image may be a range captured by the camera, or may be a range corresponding to a print range (print frame width) when the captured image is printed. Moreover, although the case where it detected based on the position of an eye was demonstrated as an example of a person range, it may be based not only on the position of an eye but on the width | variety of a face area.

  In this way, the face area is detected by image processing from the color components and luminance information of the color image, so that the angle of view and zoom of the imaging unit can be automatically adjusted by the camera and control computer without requiring a special configuration. The image can be adjusted and stable imaging can be performed.

  Conventionally, there has been a method in which an image captured at a wide angle is enlarged and confirmed by an automatic zoom until the user determines an image to be printed. However, in the digital image printing system of this embodiment, the user Since it is possible to determine whether or not to capture an image while automatically confirming an image that has undergone appropriate camera control, it is possible to reduce the time required to capture the image.

  According to such a digital image printing system of the present embodiment, it is possible to cut out only a person from a captured image, automatically recognize the number of imaging targets from the cut out image, and print the imaging range and image. By controlling the imaging unit in accordance with the range, it is possible to automatically adjust the optimum field angle and zoom.

(Second Embodiment)
FIG. 5 is a diagram showing a schematic configuration of a digital image printing system for explaining the second embodiment of the present invention. In the figure, the same reference numerals are given to the portions overlapping those in FIGS. 1 and 2 described in the first embodiment.

  As shown in FIG. 5, the digital image printing system of this embodiment includes a control unit 20 and an image printing unit 21. The control unit 20 controls the operation of the entire digital image system, and is configured mainly with a processor and a memory that operate according to a predetermined program. The image printing unit 21 is connected to the control unit 20 and includes a stamp printing unit 22, a postcard printing unit 23, and a certificate printing unit 24. In particular, with regard to postcards and stamps, the stamp printing unit 22 and the postcard printing unit 23 may be provided with a plurality of printing units according to the number of types of printing media so as to correspond to a plurality of types.

  Next, the operation of the digital image printing system of this embodiment will be described. First, the user selects a background image and an image registration method from the initial screen displayed on the display input unit 1. As an image registration method, an image is captured by the imaging unit 2 and, in addition to the captured image registration, an image captured by a data communication unit 4 from a storage medium, an image captured by a scanner, or a mobile phone or the like It is possible to register an image taken in via communication. Further, the digital image printing system of the present embodiment may be connected to a management center (not shown) via a communication line such as a network, and image data transmitted by the user to the management center in advance may be read and registered. In this case, the user can register the management number assigned to the image data transmitted to the management center by inputting it into the digital image printing system.

  When the image to be printed is confirmed, the control unit 20 displays on the display input unit 1 a display for prompting the confirmation of the type of print medium to be printed and the number of prints. Calculate and display charges. The user purchases the printed material by charging the fee input unit 5 based on the displayed fee. The fee may be charged at any time. If a fee is charged in advance and there is a shortage after the print media and the number of prints are determined, the shortage is calculated. If there is an excess, change is returned. Also good.

  In addition, the control unit 20 performs image processing on the determined image according to the designated print medium, and outputs the processed image data to the print unit corresponding to the designated print medium.

  When a stamp is selected as the print medium, the control unit 20 performs image processing for stamp printing on the image whose printing has been confirmed, and outputs image data to the stamp printing unit 22. The stamp printing unit 22 of the present embodiment includes a plurality of types and sizes of sheet stamp printing units and a single stamp printing unit. Accordingly, not only printing of sheet stamps but also image printing and sales using single stamps as printing media can be performed.

  When a postcard is selected as the print medium, the control unit 20 performs image processing for postcard printing on the image whose printing has been confirmed, and outputs image data to the postcard printing unit 23. The postcard printing unit 23 can print not only private postcards but also special postcards such as government-made postcards, postcards with pictures, postcards with lotteries, and the like as print media.

  Further, when a certificate is selected as the print medium, the control unit 20 performs image processing for certificate printing on the image that has been confirmed to be printed, and outputs image data to the certificate printing unit 24. Here, the digital image printing system of the present embodiment has a weighing unit (not shown), or is connected to a weighing device, and provides a stamp of a fee according to the weight of the mail measured by the weighing unit or the weighing device. Print.

  FIG. 6 is a diagram illustrating an example of a certificate printed by the digital image printing system of the present embodiment. In the certificate 600, an issuance date 601 and a fee 602 of variable information are formed as in the conventional certificate. The certificate 600 according to the present embodiment is formed with an image 610 that has been subjected to image processing by the control unit 20 and printed by the certificate printing unit 24.

  In addition, as shown in FIG. 6, special delivery indications 603 such as express delivery, underwriting time certification, delivery certification, delivery record mail, etc., broken items, cold storage etc. are printed as necessary. When “registered mail” is designated, the control unit 10 may perform printing control for simultaneously printing a registered mail number 604 that is additional information for tracking registered mail. In this case, for example, the registered number can be managed on the post office side by connecting the digital image printing system of the present embodiment to a post-office processing device or the like via a communication line. FIG. 6 shows an example in which a registered number two-dimensional code display 604 is printed. In this way, the registered number and the like are printed at the same time regardless of the display location of the certificate paper, thereby reducing the work at the post office.

  By the way, when providing services for large print media, when high-speed printing processing speed is required, and whether images printed on stamps and government-made postcards violate public order and morals such as copyright and portrait rights infringement If it is necessary for a person to confirm and hand it over to the user, the image printing unit 21 is connected to the control unit 20 via a communication line such as a LAN (Local Area Network), so that it can be separated from the main body. May be installed.

  When delivery is performed at a different place without directly outputting the printed matter from the main body of the image pickup system, the receipt printing unit 12 prints and outputs the voucher. FIG. 7 is a diagram showing an example of a voucher receipt. As shown in FIG. 7, the form which shares a voucher and a receipt is shown.

  The voucher receipt certificate shown in FIG. 7 may be half-cut between the receipt and the voucher to facilitate separation. And it can deliver to a user by exchanging a printing medium for a voucher. Further, in order to prevent a mistake in exchange at the time of redemption, an image 701 printed on a print medium may be printed on the voucher receipt certificate 700.

  According to the digital image printing system of the present embodiment, it is possible to print an image captured on the spot or a captured image on a stamp sheet, a postcard, a certificate paper, etc., and the service can be provided by the digital image printing system. In addition, the user of this digital image printing system can be encouraged to be interested in mail.

  Furthermore, even when the printing medium is delivered remotely, the printed matter can be reliably delivered by printing and outputting the voucher.

  In the present embodiment, the case where the image printing unit 20 includes the postcard printing unit 21, the stamp printing unit 22, and the certificate printing unit 23 is described. However, it is not necessary to include all of these printing units. One or a combination of two or more may be included.

(Third embodiment)
FIG. 8 is a diagram showing a schematic configuration of a digital image printing system for explaining a third embodiment of the present invention. In the figure, the same reference numerals are given to the portions overlapping those in FIGS. 1, 2, and 5 described in the first or second embodiment.

  As shown in FIG. 8, the digital image printing system of the present embodiment includes a control unit 30, a communication unit 31, and a voice input / output unit 32, and includes an image processing terminal device 34 and a communication line 33 such as a network. Via a communicable connection.

  The control unit 30 controls the operation of the entire digital image system, and is mainly composed of a processor and a memory that operate according to a predetermined program. The communication unit 31 is connected to the control unit 30 and is also connected to the image processing terminal 34 via a communication line 33 such as a network. The voice input / output unit 32 is connected to the control unit 30 and can perform voice input / output when voice communication is performed with the image processing terminal 34 via the communication unit 31.

  The image processing terminal 34 has staff for image processing, and provides real-time and interactive image processing services such as an avatar transformation service and an image shaping service via the communication line 31. be able to.

  Next, the operation of the digital image printing system of this embodiment will be described. When the image processing service is designated by the input of the display input unit 1, first, the user selects an image to be processed from the image captured by the image capturing unit 2, the image captured by the data input unit 4, or the like. decide. When the image to be processed is determined, the control unit 30 transmits the determined image to the image processing terminal 34 via the communication line 33. In addition, by performing information and voice communication with the image processing terminal 34 using the display input unit 1 and the voice input / output unit 32, the user can change the hairstyle or change the shape of the eyes or nose. can do.

  The operator of the image processing terminal 34 processes the image based on an instruction from the user. Then, the image processing terminal 34 transmits the processed image to the digital image printing system via the communication line 33. When the user confirms the processed image as an image to be printed, fee settlement and print processing are performed.

  According to the digital image printing system of the present embodiment as described above, since the image processing terminal 34 is connected via a communication line such as a network, it is possible to have an image processing specialist on the image processing terminal 34 side. It is possible to provide a high-quality image processing service in real time.

  INDUSTRIAL APPLICABILITY The present invention has an effect capable of capturing an image without requiring a user time and is useful for a digital image printing system or the like.

1 is an external view of a digital image printing system for explaining a first embodiment of the present invention. 1 is a block diagram showing a schematic configuration of a digital image system according to a first embodiment. FIG. 3 is a flowchart showing a procedure for adjusting the imaging unit according to the digital image printing system of the first embodiment. Conceptual diagram showing image processing in adjustment of imaging unit The figure which shows schematic structure of the digital image printing system for demonstrating the 2nd Embodiment of this invention. The figure which shows the example of the certificate printed by the digital image printing system of 2nd Embodiment Figure showing an example of a voucher receipt The figure which shows schematic structure of the digital image printing system for demonstrating the 3rd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display input part 2 Image pick-up part 3 Illumination part 4 Data communication part 5 Charge input part 6 Print taking-out part 7 Receipt taking-out part 10, 20, 30 Control part 11, 21 Image printing part 12 Receipt printing part 13 Remote controller 21 Postcard printing part 22 stamp printing section 23 certificate printing section 31 communication section 32 voice input / output section

Claims (6)

Imaging means for imaging a subject and obtaining a captured image ;
A face region detecting means for detecting a face area included in prior Symbol captured image,
Presence range detecting means for detecting a presence range of a person included in the captured image based on the detected face area;
An adjustment control unit that adjusts at least one of an angle of view and a zoom of the imaging unit according to the detected existence range, and an image printing system comprising:
The face area detecting means includes
Candidate area detection means for extracting candidate areas of human faces included in the captured image;
Determining means for determining the face area based on features included in the candidate area;
The determination means determines an area where an eye area is detected among the candidate areas as the face area,
In a case where there are a plurality of the face areas, the adjustment control means is configured so that the center of the middle points of the eye areas respectively included in the outermost face area in the left-right direction is the center of the captured image. An image printing system for sending a signal for adjusting the angle of view to the imaging means . Imaging means for imaging a subject and obtaining a captured image;
Face area detecting means for detecting a face area included in the captured image;
Presence range detecting means for detecting a presence range of a person included in the captured image based on the detected face area;
An adjustment control unit that adjusts at least one of an angle of view and a zoom of the imaging unit according to the detected presence range, and an image printing apparatus comprising:
The face area detecting means includes
Candidate area detection means for extracting candidate areas of human faces included in the captured image;
Determining means for determining the face area based on features included in the candidate area;
The determination means determines an area where an eye area is detected among the candidate areas as the face area,
In a case where there are a plurality of the face areas, the adjustment control means is configured so that the center of the middle points of the eye areas respectively included in the outermost face area in the left-right direction is the center of the captured image. An image printing apparatus for sending a signal for adjusting the angle of view to the imaging means. An image printing method used for an image printing system, comprising: an imaging unit that images a subject and acquires a captured image; and an adjustment control unit that adjusts at least one of an angle of view and a zoom of the imaging unit,
Extracting a candidate area of a human face included in a captured image input from the imaging means;
Determining an area of the candidate area in which an eye area is detected as the face area;
When there are a plurality of determined face areas, the angle of view of the imaging means is such that the center of the middle points of the eye areas respectively included in the outermost face area in the left-right direction is the center of the captured image. Sending a signal for adjusting the image from the adjustment control means to the imaging means;
An image printing method comprising: The image printing system according to claim 1, wherein the adjustment control unit adjusts a zoom of the imaging unit based on a ratio between a width of the existence range and a width of the captured image. The image printing apparatus according to claim 2, wherein the adjustment control unit adjusts a zoom of the imaging unit based on a ratio between a width of the existence range and a width of the captured image. Detecting a presence range of a person included in the captured image based on the determined face area;
The image printing method according to claim 3, further comprising: adjusting a zoom of the imaging unit based on a ratio between the width of the existence range and the width of the captured image.

Images