JP6493587B1 - Imaging apparatus, image processing method, and image processing program - Google Patents

Abstract

An imaging apparatus, an image processing method, and an image processing program capable of adjusting a range of a generated image to a user are provided. A first image capturing apparatus according to the present invention includes an image capturing unit that captures an image of a subject, a display unit, and a control unit, wherein the control unit is configured based on an original image acquired by the image capturing unit. An image generation unit that generates a plurality of shooting range candidate images having different image ranges, and subject information about the subject is calculated from the original image, and one shooting is performed from the plurality of shooting range candidate images based on the subject information. A selection unit that selects a range candidate image as an initial candidate image. [Selection] Figure 9

Description

  The present invention relates to a photographing apparatus, an image processing method, and an image processing program.

  2. Description of the Related Art Conventionally, there is known an amusement photographing apparatus that can output a photographed image obtained by photographing a user with a camera as a photographic print sheet or send it to an external device via a network. In such a game photographing apparatus, various editing operations can be performed in order to improve the appearance of photographs. For example, Patent Document 1 proposes a shooting apparatus for games that allows editing such as changing the size of eyes, changing brightness, and adding graffiti.

JP 2017-0383344 A

  By the way, when shooting with the apparatus as described above, since the range of the image generated depending on the shooting range by the camera is determined in advance, the user needs to enter the shooting range and perform shooting. There is. However, the range suitable for shooting depends on the number of subjects, height, etc., and cannot be determined uniquely. For this reason, the conventional game shooting apparatus requires the user to change the standing position and pose so as to follow a predetermined shooting range. Note that such a problem is not limited to the game shooting apparatus, and may be a problem that may occur in general shooting apparatuses including an ID camera.

  The present invention has been made to solve the above problems, and an object of the present invention is to provide a photographing apparatus, an image processing method, and an image processing program capable of matching a range of a generated image to a user. .

  A first photographing apparatus according to the present invention includes a photographing unit that photographs a subject, a display unit, and a control unit, and the control unit has a different image range from an original image acquired by the photographing unit. An image generation unit that generates a plurality of shooting range candidate images; and subject information about the subject is calculated from the original image, and one shooting range candidate image is selected from the plurality of shooting range candidate images based on the subject information. A selection unit that selects the initial candidate image.

  A second imaging device according to the present invention includes an imaging unit that captures an image of a subject, a display unit, a control unit, and an input unit, wherein the control unit is configured based on an original image acquired by the imaging unit, An image generation unit that generates a user-acquired image having a predetermined image range; and a display control unit that displays a plurality of compositing images to be combined with the user-acquired image on the display unit, The input unit accepts selection of one composition image from the plurality of composition images displayed on the display unit, and the image generation unit determines the image range based on the selected composition image. The user-acquired image is generated from the original image based on the determined image range.

  The first image processing method according to the present invention includes a step of acquiring an original image including a subject, a step of generating a plurality of shooting range candidate images having different image ranges from the original image, and a subject relating to the subject from the original image. Calculating subject information, and selecting one shooting range candidate image as an initial candidate image from the plurality of shooting range candidate images based on the subject information.

  A second image processing method according to the present invention includes a step of acquiring an original image including a subject, a step of generating a user acquired image having a predetermined image range from the original image, and a synthesis with the user acquired image A step of displaying a plurality of images for composition to be candidates, a step of accepting selection of one image for composition from the displayed plurality of images for composition, and based on the selected image for composition, Determining an image range, and generating the user acquired image from the original image based on the determined image range.

  A first image processing program according to the present invention includes a step of acquiring an original image including a subject in a computer, a step of generating a plurality of shooting range candidate images having different image ranges from the original image, and the original image Subject information about the subject is calculated from the subject, and a step of selecting one shooting range candidate image as an initial candidate image from the plurality of shooting range candidate images based on the subject information is executed.

  The second image processing program according to the present invention includes a step of acquiring an original image including a subject in a computer, a step of generating a user acquired image having a predetermined image range from the original image, and the user acquisition Displaying a plurality of compositing images that are candidates for compositing with the image; receiving a selection of one compositing image from the displayed plurality of compositing images; and selecting the compositing image And determining an image range, and generating the user-acquired image from the original image based on the determined image range.

In addition, another imaging device according to the present invention includes an imaging unit for imaging an object,
A first subject image that is an image of a first range of an original image acquired by the photographing unit, and a second subject image that is an image of a second range different from the first range of the original image. An image generation unit for generating at least one of them,
A determination unit that calculates subject information related to a subject from the original image acquired by the photographing unit and determines which one of the first range and the second range is appropriate based on the subject information; Prepare.

  In this photographing apparatus, an image related to the first range and the second range can be generated, but a larger number of ranges can be set. In addition, the first range and the second range referred to here mean, for example, when three or more ranges are set, any two of them are defined regardless of the generation order. Accordingly, it is only necessary that any two of the three or more ranges are determined by the determination unit described above as appropriate.

Further, another imaging apparatus according to the present invention includes an image generation unit that generates a subject image that is an image in a predetermined range in the original image acquired by the imaging unit;
A display unit for displaying a plurality of compositing images;
A control unit that determines a synthesis image to be synthesized with a subject image obtained by the photographing unit from among a plurality of synthesis images displayed on the display unit;
The image generation unit determines the predetermined range based on the synthesis image determined by the control unit.

  According to the present invention, the range of the generated image can be adjusted to the user.

It is a perspective view which shows the external appearance of the imaging device (without curtain) which concerns on one Embodiment of this invention. It is a perspective view which shows the external appearance of the imaging device (with a curtain) of FIG. 1A. An example of the imaging unit of the imaging apparatus of FIG. 1 is illustrated. 2 illustrates an example of a hardware configuration of the imaging apparatus in FIG. 1. An example of a software configuration of the photographing apparatus in FIG. 1 is illustrated. An example of a processing procedure for accepting a shooting request is illustrated. An example of a processing procedure taken by a user is illustrated. It is a figure explaining the image range of the user acquisition image in whole body photography. This is a screen for whole body photography. It is a figure explaining the image range of the user acquisition image based on whole body photography for up photography. It is a figure explaining the image range of the user acquisition image in up photography. It is a setting screen of the image range of the user acquisition image in up photography. This is a screen for shooting up. This is a screen for selecting an image to be enlarged. It is a figure explaining the setting of the image range of the user acquisition image in up photography. It is a setting screen of the image range of the user acquisition image in up photography. It is a figure which shows the example of the image for a synthesis | combination. It is a figure which shows the example of the image which synthesize | combined the user acquisition image and the image for a synthesis | combination.

<1. Overview of photographic equipment>
Hereinafter, the photographing apparatus according to the present embodiment will be described. FIG. 1A is a perspective view showing a state in which the curtain 13 is removed from the photographing apparatus 100 according to the present embodiment, and FIG. 1B is a perspective view showing a state in which the curtain 13 is attached in FIG. 1A.

  As shown in FIG. 1A and FIG. 1B, the photographing apparatus 100 includes a rectangular parallelepiped housing 1, and an entrance / exit 11 leading to an internal photographing space 10 is formed on a side surface of the housing 1. A curtain rail 12 is attached to the upper edge of the entrance 11, and a curtain 13 is attached to the curtain rail 12. Thereby, when the user performs photographing, the curtain 13 is closed so that the photographing space 10 cannot be seen from the outside and extra light from the outside does not enter the photographing space 10. it can. In the interior of the housing 1, there is a single color (for example, blue, green, etc.) for chroma key composition processing in a photographing range such as a surface (back surface) opposite to a surface on which a camera 32 described later is disposed. Is attached. The range to which a single color is assigned may be a part of the shooting range or the entire range.

  A reception unit 2 is provided near the entrance / exit 11 of the outer wall of the housing 1. The accepting unit 2 is configured to accept a request for taking a picture by the photographing apparatus 100. On the other hand, a photographing unit 3 is provided inside the housing 1 (the photographing space 10) in front of a position where the user should be present during photographing. The photographing unit 3 is configured to photograph a user in the photographing space 10, accept editing of the obtained image, and print the edited image. Details of the configuration of each unit (2, 3) will be described later.

<2. Hardware configuration of photographing apparatus>
Next, the hardware configuration of the image capturing apparatus 100 according to the present embodiment will be described with further reference to FIGS. 2 and 3. FIG. 2 illustrates the photographing unit 3 of the photographing apparatus 100 according to the present embodiment. FIG. 3 schematically illustrates an example of the hardware configuration of the imaging apparatus 100.

  As shown in FIG. 3, the photographing apparatus 100 according to the present embodiment is a computer in which a reception unit 2, a photographing unit 3, a control unit 5, a storage unit 6, a communication interface 7, and a drive 8 are electrically connected. . In FIG. 3, the communication interface is described as “communication I / F”.

  The control unit 5 includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and the like, and controls each component according to information processing. The storage unit 6 is an auxiliary storage device such as a hard disk drive or a solid state drive, and stores various data such as a program 61 executed by the control unit 5.

  The program 61 is a program for causing the photographing apparatus 100 to execute processing for accepting a photography request and taking a photograph and printing according to the accepted request. In addition, the storage unit 6 stores screen data used in each process. Details will be described later.

  The communication interface 7 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, or the like, and is an interface for performing wired or wireless communication via a network. The type of the communication interface 7 may be appropriately selected according to the installation location of the photographing apparatus 100 or the like. The imaging apparatus 100 can perform data communication with an external server or the like via the communication interface 7.

  The drive 8 is, for example, a CD (Compact Disk) drive, a DVD (Digital Versatile Disk) drive, or the like, and is a device for reading a program stored in a storage medium (not shown). The type of the drive 8 may be appropriately selected according to the type of the storage medium. The program 61 may be stored in a storage medium.

  The storage medium stores information such as a program by electrical, magnetic, optical, mechanical, or chemical action so that information such as a program recorded by a computer or other device or machine can be read. It is a medium. Examples of this storage medium include a CD, a DVD, a flash memory, and the like.

(Reception unit)
The reception unit 2 includes a touch panel display 21, a cash processing unit 22, a card reader 23, and a speaker 24. The touch panel display 21 is disposed on the outside of the housing 1 slightly above the main body of the reception unit 2 so as to fall within the range of the line of sight of a user who desires to take a picture. The touch panel display 21 is controlled by the control unit 5 and accepts an operation related to a photographing request from a user by appropriately accepting a screen display and a selection operation. The type of the touch panel display 21 may not be particularly limited and may be appropriately selected according to the embodiment. For example, the touch panel display 21 can be of a pressure sensitive type, an infrared type, or the like.

  The cash processing unit 22 includes a bill validator 220, a cash insertion slot 221 and a cash discharge slot 222, and inserts bills or cash (coins) into the bill verification unit 220 or the cash insertion slot 221 by various sensors. Is detected. As shown in FIG. 1A and FIG. 1B, the cash inlet 221 is arranged near the lower part of the touch panel display 21, and the cash outlet 222 is arranged below the cash inlet 221.

  When the cash processing unit 22 detects that cash more than the amount required for photographing has been inserted, the cash processing unit 22 outputs an activation signal indicating the detection to the control unit 5. The cash processing unit 22 discharges the corresponding amount of cash to the cash outlet 222 when the amount of cash greater than the amount required for cancellation of shooting and the amount of shooting is input.

  The card reader 23 is configured to be able to read information of a card such as an IC card or a credit card. As the card reader 23, a known reader capable of reading information on various cards may be used. In the present embodiment, the card reader 23 is disposed in the vicinity of the cash slot 221. The card reader 23 accepts payment of charges by electronic money, a credit card or the like, and when accepting payment of the charges, outputs an activation signal indicating that to the control unit 5.

(Shooting unit)
As shown in FIGS. 1A, 1B, and 3, the photographing unit 3 includes a touch panel display 31, a camera 32, a lighting unit 33, a speaker 34, and a printer 35. The touch panel display 31 is an example of the “display unit” in the present invention, and the camera 32 is an example of the “imaging unit” in the present invention.

  The touch panel display 31 is disposed in the center of the front panel of the photographing unit 3 main body, and a camera 32 used for photographing is disposed above the touch panel display 31. The control unit 5 controls shooting by the camera 32. Further, the control unit 5 controls display on the touch panel display 31 and input to the touch panel display 31. The types of the touch panel display 31 and the camera 32 may be appropriately selected according to the embodiment.

  Specifically, the camera 32 performs imaging according to the control by the control unit 5 and stores an image obtained by the imaging in the RAM or the storage unit 6. In this embodiment, since the position of the user is generally determined at the time of shooting, the distance between the user and the camera 32 at the time of shooting is generally determined. Therefore, the focal length of the camera 32 according to the present embodiment is constant. However, the configuration of the camera 32 is not limited to such an example, and in the case of the camera 32 including a zoom lens, the focal length of the camera 32 is appropriately adjusted by the control unit 5 as necessary. It may be controlled. The adjustment of the focal length requires a mechanism that rotates the outer cylinder of the zoom lens by applying a force from the outside of the camera 32. The controller 5 adjusts the amount by which the outer cylinder of the zoom lens is rotated by controlling this mechanism.

  An image captured by the camera 32 is displayed on the touch panel display 31. The control unit 5 captures a still image of the subject (user) with the camera 32 at a predetermined timing. The camera 32 captures an image in real time and outputs an image signal for live video representing the image. The image signal output from the camera 32 is temporarily stored in the RAM of the control unit 5 and transmitted to the touch panel display 31. Thereby, on the touch panel display 31, a still image photographed by the camera 32 and a live video based on the image signal are displayed.

  Further, on the touch panel display 31, based on the program 61, a guidance screen showing guidance for photographing is displayed. In each screen, an operation input such as a selection operation is accepted. The control part 5 detects the operation input with respect to each screen, and performs the process according to the detected operation input.

  In the present embodiment, a pair of electronic pens 40 are arranged on both sides of the touch panel display 31 as operation devices for performing operation input on each screen. Each electronic pen 40 is a pen constituting a digitizer, for example. Accordingly, the touch panel display 31 may be a display in which a known touch panel constituting a digitizer is stacked. Thereby, the control part 5 can detect the input by each electronic pen 40, after identifying each electronic pen 40. FIG.

  Each electronic pen 40 is connected to the photographing unit 3 main body via a cable 41. The length of each cable 41 may be determined as appropriate so that each electronic pen 40 can contact the screen of the touch panel display 31. The user can operate each screen displayed on the touch panel display 31 by using each electronic pen 40.

  The lighting unit 33 includes an upper strobe box 331 and a lower strobe box 332. As shown in FIG. 2, the upper strobe box 331 has a curved cover facing the user side, and is fixed to a front panel (not shown) or the like using a predetermined mounting member. The upper strobe box 331 includes a fluorescent lamp and a strobe arc tube inside, and irradiates strobe light near the user's face from the upper front. The lower strobe box 332 is disposed below the touch panel display 31 and around the photo print outlet 36. The front surface of the lower strobe box 332 is constituted by a plate-like member that forms a vertical surface, and the upper surface is constituted by a plate-like member that forms a steep slope. The plate member is a plate member having translucency such as a milky white acrylic plate. The lower strobe box 332 also has a fluorescent lamp and a strobe arc tube inside. In addition, the fluorescent lamps of the strobe boxes (331, 332) are controlled by the control unit 5 to adjust the amount of light emitted from the electric lamps, thereby adjusting the brightness in the shooting space 10 according to the stage of the user's shooting process. Adjust.

  The speaker 34 and the printer 35 are built in the photographing unit 3 body. The speaker 34 outputs a sound such as a guide for taking a picture according to control by the control unit 5. In addition, the printer 35 prints the captured image or the edited image under the control of the control unit 5, and discharges the printed image to the outlet 36.

(Other)
Note that regarding the specific hardware configuration of the image capturing apparatus 100, it is possible to omit, replace, and add components as appropriate according to the embodiment. For example, the control unit 5 may include a plurality of processors. Further, the image capturing apparatus 100 may be a general-purpose PC (Personal Computer) or the like in addition to an information processing apparatus designed exclusively for the provided service.

<3. Software configuration of photographing device>
Next, an example of a software configuration of the photographing apparatus 100 according to the present embodiment will be described with reference to FIG. FIG. 4 schematically illustrates an example of the software configuration of the imaging apparatus 100 according to the present embodiment.

  The control unit 5 of the photographing apparatus 100 expands the program 61 stored in the storage unit 6 in the RAM. The control unit 5 interprets and executes the program 61 expanded in the RAM by the CPU, and controls each component. Accordingly, as illustrated in FIG. 4, the control unit 5 and the like of the photographing apparatus 100 according to the present embodiment are configured to include a reception unit 51, a photographing processing unit 52, and an output processing unit 55 as software modules. .

  The accepting unit 51 displays an operation screen related to a photographing request on the touch panel display 21 of the accepting unit 2, accepts a user input by a touch operation on the touch panel display 21, and executes a process according to the input. As a result, the accepting unit 51 accepts a request for photographing from the user, settings relating to photographing, printing, and the like.

  The photographing processing unit 52 displays a guidance screen indicating photographing guidance on the touch panel display 31 and performs photographing processing by the camera 32. Thereby, the imaging processing unit 52 acquires an image in which the user (subject) is captured. The photographing processing unit 52 includes an image generation unit and a selection unit (determination unit) according to the present invention. The image generation unit generates user acquired images having various image ranges, which will be described later, and the selection unit selects a user acquired image having an image range suitable for shooting. The output processing unit 55 prints the finally obtained image on a paper medium, and outputs the printed image from the outlet 36. The output processing unit 55 transmits the generated image together with the external server.

  Each software module of the photographing apparatus 100 will be described in detail in an operation example described later. In the present embodiment, an example is described in which each software module of the image capturing apparatus 100 is realized by a general-purpose CPU. However, some or all of the above software modules may be realized by one or a plurality of dedicated hardware processors. In addition, regarding the software configuration of the imaging apparatus 100, functions may be omitted, replaced, and added as appropriate according to the embodiment.

<4. Example of operation of photographing apparatus>
<4-1. Procedure for accepting shooting requests>
Next, a processing procedure for accepting a photographing request by the photographing apparatus 100 according to the present embodiment will be described with reference to FIG. FIG. 5 illustrates an example of a processing procedure for accepting an imaging request by the imaging apparatus 100 according to the present embodiment.

  The control unit 5 of the imaging apparatus 100 operates as the reception unit 51, and performs an imaging request reception process according to the processing procedure illustrated in FIG. For example, the control unit 5 displays a demonstration screen such as an advertisement on the touch panel display 21 of the reception unit 2 until the reception process is started, and in response to the touch operation on the touch panel display 21, the following Start the acceptance process. Note that the processing procedure described below is merely an example, and each processing may be changed as much as possible. Further, in the processing procedure described below, steps can be omitted, replaced, and added as appropriate according to the embodiment.

(Step S100)
In step S <b> 100, the control unit 5 displays a screen for selecting the type of language used on the touch panel display 21. For example, the control unit 5 displays buttons corresponding to each language such as Japanese, English, Chinese, and Korean on the touch panel display 21 and causes the user to touch any button. Thereby, the control unit 5 accepts the selection of the language used. The storage unit 6 stores screen data corresponding to each language used, and the control unit 5 displays a screen corresponding to the selected language used in the processing after step 100 and the next step S102. At the same time, sound corresponding to the selected language is output from the speaker 24. When the selection of the language to be used is completed, the control unit 5 advances the processing to the next step S102.

(Step S102)
In step S <b> 102, the control unit 5 displays a screen for selecting the number of prints on the touch panel display 21. For example, the control unit 5 displays buttons corresponding to the number of printed sheets such as one sheet, two sheets, and the like on the touch panel display 21 and makes the user touch any button. Thereby, the control unit 5 accepts selection of the number of printed sheets. When the selection of the number of prints is completed, the control unit 5 advances the processing to the next step S104.

(Step S104)
In step S <b> 104, the control unit 5 displays a screen for selecting a payment method on the touch panel display 21 together with the amount based on the selection result in step S <b> 102. For example, the control unit 5 displays a button corresponding to each settlement method such as a credit card, an IC card, or cash on the touch panel display 21 and causes the user to touch any button. Thereby, the control part 5 receives selection of the payment method. When the selection of the settlement method is completed, the control unit 5 advances the processing to the next step S106.

(Step S106)
In step S106, the control unit 5 displays a payment screen corresponding to the payment method selected in step S104 on the touch panel display 21. Thereby, the control part 5 receives the payment by the payment method selected in step S104.

  When cash settlement is selected, the user inserts the fee specified on the settlement screen into the cash slot 221. When cash corresponding to the designated fee (the fee based on the selection result in step S104) or more cash is inserted, the cash processing unit 22 outputs the activation signal to the control unit 5. On the other hand, when the payment with the credit card or the IC card is selected, the user causes the card reader 23 to read the corresponding card. When the corresponding card is read, the card reader 23 outputs the activation signal to the control unit 5. After receiving these activation signals, the control unit 5 proceeds to the next step S108.

(Step S108)
In step S <b> 108, the control unit 5 displays a screen for selecting a template image of a seal design to be printed on the touch panel display 21. Each design may be stored in the storage unit 6, or may be downloaded from another information processing apparatus such as a NAS (Network Attached Storage) via a network. Each design has a different layout in which a plurality of photographed images are arranged, and a color and an illustration drawn on the sticker are different.

  For example, the control unit 5 displays a thumbnail of each design on the touch panel display 21 and causes the user to touch any one of the thumbnails. Thereby, the control part 5 receives selection of the design of the seal | sticker to print. When the selection of the design is completed, the control unit 5 advances the processing to the next step S110.

(Step S110)
In step S <b> 110, the control unit 5 displays on the touch panel display 21 a screen for selecting a background or foreground design to be combined with the captured image. Each design may be stored in the storage unit 6, or may be downloaded from another information processing apparatus such as a NAS (Network Attached Storage) via a network. Each design includes at least one of the background and foreground of the image related to the subject by the chroma key composition process. Hereinafter, this is referred to as a composition image.

  For example, the control unit 5 displays thumbnails of the images for synthesis on the touch panel display 21 and makes the user touch any one of the thumbnails. Thereby, the control part 5 receives selection of the image for a synthesis | combination. When the selection of the composition image is completed, the control unit 5 advances the processing to the next step S112.

(Steps S112 and S114)
In step S <b> 112, the control unit 5 displays on the touch panel display 21 a demonstration screen for shooting guidance, advertisements, and the like by the shooting unit 3 until the shooting unit 3 becomes available.

  When there is a user who uses the imaging apparatus 100 before the target user who has requested imaging in the reception process according to this operation example, when the target user reaches this step S112. There is a possibility that the previous user is still performing the photographing process by the photographing unit 3. While the previous user occupies the photographing unit 3, the control unit 5 displays a demonstration screen in this step S112 in order to make the target user stand by outside the casing 1. If there is no previous user or the previous user has completed shooting and the shooting unit 3 can be used immediately, the control unit 5 omits the process of step S112. Also good.

  In the next step S <b> 114, the control unit 5 displays a moving guide to the shooting space 10 on the touch panel display 21 and prompts the user who has requested the shooting to move into the shooting space 10. Thereby, the control part 5 complete | finishes the reception process which concerns on this operation example.

  The screen displayed at each step may be provided with a button for returning to the previous step or returning to the first step S100. Thus, the user can return the reception process to a desired step or cancel the shooting request.

<4-2. Shooting procedure>
Next, a processing procedure of photographing by the photographing apparatus 100 according to the present embodiment will be described using FIG. FIG. 6 illustrates an example of a processing procedure of shooting by the shooting apparatus 100 according to the present embodiment.

  The control unit 5 of the imaging apparatus 100 operates as the imaging processing unit 52 in response to the completion of the reception process, and starts the imaging process illustrated in FIG. Note that the processing procedure described below is merely an example, and each processing may be changed as much as possible. Further, in the processing procedure described below, steps can be omitted, replaced, and added as appropriate according to the embodiment.

(Step S200)
In step S <b> 200, the control unit 5 displays a screen for starting shooting on the touch panel display 31. For example, the control unit 5 displays a screen including a start button for allowing the user to start the shooting play on the touch panel display 31, and the user presses the start button with one of the pair of electronic pens 40. Touch. Thereby, the control part 5 receives the start of imaging | photography, and advances a process to following step S202. In the following process, unless otherwise specified, the touch panel display 31 is touched with any of the electronic pens 40 to advance the shooting process. Therefore, hereinafter, the term “touch” means a touch with the electronic pen 40.

(Step S202)
In step S <b> 202, the control unit 5 performs shooting after displaying guidance for performing whole body shooting on the touch panel display 31. For example, when the whole body is photographed by the camera 32, a photographed image (original image) as shown in FIG. 7 is generated. However, since the peripheral portion of the photographed image may be optically distorted, the peripheral portion is cut out and the image range of the image acquired by the user is determined. Hereinafter, an image acquired by the user based on the image range is referred to as a “user acquired image”. For example, in the example of FIG. 7, the dotted line is the contour of the user acquired image.

  Then, as shown in FIG. 8, the screen on which the live video is displayed is displayed on the touch panel display 31. The live image may be a subject image extracted by performing chroma key processing on a user acquired image (or an image obtained by cutting a peripheral edge so as to correspond to the user acquired image after performing chroma key processing on a captured image), and in step S110. This is an image synthesized with the selected composition image, and is hereinafter referred to as a user-acquired composite image. The user pauses appropriately while watching the live video. Then, after the countdown 72 is performed, the whole body is photographed by the camera 32. That is, a still image as a user acquired composite image is generated. The generated still image may be an image in the same range as the display range of the live video, or may be an image in a range that approximates the display range of the live video. Here, two shots are taken along with the countdown. The generated two user-acquired composite images relating to the whole-body imaging are stored in the storage unit 6 by the control unit 5. Note that the number of times of photographing is not particularly limited, and may be other than twice. This is the same in up-shooting described later.

  When the whole body shooting is performed in this way, the up shooting is performed so that the vicinity of the face is enlarged, and in this embodiment, the initial setting of the image range of the user acquired image in the up shooting is performed. Is performed using a captured image (or a user acquired image) acquired by whole body imaging. Hereinafter, this setting method will be described.

In the present embodiment, three types of image ranges, that is, first to third ranges are set for a user acquired image in up-shooting. As shown in FIG. 9, the first range is a rectangular image range intended for adults, and is arranged at the top of the captured image. That is, this image range is set so as to mainly include adult faces. The second range is, for example, a rectangular image range set to include children, and the size and aspect ratio are the same as the first range so that a person with a short height can also be included. It arrange | positions below the 1st range. The third range is an image range that can include a large number of people including children and adults. As for the vertical position of the third range, the upper side substantially coincides with the upper side of the first range, and the lower side substantially coincides with the lower side of the second range. The aspect ratio of the third range is the same as the aspect ratio of the first range and the second range. Therefore, the size of the third range is wider than the sizes of the first range and the second range. An image generated by such first to third ranges corresponds to a shooting range candidate image of the present invention. Further, any two of the images generated by the first to third ranges correspond to the first subject image and the second subject image of the present invention.

  The above three image ranges can be selected by the user at the time of up-photographing described below, but the control unit 5 presets any one of the image ranges as an initial candidate. The method for determining this initial candidate is as follows.

First, the control unit 5 detects a subject's face included in the captured image from the captured image using a known face recognition technique. For example, when the subject's face is recognized from the whole-body captured image shown in FIG. 9, initial candidates are set based on the following criteria. Here, the captured image refers to any one of two captured images and two user acquired images acquired by two whole body images.
(1) When the number of recognized subject images is less than the predetermined value N and the face of the recognized subject exists only above the reference line L in the captured image, the first range is set as an initial candidate. And
(2) If the number of recognized subject images is less than the predetermined value N and one of the recognized subject faces exists below the reference line L in the captured image, the second The range is the initial candidate.
(3) If the number of recognized subject faces is equal to or greater than a predetermined value N, the third range is set as an initial candidate regardless of the position of the subject face.

  The reference line L can be set in various ways. For example, the reference line L may be based on a person (child) whose height is 135 cm when standing at a predetermined position in the photographing booth. That is, when the subject's face is below the reference line L, it can be determined that a person whose height is 135 cm or less is included. The number of faces of the subject related to the third range can be set to N = 5, for example. That is, when five or more faces are detected, the third range can be set as an initial candidate. If the number N of faces of the subject is less than 5, the above criteria (1) and (2) are prioritized. When the number N of the faces of the subject is 0, the first range that is a general range can be set as the initial candidate.

If the third range is not adopted as the initial candidate, the initial candidate is set according to the following criteria.
(4) When the face of the recognized subject exists only above the reference line L in the captured image, or when face detection fails, the first range is set as an initial candidate.
(5) If even one of the recognized faces of the subject exists below the reference line L in the captured image, the second range is set as an initial candidate.

  In this way, the control unit 5 determines an initial candidate of the image range for the user acquired image in the up-shooting from the captured image and stores it in the storage unit 6. For example, in the example of FIG. 9 described above, the second range is set as an initial candidate, and becomes an image range at the time of up shooting described below. This process is performed in parallel with the process related to the up-shooting described above. Note that when the initial candidate is determined using an image acquired by the first whole body imaging, the initial candidate can be determined after the still image is acquired by the first whole body imaging. When performing using the image acquired by the 2nd whole body imaging | photography, it can carry out after a still image is acquired by the 2nd whole body imaging | photography. When using an image obtained by the first whole body imaging and an image having a better condition among the images obtained by the second whole body imaging (for example, an image having a higher face detection success rate) This can be done after the still image is acquired in the second whole body photographing.

(Steps S204 and S206)
Next, the control unit 5 performs an up shooting process. That is, after displaying guidance for performing up-shooting on the touch panel display 31, the image range is set. That is, as shown in FIG. 10, the second range is set as described above in the captured image (original image) of the up-shooting. Then, the image in the second range is cut out, and a screen as shown in FIG. 11 is displayed on the touch panel display 31. Note that the image shown on the screen shown in FIG. 11 is a user-acquired composite image, as in the case of whole body photography described above.

  The screen shown in FIG. 11 includes a live video 78 corresponding to the user-acquired composite image, three selection displays 75 for selecting the first to third ranges below the area where the live video 78 is displayed, Is displayed. The three selection displays 75 are displays corresponding to the first to third ranges, and display the first range, the second range, and the third range, respectively, as “display standing” and “squatting and shooting”. ”And“ Shoot in groups ”are displayed.

  Then, when transitioning to the screen shown in FIG. 11, the user-acquired composite image (initial candidate image) corresponding to the initial candidate determined in step 202 is displayed as the live video 78 out of these three image ranges, and corresponding to it. The selection display 75 to be displayed is highlighted. Emphasis includes, for example, changing the color or design of the selected selection display, or displaying a frame. In the example of FIG. 11, a user-acquired composite image corresponding to the second range (capturing and shooting) is displayed as an initial candidate. Prior to the screen of FIG. 10, a screen explaining the three image ranges can be displayed.

  When the user touches any selection display 75, the user acquired image corresponding to the touched selection display 75 is switched and displayed as a live video 78. Then, when confirming the selection, the OK button 71 is touched. Therefore, any image range can be selected until the OK button 71 is touched. If the OK button 71 is not touched within a predetermined time, the image range selected at that time is set as the image range for up shooting.

  When the range of the user-acquired composite image for up-shooting is determined in this way, a screen on which live video corresponding to the selected range is displayed is displayed on the touch panel display 31, as shown in FIG. Then, after the countdown 72 is performed, the up shooting is performed by the camera 32. That is, a still image as a user acquired composite image is generated. Note that the live video can be a lower quality image than the still image generated here, and the processing speed related to the display of the live video can be improved. The generated still image may be an image in the same range as the display range of the live video displayed on the screen of FIG. 12, or may be an image in a range approximate to the display range of the live video. Here, two shots are taken along with the countdown. The generated two user-acquired composite images related to up-shooting are stored in the storage unit 6 by the control unit 5.

(Steps S208 and S210)
Subsequently, the control unit 5 causes the user to select an image to be enlarged in the printed sheet. That is, as shown in FIG. 13, all the user-acquired composite images that have already been captured are displayed on the touch panel display 31, and an image to be enlarged in the sticker is selected from these images. When the user touches any image, a selection frame 79 is displayed on the touched image. Then, when confirming the selection, the OK button 71 is touched. Therefore, any image can be selected until the OK button 71 is touched. Subsequently, the control unit 5 generates a sheet image by arranging each user-acquired composite image on the template image selected in step S108. The arrangement position of the user acquired composite image on the template image is determined according to the selection result in step S212. Next, the control unit 5 operates as the output processing unit 55 and starts a printing process for printing the sheet image determined using the printer 35 on the print sheet.

(Steps S212 and S214)
Subsequently, the control unit 5 performs a bonus photographing process in parallel with the printing process. The time required for completing the printing process differs depending on the selection result in step S102. It takes about 90 seconds to print one sheet image, and about 180 seconds for two sheets. Bonus shooting is performed using this time. The content of the bonus shooting may be any shooting such as still image or moving image shooting that can be acquired by the above-described up shooting or whole body shooting.

  When the control unit 5 detects that the n-th (n is an integer equal to or greater than 1) bonus shooting has been completed, the control unit 5 determines whether or not the remaining print processing time is equal to or longer than a predetermined time (step S214). If it is longer than the predetermined time (YES in step S214), the n + 1th bonus shooting is performed (step S212). If it is less than the predetermined time (NO in step S214), the (n + 1) th bonus shooting is not performed. Note that when the bonus shooting is performed, the printing of the sheet image has already started, so the image generated by the bonus shooting is not printed, and can be acquired later by uploading to the server as will be described later. Like that.

(Step S216)
In response to the completion of the printing process started in step S <b> 210, the control unit 5 displays guidance on the touch panel display 31 indicating that the printing process has been completed. Then, the controller 5 removes the seal from the outlet 36. By the way, there are often users who forget to remove the sheet from the outlet 36. A method for preventing this will be described below. Some outlets 36 are provided with a lid, while others are not provided with a lid and are simply open. First, what is provided with a lid will be described. In this aspect, a detection sensor for detecting opening and closing of the lid is provided. Then, the control unit 5 detects whether or not the lid has been opened within a predetermined time after completion of the printing process. When the lid is not opened, the touch panel display 31 and the speaker 34 are used to perform screen display and audio output for notifying the user that the sheet has been discharged.

  The same effect can be obtained by the following method. First, after the printing is completed, the control unit 5 uses the display 31 and the speaker 34 to perform screen display and audio output for notifying the user that the sheet has been discharged. Subsequently, the opening / closing of the lid of the outlet 36 is detected. When it is detected that the lid is open, the screen display and audio output are stopped.

  On the other hand, in the case where the lid is not provided, instead of detecting the opening / closing of the lid, a sensor for detecting whether or not a hand has been put in the outlet 36 may be provided, thereby performing the above processing. .

At this time, the control unit 5 prints the number of stickers selected in step S102. After the sticker on which each image is printed is ejected from the outlet 36, the control unit 5 displays guidance on the touch panel display 31 urging the user to take out the sticker and go out of the imaging space 10. The user takes out the printed sticker from the outlet 36 according to the guide and exits the photographing space 10. Thereby, the control part 5 complete | finishes the imaging | photography process which concerns on this operation example.

<5. Features>
As described above, according to the present embodiment, the user's favorite image range can be set in up-shooting. For example, when the subject includes a child, a user acquired image whose image range is shifted downward can be selected. When the subject is a large number of people, a wide user acquired image can be selected in the horizontal direction. All subjects can be included. Therefore, it is possible to generate an image that matches the number of users, height, and the like.

  Further, initial candidates are set in advance for the image range of the user acquired image before the up-shooting. This initial candidate is determined by the control unit as being most suitable for photographing from the face position and the number of faces of the subject detected from the photographed image. Therefore, for example, even when the user forgets to select an image range during up-shooting, up-shooting can be performed with an appropriate image range.

<6. Modification>
As mentioned above, although one Embodiment of this invention was described, the above description is only the illustration of this invention in all the points. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. For example, the following changes are possible. In the following, the same reference numerals are used for the same components as in the above embodiment, and the description of the same points as in the above embodiment is omitted as appropriate. The following modifications can be combined as appropriate.

<6.1>
The image range of the user acquired image shown in the above embodiment is an example, and can be set to various sizes and shapes. Also, two or four or more image range candidates can be prepared. Furthermore, in the above embodiment, the image range can be selected at the time of up-shooting, but the same image range can be selected at the time of whole-body shooting.

<6.2>
In addition to setting the image range of the user acquired image in advance as in the above embodiment, the user can also set it. For example, when the image range of the user acquired image is set in up shooting, the reference image range of the user acquired image is set in the captured image as shown in FIG. Based on the reference image range, the user can set the image range of the user acquired image on the screen shown in FIG. That is, when the upper button 73 or the lower button 74 in FIG. 14 is touched, the reference image range moves up and down in the captured image in FIG. 14, and the live video in this range is displayed on the screen in FIG. It has become. On the other hand, when the zoom up button 75 or the zoom out button 76 is touched, the reference image range is enlarged or reduced with reference to the center point shown in FIG. 14, and a live video 77 within the range is displayed on the screen of FIG. It has become so. At this time, the display size of the live video 77 is not changed even if the zoom-up button 73 to 76 is touched. 14 and 15 show an example of up-shooting, but the present invention can also be applied to whole-body shooting. Further, the position of the center point is not particularly limited, and can be changed as appropriate.

<6.3>
The initial candidate for selection of the image range is set by using a captured image at the time of whole body imaging. If a captured image showing such a whole body can be used, the initial candidate is determined by the image range. This can be done at any time before making the selection. For example, when it is set that the up-shooting is performed first and the whole-body shooting is performed after that, a photographed image showing the whole body can be acquired before the up-shooting, and an initial candidate can be determined. In the photographing apparatus according to the present embodiment, since the whole body photographing and the up photographing are performed without changing the photographing conditions (focal length, angle of view, etc.) of the camera, the user acquired image obtained from any photographing is also available. The image is generated by performing trimming from a captured image showing the whole body. Therefore, the initial candidate can be set even when the up-shooting is performed first as described above.

  However, when the shooting conditions of the camera change between whole body photography and up photography, it is not possible to acquire a photographed image showing the whole body during up photography. Therefore, in this case, whole body photography is performed first, and at that time, initial candidates are determined from a photographed image showing the whole body. Alternatively, whole body photography for determining an initial candidate can be separately performed before up-shooting, and the initial candidate can be determined from the whole body image thus obtained.

<6.4>
Conditions for determining initial candidates for the image range can be set as appropriate. In the above embodiment, the position of the face of the subject and the number of faces of the subject are taken as subject information according to the present invention from the photographed image showing the whole body, and based on this, the initial candidate is determined. Other than that. For example, the image range may be determined by specifying an approximate height from the race of the subject.

  It is also possible to determine initial candidates from live video. In this case, the initial candidate can be determined from the live video before shooting. For example, when four times of shooting are performed, the initial candidate can be automatically changed four times according to the state of the user (the position of the face of the subject, the number of faces, etc.).

  In the above embodiment, after the initial candidate is determined, as shown in FIG. 11, the user can arbitrarily determine the image range, but this process can be omitted, that is, the apparatus determines It is also possible to generate a user acquired image (and a user acquired composite image) related to up-shooting based on the initial candidate image range.

<6.5>
The image range can also be determined based on the composition image. This point will be described. The composition image has at least one of the foreground and background of the subject image. For example, FIG. 16A shows a composition image having the background of the subject image. On the other hand, FIG. 16B shows a composition image having a foreground of the subject image. That is, the composition image has a waveform design along the lower side of the image range. However, when this foreground image is used as a composition image, depending on the position of the subject image, a part of the subject image may be hidden by the foreground image as shown in FIG. This problem can occur, especially for short children. Therefore, when a composition image including a foreground image is selected, the image range can be set to be changed depending on the position of the foreground image.

  That is, in the above embodiment, three image ranges are prepared at the time of up-shooting, but the predetermined image range can be changed by the selected composition image. FIG. 17A shows, as an example, an image obtained by synthesizing the user-acquired image and the synthesis image in the second range. For example, when the synthesis image in FIG. 16B is selected, The second range set in advance can be shifted downward. As a result, as shown in FIG. 17B, it is possible to prevent part of the subject from being hidden by the foreground image.

  As described above, the first to third ranges include, for example, an adjustment image range shifted from the initial range so as to correspond to the selected composition image other than the preset initial range as shown in FIG. Can be prepared. Note that, as described above, the shifting direction can be set as appropriate according to the image for synthesis, such as not only downward but also upward and left and right. For example, when the foreground is included near the upper side of the composition image, the second range is shifted upward, and when the foreground is included near the right side of the composition image, the second range is shifted to the right. The amount to be shifted can be changed according to the vertical width or horizontal width of the corresponding foreground constituting the compositing image. When shifting up and down, the amount of shifting is determined according to the vertical width of the foreground, and when shifting to the left and right, the amount of shifting is determined according to the width of the foreground. It is preferable to increase the amount of shift as the foreground width or height increases. Further, the adjusted image range is not simply shifted from the initial range, and the size and shape of the image range may be changed according to the composition image (foreground and / or background).

  Further, it is not necessary to prepare an adjustment image range for all the image ranges in the first to third ranges. For example, there is a high possibility that adjustment is necessary (a child with a short height may be captured). Only the second range and the third range can be prepared for the adjustment image range. Further, as shown in FIG. 14, the adjustment image range can be further adjusted.

<6.6>
In the above embodiment, the live image is displayed on the screen (FIG. 11) for selecting the image range of the user acquired image. However, a still image can be displayed, and the image range can be selected from here. Still images can be a plurality of still images with different angles of view at the same timing, or can be a plurality of still images with different angles of view at different timings. In the former case, a plurality of still images are obtained by extracting a plurality of images in different ranges from the original image acquired by one shooting. In the latter case, a plurality of still images are obtained by photographing different trimming ranges a plurality of times. Then, on the shooting screen (FIG. 12), shooting can be performed after displaying a live video corresponding to the selected image range.

<6.7>
In the above embodiment, input is performed by touching the touch panel display 31 with an electronic pen. However, input may be performed by touching with a finger, or an input unit such as a physical button is provided for input. Can also be done. Input can also be performed by voice. That is, the control unit 5 can also perform an operation by performing an operation instruction by uttering a voice and receiving the instruction.

<6.8>
In the above embodiment, the user-acquired image is trimmed from the captured image and the trimmed image is displayed on the selection screen (FIG. 11). However, the display mode of the user-acquired image is not limited to this. For example, the captured image itself (or a part thereof) can be displayed on the selection screen so that only the user-acquired image is displayed without masking the above-described trimming. In short, an image range defined by the user acquired image may be displayed on the screen. Note that the sizes of the plurality of images that are visible to the user as the live video to be selected can all be the same or substantially the same.

<6.9>
In addition to generating a user-acquired image from a captured image by trimming or masking, the image range of the user-acquired image is determined by, for example, changing the orientation of a physical camera or optically zooming in and out. Also good. That is, an image captured by the camera can be used as a user acquired image. Furthermore, it is possible to set the image range of the user-acquired image by mixing camera orientation change, zoom-up and zoom-out, trimming and masking.

<6.10>
In the above embodiment, two types of whole body photographing and up photographing are performed, but only up photographing may be used.

<6.11>
In the photographing apparatus according to the above-described embodiment, the output processing unit 55 outputs a user acquired image by printing a sheet, but can output a sheet or data of a user acquired image. In this case, the electronic data can be directly transmitted to the user's portable terminal, or can be acquired from the server via the Internet after being transmitted to the external server.

<6.12>
In the photographing apparatus according to the embodiment, an image can be edited. That is, an image editing operation may be performed on the user acquired image or sheet.

<6.13>
When the image for synthesis is not selected, the apparatus can automatically select the image for synthesis and generate a user-acquired composite image by combining it with the subject image.

<6.14>
In the above embodiment, the user-acquired synthesized image obtained by synthesizing the user-acquired image and the image for synthesis is displayed on the screen as a live image or a still image. However, the user-acquired image before synthesis with the image for synthesis is displayed on the screen. You can also In the above embodiment, for example, as shown in FIG. 11, only one of a plurality of shooting range candidate images is displayed on the screen as a live image or a still image. However, all shooting range candidate images are displayed. You may make it display on a screen and make it select one from them.

<6.15>
In the above embodiment, in addition to the initial candidates, images related to other image ranges are also generated, but only the initial candidates can be generated. For example, when the control unit 5 determines that the second range is a range suitable for the subject in the first to third ranges, the control unit 5 determines the second range extracted from the photographed image (original image). A live image or a still image (a user-acquired composite image) is generated based on the image. At this time, live video or still images related to the first range and the third range are not generated.

31 ... Touch panel display (input unit, display unit)
32 ... Camera (shooting unit),
40. Electronic pen (input unit),
5 ... control unit,
61 ... Program

Claims (3)

A shooting unit for acquiring a shot image including a subject;
The first synthetic image having a predetermined foreground at the bottom, and Unlike the first synthetic image, a plurality of types of combined images including the second synthetic image not including the foreground of the first synthesized image A storage unit for storing
An image generation unit that extracts a first acquired image or a second acquired image that is a part of the captured image and combines the extracted image with the image for synthesis;
With
The first acquired image and the second acquired image include the subject,
The image generation unit
When the composition image is the first composition image, a range set for the first composition image is extracted from the captured image to generate the first acquisition image, and the first acquisition image And the first image for synthesis,
When the composition image is the second composition image, a range set for the second composition image is extracted from the photographed image to generate the second acquisition image, and the second acquisition image And the second composition image,
The imaging device, wherein the first acquired image includes a range below the second acquired image in the captured image so as to correspond to the foreground . Obtaining a captured image including a subject;
The first synthetic image having a predetermined foreground at the bottom, and Unlike the first synthetic image, a plurality of types of combined images including the second synthetic image not including the foreground of the first synthesized image Accepting a selection of either
When the first composition image is selected as the composition image, a range set for the first composition image is extracted from the captured image to generate the first acquired image including the subject. Combining the first acquired image with the first composition image;
When the second composition image is selected as the composition image, a range set for the second composition image is extracted from the photographed image to generate the second acquired image including the subject. Combining the second acquired image and the second combining image;
With
The image processing method, wherein the first acquired image includes a range below the second acquired image in the captured image so as to correspond to the foreground . On the computer,
Obtaining a captured image including a subject;
The first synthetic image having a predetermined foreground at the bottom, and Unlike the first synthetic image, a plurality of types of combined images including the second synthetic image not including the foreground of the first synthesized image Accepting a selection of either
When the first composition image is selected as the composition image, a range set for the first composition image is extracted from the captured image to generate the first acquired image including the subject. Combining the first acquired image with the first composition image;
When the second composition image is selected as the composition image, a range set for the second composition image is extracted from the photographed image to generate the second acquired image including the subject. Combining the second acquired image and the second combining image;
With
The image processing program, wherein the first acquired image includes a range below the second acquired image in the captured image so as to correspond to the foreground .