JP2015133549A - Image processing system, image processing method and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system, an image processing method and a computer program, which can obtain a suitable image irrespective of a body length of a user or a standing position in a photographing space by a photographing game machine.SOLUTION: Frame information on a plurality of frames is previously stored in a storage device, and a group of two frames in the plurality of frames is selected based on the frame information. A corresponding region between two selected frames is specified in a captured image. A rate of a region of a subject person or the number of pixels in the specified region is determined to be within a prescribed range or not. When it is determined to be within the prescribed range, a trimming range is determined based on one or both of the two selected frames. When it is determined to be out of the prescribed range, the frame different from the two selected frames is selected again and processing is re-performed.

Description

  The present invention relates to a shooting game machine that can take a photograph of a person who is a person as a subject and obtain a predetermined sheet or data on which the shooting result is output, and in particular, shooting that allows the user to obtain a preferable shooting result. The present invention relates to an image processing apparatus, an image processing method, and a computer program in a game machine.

  An apparatus for discharging a photo sticker sheet obtained by a plurality of users photographing themselves is provided as a shooting game machine. In such a shooting game machine, a device for automatically shooting is provided in a shooting space where a plurality of users can enter, and a user group consisting of a plurality of users performs shooting in the shooting space. . In addition, the user group can select a favorite background image or decoration image, and can freely write characters or graffiti on the captured image. The selected image and written characters or graffiti can be captured. It is combined with the image and printed on a photo sticker sheet. The user group can enjoy photographing in the photographing space and inputting characters or graffiti together with his / her friends and obtain a photo sticker sheet on which a desired image is printed.

  In such a shooting game machine, the orientation, depression angle and angle of view of the imaging device, that is, the imaging range is fixed. On the other hand, the shooting space is wide enough for a plurality of users to move, and in most cases, the user group stands up and performs shooting. In order to inform the user group of the imaging range of the imaging device, a display device that displays live video signals output by the imaging device is provided in the vicinity of the imaging device. Therefore, the user group can take a picture while checking the imaging range, and can move in the horizontal direction to find a suitable position. However, since the range that can move in the vertical direction is limited, depending on the height or standing position of the user group, the position or range of the person subject area in the captured image may not be a suitable balance. Specifically, the space above the area corresponding to each user's head in the imaging range becomes uselessly widened, or conversely, the area corresponding to the head is cut off. In such a case, it is difficult to improve the user's expectation and satisfaction with respect to the resulting photo sticker sheet, because the result of shooting set in the shooting game machine cannot be obtained.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a method that can easily obtain a balanced image by trimming a captured image. In the method disclosed in Patent Document 1, a line in which a person subject area does not exist on a line among a plurality of preset horizontal or vertical lines in a captured image including a plurality of pixels is specified. The trimming range and position are set based on the identified line.

JP 2011-249873 A

  In order to improve the user's expectation and satisfaction with the resulting photo sticker sheet in the shooting game machine, an image with a suitable balance can be automatically obtained regardless of the height or standing position of the user group. It is desirable to perform trimming.

  Although the trimming is automatically performed in the method disclosed in Patent Document 1, it is determined whether or not a person subject area exists on a preset line, and the person subject area is automatically trimmed without being lost. A range is determined. However, depending on the pose of the user group, a product with higher aesthetics may be obtained by performing trimming to such an extent that a part of the region corresponding to clothes, arms or fingers is missing. In addition, particularly when the user is photographed up, it is often the case that trimming is performed to such an extent that a region corresponding to the head is partially missing, but a result with high aesthetics is often obtained. In this method, since only the presence / absence of a person subject is determined on the line, the trimming range is not determined so that a part of the person subject area is missing.

  The present invention has been made in view of such circumstances, and automatically performs trimming on a photographed image photographed by a photographing game machine, and is suitable regardless of the height of the user or the standing position in the photographing space. An object is to provide an image processing apparatus, an image processing method, and a computer program from which an image can be obtained.

  An image processing apparatus according to the present invention includes an acquisition unit that acquires image data from a photographing device that captures a human subject, and an extraction unit that extracts a human subject region from an image composed of a plurality of pixels based on the acquired image data. In the image processing apparatus for determining a trimming range including the person subject area of the image, frame information indicating positions and sizes of three or more frames in the image is stored in a storage device in advance. A means for selecting two sets of overlapping frames from the plurality of frames based on the frame information, and one of the two frames from the image. Specifying means for specifying an area excluding an overlapping portion; determining means for determining whether the ratio or the number of pixels of the person subject area in the area specified by the specifying means is within a predetermined range; Judge Is determined to be within the predetermined range, the determination means for determining the trimming range based on one or both of the two selected frames and the determination means determined to be outside the predetermined range, And means for re-selecting a different set by the selection means.

  The image processing apparatus according to the present invention is such that one of any two of the plurality of frames includes the other in the frame, and the selecting means includes two from the outside of the plurality of frames. The frame is selected, and the determination means determines whether or not the ratio or the number of pixels of the person subject area in the area specified by the specifying means is equal to or greater than a predetermined ratio or the number of pixels. It is characterized by that.

  In the image processing apparatus according to the present invention, one of any two of the plurality of frames includes the other in the frame, and the selection unit includes two of the plurality of frames from the inside. The frame is selected, and the determination means determines whether the ratio or the number of pixels of the person subject area in the area specified by the specifying means is equal to or less than a predetermined ratio or the number of pixels. It is characterized by that.

  In the image processing apparatus according to the present invention, the determining means determines either one of the two selected frames, or one of the outer and inner frames as a trimming range. Features.

  The image processing apparatus according to the present invention is characterized in that the determining means determines a range that is larger or smaller by a predetermined number of pixels from one of the two selected frames as a trimming range. To do.

  In the image processing device according to the present invention, whether or not a part of the person subject region in the horizontal direction exists outside a specific frame of the plurality of frames indicated by the frame information at a predetermined ratio or less. A lateral determination means for determining whether the horizontal determination means is present, wherein the specifying means specifies an upper portion between the two frames as the region. To do.

  In the image processing apparatus according to the present invention, the acquisition unit includes a unit that acquires a plurality of image data and identifies which of the different imaging methods each image data was captured, and the storage device includes: Different frame information is stored in advance for each different shooting method, and the selection unit selects a pair of two frames based on the frame information corresponding to the shooting method of the acquired image data. It is characterized in that it is determined whether or not it is within a predetermined range corresponding to the method of photographing the acquired image data.

  An image processing method according to the present invention includes an acquisition unit that acquires image data from a photographing device that captures a human subject, an extraction unit that extracts a human subject region from an image composed of a plurality of pixels based on the acquired image data, and a storage In an image processing method in which an image processing apparatus having means for storing information in the apparatus performs a process of determining a trimming range including the person subject area of the image, positions of three or more frames in the image And frame information indicating the size are stored in the storage device in advance, and based on the frame information, a pair of two frames that overlap in the frame is selected from the plurality of frames, and the two images are selected from the image. An area in one of the frames that excludes the overlapping portion is specified, and it is determined whether the ratio or the number of pixels of the person subject area in the specified area is within a predetermined range. , When it is determined that it is within the predetermined range, the trimming range is determined based on one or both of the two selected frames, and when it is determined that it is outside the predetermined range, the two selected frames The processing is re-executed by selecting a different frame from the above.

  A computer program according to the present invention acquires image data from the imaging device to a computer that is connected to an imaging device and can read information from a storage device, and a person from an image composed of a plurality of pixels based on the image data. In a computer program for extracting a subject area and executing image processing for determining a trimming range including the person subject area of the image, the computer includes the three or more frames stored in the storage device. A step of reading frame information indicating the position and size in the image, a step of selecting a pair of two frames that overlap in the frame based on the read frame information, and based on the acquired image data A step of identifying an area within one of the two frames and excluding an overlapping portion from the image; A step of determining whether the ratio or the number of pixels of the person subject area in the area is within a predetermined range; if it is determined to be within the predetermined range, one of the two selected frames Or, it is characterized in that a step of determining a trimming range based on both and a step of re-selecting a set different from the two selected frames when it is determined that the trimming range is outside the predetermined range are performed.

  In the present invention, based on the frame information indicating the position and size of a plurality of frames in the image, a pair of two frames that overlap in the frame is selected, and overlaps in one of the two frames. When an area excluding the portion is specified and the ratio of the person subject area or the number of pixels in the area is within a predetermined range, the trimming range is determined based on the selected frame. The trimming range is determined based on the determination of how much part of the person subject area is included in the corresponding area between the frames, not on the line in the image. It is also possible to obtain a suitable image.

  In the present invention, the determination as to whether or not a part of the person subject area is included in the area between the frames corresponds to the person subject area in the area between the two frames selected from the outside. It may be determined whether the area to be processed is a predetermined ratio or the number of pixels or more, and the area corresponding to the person subject area is a predetermined ratio within the area corresponding to the two frames selected from the inside. Or you may make it judge whether it is below the number of pixels.

  In the present invention, when one of the two frames selected when determined to be within the predetermined range is the trimming range, or one outer frame or one inner frame is the trimming range. It becomes. In this way, the frame related to the determination may be used as the trimming range, or a range that is larger or smaller by a predetermined pixel is set as the trimming range based on one of the two selected frames. May be.

  In the present invention, when a part of the person subject area in the horizontal direction is located outside a specific frame at a predetermined ratio or less, the person subject area is included in the corresponding area between the two frames. It is excluded from the judgment object of whether or not. It is based on the premise that the part outside the specific frame in the lateral direction of the person subject may be slightly outside the trimming range. By performing the exclusion, trimming can be performed to such an extent that a part of the region corresponding to the clothes, arms, or fingers is missing.

  In the present invention, the plurality of frames for determination and the predetermined range are different depending on the photographing method. As a result, even if the same processing is performed on images having different photographing methods, the trimming range corresponding to each photographing method is determined, and a suitable image can be obtained.

  According to the present invention, since trimming is automatically performed, a suitable image can be obtained with a shooting game machine regardless of the height of the user or the standing position in the shooting space.

It is a perspective view which shows the external appearance of the imaging | photography game machine in this Embodiment. It is a block diagram which shows typically the structure of the imaging | photography game machine in this Embodiment. It is a flowchart which shows an example of the whole process performed with the imaging | photography game machine of this Embodiment. It is a flowchart which shows an example of the whole process performed with the imaging | photography game machine of this Embodiment. It is a schematic diagram which shows the example of the content of the photograph sticker sheet obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the frame information memorize | stored in the image process part. It is explanatory drawing which shows the example of the content of the frame information memorize | stored in the image process part. It is a flowchart which shows an example of the process sequence of the trimming determination performed in this Embodiment. It is a flowchart which shows an example of the process sequence of the trimming determination performed in this Embodiment. It is explanatory drawing for demonstrating the process of step S306. It is explanatory drawing for demonstrating the process of step S323. It is explanatory drawing for demonstrating the image obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing for demonstrating the process in which an image is obtained with the imaging | photography game machine in this Embodiment. It is explanatory drawing which shows the example of the content of the image obtained with the imaging | photography game machine of this Embodiment.

  Hereinafter, the present invention will be specifically described with reference to the drawings showing embodiments thereof.

  FIG. 1 is a perspective view showing an external appearance of a shooting game machine according to the present embodiment, and FIG. 2 is a block diagram schematically showing the configuration of the shooting game machine. A photographing amusement machine as a whole is a box-shaped device having a substantially rectangular parallelepiped shape that a plurality of users can enter together. A shooting game machine can be roughly divided into a shooting area A and an editing area B, and a plurality of devices are provided in each of the areas A and B.

  In the imaging area A, devices related to the reception unit 1 and the imaging unit 2 are provided. The receiving unit 1 includes a coin slot, a touch panel display, a speaker, and the like provided toward the outside of the shooting area A. Each component included in the receiving unit 1 is connected to a control mechanism described later. The accepting unit 1 outputs a control signal to the control mechanism when accepting insertion of a predetermined fee at the coin slot, and outputs information corresponding to the operation accepted on the touch panel display to the control mechanism.

  The photographing unit 2 includes a camera 21, a display 22, a lighting device group 23, and a speaker 24 that are installed inward on a wall surface inside the photographing area A. The camera 21 of the photographing unit 2 uses a digital camera having a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and outputs image data obtained by photographing, and also outputs a video signal for monitoring. It has the function to do. Each component included in the imaging unit 2 is connected to a control mechanism described later.

  In the editing area B, devices related to the editing unit 3 and the printing unit 4 are provided. The editing unit 3 includes a device in which a multi-touch panel display for displaying an operation screen is exposed at the center of the editing area B to a height at which the user can easily operate from the casing. The editing unit 3 further includes a speaker, a lighting device, and a touch pen for displaying the operation screen. Each component included in the editing unit 3 is connected to a control mechanism described later. The editing unit 3 accepts a graffiti operation on an image based on the photographed image obtained by the photographing unit 2 with a display and a touch pen, and outputs information corresponding to the accepted operation to the control mechanism.

  The printing unit 4 includes a printer provided in the housing of the apparatus included in the editing unit 3 in the editing area B. The printing unit 4 further includes a touch panel display for displaying the customer service screen and a speaker on the surface of the housing. Each component included in the printing unit 4 is connected to a control mechanism described later. The printing unit 4 receives an operation from the user on the touch panel display, and outputs information corresponding to the received operation to the control mechanism. The photo sticker sheet output from the printer is discharged from the discharge port provided on the surface of the housing.

  The shooting game machine includes the reception unit 1, the shooting unit 2, the editing unit 3, and the printing unit 4 described above in a range that is visible to the user in the shooting area A and the editing area B, and on the wall surface inside the shooting area A. A communication unit 5 and a control mechanism using a personal computer (hereinafter referred to as a personal computer (PC)) are provided in a hidden portion or in the housing of the device in the editing area B.

  The communication unit 5 is connected to an external network such as the Internet to realize data transmission / reception. The communication unit 5 is connected to a control mechanism, and the control mechanism can communicate with a server device on an external network via the communication unit 5 to transmit and receive data. In the shooting game machine according to the present embodiment, the communication unit 5 transmits image data obtained by shooting to the server device, and the user captures and edits an image that the user has shot and edited from the server device, such as a mobile phone (smartphone) or a PC. It is possible to obtain it by downloading it to a terminal device.

  The control mechanism includes a PC that controls each hardware described above, a control board including a bus 100 to which each hardware is connected, and a power supply unit (not shown) that supplies power to each hardware. Different PCs may be used for each control target, such as a PC that controls the reception unit 1, a PC that controls the photographing unit 2, a PC that controls the editing unit 3, and a PC that controls the printing unit 4. Then, all may be controlled by one PC. In the following description, in order to mainly explain image processing for an image, a first PC corresponding to a control unit 6 that controls processing in the reception unit 1 and the imaging unit 2 and an image obtained by the imaging unit 2 are virtually described. A description will be given separately to the second PC corresponding to the image processing unit 7 that performs image processing, controls the editing by the editing unit 3 for the image after image processing, and instructs printing output in the printing unit 5.

  The control unit 6 includes a CPU (Central Processing Unit) 60, a memory 61, an HDD (Hard Disk Drive) 62, and a capture / chroma keyboard 63 provided in the first PC. As the memory 61, a RAM such as a DRAM (Dynamic Random Access Memory) or an SDRAM (Synchronous DRAM) is used, and a flash memory or another nonvolatile storage device such as an SSD (Solid State Drive) may be used instead of the HDD 62. .

  The CPU 60 reads the control program 6P stored in the HDD 62, and executes the control program 6P while reading / writing various information in the memory 61, thereby realizing the following functions. The CPU 60 accepts a predetermined fee at the accepting unit 1, displays an image on the display, accepts an input operation, and outputs sound from the speaker. The CPU 60 inputs the monitor video signal obtained from the camera 21 to the capture / chroma keyboard 63 and obtains it as a plurality of frame images. Based on the obtained images, the CPU 60 creates an image signal of an image for a live screen. The processed image signal is output to the display 22. Further, the CPU 60 outputs a screen image signal for notifying the user of the start of shooting and guidance to the display 22, and outputs an audio signal to the speaker 24.

  The CPU 60 performs shooting by synchronizing shooting by the camera 21 of the shooting unit 2 and flash lighting by the illumination device group 23. At this time, the CPU 60 controls to adjust the angle of view of the camera 21 so as to perform shooting at different angles of view for up-shooting and whole-body shooting. For example, in up-shooting, shooting is performed from the vicinity of the user's waist to the vicinity of the head in the imaging range. In whole-body imaging, imaging is performed in an imaging range that includes the whole body. Note that a photographed image photographed by the up photographing and a photographed image photographed by the whole body photographing are distinguished by the image size. At this time, the CPU 60 may add identification information so as to distinguish between the up-captured image data and the whole-body-captured image data, and store the identification information in the HDD 62. For example, numbers such as 1 to 4 or symbols such as A to D are used for up-captured image data, and numbers such as 5, 6 or symbols such as E and F are used for whole-body captured image data. The photographing unit 2 may execute photographing called special photographing such as applying a predetermined filter. The CPU 60 acquires image data of an image obtained by photography from the camera 21, stores the acquired image data in the HDD 62, duplicates it, and outputs it to the image processing unit 7.

  The HDD 62 stores various information referred to by the CPU 60. The HDD 62 stores a control program 6P executed by the CPU 60 in advance. The HDD 62, in addition to the control program 6P, images and font data to be displayed on the display of the reception unit 1, background images to be displayed on the display 22 together with the captured image, audio to be output by the speaker of the reception unit 1 and the speaker 24 of the shooting unit 2. Such data is stored in advance. The HDD 62 stores image data obtained by taking a picture with the camera 21.

  The capture / chroma keyboard 63 is a circuit board having a capture function and a chroma key function. The capture function is a function that acquires and outputs, for example, 30 (29.97) frame images per second from the video signal. The chroma key function extracts pixels that are determined to have a predetermined color tone and brightness within a certain range from each captured still image, and makes the transparency by setting an α value (transparency) for the extracted pixels. It is a function to output. The capture / chroma keyboard 63 sequentially captures frame images from the monitor video signal from the camera 21 and writes the still images after executing the chroma key processing into a built-in memory (not shown). The CPU 60 sequentially reads still images from the memory built in the capture / chroma keyboard 63 and creates an image signal of an image for a live screen.

  The image processing unit 7 includes a CPU 70, a memory 71, an HDD 72, and a graphic board 73 provided in the second PC. The memory 71 uses a RAM such as DRAM or SDRAM.

  The CPU 70 reads the image processing program 7P stored in the HDD 72, and executes image processing based on the image processing program 7P while reading / writing various information from / to the memory 71. Further, the CPU 70 stores the image data output from the control unit 6 in the memory 71 or the HDD 72 together with the assigned identification information, and performs a processing process based on the image data. The processing includes processing to make the face of the person in the image a small face, processing to gloss the hair, processing to brighten the hair color, processing to enlarge the eyes, processing to make the body line appear thin, legs Various processes such as a process for making the image look longer are included. Further, the CPU 70 performs automatic trimming on the image of the image data based on the image processing program 7P. Details of the automatic trimming will be described later. Further, the CPU 70 accepts a graffiti operation with the display and the touch pen in the editing unit 3 for an image based on the image data stored in the HDD 72. The CPU 70 executes a process of creating a composite image according to the contents of the accepted operation, and further executes a process of printing out a photo sticker sheet and a process of transmitting the composite image from the communication unit 5 to the external server device. .

  The HDD 72 stores various information referred to by the CPU 70. The HDD 72 stores an image processing program 7P executed by the CPU 70 in advance. The HDD 72 stores data such as guidance characters and images to be displayed on the display of the editing unit 3, characters or images that are composition materials, and voices to be output by a speaker in advance. Similarly, the HDD 72 stores in advance data such as guidance characters and images to be displayed on the display for the subsequent customer service screen, and voice output by the speaker. Further, the HDD 72 stores in advance setting information 721 including various threshold values to be referred to in image processing. The setting information 721 includes information on a plurality of frames in the image that is referred to during the trimming range determination process described later. The setting information 721 can be rewritten. Also, the HDD 72 stores an image obtained by the processing process and image data of the synthesized image.

  The graphic board 73 is hardware that draws an image based on the received image and a drawing command. The CPU 70 uses the graphic board 73 to perform image processing on the image data acquired from the control unit 6 and stored in the memory 71. Specifically, the CPU 70 gives image data and a drawing command accompanying the image processing to the graphic board 73 to perform the drawing processing, and the image data of the image obtained by the drawing processing is received from a board built-in memory (not shown). read out. The drawing process includes the above-described chroma key function, trimming function, alpha conversion function, adjustment function such as brightness or color tone, and composition function.

  FIG. 3 and FIG. 4 are flowcharts showing an example of the overall processing executed in the shooting game machine of the present embodiment. The processing procedure performed by the control unit 6 and the processing procedure performed by the image processing unit 7 will be described separately. FIG. 3 is a flowchart illustrating an example of a processing procedure executed by the control unit 6.

  The CPU 60 of the control unit 6 causes the reception unit 1 to display the guidance of the shooting game machine on the display and output a guidance voice from the speaker (step S101) to determine whether or not a predetermined fee has been inserted (step S101). S102). If the CPU 60 determines that the predetermined fee has not yet been charged (S102: NO), it returns the process to step S101.

  When the CPU 60 determines that the predetermined fee has been inserted (S102: YES), the CPU 60 accepts the selection of the shooting mode on the display of the accepting unit 1 (step S103). The CPU 60 determines whether or not the photographing area A is vacant (step S104). If the CPU 60 determines that the photographic area A is not vacant (S104: NO), the CPU 60 displays a guidance screen for prompting standby on the display of the reception unit 1. The guidance voice is output from the speaker (step S105), and the process returns to step S104.

  When the CPU 60 determines that the shooting area A is empty (S104: YES), the CPU 60 displays a guidance screen that prompts the user to move into the shooting area A on the display of the receiving unit 1 and outputs a guidance voice (step). S106).

  Next, the CPU 60 causes the display 22 of the photographing unit 2 to display a guidance screen for photographing contents in the photographing area A, outputs guidance sound from the speaker 24, and performs live for up photographing based on the video signal from the camera 21. A screen is displayed (step S107). When displaying the live screen, the CPU 60 trims a still image based on the video signal from the camera 21 within a preset trimming range. At this time, the CPU 60 displays an image indicating a countdown until the start of the up-shooting to be executed first, and outputs a countdown sound.

  The CPU 60 controls the camera 21 and the illumination device group 23 of the photographing unit 2 to execute up-shooting (step S108), and stores image data of the up-shot image obtained by the up-shooting in the HDD 62 (step S109). The CPU 60 creates a preview screen for confirmation based on the up-captured image data and displays it on the display 22 (step S110). Note that up-shooting is performed a total of four times, and steps S108 to S110 are repeated four times. As a result, the CPU 60 stores the four up-captured image data in the HDD 62.

  The CPU 60 causes the display 22 to display a guidance screen for whole body photography, to output guidance voice from the speaker 24, and to display a live screen for whole body photography based on the video signal from the camera 21 (step S111). At this time, the CPU 60 outputs a sound indicating the user's standing position, displays an image indicating a countdown until the start of whole body imaging, and outputs a countdown sound.

  The CPU 60 controls the camera 21 and the illumination device group 23 of the photographing unit 2 to execute whole body photographing (step S112), and stores image data of the whole body photographing image obtained by whole body photographing in the HDD 62 (step S113). The CPU 60 creates a preview screen for confirmation based on the image data obtained by whole body photography and displays it on the display 22 (step S114). Note that whole body imaging is performed twice in total, and steps S112 to S114 are repeated twice. As a result, the CPU 60 stores the two whole-body photographed image data in the HDD 62.

  The CPU 60 determines whether or not the editing area B is vacant (step S115). If the CPU 60 determines that the editing area B is not vacant (S115: NO), the CPU 60 displays a guidance screen for prompting standby on the display unit 2 of the photographing unit 2. The guidance voice is output from the speaker 24 (step S116), and the process returns to step S115.

  When the CPU 60 determines that the editing area B is empty (S115: YES), the CPU 60 causes the display 22 to display a guidance screen that prompts the user to move to the editing area B, and outputs a guidance voice from the speaker 24 (step S117). Then, the process in the shooting area A ends.

  In addition to the processing procedure described above, after step S114, the CPU 60 performs control to execute guidance display and sound output for special shooting, such as applying a predetermined filter, shooting execution, and preview display. Also good.

  FIG. 4 is a flowchart illustrating an example of a processing procedure executed by the image processing unit 7. The processing procedure shown below is started by the image processing unit 7 simultaneously in the background after step S108 in the flowchart of FIG. 3 so that the processing proceeds while the movement guide screen is displayed in the editing area B. Executed.

  The CPU 70 of the image processing unit 7 acquires the image data stored in the HDD 62 by the control unit 6 (step S201). Specifically, in step S201, the CPU 60 of the control unit 6 reads out from the HDD 62 and stores it in the HDD 72 so that the CPU 70 can read out, or the CPU 70 directly reads out image data from the HDD 62. The When the control unit 6 and the image processing unit 7 are realized by different PCs, the image data may be written to a common storage device (not shown) and read by the CPU 70. You may implement | achieve by transmitting / receiving image data between the control part 6 and the image process part 7 by communication.

  The CPU 70 executes processing for the image based on the acquired image data (step S202). In step S <b> 202, the CPU 70 performs processing suitable for the up-shooting and the whole-body shooting on each of the four up-shot image data and the two whole-body shot image data. As described above, the processing includes processing to make the face small, processing to make the hair gloss, processing to lighten the hair color, processing to enlarge the eyes, processing to make the body lines appear thin, and to make the legs longer Processing to be shown is included, but each processing does not have to be completed in step S202. For example, processing for making a small face is completed, but for processing for enlarging eyes, pre-processing for each processing is performed, processing processing is performed at the time of combining processing described later, and processing for leg length processing is performed Run before.

  Next, the CPU 70 performs a process of extracting a person subject area based on the acquired image data (step S203). Specifically, in step S203, the CPU 70 uses the graphic board 73 to extract pixels that are determined to have a predetermined color tone and brightness within a certain range from images based on a total of six image data, and other than the extracted pixels. A mask image obtained by converting the pixels corresponding to the person region in which the person subject is imaged into α (transparent) is created.

  The CPU 70 performs a process of determining an image trimming frame for each of the six image data based on the person subject area extracted in step S203 (step S204), and performs trimming (step S205). Details of the process for determining the trimming frame will be described later.

  The CPU 70 displays a screen for editing guidance in the editing unit 3 on the display of the editing unit 3 and outputs a guidance voice from the speaker (step S206). Note that the captured image after trimming in step S205 is displayed on the editing guidance screen displayed in step S206. At this time, the CPU 70 may display the captured image after receiving selection of information related to the processing process such as the size of the eyes.

  The CPU 70 accepts a graffiti operation in the editing unit 3 (step S207), and accepts a selection of a layout or the like on the photograph sticker sheet of the combined image (step S208). The CPU 70 synthesizes the photographed image and the character or image based on the graffiti operation accepted in step S207, and executes a composition process for laying out the photograph sticker sheet based on the accepted selection (step S209).

  The CPU 70 displays a preview screen of the composite photo sticker sheet on the display of the editing unit 3 (step S210), determines whether the printer of the printing unit 4 is not in use (step S211), and is in use. When it is determined that there is (S211: YES), a guidance screen prompting standby is displayed on the display of the editing unit 3, and guidance voice is output from the speaker 24 (step S212), and the process returns to step S211.

  When the CPU 70 determines that it is not in use (S211: NO), the CPU 70 displays a guidance screen prompting the user to move the printing unit 4 forward on the display of the editing unit 3 and outputs a guidance voice (step S213). The CPU 70 causes the printer of the printing unit 4 to start print output of the photo sticker sheet (step S214), and a destination such as an address for executing image data transmission to the user's mobile phone during the print output process. An information input guidance screen is displayed on the display of the printing unit 4 and a guidance voice is output (step S215). The CPU 70 accepts an input operation on the display of the printing unit 4 (step S216), stores the input transmission destination information in the HDD 72 (step S217), and transmits image data of the photo sticker sheet from the communication unit 5 as necessary. The data is transmitted to the external server device (step S218), and the process ends.

  By performing the processing as described above, the user can enjoy the photographing itself in the photographing amusement machine and obtain the printed sticker sheet and the image data via the external server device.

  FIG. 5 is a schematic diagram showing an example of the contents of a photographic sticker sheet obtained by the photographing amusement machine in the present embodiment. As shown in FIG. 5, the photograph sticker sheet includes four up-captured images and two whole-body-captured images. In the example of contents shown in FIG. 5, an up-captured image and a whole-body-captured image edited according to the effects set in the shooting game machine are used.

  In the photographing amusement machine according to the present embodiment, automatic trimming is performed by the image processing unit 7 in order to make the up-captured image and the whole-body captured image used for the photo sticker sheet suitable images that the user satisfies ( S205). A suitable image is an image that has been trimmed so that a blank space outside the person area exists to the extent that it feels aesthetic (see image in FIG. 5). Thereby, a photograph sticker sheet can be made into the printed matter which makes a viewer feel the atmosphere as the production | presentation set as the imaging | photography game machine, and a user's expectation degree and satisfaction can be improved.

  In order for the image processing unit 7 to perform automatic trimming, the setting information 721 stored in advance in the HDD 72 of the image processing unit 7 includes frame information for determining a trimming range. The setting information 721 is stored as an “INI file” in which various threshold values, frame information, and the like are described in text. The frame information is information indicating the position and size of frames with different sizes in the image. For example, the coordinate information of each frame in the image corresponds to the position (v, h), width (width), and height (height) of the pixel corresponding to the reference point (upper left or center) of the frame. This is information on the number of pixels. 6 and 7 are explanatory diagrams illustrating an example of the contents of the frame information stored in the image processing unit 7. 6 and 7 illustrate a case where all of a plurality of frames based on the frame information are drawn in the image so that the height direction of the user is the vertical direction.

  FIG. 6 shows frame information for the whole-body photographed image. A symbol W in FIG. 6 indicates an outer frame of an image based on image data obtained from the camera 21 by whole body photography. The frame information for the whole-body photographed image indicates coordinate information of the frames WF1 to WF9 illustrated in FIG. As shown in FIG. 6, the frames WF1 to WF9 have a nested structure, and when any two frames are selected, the other frame is set to be included in one frame. The frames WF1 to WF9 coincide with the aspect ratio 16: 9 of the trimming range of the whole-body photographed image in order to use the trimming range as a reference. Further, the frames WF1 to WF 9 are different in the vertical direction by about 50 pixels (pixels) between the inner frame and the outer frame. Note that the aspect ratio of the trimming range of the whole-body photographed image matches the aspect ratio of the whole-body photographed image printed on the photographic sticker sheet shown in FIG. This is because after the image processing unit 7 trims the whole-body captured image in step S205, it is possible to perform image processing while maintaining the ratio, and it is not necessary to change the ratio for print output and transmission.

  FIG. 7 shows frame information for the up-captured image. 7 indicates an outer frame of an image based on image data obtained from the camera 21 by up-shooting. The frame information for the up-captured image indicates coordinate information of the frames UF1 to UF5 illustrated in FIG. As illustrated in FIG. 7, the frames UF <b> 1 to UF <b> 5 have a nested structure, and are set so that the other frame is included in one frame when any two frames are selected. The frames UF1 to UF5 match the trimming range aspect ratio 1.2: 1 of the up-captured image in order to use the trimming range as a reference. Further, the frames UF1 to UF5 are different from each other by about 100 pixels (pixels) in the vertical direction between the inner frame and the outer frame. Also in the up-captured image, the aspect ratio of the trimming range is made to coincide with the aspect ratio of the up-captured image printed on the photographic sticker sheet shown in FIG.

  Of course, the frame information used by the image processing unit 7 is not limited to the content examples in FIGS. 6 and 7. In the example of the frame information shown in FIGS. 6 and 7, the plurality of frames have a nested structure, and in any two of the plurality of frames, one frame is included in the other frame. is there. Thereby, the area | region corresponding between frames is easy to be specified, and the arithmetic processing which concerns on judgment whether it is in the predetermined range is simplified. However, the plurality of frames may intersect if most of the regions in the frame overlap. The plurality of frames may be a plurality of frames having the same size and shifted positions. In the example of the frame information shown in FIG. 6, the plurality of frames are all rectangular frames having an aspect ratio of 16: 9 and are in a similar relationship. In the example of the frame information shown in FIG. 7, the plurality of frames are all rectangular frames having an aspect ratio of 1.2: 1 and are in a similar relationship. However, the plurality of frames may not have a similar relationship. The shape may be not only a rectangular frame but also an arbitrary two-dimensional shape, and the plurality of frames may be different from each other.

  A processing procedure in which the image processing unit 7 determines a trimming range using setting information 721 including frame information will be described with reference to a flowchart. FIG. 8 and FIG. 9 are flowcharts showing an example of processing procedures for trimming determination executed in the present embodiment. The processing procedure shown in the flowcharts of FIGS. 8 and 9 corresponds to the details of step S204 of FIG. The CPU 70 executes the process described below for each of the total six pieces of image data of the acquired up-captured image data and whole-body captured image data.

The CPU 70 selects image data (step S301), and specifies whether the selected image data is up-captured image data or whole-body captured image data (step S302). In step S302, the CPU 70 can specify whether the image data is the up-captured image data or the whole-body-captured image data according to the image size of the selected image data.
Note that the CPU 70 may specify whether it is up-captured image data or whole-body-captured image data based on identification information given to the selected image data.

  The CPU 70 reads setting information 721 including various threshold values and frame information stored in the HDD 72 according to the photographing method specified in step S302 (step S303). The CPU 70 acquires a mask image for the human subject area extracted for the currently selected image data (step S304).

  The CPU 70 determines whether or not the selected image data is whole body photographed image data (step S305). If the CPU 70 determines that the selected image data is whole body photographed image data (S305: YES), the process proceeds to the next step S306. Proceed.

  The CPU 70 extracts pixels located outside in the horizontal direction from the specific frame in the human subject area in the selected image data (step S306). Here, the specific frame corresponds to a range in which the CPU 60 of the control unit 6 that controls the photographing unit 2 trims a still image based on the video signal from the camera 21 when the live screen is displayed on the display 22. . The determination in step S306 is that the user becomes a subject while checking the live screen, so the body part that appears outside the live screen may be slightly outside the trimming range, but the body part that appears outside the live screen It is based on the premise that it should not be ignored when the number of parts is larger than a predetermined ratio. As a result, when three or more persons perform whole body photographing, it is possible to avoid that most of them are out of the trimming range by mistake. The specific frame is not necessarily the trimming range of the live screen.

  In step S306, the CPU 70 is located on the inner side of the outermost frame WF1 among the frames WF1 to 9 indicated by the setting information 721 from the mask image acquired in step S304 and in the vertical direction of the specific frame WF5 ( Pixels located outside the line in the vertical direction of the person area are extracted. FIG. 10 is an explanatory diagram for explaining the processing in step S306. In FIG. 10, the whole body captured image frames WF1 to WF9 are partially omitted, and a frame WF5 that is a specific frame is indicated by a bold line. In FIG. 10, a range that is inside the outermost frame WF1 and outside the line in the vertical direction of the specific frame WF5 (the vertical direction of the person area) is indicated by hatching. . The CPU 70 extracts pixels corresponding to the hatched portions in FIG. 10 from the mask image.

  CPU70 extracts the pixel whose pixel value is alpha value (for example, 255) among the extracted pixels (step S307). The pixel whose pixel value is the α value is a pixel that has been converted to α in order to specify the person subject area in the mask image, and is located at a position included in the person subject area. The CPU 70 determines whether or not the ratio (or the number of pixels) of the pixels extracted in step S307 out of the pixels extracted in step S306 is equal to or greater than a predetermined threshold (predetermined ratio or predetermined number of pixels) for lateral determination. Is determined (step S308).

  In step S308, the CPU 70 has a predetermined ratio (for example, 4%) that is equal to or greater than a predetermined threshold for horizontal determination, that is, the ratio of pixels located outside the specific frame in the horizontal direction within the human subject region. If it is determined that it cannot be ignored (S308: YES), the process proceeds to the next step S309. Note that in step S308, it is determined only whether there is a pixel with a pixel value of α value, and based on the above assumption, processing is performed on the assumption that the part that appears outside the live screen in the horizontal direction should be ignored. May be advanced to step S321.

  The CPU 70 sets the flag indicating whether or not the trimming range reference frame has been found to OFF and stores it in the memory 71 (step S309).

  The CPU 70 selects one of the frames WF1 to WF 9 indicated by the setting information 721 in order from the outside (step S310). In the mask image acquired in step S304, the CPU 70 selects the selected frame and one frame inside the frame. An area corresponding to the interval is specified (step S311).

  The CPU 70 extracts the pixel value of the pixel located in the specified area (step S312), and calculates the ratio of the pixel whose pixel value is the α value (for example, 255) to the total number of pixels in the specified area ( Step S313). The CPU 70 determines whether or not the calculated ratio is equal to or greater than a predetermined threshold value (for example, 5%) read in step S303 (step S314). Note that the ratio may not be calculated in step S313, and the number of pixels whose pixel value is an α value may be maintained. In step S314, it may be determined whether or not the number is equal to or greater than a predetermined number.

  If the CPU 70 determines in step S314 that the frame is equal to or greater than the predetermined threshold (S314: YES), it stores selection frame information indicating which frame is being selected (step S315), and turns on the flag. The setting is made (step S316), and the process proceeds to step S318.

  If the CPU 70 determines that it is less than the predetermined threshold value in step S314 (S314: NO), it determines whether all the frames have been selected (step S317). In step S317, when the WF8 that is one outer side than the innermost WF9 has been selected, the CPU 70 determines that all the frames have been selected. If the CPU 70 determines in step S317 that there is an unselected frame (S317: NO), the process returns to step S310 to select one inner frame and continue the process.

  When determining that all the frames have been selected in step S317 (S317: YES), the CPU 70 determines whether or not a flag indicating whether or not a reference frame in the trimming range has been found is on. (Step S318).

  If the CPU 70 determines that the flag is on (S318: YES), the CPU 70 determines a trimming range that is a predetermined number of pixels larger than the frame indicated by the stored selection frame information (step S319), and the trimming range. The decision process is terminated. Thereby, the process returns to step S205 of the flowchart of FIG.

  In step S319, a range larger by a predetermined number of pixels is set as a trimming range. This is to prevent the margin at the top of the person subject area from being unnecessarily reduced. The inventors have empirically obtained knowledge that, for example, a suitable result can be obtained when the range is large enough to be one to three outer frames.

  If the CPU 70 determines that the flag is off (S318: NO), the CPU 70 determines a frame that is one outermost than the innermost side as a trimming range (step S320), and ends the trimming range determination process.

  In step S308, the CPU 70 determines that the ratio of pixels located outside the specific frame in the lateral direction within the human subject area is less than the predetermined ratio and can be ignored. If so (S308: NO), the process proceeds to the next step S321.

  The CPU 70 sets the flag indicating whether or not the trimming range reference frame has been found to OFF and stores it in the memory 71 (step S321).

  The CPU 70 selects one of the frames WF1 to WF 9 indicated by the setting information 721 in order from the outside (step S322). In the mask image acquired in step S304, the CPU 70 selects the selected frame and a frame inside the frame. Among the intervening regions, the region of the upper part in the vertical direction of the human subject is specified (step S323). FIG. 11 is an explanatory diagram for explaining the processing in step S323. In FIG. 11, the whole-body captured image frames WF1 to WF9 are partially omitted. In FIG. 11, the upper part in the vertical direction of the human subject in the area between the outermost frame WF1 and the one inner frame WF2 is indicated by hatching. When the CPU 70 selects WF1 in step S322, in step S323, the CPU 70 extracts a pixel corresponding to the hatched portion in FIG. 11 from the mask image.

  The CPU 70 extracts the pixel value of the pixel located in the specified area (step S324), and calculates the ratio of the pixel whose pixel value is the α value (for example, 255) to the total number of pixels in the specified area ( Step S325). The CPU 70 determines whether or not the calculated ratio is equal to or higher than a predetermined threshold for determining the upper part for each imaging method read in step S303 (for example, 0.1% for the whole body image and 0.5% for the up image). Is determined (step S326). It should be noted that the ratio may not be calculated in step S325, and the number of pixels whose pixel value is an α value may be maintained. In step S326, it may be determined whether or not the number of pixels is equal to or greater than a predetermined number.

  In step S326, the predetermined threshold value differs between the whole-body photographed image and the up-captured image. By differentiating the threshold value depending on the shooting method in this way, an image obtained by any of the shooting methods is suitable for the whole-body shot image and the up-shot image depending on the difference in the area of the margin that makes it feel high in aesthetics. Can be obtained.

  When the CPU 70 determines in step S326 that the frame is equal to or greater than the predetermined threshold (S326: YES), the CPU 70 stores selection frame information indicating which frame is being selected (step S327), and turns on the flag. The setting is made (step S328), and the process proceeds to step S318.

  When CPU 70 determines in step S326 that it is less than the predetermined threshold (S326: NO), CPU 70 determines whether or not all frames have been selected (step S329). In step S329, if the WF8 that is one outer side than the innermost WF9 has been selected, the CPU 70 determines that all the frames have been selected. If the CPU 70 determines in step S329 that there is an unselected frame (S329: NO), it returns the process to step S322, selects the one inner frame, and continues the process.

  CPU70 advances a process to step S318, when it is judged that all the frames were selected in step S329 (S329: YES).

  If the CPU 70 determines in step S305 that it is up-captured image data (S305: NO), the process proceeds to step S321, and the processes after step S322 are similarly executed. Note that the number of frames selected in step S322 is one in order from the outside of the frames UF1 to UF5 indicated by the setting information 721 for the up-captured image. In step S329, if one outer frame UF4 is selected from the innermost frame UF5, it is determined that all the frames have been selected.

  By performing the above-described processing by the image processing unit, a suitable trimming range is determined for images in up-shooting and whole-body shooting. Hereinafter, the effect will be described by giving an example of the determined trimming range. 12 to 30 are explanatory diagrams for explaining the process of obtaining an image with the photographing amusement machine according to the present embodiment, among which FIGS. 15, 18, 21, 24, 27 and FIG. 30 shows an example of the content of an image obtained by the shooting game machine in the present embodiment.

  12 schematically shows an example of the whole body image, FIG. 13 shows a mask image acquired for the whole body image shown in FIG. 12, and FIG. 14 shows frames WF1 to 9 for the whole body image shown in FIG. Indicates the position. Due to the processing of the CPU 70 of the image processing unit 7, there is no pixel of α value that is a part of the person subject area outside the frame image WF 5 that is a specific frame in the lateral direction with respect to the mask image of FIG. It is determined that the ratio of the pixels having the α value is less than a predetermined threshold for lateral determination (S308: NO). Then, it is determined whether or not the person subject area is included only in the upper part of the area between the frames as shown in FIG. By the processing of the CPU 70 of the image processing unit 7, a frame is selected inward from the frame WF1 in order with respect to the mask image of FIG. 13, and the upper part of the area between the frame WF1 and the one inner frame WF2 It is determined whether or not the pixel having the α value in the area is equal to or greater than a predetermined threshold value for determining the upper part (S326). In the whole-body photographed image of FIG. 12, when the frame WF6 is selected, a pixel having an α value in the upper region of the region between the frame WF6 and the frame WF7 is a predetermined upper determination. It is determined that the value is equal to or greater than a threshold (for example, 0.1%) (S326: YES), and the frame WF6 is stored (S327). The CPU 70 of the image processing unit 7 determines a trimming range (for example, the frame WF5) that is larger than the frame WF6 by a predetermined number of pixels (S319), and executes trimming (S205). Thereby, a whole-body photographed image as shown in the content example of FIG. 15 is obtained. When the image shown in FIG. 12 is directly combined with a photographic sticker sheet as shown in FIG. 5 as a whole-body photographed image, the face of the person subject area in the image becomes too small, and a favorable result is not obtained. However, the trimmed whole-body photographed image in FIG. 15 is suitable when the balance between the human subject area and the margin is combined with the photo sticker sheet.

  FIG. 16 schematically shows another example of the whole body photographed image, and FIG. 17 shows the positions of the frames WF1 to WF with respect to the whole body photographed image of FIG. The mask image acquired for the whole-body photographed image of FIG. 16 by the processing of the CPU 70 of the image processing unit 7 is a part of the person subject area laterally outward from the frame WF5 that is a specific frame. Although there are pixels with an α value, it is determined that the ratio of pixels with an α value is less than a predetermined threshold value for horizontal determination (eg, 4%) (S308: NO). Then, it is determined whether or not the person subject area is included only in the upper part of the area between the frames as shown in FIG. Specifically, in order from the frame WF1, the frame is selected inward, and the pixels having the α value in the upper region in the region between the frame WF1 and the one inner frame WF2 are used for the upper determination. It is determined whether or not the predetermined threshold value is greater than or equal to (S326). In the whole-body photographed image of FIG. 16, as shown in FIG. 17, even when the last frame WF8 is selected, the α value in the upper region in the region between the frames WF8 and WF9 is selected. It is determined that the pixel is less than a predetermined threshold value for determining the upper part (S326: NO). Therefore, it is determined that the already found flag is OFF (S318: NO), and the frame WF8 that is one outer side than the innermost frame WF9 is determined as the trimming range (S320). Thereby, a whole-body photographed image as shown in the content example of FIG. 18 is obtained.

  For example, when the trimming range is determined by determining whether pixels of the person subject area are included on the line of the frames WF1 to 9 sequentially from the outside of the frames WF1 to 9 with respect to the whole body captured image of FIG. It is determined that the pixel of the person subject area is included on the line, and the frame WF1 may be determined as the trimming range. When the frame WF1 is set as the trimming range, the margin above the person subject area is unnecessarily wide and a good result is not obtained. However, in the result obtained by the processing of the image processing unit 7 of the present embodiment, like the whole-body photographed image after trimming in FIG.

  Furthermore, when the whole body photographed image of FIG. 16 is compared with the whole body photographed image of FIG. 12, the height of the user group that is the subject person is low. Further, in the whole-body photographed image of FIG. 16, the standing position of the user group as the subject person is before the standing position of the subject user group of the whole-body photographed image of FIG. Therefore, the balance between the human subject region and the margin differs between the whole body photographed image of FIG. 12 and the whole body photographed image of FIG. However, the whole body photographed image of FIG. 15 obtained by the processing of the CPU 70 of the image processing unit 7 of the present embodiment and the whole body photographed image of FIG. Yes.

  FIG. 19 schematically shows another example of the whole body photographed image, and FIG. 20 shows the positions of the frames WF1 to WF with respect to the whole body photographed image of FIG. The mask image acquired for the whole-body photographed image of FIG. 19 by the processing of the CPU 70 of the image processing unit 7 is a part of the person subject area outside the specific frame WF5 in the lateral direction. It is determined that there is no α-value pixel and the ratio of α-value pixels is less than a predetermined threshold for lateral determination (S308: NO). Then, in order from the frame WF1, a frame is selected inward, and an α value pixel in the upper region of the region between the frame WF1 and the one inner frame WF2 is a predetermined upper determination. It is determined whether or not the threshold value is exceeded (S326). In the whole-body photographed image of FIG. 19, when the frame WF2 is selected, the pixel that is the α value in the region between the frames WF2 and WF3 is equal to or greater than a predetermined threshold (for example, 0.1%). The determination is made (S326: YES), and the frame WF2 is stored (S327). The CPU 70 of the image processing unit 7 determines a trimming range larger than the frame WF2 by a predetermined number of pixels (S319), and executes trimming (S205). Thereby, a whole-body photographed image as shown in the content example of FIG. 21 is obtained. The trimmed whole-body photographed image in FIG. 21 is suitable when the balance between the human subject area and the margin is combined with the photographic sticker sheet.

  When the whole body photographed image of FIG. 19 is compared with the whole body photographed image of FIG. 12, the height of the user group that is the subject person is high. Therefore, the balance between the human subject area and the margin differs between the whole body photographed image of FIG. 12 and the whole body photographed image of FIG. However, the upper margin of the whole body photographed image of FIG. 15 obtained by the processing of the CPU 70 of the image processing unit 7 of the present embodiment and the whole body photographed image of FIG.

  The effect of trimming based on the trimming range determined by the CPU 70 of the image processing unit 7 is prominent when the result for the whole body photographed image in FIG. 16 is compared with the result for the whole body photographed image in FIG. For example, when the whole-body photographed image of FIG. 16 and the whole-body photographed image of FIG. 19 are directly combined with the photographic sticker sheet, the margins are completely different, which is not good. Even if the image is trimmed with the fixed frame WF5, the balance between the human subject area and the margin in the whole-body captured image obtained is greatly different. However, the whole body photographed image of FIG. 18 and the whole body photographed image of FIG. 21 have the same margin in particular above the person subject area. As described above, in the present embodiment, a suitable result can be obtained regardless of the difference in the height and the standing position by the trimming range determined by the CPU 70 of the image processing unit 7. As a result, it is possible to obtain a result as produced in the shooting game machine and to improve the satisfaction of the user.

  FIG. 22 schematically shows another example of the whole body photographed image, and FIG. 23 shows the positions of the frames WF1 to WF with respect to the whole body photographed image of FIG. The mask image acquired for the whole-body photographed image of FIG. 22 by the processing of the CPU 70 of the image processing unit 7 is a part of the person subject region laterally outside the frame WF5 that is a specific frame. It is determined that there is an α-value pixel and the ratio of the α-value pixel is less than a predetermined threshold for horizontal determination (S308: NO). Then, as shown in FIG. 11, it is determined whether or not the person subject area is included only in the upper part of the area between the frames (S326). Specifically, pixels are selected inward from the frame WF1 inward, and when the frame WF6 is selected, pixels having an α value in the upper region in the region between the frames WF6 and WF7. Is greater than or equal to a predetermined threshold value for upper determination (S326: YES), and the frame WF6 is stored (S327). The CPU 70 of the image processing unit 7 determines a trimming range larger than the frame WF6 by a predetermined number of pixels (S319), and executes trimming (S205). Thereby, a whole-body photographed image as shown in the content example of FIG. 24 is obtained.

  When the whole-body photographed image of FIG. 22 is compared with the whole-body photographed image of FIG. 12, the user group that is the subject person is the same. However, in the whole-body photographed image of FIG. 22, the user group is photographed in a pose with arms out in the horizontal direction. For example, in order to determine the trimming range by determining whether pixels of the person subject area are included on the line of the frames WF1 to 9 sequentially from the outside of the frames WF1 to 9, for the whole-body photographed image of FIG. Are determined to include pixels in the human subject area. Accordingly, in this case, the frame WF5 is determined as the trimming range, and a whole-body photographed image having different margins is obtained even though the same person is the subject person and the upper margin should be the same. In the present embodiment, the whole body photographed image of FIG. 15 and the whole body photographed image of FIG. 24 have the same margin in particular above the person subject area, and a favorable result is obtained.

  FIG. 25 schematically shows another example of the whole body photographed image, and FIG. 26 shows the positions of the frames WF1 to WF with respect to the whole body photographed image of FIG. The example shown in FIG. 25 is significantly different from the example shown in FIGS. 12, 16, 19, and 22 in that the number of user groups is three. Therefore, as shown in FIG. 25, the range of the person subject area is wide in the horizontal direction. In this case, by the processing of the CPU 70 of the image processing unit 7, the mask image acquired for the whole-body photographed image of FIG. 25 is placed on one side of the person subject area laterally outward from the frame WF5 that is a specific frame. It is determined that there is an α-value pixel that is a part, and the ratio of the α-value pixel is equal to or greater than a predetermined threshold value for lateral determination (eg, 4%) (S308: YES). Then, it is determined how much the person subject area is included in the area between the frames. Specifically, by the processing of the CPU 70 of the image processing unit 7, frames are selected inward from the frame WF1 in order from the mask WF1 in FIG. 25, and between the frame WF1 and the one inner frame WF2. It is determined whether or not the ratio of the pixels having the α value that are part of the person subject area in the area is equal to or greater than a predetermined ratio (S314). In the whole-body photographed image of FIG. 25, when the frame WF6 is selected, it is determined that the α value pixel in the region between the frame WF6 and the frame WF7 is equal to or greater than a predetermined threshold (for example, 5%). (S314: YES), the frame WF6 is stored (S315). The CPU 70 of the image processing unit 7 determines a trimming range (for example, the frame WF5) that is larger than the frame WF6 by a predetermined number of pixels (S319), and executes trimming (S205). Thereby, a whole-body photographed image as shown in FIG. 27 is obtained. In the photographing amusement machine in the present embodiment, the number of user groups is assumed to be two (see FIG. 5), but three or more people can be subject persons. When three or more persons are subject persons, both sides of the area between the frames are also determined as a target of the α value pixel ratio by the above-described processing. As a result, as shown in FIG. 27, it is possible to determine a trimming range in which the margin above the portion corresponding to the head of the person subject area is suitable without excessive lack of the subject person.

  FIG. 28 schematically shows an example of the up-captured image, and FIG. 29 shows the positions of the frames UF1 to UF5 with respect to the up-captured image of FIG. The mask image acquired for the up-captured image of FIG. 28 by the processing of the CPU 70 of the image processing unit 7 includes the human subject area only at the upper part of the area between the frames as shown in FIG. It is determined whether or not. Specifically, when the frame is selected inward from the frame UF1 and when the frame UF4 is selected, the pixels of the α value in the upper region in the region between the frames WF4 and WF5 Is greater than or equal to a predetermined threshold (for example, 0.5%) for the up-captured image (S326: YES), and the frame UF4 is stored (S327). The CPU 70 of the image processing unit 7 determines a trimming range larger than the frame UF4 by a predetermined number of pixels (S319), and executes trimming (S205). Thereby, an up-captured image as shown in the content example of FIG. 30 is obtained. As shown in FIG. 30, in the result obtained by the processing of the image processing unit 7 of the present embodiment, the up-captured image is trimmed to such an extent that the region corresponding to the head is partially missing, and is combined with the photo sticker sheet. In this case, a highly aesthetic result is obtained.

  Thus, in the shooting game machine according to the present embodiment, trimming is automatically performed so that a suitable image can be obtained regardless of the height of the user or the standing position in the shooting space, and the degree of expectation and satisfaction of the user. Can be printed out.

  Note that the trimming range determination process described above is also performed on the preview screen during up-shooting and whole-body shooting. Specifically, the CPU 60 of the control unit 6 performs the above-described trimming range determination process when creating the up shot image preview screen in step S110 and the whole body shot image preview screen in step S114 in the flowchart of FIG. . Note that in up-shooting (4 times in total) and whole-body shooting (2 times in total), the CPU 60 creates a preview screen for each shooting. However, at the time of up-shooting, the trimming range on the preview screen is limited so that it is not significantly different from the trimming range on the live screen.

  Specifically, when displaying a live screen on the display 22, the CPU 60 sets a trimming range for a still image based on a video signal from the camera 21 to the outermost frame UF <b> 1 during up-shooting. On the other hand, when the CPU 60 determines the trimming range as the innermost frame UF5 when creating the preview screen, the trimming range is greatly different between the live screen and the preview screen. In such a case, the user group may feel uncomfortable on the preview screen, move the standing position away from the camera 21 in the next up shooting, and as a result, the face area in the up shot image may be reduced. Therefore, when the CPU 60 determines the trimming range of the preview screen during up-shooting, the trimming range is within the limit. Specifically, the CPU 60 determines to be between the trimming range determined by the processing procedure shown in the flowcharts of FIGS. 8 and 9 and the trimming range on the live screen. For example, even when the CPU 60 determines the frame UF5, the CPU 60 determines the frame UF3 intermediate to the frame UF1 that is the trimming range of the live screen as the trimming frame.

  In the up-captured image, the user group tends to shoot from the distance with respect to the camera 21 in the shooting area A. However, by the above-described trimming range determination process, the resultant photo sticker sheet can be obtained as a result having high aesthetics that is trimmed to such an extent that the region corresponding to the head is partially missing. However, by trimming the trimming range step by step from the live screen to the preview screen and further to the editing screen, the user can be made unaware of the trimming frame, and the user can preview the screen when shooting. It is possible to prevent the standing position from moving further to the rear side after confirming the above.

  In this embodiment, in the flowcharts of FIG. 8 and FIG. 9 and the explanation of the flowcharts, the plurality of frames WF1 to 9 (UF1 to 5) are selected one by one from the outside toward the inside. It has been described that two regions are automatically selected from one inner frame and a corresponding region is specified between the two frames. However, in order to obtain the effect of the present invention, one of the plurality of frames WF1 to WF9 (UF1 to UF5) is selected one by one from the inside toward the outside, and thereby one outer frame is automatically selected. The two may be selected, and a procedure for specifying a corresponding region between the two selected frames may be used. In this case, it is only necessary to determine whether or not the ratio of the pixels having the α value is equal to or smaller than a predetermined threshold, instead of determining whether or not the ratio is equal to or larger than a predetermined threshold. In addition, when one frame is selected, a combination with one inner frame or one outer frame is selected. However, two frames may be selected every several frames, such as every other frame or every other frame.

  It should be understood that the embodiment disclosed above is illustrative in all respects and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

7 Image processing unit 70 CPU (computer)
71 Memory (storage device)
72 HDD (storage device)
721 Setting information (frame information)
74 Graphic board (extraction means)
7P image processing program

Claims (9)

An acquisition unit that acquires image data from a photographing device that captures a human subject; and an extraction unit that extracts a human subject region from an image composed of a plurality of pixels based on the acquired image data. In an image processing apparatus for determining a trimming range including:
Means for previously storing frame information indicating positions and sizes of the three or more frames in the image in a storage device;
Based on the frame information, a selection unit that selects, from the plurality of frames, a set of two frames that overlap within the frame;
A specifying means for specifying an area in one of the two frames and excluding an overlapping portion from the image;
Determining means for determining whether the ratio or the number of pixels of the person subject area in the area specified by the specifying means is within a predetermined range;
When the determination means determines that it is within the predetermined range, the determination means for determining the trimming range based on one or both of the two selected frames and the determination means determine that it is outside the predetermined range In this case, an image processing apparatus comprising: means for reselecting a different set by the selection means. One of any two frames out of the plurality of frames includes the other in the frame,
The selection means is configured to select two frames from the outside of the plurality of frames,
The determination means is configured to determine whether or not the ratio or the number of pixels of the person subject area in the area specified by the specifying means is equal to or greater than a predetermined ratio or the number of pixels. Item 8. The image processing apparatus according to Item 1. One of any two frames out of the plurality of frames includes the other in the frame,
The selection means is configured to select two frames from the inside of the plurality of frames,
The determination means is configured to determine whether or not the ratio or the number of pixels of the person subject area in the area specified by the specifying means is equal to or less than a predetermined ratio or the number of pixels. Item 8. The image processing apparatus according to Item 1. 4. The determination unit according to claim 1, wherein the determination unit determines one of the two selected frames, or one of the outer and inner frames of the one as the trimming range. The image processing apparatus according to any one of the above. 4. The method according to claim 1, wherein the determining unit determines a range that is larger or smaller by a predetermined number of pixels from one of the two selected frames as a trimming range. The image processing apparatus according to one. Horizontal determination means for determining whether or not a part of the person subject area in the horizontal direction exists outside a specific frame of a plurality of frames indicated by the frame information at a predetermined ratio or less. ,
6. The device according to claim 1, wherein when it is determined that the lateral determination unit exists, the specifying unit specifies an upper portion between the two frames as the region. The image processing apparatus described in one. The acquisition means includes means for acquiring a plurality of image data and identifying which of the different image capturing methods was used for each image data,
In the storage device, different frame information is stored in advance for different shooting methods,
The selection means selects a pair of two frames based on the frame information corresponding to the method of capturing the acquired image data,
The image according to any one of claims 1 to 6, wherein the specifying unit is configured to determine whether or not a predetermined range corresponding to a photographing method of the acquired image data. Processing equipment. An acquisition means for acquiring image data from a photographing apparatus for photographing a human subject, an extraction means for extracting a human subject area from an image composed of a plurality of pixels based on the acquired image data, and a means for storing information in a storage device In an image processing method in which an image processing apparatus performs a process of determining a trimming range including the person subject area of the image,
Frame information indicating the position and size in the image of three or more frames is stored in the storage device in advance,
Based on the frame information, a set of two frames that overlap in the frame is selected from the plurality of frames,
From the image, specify an area within one of the two frames and excluding an overlapping portion,
Determining whether the ratio or the number of pixels of the person subject area within the specified area is within a predetermined range;
When it is determined that it is within the predetermined range, the trimming range is determined based on one or both of the two selected frames,
An image processing method comprising: reselecting a frame different from the two selected frames and re-executing the process when it is determined that the value is outside the predetermined range. A computer connected to the imaging device and capable of reading information from a storage device acquires image data from the imaging device, extracts a human subject region from an image composed of a plurality of pixels based on the image data, and the image In a computer program for executing image processing for determining a trimming range including the person subject area of
In the computer,
Reading frame information indicating positions and sizes in the image of three or more frames stored in the storage device;
Selecting a set of two frames that overlap within the frame from the plurality of frames based on the read frame information;
Identifying an area in one of the two frames and excluding an overlapping portion from an image based on the acquired image data;
Determining whether the ratio or the number of pixels of the person subject area within the specified area is within a predetermined range;
Determining a trimming range based on one or both of the two selected frames if determined to be within a predetermined range; and
A computer program characterized by causing a step of re-selecting a set different from the two selected frames when it is determined that it is out of a predetermined range.

Images