JP2008061114A - Automatic photo studio - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce the number of failure photographs as much as possible by photographing a child who is an object at a wide angle and cutting a portion at which the child is photographed from the image photographed at a wide angle, and to acquire a photograph in which the child is photographed vividly. <P>SOLUTION: An automatic photo studio has: a camera for photographing an object as a still image at a wide angle; a person detection means for generating the mask pattern of the object from an image photographed by the camera for photographing and for extracting a flesh color portion from the photographed image to detect the mask pattern in which the flesh color portion exists in the mask pattern as a person pattern; and an automatic trimming means for cutting a portion corresponding to the mask pattern that the person detection means detects as the person pattern from the photographed image to expand the cut partial image to a prescribed image size. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an automatic photo studio that automatically captures an image of a subject (subject image) centered on a child.

  A recent child is said to have six wallets. In recent years, when the number of one child increases and one child marries and a child is born, a total of six parents and grandparents love this one child without paying attention to the money.

  Reflecting this social situation, there are an increasing number of photo studios dedicated to taking pictures of children in various parts of the country. In such a photo studio, a mother can bring a small child and have a photographer take a picture of the child, and the photograph taken can be confirmed on the spot. And if you have taken “good photos” (photos that show the cuteness of the children, photos that show the children ’s liveliness, etc.), you can order the same photos in order to send them to your grandparents. become. For this reason, the photo studio also prepares dress-ups such as princess-like dresses so that you can take pictures with a different image than usual.

  In these photo studios, professional photographers take pictures to take pictures that satisfy users. However, hiring a professional photographer increases the cost of operating a photo studio, which in turn increases the price paid by users.

  Also, it is not easy for professional photographers to take “good photos” of small children (approximately 6 years old or younger). This is because a small child may not be able to understand the meaning of the instruction even if the cameraman instructs the direction of the line of sight and the pose. This is because they usually turn in the direction, and on the contrary, their facial expressions become stiff, and they run around even when they are required to stop.

  Rather, the fact that there are strange photographers other than mothers makes it difficult for small children to relax and to take “good photos”.

  Recently, an automatic photo studio system has been proposed in order to reduce the above-described operating costs and to perform shooting in a relaxed atmosphere by eliminating other people such as a photographer.

  The automatic photo studio system is a photo studio equipped with an automatic photo studio, photo editing equipment and printing device, and users can take photos of their children without worrying about others' eyes in the auto photo studio. You can shoot and use the photo editing equipment to edit the photo you took, such as attaching a decorative frame or entering the date of the photo. And you can print just the photos you like in various sizes on the spot and take them home.

  Even in such an automatic photo studio system, it is not easy to take a photo that can be taken home as a memorial with a small child as a subject. As children turn their attention one after another to something that attracts attention, it is even more difficult to make them stand still at the shutter timing, and to make a good face and a good pose.

  In order to solve such problems, the applicants of the present application have already installed a monitor in the vicinity of the camera of the automatic shooting studio, and displayed the video of the game on this monitor to attract the attention of the child. Japanese Patent Application No. 2005-192183 proposes a method of calling a child to jump or lie down and shooting at the timing of this call.

  However, even if such a method is adopted, a small child can shoot without blurring (that is, the child keeps a substantially stationary state at the shutter timing) while staying within the shooting angle of view at the shutter timing. Probability is not high.

  For this reason, in the automatic photography studio of the automatic photo studio, in addition to the above-described method, continuous photography is performed every predetermined time (for example, 5 seconds), and 50 sheets are used every time the automatic photography studio is used. Taking a photo (image) of a degree is performed. In other words, increasing the number of shots results in an increase in the number of good photos.

  As described above, about 50 photographs (images) are taken every time the automatic photographing studio is used. In addition, a user who visits an automatic photo studio often uses an automatic photo studio several times per visit, rather than using the auto photo studio once.

  For this reason, it takes a lot of time to check a photograph taken by the user and select a favorite photograph to be edited / printed and taken home. Also, you can't display and compare hundreds of photos at once on the screen (the image gets smaller and you can't check the contents even if you forcibly display it), so for example, several photos are displayed in order. Then, the method of selecting sequentially can be considered.

  Therefore, in automatic photo studios, it is necessary to make it easier to select photos by preventing unsuccessful shooting such that the child's face as the subject does not fall within the shooting angle of view, thereby reducing the number of wasted shots. There is. For this purpose, it is one method to shoot with multiple cameras with different shooting angles, but increasing the number of cameras unnecessarily increases the cost and, above all, the number of failed photos. On the contrary, it may increase the effort required for the user to select a photo. Therefore, it is desirable that the child as the subject can be almost covered and photographed by one camera even when the child is running around.

  The present invention has been made in view of the above points, and an object of the present invention is to photograph a child as a subject at a wide angle in an automatic photo studio, and cut out a portion where the child is photographed from a photographed image taken at a wide angle. By enlarging it, the number of failed photos is reduced as much as possible, and it is also possible to acquire a photo that captures a lively figure of a child.

In order to achieve the above object, an automatic photo studio according to the present invention generates a mask pattern of a subject from a photographic camera that shoots a still image of a subject at a wide angle, and a photographic image taken by the photographic camera. A person detection unit that extracts a skin color part and detects the mask pattern having a skin color part in the mask pattern as a person pattern, and a part corresponding to the mask pattern detected by the person detection unit as a person pattern from the photographed image. Automatic trimming means for cutting out and enlarging the cut-out partial image to a predetermined image size.
The automatic trimming means also sets up, down, left, and right margins to be set for the enlarged image depending on whether the top, bottom, left and right edges of the partial image cut out from the captured image match the top, bottom, left and right edges of the captured image. To control.
Alternatively, the automatic trimming means controls the margins set on the left and right and / or the top and bottom of the enlarged image according to the barycentric position of the skin color portion in the partial image.

According to the present invention, by photographing a child as a subject at a wide angle in an automatic photo studio, even if the child is moving around, the child can be generally captured within the photographing angle of view. By cutting out and enlarging the part of the child, the number of failed photos that do not show the child's face etc. can be reduced as much as possible, and the child's lively appearance can be taken well It is also possible to obtain a photograph taken.
In addition, it is possible to give a good-looking margin according to the cut-out location of the partial image and the center of gravity of the flesh-colored portion to the enlarged image, and obtain a printed output (print photo) with a good-looking margin. Can do.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a layout diagram showing the in-store (in-house) structure of an automatic photo studio according to an embodiment of the present invention (hereinafter referred to as the present example).

  In the automatic photo studio 0101, equipments of a counter 0102, a satellite 0106, and a studio 0107 are arranged.

  The detailed configuration and function of each facility will be described later. The counter 0102 is a facility for the user to issue an IC card to be used in the store and to perform accounting. Studio 0107 is an automatic photography studio equipped with a camera, lighting, background, and the like. The satellite 0106 is a facility for a user to spend time before photographing or to edit a photographed image, and includes a table on which a computer is installed and one or more chairs.

  In the automatic photo studio 0101 store, a plurality of studios 0107 and a plurality of satellites 0106 are installed so that a plurality of users can simultaneously shoot and edit images.

  Although not shown in FIG. 1, a counter system 0104, a printer system 0105, and a server system 0103 including a computer system and various components connected thereto are installed near the counter 0102. Similarly, a satellite system 0110 is installed in each satellite 0106, and a studio system 0111 is installed in each studio 0107.

  In addition to the above facilities, the store has a costume shelf that stores rental costumes used for shooting, a room for changing clothes, shelves for storing small items such as stuffed animals used for shooting, toilets, shoe boxes, and bored. There are various facilities necessary for the operation of an automatic photo studio, such as a play area for children to play and a backyard for storing equipment.

  FIG. 2 is a schematic diagram of the entire system configuration of the automatic photo studio according to the present embodiment. The detailed configuration of each system in FIG. 2 will be described later. The server system 0103 records various files used mainly in the entire automatic photo studio system, and provides data according to requests from other systems. It functions as a so-called file server. The counter system 0104 performs operations necessary for the operation of an automatic photo studio, such as issuance of IC cards, confirmation of printing status, and accounting. On the other hand, the satellite system 0110 and the studio system 0111 are systems mainly for users, and are used for image (photo) editing and image shooting, respectively. A printer system 0105 is a system for controlling image printing by a printer.

  Each system is configured by connecting a computer such as a PC and peripheral devices such as an IC card R / W (reader / writer), a touch panel monitor, and the like, and are connected to each other via a communication line 0114. Therefore, for example, the server system 0103 receives the operating status information of the satellite system 0110, records it in a file for managing the operating status of the automatic photo studio system, and sends it in accordance with a request from the counter system 0104. It can be displayed on a touch panel monitor of the counter system 0104.

  For the printer system 0105, the satellite system 0110, and the studio system 0111, a plurality of systems of the same type may be installed according to the number of users and the number of printed images. In the following description, the server system 0103, the counter system 0104, the printer system 0105, the satellite system 0110, and the studio system 0111 are simply referred to as “system”. In addition, when all of a plurality of systems are systems of the same application, for example, the printer system 0105, they are described as “the same type of system”.

  FIG. 3 is a flowchart showing a flow of use of the automatic photo studio by the user in the automatic photo studio (hereinafter abbreviated as “store”) according to the present embodiment.

  When the user enters the store (S0301), first, the counter 0102 accepts it (S0302) and receives an IC card (player card). As a user, it is assumed that parents and children (especially, a user group consisting of a mother and its children) is the center, and one IC card is given to one user group. The IC card identifies a user or user group (hereinafter, even if it is a user group, it is simply described as “user” unless there is a need to clearly indicate that there are multiple users). A unique code is recorded.

  Next, the user moves to a vacant satellite 0106, sits down, and waits for a studio 0107 to be used for photographing to become available (S0303). At this time, if it is not clear how to use the store for the first time, the satellite system 0110 can be used to explain the usage.

  When a user who has used the target studio 0107 leaves, the lamp installed near the entrance of the studio 0107 indicating that the studio is in use is turned off. The user confirms that the studio 0107 can be used by turning off the light, moves to the studio 0107, and performs shooting using the studio system 0111 (S0304).

  When it is desired to continue shooting in another studio 0107 after the shooting is completed, the camera 0107 is moved after confirming that the studio 0107 can be used, and when the target studio is in use, the satellite 0106 is moved. (In the case of YES at S0305). Also, when it is desired to display and confirm the photographed image once, it is returned to the satellite 0106 (NO in S0305). At this time, it is not always necessary to return to the satellite 0106 sitting down after visiting the store, and it is sufficient to go to the satellite 0106 that is free at this time.

  In the satellite 0106, the captured image can be confirmed and selected using the satellite system 0110 (S0306). Even if a favorite image is selected, if it is desired to further shoot (YES in S0307), it is possible to shoot again in the studio 0107.

  If there is no need for additional shooting (NO in S0307), the user uses the satellite system 0110 to edit the selected image, and then selects a photo to be finally printed and prints it. (S0308).

  After the printing instruction is completed, the user stops at the counter 0102, returns the IC card, completes the accounting, receives the output photo (S0309), and exits (S0310).

  In the following, first, the detailed configuration and the like of each facility and each system shown in FIGS. 1 and 2 will be described, and then each process (reception, shooting, editing, etc.) in the flowchart of FIG. The operation will be described.

  FIG. 4 is a view of a part of the counter 0102 as viewed obliquely from above. FIGS. 5, 6, and 7 are block diagrams of the server system 0103, the counter system 0104, and the printer system 0105, respectively.

  As shown in FIG. 4, a PC main body 0600 of the counter system 0104 and a PC main body 0700 of the printer system 0105 are stored in the counter table. On the counter table, a touch-type monitor 0603 for employees to perform processes such as reception, a touch-type monitor 0703 for performing processes such as additional printing, and a printer 0710a for printing / outputting photographs are placed. . Although not shown in FIG. 4, the IC cards R / W 0606a and 0606b of the counter system 0104 and the IC card R / W 0706 of the printer system 0105 are also placed on the counter table.

  Inside the counter 0102, a PC main body 0500 of the server system 0103, a monitor 0503, and a keyboard 0504 and an IC card R / W 0506 (not shown in FIG. 4) are installed.

  The PC main body of each system and its peripheral devices, and the PC main bodies of each system need only be able to communicate with each other by a wired or wireless method, and the installation location is not limited to the above-described location. In consideration of the aesthetics of the store, it should be installed at a convenient location for normal operation.

  As shown in FIG. 5, the server system 0103 includes a PC main body 0500, a monitor (server monitor) 0503, a keyboard 0504, and an IC card R / W 0506.

  Employees operate using the keyboard 0504 to create newly adopted IC cards for employees (hereinafter referred to as “operator cards”) using the IC card R / W0506, or to make system settings. Can be initially created or changed, and the operating status of each system can be displayed on the monitor 0503.

  The PC main body 0500 has a CPU 0501, a memory 0502, an image output unit 0505, a communication interface 0507, and a magnetic disk 0508. The magnetic disk 0508 records information necessary for store operation and the like.

  Each information is transmitted / received to / from other systems such as the counter system 0104 via the communication interface 0507 and the communication line 0114.

  FIG. 6 is a block diagram of the counter system 0104. The counter system 0104 includes a PC main body 0600, a touch monitor (touch counter monitor) 0603, and IC cards R / W 0606a and 0606b. The PC main body 0600 includes a CPU 0601, a memory 0602, an image output unit 0605, a communication interface 0607, and a magnetic disk 0608.

  An employee (operator) is allowed to operate the counter system 0104 by inserting the operator card into the IC card R / W0806a, and performs an actual operation by touching the monitor 0603 with a finger. For example, it is possible to input the information of the user who has visited the store, create an IC card inserted into the IC card R / W0806b as a player card, or display the usage status of each system on the monitor 0603.

  User information or the like input by the counter system 0104 is transmitted / received to / from other systems such as the server system 0103 via the communication interface 0607 and the communication line 0114.

  FIG. 7 is a block diagram of the printer system 0105. The printer system 0105 includes a PC main body 0700, a touch monitor (touch printer monitor) 0703, an IC card R / W 0706, and one or more printers 0710a, 0710b, and 0710c (hereinafter referred to as printer 0710a). , 0710b and 0710c are collectively referred to as a printer 0710). The reason why a plurality of printers 0710 are connected is that, in addition to the purpose of shortening the printing waiting time by performing printing in parallel using a plurality of printers 0710, printers generally distributed in the market are A3 size. For example, it is possible to print only up to a certain size. For example, a special printer is required to print the A1 plate. The PC main body 0700 includes a CPU 0701, a memory 0702, an image output unit 0705, a communication interface 0707, a magnetic disk 0708, and a printer control unit 0709.

  An employee (operator) is allowed to operate the printer system 0105 by inserting the operator card into the IC card R / W 0706, and performs an actual operation by touching the monitor 0703 with a finger. For example, it is possible to perform operations such as reprinting (redo printing) when a problem occurs during printing.

  The processing status of the printer system 0105 is transmitted / received to / from other systems such as the server system 0103 via the communication interface 0707 and the communication line 0114.

  FIG. 8 is a view of the satellite 0106 as viewed obliquely from above. FIG. 9 is a block diagram of the satellite system 0110.

  The satellite 0106 is a facility for a user to wait for a free space in the studio 0107 or to edit a captured image. In this embodiment, as shown in FIG. 8, a circular table is divided into approximately four equal parts by a partition plate 0804, and one or more chairs and a satellite system 0110 are provided in each partitioned place. .

  In this embodiment, the PC main body 0900 of the satellite system 0110 is housed inside the column 0803 of the table 0801, and the touch monitor 0903, the touch pen 0904, and the IC card R / W 0906 are attached to the upper surface 0802 of the table 0801. It has been. The PC main body 0900, the touch-type monitor 0903, the touch pen 0904, and the IC card R / W 0906 are connected to be communicable by wire or wirelessly.

  As shown in FIG. 9, the satellite system 0110 includes a PC main body 0900, a touch-type monitor (satellite monitor) 0903, a touch pen 0904, and an IC card R / W 0906. The PC main body 0900 includes a CPU 0901, a memory 0902, an image output unit 0905, a communication interface 0907, and a magnetic disk 0908.

  The user can operate using the touch pen 0904 to display the shooting method in the studio 0107 on the touch-type monitor 0903, and to perform operations such as editing of a captured image and a print instruction. Note that it is also possible to operate with a finger without using the touch pen 0904. In this case, since the touch pen is unnecessary, the cost required for the system construction can be reduced, and the touch pen does not break down or be lost. However, some users are reluctant to touch the monitor screen touched by another person's hand, so this point needs attention.

  The memory 0902 stores line drawing patterns and thicknesses used for image editing, various stamp images prepared in advance for image composition, print layout samples, various guidance messages (speech and sentence information), and the like. . These pieces of information are recorded in the magnetic disk 0508 of the server system 0103 and transferred to the satellite system 0110 as necessary when starting the satellite system 0110 or updating the recorded contents of the magnetic disk 0508. can do.

  The usage status of the satellite system 0110 is transmitted / received to / from other systems such as the server system 0103 via the communication interface 0907 and the communication line 0114.

  Next, the configuration and function of the studio 0107 will be described. Studio 0107 is intended for children of a certain age or older who can change their standing position or pose according to their parents' instructions.

  FIG. 10 is a view of the studio 0107 as viewed from obliquely above. The studio 0107 is surrounded on three sides by walls 1005a, 1005b, and 1005c so that the studio 0107 is not seen from the outside. An in-use lamp 1227 is installed on the wall 1005c in the vicinity of the entrance / exit 1006. The lamp is turned on during photographing, and the lamp is turned off when photographing is completed. Therefore, the user can know from the outside whether the studio is vacant by blinking the in-use lamp 1227.

  In FIG. 10, the inside of the studio with the wall 1005c watermarked is drawn, but this does not indicate that the wall 1005c is a transparent wall, but is due to the necessity for drawing. The wall 1005c may be transparent glass or the like, but should normally be an opaque wall material.

  Inside the studio 0107, a camera box 1002 housing a photographing camera 1221 and the like, and an illumination device 1222 for illuminating a user who is a subject (front strobe 1001a, right strobe 1001b, left strobe 1001c) A surface light source 1222a) that is always lit not shown in FIG. 10 is installed, and a horizont curtain 1004 and a background mechanism 1223 are installed in the vicinity of the opposite end. A space between the camera box 1002 and the horizont curtain 1004 becomes a shooting space, and a user (usually a child) who is a subject enters the shooting space and takes a pose by taking instructions from the mother and taking a picture.

  A console 1003 is placed in front of the shooting space, and a touch panel for the user (usually a mother) to determine a shooting mode to be described later and to confirm the pose of the subject. A formula operation monitor 1203 is attached.

  An IC card R / W 1206 is also attached to the console 1003. When the user inserts the player card into the IC card R / W 1206, the studio system 0111 of the studio 0107 becomes usable, and the in-use lamp 1227 lights up.

  The camera box 1002 houses a shooting camera 1221 for shooting a subject (still image shooting) and a monitor camera 1220 for shooting a subject image in real time (moving image shooting).

  In the present embodiment, the shooting camera 1221 is a wide-angle camera that can cover and cover the entire shooting space, and covers at least the entire width of the horizont curtain 1004 (contains within the shooting angle of view). Shooting is possible. The monitor camera 1220 is installed in the vicinity of the shooting camera 1221. In this embodiment, the monitor camera 1220 is configured to capture an image that is almost the same as the image that should be shot by the shooting camera 1221. May not be as wide as the shooting camera 1221.

  The image (moving image) projected by the monitor camera 1220 is displayed on the operation monitor 1203, and the mother confirms this by checking whether the child is within the shooting angle of view. You can instruct them to move left and right or pose.

  In addition, the image projected by the monitor camera 1220 is also displayed on the confirmation monitor 1205 housed in the camera box 1002. The purpose is to show the child, who is the subject, and to attract interest.

As a background for shooting, a favorite one of a plurality of roll curtains set in the background mechanism 1223 can be selected and used, or the roll curtains are all rolled up and colored in a color that is easy to synthesize chroma keys. It is also possible to use a horizont curtain 1004 that has been made.
FIG. 11 is a simplified block diagram of the studio system 0111. As shown in FIG. The studio system 0111 includes a studio PC 1200, a monitor camera 1220, a photographing camera 1221, an operation monitor 1203, and a confirmation monitor 1205.

  An image photographed by the photographing camera 1221 is temporarily recorded on a magnetic disk or the like of the studio PC 1200 that has photographed, and transferred to the server system 0103. The studio PC 1200 is responsible for the main functions of the studio system 0111 described above.

  FIG. 12 is a block diagram showing a configuration of a studio PC 1200 which is a main component of the studio system 0111 and each component connected thereto. The above-described components and the like are connected to the studio PC 1200 of the studio system 0111. The studio PC 1200 gives a shooting instruction to the CPU 1201 that controls the entire studio PC 1200 by a program stored in the memory 1202, a magnetic disk 1208 that stores various image data (for example, sample content described later), and the monitor camera 1220. Also, a monitor camera control unit 1231 that inputs a captured image (moving image), a shooting camera control unit 1232 that gives a shooting instruction to the shooting camera 1221 and inputs a shot image (still image) , A confirmation monitor image output unit 1235 for displaying a moving image of the subject on the confirmation monitor 1205, an audio output unit 1237 for outputting audio signals of various guidance messages to the speaker 1224, and various guidance messages (audio) And text information) And 1238, a timer 1225 for measuring various operating time or the like, a background mechanism control section 1236 for controlling the background mechanism 1223 includes such use during lamp controller 1244 for controlling the use of the lamp 1227.

  Image information and the like captured by the studio system 0111 are transmitted / received to / from other systems such as the server system 0103 via the communication interface 1207 and the communication line 0114.

  This is the end of the description of each system component, and hereinafter, the operation of the studio system directly related to the present invention will be described.

  FIG. 13 is a flowchart showing an outline of processing performed in the studio system 0111.

  When activated, the CPU 1201 of the studio system 0111 displays a screen for prompting insertion of an IC card on the operation monitor 1203 (S1301), and waits until a player card is inserted into the IC card R / W 1206 (S1302).

  When a player card is inserted into the IC card R / W 1206, refer to the usage history of the day recorded on the IC card, and if an attempt is made to continuously shoot in the studio immediately after shooting, an error will be indicated. After the display, a screen prompting insertion of the IC card is displayed again (S1303).

  If the studio can be used, the CPU 1201 turns on the in-use lamp 1227, displays the shooting course selection screen on the operation monitor 1203, and performs shooting course selection processing (S1304).

  FIG. 14 shows a display example of the shooting course selection screen. On the shooting course selection screen, four buttons labeled “dance shooting”, “game shooting”, “pose shooting”, and “free shooting” are displayed. When the user touches one of the four buttons, the CPU 1201 displays a display corresponding to each shooting course on the operation monitor 1203 and the confirmation monitor 1205 (S1306). For “Dance Shooting”, “Game Shooting”, and “Pause Shooting”, the type is selected (S1307, S1309, S1311), shooting processing is performed (S1308, S1310, S1312), and “Free Shooting” is left as it is. A photographing process is performed (S1313).

  Since the operation of the system in each course is basically the same, the case where dance shooting is selected will be described first, and then the differences in other courses will be described.

  When dance shooting is selected, the CPU 1201 displays a dance selection screen on the monitor 1203 (S1307). At this time, the confirmation monitor 1205 displays an animation screen for attracting the child's interest.

  FIG. 15 shows a display example of the dance selection screen. On the dance selection screen, there are three buttons labeled “Relaxing Yugi Course (2 to 4 years old)”, “Fun Enjoying Yugi Course (4 to 6 years old)” and “Exact Dance Course (6 years old and up)” Is displayed. When the user touches any of these three buttons, the CPU 1201 displays a shooting screen on the operation monitor 1203 and performs shooting processing (S1308). The photographing process ends when a predetermined time elapses.

  FIG. 16 shows a display example of the shooting screen. On the shooting screen, both a studio monitor video 1601 that is a sample video (sample content) showing the instructor dancing a sample dance and an in-studio video 1602 showing the child in the studio are displayed.

  The confirmation monitor 1205 displays the same video as the studio monitor video 1601.

  The video displayed on the in-studio video 1602 (as described above, the same video is also displayed on the confirmation monitor 1205) is a video (moving image) taken by the monitor camera 1220.

  The selected sample content (studio monitor image 1601 as a sample image) is recorded in advance on the magnetic disk 1208 of the studio PC 1200 of the studio system 0111. The camera designation information differs depending on the sample content. For example, after 23 seconds from the start of the video data, the instructor calls, such as “Oh, jump, ichi, ni, sang”, and then the video to which the instructor jumps is displayed. If it is recorded, shooting is performed in accordance with the playback time of this video.

  In the dance photography described above, photography is performed automatically. That is, when the shooting process is started and the same video as the studio monitor video 1601 is displayed on the confirmation monitor 1205, the CPU 1201 continues until a predetermined time elapses, that is, until the video of the selected sample content is finished. Take a photo. In general, photographing is performed for about 3 to 5 minutes.

  More specifically, the CPU 1201 shoots after a certain time (for example, after 3 seconds) when the shooting process starts, and waits until the strobe (1001a, 1001b, 1001c) is charged after the shooting is finished. And shoot again. This is repeated until the photographing process is completed.

  Because the subject is a small child, even if a nearby mother specifies a standing position or pose, it is not always possible to follow the instructions, and even if the instructor instructs jumping etc. on the sample content video, You can't act that way. For this reason, the possibility of taking a well-made photograph is increased by increasing the frequency of shooting as much as possible and continuously shooting.

  Next, the processing when “game shooting” is selected on the shooting course selection screen will be described focusing on differences from the case of dance shooting. The differences are the following two points.

  1) In “game shooting”, a game selection screen is displayed instead of a dance selection screen. As in the dance selection screen, the user can select a game suitable for the child who is the subject from a plurality of games displayed on the game selection screen according to the age of the child.

  2) When the game is selected, unlike the dance shooting, only the in-studio video 1602 showing the state of the child in the studio is displayed on the shooting screen of the operation monitor 1203. In addition, on the confirmation monitor 1205, not a video in which an instructor is shown, but a video in which a video of a child, which is a subject that is shot in a studio video 1602, is displayed on a game video. As game images, images of balloons of various colors falling one after the other as shown in FIG. 17 and images of moles appearing irregularly or withdrawing at multiple locations on the screen are displayed. , "Now the balloon!" When a child puts his limbs on a balloon or a video of a mole, the balloon breaks or the mole turns his eyes, so the child is amused and performs various actions. As a result, it is possible to shoot a pose with lively movements of a child that cannot normally be taken.

  Next, the processing when “pose shooting” is selected on the shooting course selection screen will be described focusing on differences from the case of dance shooting. The differences are the following two points.

  1) In “pose photography”, a pose selection screen is displayed instead of a dance selection screen. As in the dance selection screen, the user can select a pose sample content suitable for the child as the subject from a plurality of poses according to the age of the child displayed on the pose selection screen.

  2) When pose shooting is selected, as with dance shooting, the shooting screen of the operation monitor 1203 includes a studio monitor video 1601 that is a sample video showing the instructor taking a sample pose, Both the in-studio video 1602 showing the child's state are displayed. Similar to the shooting screen of the operation monitor 1203, the confirmation monitor 1205 also includes a studio monitor image 1601 that is a sample image showing the instructor taking a pose of the sample, and an inside of the studio that shows the child in the studio. Both images 1602 are displayed. As a sample video, the instructor's standing, sitting, and lying down are displayed, and voice messages etc. are used to encourage the child to take the same pose.

  Next, the processing when “free shooting” is selected on the shooting course selection screen will be described focusing on differences from the case of dance shooting. Differences are the following three points.

  1) In “free shooting”, a shooting screen starts without displaying a selection screen such as a dance selection screen.

  2) In the shooting process, a video shot by the monitor camera 1220 is displayed on the shooting screen of the operation monitor 1203, and two images labeled “shutter” and “triple shooting” are displayed below the video. A button is displayed. When the user presses the “shutter” button, the photographing camera 1221 performs photographing. In the case of “triple continuous shooting”, three continuous shootings are performed by the shooting camera 1221. Regardless of which button is pressed, the mother who is the user guides the child to make a good pose while viewing the display on the operation monitor 1203 or the like.

  3) In free shooting, as described above, shooting is not automatically performed, but is performed by pressing a single shooting or triple shooting button. The photographing process ends when a predetermined time has elapsed from the start.

  Next, a technique that is commonly performed in each shooting course, shooting a child as a subject at a wide angle, and cutting out and expanding the subject portion will be described.

  When shooting is performed, the CPU 1201 records a shot image (still image) shot by the shooting camera 1221 in the memory 1202, cuts out only the subject from the background of the shot image, and simply masks the subject portion (hereinafter simply referred to as a mask pattern). (Described as “mask pattern”), and records this in the memory 1202. Note that a technique for cutting out a subject from the background, that is, a technique for generating a mask pattern, is widely known as a technique related to chromach synthesis and the like, and therefore the description thereof is omitted here.

  FIG. 18 is a diagram showing a state of studio photography in the present embodiment, in which a stand that is a photography tool is placed in front of a background that can be combined with blackboard, and a dressed child stands in front of it. ing.

  FIG. 19 is a diagram schematically showing how the above-described mask pattern is recorded, with FIG. 18 as an example. In other words, the shooting camera 1221 is always set to shoot at a wide angle enough to cover the entire portion to be shot (for example, the entire horizontal direction of the horizont curtain 1004). As shown in 1903, a part of the photographed image is photographed smaller.

  By the way, when only the child as the subject exists within the shooting angle of view of the camera for shooting 1221 or when there are shooting tools such as a stand in addition to the child but they overlap (as in 1901) In this case, the mask pattern is generated as one lump (that is, a group of pixels adjacent to each other) as indicated by 1902, but the child and the shooting prop are separated (in the case of 1903). First, a mask pattern is generated by being separated into a plurality of blocks as indicated by 1904.

  Since the child is photographed smaller by wide-angle shooting, it is desired to cut out and enlarge only the child part by an automatic trimming process to be described later. In a state such as 1904, it is not known which of the chunks is the child.

  Therefore, the CPU 1201 extracts a flesh-colored portion from a photographed image captured by the photographing camera 1221 and recorded in the memory 1202, and among the one-piece portions of the mask pattern, a child overlapping with the flesh-colored portion is a child. Judge that there is.

  Specifically, a range of RGB values (or CMYK (Cyan, Magenta, Yellow, blackK) values or other values that can specify other colors) of the skin color is determined, and from the photographed image, for example, within this RGB value range This can be achieved by extracting pixels.

  Reference numeral 1905 in FIG. 19 is a result image obtained by extracting the skin color portion in this way. In this example, only the child's face and hands are extracted.

  Next, the CPU 1201 collates the extracted image of the skin color part with the mask pattern, and determines in which part of the mask pattern the skin color part exists. Then, the mask pattern is removed except for the lump where the skin color portion exists. A reference numeral 1906 in FIG. 19 indicates a final mask pattern generated in this way for the captured image 1903.

  When the skin color portion does not exist (not shown, for example, only the stand is shown), the final mask pattern is a blank image.

  Here, as a photographing tool, a skin color portion that is determined to be a skin color is not used, so that it is possible to prevent a skin color portion from being extracted from other than a child. Further, even if the clothes worn by the child are skin-colored, there is no particular problem because it is no doubt that it is a part of the child part that is the subject.

  Therefore, the plurality of blocks of the mask pattern should not have a flesh-colored part.For example, the user brings in and uses a photographing prop, and the prop has a flesh-colored part, and In the case where the child is placed away from the child, the plurality of blocks of the mask pattern may have a skin color portion. In such a case, the area (for example, the number of pixels) of the skin color portion in each block may be calculated, and the largest block may be determined as a child.

  Although not explicitly shown in FIG. 19, even when the mask pattern is a single block as in 1901, the above-described processing such as the extraction of the skin color portion is performed, and finally the result is shown in 1902. Such a mask pattern (as a result, the same image as the mask pattern first generated from the photographed image) is obtained.

  Next, the automatic trimming process will be described with reference to FIG. In other words, since shooting is performed at a wide angle, the entire body of the subject can be shot as shown in 2001 as long as the child who is the subject remains at the place to be shot. Then it looks bad as a photograph.

  Therefore, the CPU 1201 cuts out only the portion of the subject that is a child from the photographed image and enlarges it. For example, 2001 will be described. A mask pattern 2003 is generated from the captured image 2001 by the above-described method, and a portion of the captured image 2001 that is covered with the mask pattern 2003 is extracted. In the captured image 2001, a portion 2002 is extracted.

  Next, the CPU 1201 obtains upper, lower, left and right end portions of the extracted image portion, and generates a virtual rectangle adjacent to surround the extracted image portion. In the photographed image 2001, a dotted line surrounding the portion 2002 corresponds to this. Then, the CPU 1201 enlarges the image portion included in this rectangle without changing the aspect ratio. 2005 shows the result of enlarging the rectangular portion of the captured image 2001 in this way.

  Here, the enlargement process is performed until a maximum width (for example, the number of pixels) in the vertical direction and the horizontal direction is determined in advance, and either one of the vertical and horizontal portions in the rectangle reaches the maximum value. This is because when the image of the subject is enlarged to the very minimum in the vertical and horizontal directions, the image looks worse, so that a certain amount of margin is formed on the top, bottom, left and right of the final result image 2004.

  Therefore, the maximum width in the vertical and horizontal directions may be set slightly smaller than the vertical and horizontal width of the final result image.

  Note that the top, bottom, left, and right margins of the final result image may be equal to each other, for example, the center of gravity of the inner image surrounded by the rectangle may be calculated and set accordingly. .

  For example, the horizontal width (for example, the number of pixels) of the rectangular portion is a, the vertical width is b, the center of the top, bottom, left and right (points at equal distance from both the left and right ends, both ends) is P, and the center of gravity of the inner image surrounded by the rectangle Is G. The horizontal distance between G and P is x (when G is rightward toward the image with respect to P, it is a positive value; when it is leftward, it is a negative value), and the vertical distance is y ( G is assumed to be a positive value when it is upward toward the image with respect to P, and a negative value when it is downward.) The total width of the left and right margins is w, and the total width of the upper and lower margins is h.

  At this time, for example, the left margin value can be obtained by w / 2− (w / 2 × ((2 × x) / a)). The right margin value may be the w-left margin value, and the margin value can be obtained in the vertical direction using the same calculation formula.

  Of course, the above calculation formula is merely an example, and how to arrange the image when the center of the image is different from the center of gravity may be changed in a timely manner while observing the reaction of the user.

  The basic method of automatic trimming processing, that is, processing when the entire subject is within the shooting angle of view as in 2001 is as described above.

  However, the child may go out of the place to be photographed. In this case, for example, as shown by 2101 in FIG. 21, the photograph may be taken with a part of the subject cut out. In such a case, the basic method may be used. However, since the subject is enlarged in a state where a part of the subject is cut off, if the margins are arranged vertically and horizontally, the appearance is poor. .

  Therefore, automatic trimming processing is performed as follows. The captured image 2101 in FIG. 21 will be described. First, the CPU 1201 generates a mask pattern 2104 from the captured image 2101 by the method described above, and extracts a portion covered with the mask pattern 2104 in the captured image 2101. In the captured image 2101, a portion 2102 is extracted.

  Then, the CPU 1201 generates a rectangle surrounding the portion 2102 (in the captured image 2101, the dotted line surrounding the portion 2102 corresponds to this), and changes the aspect ratio of the portion surrounded by the rectangle in the captured image 2101. As shown in FIG. 4, the image is enlarged until either the vertical or horizontal width of the portion in the rectangle reaches the preset vertical and horizontal maximum widths. The processing so far is the same as the basic method.

  Next, the CPU 1201 detects that the mask pattern 2104 is applied to the left end and the lower end of the captured image 2101, and does not leave a blank in a portion corresponding to the end of the captured image on which the mask pattern is applied. The enlarged image 2106 is arranged. By doing in this way, the portion covering the edge of the image is enlarged as it is as illustrated in the final result image 2105, and a good-looking image can be obtained.

  In this case, if the margin widths in the horizontal and vertical directions are the same as those in the basic method, there is a possibility that the right end and the upper end of the side that is not applied to the end, that is, 2105, are too vacant. Therefore, in the case where the horizontal direction and the vertical direction are applied to either end, the width of the margin may be approximately half of w and h described in FIG. As a result, for example, when either the left or right end is cut off, the margin width in the horizontal direction can be increased to w / 2. In this case, at the time of enlargement, the maximum width in the vertical direction and the horizontal direction should be increased by the amount of the reduced margin.

  Incidentally, in the example 2101, a part of the trash bin 2103 exists in the rectangle to be enlarged in addition to the child as the subject. When the enlargement process is performed by the method described so far, only the portion in the rectangle of the trash can 2103 is enlarged, so that an image with a part missing is obtained as in 2107.

  In order to prevent this, the image to be enlarged may be added to the image in the rectangle, and the image in the rectangle may constitute a part of the image. Also in the example of 2101, as already described in the mask pattern generation process, the mask pattern of the trash can 2103 portion is also generated, which can be used.

  Even when the enlargement target is expanded in this way, the portion of the captured image 2101 surrounded by a rectangle is enlarged until the maximum width in the vertical or horizontal direction set in advance is reached, and the margin is increased. However, it should be set considering only the child part that is the true subject. As a result, when a part of the enlarged image spreads outside the screen, the image spread outside the screen may be arranged on the margin part. By doing in this way, the part of 2007 is expanded like 2108.

  Next, still another margin setting method in the automatic trimming process will be described with reference to FIG. 2201, 2202, 2203, and 2204 are enlarged views of the mask pattern portion when the child, who is the subject, takes various poses.

  In addition to each mask pattern, the CPU 1201 extracts a skin color portion by the above-described method. In 2201, 2202, 2203, and 2204, for the convenience of explanation, the extracted image of the skin color portion is displayed in gray on the mask pattern.

  Next, the CPU 1201 calculates the center of gravity of the skin color portion and uses this to adjust the margin. A specific margin setting method is the same as the above-described method based on the center of the rectangle to be enlarged and the center of gravity of the image in the rectangle, and thus description thereof is omitted.

  By doing in this way, the left and right balanced images such as 2201 and 2202 are arranged at the approximate center of the image, and the image where the center of gravity of the flesh-colored part is biased to the left like 2203 For an image in which the margin is large and the center of gravity of the flesh-colored part is biased to the right as in 2104, the right margin is large, so that a final result image in which the entire balance is achieved can be obtained.

  This completes the description of the method for obtaining the image to be enlarged, the enlargement method, the margin setting method, and the like in the automatic trimming process. An image (final result image) enlarged by the automatic trimming process is recorded instead of the original photographed image, and is subjected to editing processing, printing processing, and the like.

  Note that in order to shoot at a wide angle and to enlarge a portion of the image and display it without a sense of incongruity, the captured image needs to be sufficiently high-definition. Therefore, a camera with a condition such as the number of pixels equal to or greater than a certain value must be selected as the photographing camera 1221 and interpolation should be performed by an appropriate method when enlarging the image.

It is a layout view showing the in-store structure of an automatic photo studio according to an embodiment of the present invention. 1 is a system configuration diagram of an automatic photo studio according to an embodiment of the present invention. It is a flowchart which shows the flow of the photo studio use by the user in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which looked at the counter of the automatic photo studio which concerns on one Embodiment of this invention from diagonally upward. It is a block diagram of the server system of the automatic photo studio which concerns on one Embodiment of this invention. It is a block diagram of the counter system of the automatic photo studio which concerns on one Embodiment of this invention. 1 is a block diagram of a printer system for an automatic photo studio according to an embodiment of the present invention. It is explanatory drawing which looked at the satellite of the automatic photo studio which concerns on one Embodiment of this invention from diagonally upward. It is a block diagram of the satellite system of the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which looked at the studio of the automatic photo studio which concerns on one Embodiment of this invention from diagonally upward. 1 is a simplified block diagram of a studio system for an automatic photo studio according to an embodiment of the present invention. 1 is a block diagram showing a configuration of a studio PC, which is a main component of a studio system, and each component connected to the studio PC in an automatic photo studio according to an embodiment of the present invention. FIG. It is a flowchart which shows the outline | summary of the process in a studio system in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the display screen of the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the display screen of the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the display screen of the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the display screen of the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the mode of imaging | photography in a studio in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the picked-up image, the produced | generated mask pattern, etc. in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the picked-up image, the produced | generated mask pattern, and the final result image in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the picked-up image, the produced | generated mask pattern, and the final result image in the automatic photo studio which concerns on one Embodiment of this invention. It is explanatory drawing which shows the example of the margin set to the final result image in the automatic photo studio which concerns on one Embodiment of this invention.

Explanation of symbols

0101 Automatic photo studio 0102 Counter 0103 Server system 0104 Counter system 0105 Printer system 0106 Satellite 0107 Studio 0110 Satellite system 0111 Studio system 0114 Communication line 0500 PC body of server system 0501 CPU of server system
0502 Memory (server system) 0503 (Server system) Monitor 0504 (Server system) Keyboard 0505 (Server system) Image output unit 0506 (Server system) IC card R / W
0507 Communication interface (server system) 0508 (server system) magnetic disk 0600 (counter system) PC main body 0601 (counter system) CPU
0602 Memory (for counter system) 0603 Monitor (for counter system) 0605 Image output unit (for counter system) 0606a IC card R / W (for counter system)
0606b (Counter system) IC card R / W
0607 Communication interface (counter system) 0608 Magnetic disk (counter system) 0700 PC body (printer system) 0701 CPU (printer system)
0702 Memory (printer system) 0703 (Printer system) Monitor 0705 (Printer system) Image output unit 0706 (Printer system) IC card R / W
0707 Communication interface of the printer system 0708 Magnetic disk of the printer system 0709 Printer control unit of the printer system 0710a Printer of the printer system 0710b Printer of the printer system 0710c Printer of the printer system 0801 Satellite table 0802 Satellite table top surface 0803 Satellite table support 0900 (satellite system) PC body 0901 (satellite system) CPU
0902 Memory (satellite system) 0903 (Satellite system) monitor 0904 (Satellite system) touch pen 0905 (Satellite system) image output unit 0906 (Satellite system) IC card R / W
0907 Communication interface (for satellite system) 0908 Magnetic disk (for satellite system) 1001a Front strobe 1001b Right strobe 1001c Left strobe 1002 Camera box 1003 Console 1004 Horizont curtain 1005a Outer wall at the back of studio 1005b Inner wall at the side of studio 1005c Inner wall at the front of studio 1006 Entrance 1200 Studio PC
1201 CPU (Studio PC)
1202 Memory (Studio PC) 1203 (Studio System) Operation Monitor 1205 (Studio System) Confirmation Monitor 1206 (Studio System) IC Card R / W
1207 (Studio PC) Communication Interface 1208 (Studio PC) Magnetic Disk 1220 (Studio System) Monitor Camera 1221 (Studio System) Shooting Camera 1222 (Studio System) Lighting Device 1223 (Studio System) Background Mechanism 1224 (Studio System) Speaker 1225 (Studio PC) Timer 1227 (Studio System) In Use Lamp 1231 (Studio PC) Monitor Camera Control Unit 1232 (Studio PC) Shooting Camera Control Unit 1233 (Studio PC) Illumination control unit 1234 (Studio PC) operation monitor control unit 1235 (Studio PC) confirmation monitor image output unit 1236 (Studio PC) background mechanism control unit 1237 (Studio PC) audio output Part 1238 (Studio PC) Pattern memory 1244 (Studio PC) In-use lamp control part

Claims (6)

A camera for taking still images of the subject at a wide angle;
A person who generates a mask pattern of a subject from a photographed image photographed by the photographing camera, extracts a skin color portion from the photographed image, and detects the mask pattern in which the skin color portion exists in the mask pattern as a person pattern Detection means;
Automatic trimming means for cutting out a portion corresponding to the mask pattern detected by the person detection means as a person pattern from the photographed image and enlarging the cut-out partial image to a predetermined image size;
An automatic photo studio characterized by the provision. In the automatic photo studio according to claim 1,
The automatic trimming unit sets up, down, left, right, left, right, and left ends of the partial image cut out from the captured image, depending on whether the top, bottom, left, right, and left ends of the captured image coincide with each other. Automatic photo studio to control the margins of the. In the automatic photo studio according to claim 2,
The automatic trimming means enlarged the center of the enlarged image when all of the upper, lower, left and right edges of the partial image cut out from the captured image do not coincide with the upper, lower, left and right edges of the captured image. An automatic photo studio characterized in that margins are set on the top, bottom, left, and right of an enlarged image according to the relationship with the image center of gravity in the image. In the automatic photo studio according to claim 2,
The automatic trimming means, when any of the upper, lower, left and right edges of the partial image cut out from the captured image coincides with the upper, lower, left and right edges of the captured image, An automatic photo studio characterized in that no margin is provided on the above-mentioned matching end portion among the end portions, and a margin is set on the opposite end portion where no margin is provided. In the automatic photo studio according to claim 1,
The automatic photo studio, wherein the automatic trimming unit controls margins set to the left and right and / or the top and bottom of the enlarged image according to the position of the center of gravity of the skin color portion in the partial image. In the automatic photo studio according to claim 5,
The automatic trimming means makes the width of the margin set at the end of the enlarged image near the center of gravity of the flesh-colored portion larger than the width of the margin set at the end opposite to the end. A featured automatic photo studio.