JP6455125B2 - Image printing apparatus, system and method - Google Patents

Description

  The present invention relates to an image printing apparatus, system, and method for photographing a user and printing and providing a photographed image.

  2. Description of the Related Art In recent years, an image printing apparatus (for example, Photo Club (registered trademark)) that takes a photograph of a user, prints it on a medium such as dedicated photographic paper or a sticker, and outputs the medium is installed in a game center or the like. A conventional image printing device takes a picture of a person who poses in a shooting box with a camera, removes the background from the obtained image, extracts only the shot person, and prepares it as image data in advance. The character image such as the background image or mascot that is present and the extracted person image are combined and printed out.

  In such an image printing apparatus, user needs are diversified, and new functions are always required.

JP 2013-2222034 A JP 2008-29016 A

  The present invention has been made in view of the above-described conventional situation, and is an image printing apparatus that can combine images of users taken by a plurality of apparatuses and provide an image as if taken together at the same place, It is an object to provide a system and method.

  An image printing apparatus according to an aspect of the present invention continuously captures a subject at predetermined time intervals, generates a captured image, a communication unit that communicates with another image printing apparatus, and the captured image. An image processing unit that cuts out a first person image, combines the second person image received from the other image printing apparatus via the communication unit and the first person image, and generates a plurality of continuous composite images; A display unit that displays a moving image using the plurality of composite images; and a printer that prints the composite image on a print based on an instruction from the subject.

  In the image printing apparatus according to the aspect of the present invention, it is preferable that the communication unit transmits the first person image to the other image printing apparatus.

  In the image printing apparatus according to an aspect of the present invention, the image processing unit determines a front-rear positional relationship between a subject corresponding to the first person image and a subject corresponding to the second person image, and a determination result It is preferable to generate the composite image based on the above.

  An image printing apparatus according to an aspect of the present invention further includes a microphone that collects a subject's voice, and a speaker that reproduces and outputs voice data received from the other image printing apparatus by the communication unit. The communication unit preferably transmits audio data collected by the microphone to the other image printing apparatus.

  In the image printing apparatus according to an aspect of the present invention, the image processing unit edits the composite image based on an editing instruction from the subject or an editing content received by the communication unit from the other image printing apparatus. It is preferable to add items.

  An image printing system according to an aspect of the present invention includes a plurality of the above-described image printing apparatuses, and the apparatuses are connected to be communicable with each other.

  In the image printing method according to an aspect of the present invention, the photographing unit continuously photographs the subject at predetermined time intervals to generate a photographed image, and the image processing unit performs the first person image from the photographed image. A step in which the communication unit receives the second person image from the other image printing apparatus, and the image processing unit combines the first person image and the second person image, A step of generating a composite image, a step of displaying a moving image using the plurality of composite images, and a printer printing and outputting the composite image on a print based on an instruction from the subject And a step of performing.

  In the image printing method according to an aspect of the present invention, a front-rear positional relationship between a subject corresponding to the first person image and a subject corresponding to the second person image is determined, and the composite image is based on a determination result. Is preferably generated.

  ADVANTAGE OF THE INVENTION According to this invention, the image of the user image | photographed with the some apparatus can be synthesize | combined and the image as if it image | photographed together in the same place can be provided.

1 is a diagram illustrating a configuration example of an image print system according to an embodiment of the present invention. It is a figure which shows the example of the image synthesis which concerns on the same embodiment. FIG. 2 is a schematic configuration diagram of an image printing apparatus according to the embodiment. It is a hardware block diagram of the arithmetic and control unit concerning the embodiment. 2 is a functional block diagram of an image processing unit according to the embodiment. FIG. FIG. 7 is a sequence diagram illustrating an image processing method according to the embodiment. It is a block diagram of the image print system by a modification. It is a sequence diagram explaining the connection establishment process by a modification.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a configuration diagram of an image print system according to the present embodiment. As shown in FIG. 1, the image printing system includes a plurality of image printing apparatuses 1 that are communicably connected via a network such as the Internet. The plurality of image printing apparatuses 1 may be installed in a remote place, or may be installed in the same facility or adjacent to each other.

  As an example of the image printing system, a system including two image printing apparatuses 1A and 1B will be described. The image printing apparatus 1A captures a user and generates a captured image 110 as shown in FIG. When the image printing apparatus 1A performs chroma key processing on the captured image 110 and cuts out a person image, the image printing apparatus 1A transmits the person image data to the image printing apparatus 1B. The user's shooting is continuously performed at predetermined time intervals, and a person image is cut out from each shot image. The shooting interval (frame rate) is set according to the processing performance of the image printing apparatus 1A, the bandwidth of the communication network connecting the image printing apparatuses 1A and 1B, and the like.

  Similar to the image printing apparatus 1A, the image printing apparatus 1B images the user and generates a captured image 120 as shown in FIG. When the image printing apparatus 1B performs chroma key processing on the captured image 120 and cuts out a person image, the image printing apparatus 1B transmits the person image data to the image printing apparatus 1A. The user's shooting is continuously performed at the same time interval as the image printing apparatus 1A, and a person image is cut out from each shot image.

  The image printing apparatus 1A combines the person image cut out from the photographed image 110 and the person image received from the image printing apparatus 1B to create a composite image 130 as shown in FIG. 2C, and displays it on the display screen. indicate. Since the composite image 130 is generated and displayed according to the shooting interval, a moving image is displayed on the display screen.

  The image printing apparatus 1B combines the person image cut out from the photographed image 120 and the person image received from the image printing apparatus 1A, and, like the image printing apparatus 1A, the combined image 130 as shown in FIG. Is created and displayed on the display screen. Also in the image printing apparatus 1B, since the composite image 130 is generated and displayed according to the shooting interval, a moving image is displayed on the display screen.

  In this way, a moving image obtained by combining the user of the image printing apparatus 1A and the user of the image printing apparatus 1B can be displayed on both apparatuses. The users of the image printing apparatuses 1A and 1B can perform editing operations such as adding frames, stamps, and characters, and setting a background image. The editing operation performed on one device is also reflected in the image displayed on the other device.

  For example, when the user of the image printing apparatus 1A adds a frame, as shown in FIG. 2D, the composite image 130 with the frame 140 added is displayed on both the image printing apparatuses 1A and 1B. Further, when the user of the image printing apparatus 1B adds a stamp, as shown in FIG. 2E, the composite image 130 with the stamp 150 added is displayed on both the image printing apparatuses 1A and 1B.

  When the user of the image printing apparatus 1A or 1B presses the shooting instruction button, after pressing the button, shooting is performed at a predetermined timing in both apparatuses, and the composite image is displayed on the display screen as a still image. When the user of both apparatuses confirms the display screen and presses the approval button, the composite image is printed on a printed matter and output.

  In this way, the user of the image printing apparatus 1A and the user of the image printing apparatus 1B can obtain a printed matter of an image as if they were photographed together with the same apparatus even at different locations. .

  FIG. 3 shows a schematic configuration of the image printing apparatus 1A. The image printing apparatus 1A shoots a user (photographed person) P, generates a photographic image data, an arithmetic control device 11 that performs image processing on the photographic image data, and a print (photograph). ), A microphone 15 that collects the voice of the user P, a speaker 16 that outputs the voice, and a communication unit 17 that communicates with the image printing apparatus 1B.

  In addition, the image printing apparatus 1A includes a touch panel 13 that receives various instructions from the user P and displays a moving image of the composite image. Further, the image printing apparatus 1A is provided with a billing unit (not shown) for accepting money paid by the user P as the price of the printed matter or paying out change. The wallpaper on the back side of the user P in the image printing apparatus 1A has a color suitable for chroma key composition, for example, blue or yellow-green.

  One or more users P may be used. The image printing apparatus 1B has the same configuration as the image printing apparatus 1A.

  The photographing device 12 is a digital video camera, for example, and includes a lens, a shutter, a CMOS sensor, an A / D converter, and the like. When the photographing device 12 photographs the user P, the CMOS sensor receives the photographing light converged by the lens through the shutter, and photoelectrically converts the optical image formed on the light receiving surface. Output as a signal. Then, the A / D converter performs A / D conversion on the image signal output from the CMOS sensor, and generates captured image data. The imaging device 12 performs imaging at a predetermined frame rate, and outputs captured image data to the arithmetic and control unit 11.

  The communication unit 17 communicates with the image printing apparatus 1B. The communication unit 17 transmits person image data generated by image processing to be described later to the image printing apparatus 1B, and receives person image data transmitted from the image printing apparatus 1B. Further, the communication unit 17 transmits the position information of the person P to be photographed in a photographing region to be described later to the image printing apparatus 1B and receives the position information of the person to be photographed transmitted from the image printing apparatus 1B.

  When an editing operation such as addition of a frame, stamp, or character or setting of a background image is performed, the communication unit 17 transmits the edited content to the image printing apparatus 1B. Further, the communication unit 17 receives the content of the editing operation performed on the image printing apparatus 1B from the image printing apparatus 1B.

  Further, the communication unit 17 transmits the voice data of the subject P collected by the microphone 15 to the image printing apparatus 1B and receives the voice data transmitted from the image printing apparatus 1B.

  The speaker 16 reproduces and outputs the audio data received by the communication unit 17. Thereby, it is possible to have a conversation between the user P of the image printing apparatus 1A and the user of the image printing apparatus 1B.

  The arithmetic control device 11 is connected to the photographing device 12, the touch panel 13, the printer 14, the microphone 15, the speaker 16, the communication unit 17, and the accounting unit, and controls each unit and transfers data.

  FIG. 4 shows a hardware configuration of the arithmetic control device 11. The arithmetic control device 11 includes a CPU (central processing unit) 21, a main memory 22, a disk device 23, and an input / output unit 24. Each part of the arithmetic and control unit 11 is connected via a bus 26.

  The disk device 23 stores an image processing program 27 executed by the CPU 21 and a database 28 of edit items. The database 28 records stamps that can be added to images, background image data, and the like.

  The disk device 23 is, for example, a hard disk drive. The image processing program 27 may be stored in the ROM or magnetic tape (both not shown) instead of the disk device 23.

  The CPU 21 loads the image processing program 27 in the disk device 23 to the main memory 22 and executes the image processing program 27. As the image processing program 27 is executed, an area for storing the captured image data, person image data, and composite image data is secured on the main memory 22.

  When the CPU 21 executes the image processing program 27, an image processing unit having a cutout unit 31, a position detection unit 32, a determination unit 33, and a synthesis unit 34 as shown in FIG. 5 is realized.

  The cutout unit 31 determines a color difference between the person in the captured image and the background color (wallpaper color), and cuts out the person image from the captured image. The color difference determined here is a hue difference, a saturation difference, or a combination of a hue difference and a saturation difference. The cut-out person image data is used for image composition processing in the composition unit 34 and is transmitted to the image printing apparatus 1B by the communication unit 17.

  The position detection unit 32 receives focus information from the photographing apparatus 12 and detects the position of the user P in the photographing area (the photographing space between the front panel and the rear panel) of the image printing apparatus 1A. The imaging device 12 has an autofocus mechanism, and generates focus information indicating the distance from the imaging device 12 to the subject (user P). For example, in the passive autofocus, the distance from the image information to the object is extracted. When there are a plurality of users P, the position of each user is detected. In order to detect the position of the user P with high accuracy, a camera may be installed not only in front of the user P but also above the user P.

  The position information of the user P detected by the position detection unit 32 is used for the front / rear determination process in the determination unit 33 and is transmitted to the image printing apparatus 1B by the communication unit 17.

  Based on the position information of the user P detected by the position detection unit 32 and the user position information received from the image printing apparatus 1B via the communication unit 17, the determination unit 33 is an image viewed from the photographing device 12. The front-rear positional relationship of the users in the printing apparatuses 1A and 1B is determined. For example, when it is determined that the user of the image printing apparatus 1A is closer to the photographing apparatus 12 than the user of the image printing apparatus 1B, the user of the image printing apparatus 1A is in front of the image printing apparatus 1B. It is determined that the user is behind.

  The determination of the front-rear positional relationship is performed for each user. Therefore, when there are two users P1 and P2 in the image printing apparatus 1A and there is a user P3 in the image printing apparatus 1B, it is determined that the user P3 is behind the user P1 and before the user P2. There is also.

  The combining unit 34 combines the person image cut out from the photographed image by the cutting unit 31 and the person image received from the image printing apparatus 1B via the communication unit 17 to create a combined image. The composition unit 34 synthesizes a person image by adjusting the front-rear position of each person based on the determination result of the front-rear position relationship by the determination unit 33.

  Further, the synthesizing unit 34 adds a frame, a stamp, a character, sets a background image, and the like based on the edited content, and generates a synthesized image. This editing content is editing content by the user P using the touch panel 13 or editing content received from the image printing apparatus 1 </ b> B via the communication unit 17.

  The composite image is displayed on the touch panel 13. Since the composite image is generated and displayed in accordance with the photographing interval of the photographing device 12, a moving image obtained by synthesizing the users in the image printing devices 1A and 1B is displayed on the touch panel 13.

  The touch panel 13 displays an operation button, and when the operation button is pressed, receives an operation instruction corresponding to the operation button. When the image processing unit receives an editing instruction from the user P via the touch panel 13, the image processing unit takes out an editing item such as a stamp from the database 28 of the disk device 23 and displays it on the touch panel 13. The user P can edit the composite image by selecting / adding an edit item.

  When the shooting instruction button on the touch panel 13 is pressed, shooting processing for generating a print image is performed at a predetermined timing after the button is touched, and the composite image is displayed as a still image. When the user P confirms the displayed composite image and presses the approval button, the arithmetic and control unit 11 transfers the data of the composite image (print image) to the printer 14.

  The printer 14 prints and outputs the print image received from the arithmetic and control unit 11 on a print such as photographic paper or a sticker. The printing method of the printer 14 is not particularly limited, and an inkjet method, a sublimation type thermal transfer method, a melt type thermal transfer method, or the like can be used.

  Next, the image printing method according to the present embodiment will be described with reference to the sequence diagram shown in FIG.

  The users PA and PB enter the imaging areas of the image printing apparatuses 1A and 1B, respectively, and operate the touch panel 13 to start use (steps S101 and S102). For example, the users PA and PB select “remote mode” from the touch panel 13. By selecting “remote mode”, identification information of the device itself is displayed on the touch panel 13. By inputting the identification information of one device on the other device, the connection between the devices is established.

  For example, the user PA notifies the user PB of identification information such as the machine ID and IP address of the image printing apparatus 1A displayed on the touch panel 13 using a portable terminal or the like (step S103). The user PB operates the touch panel 13 of the image printing apparatus 1B, inputs the identification information notified from the user PA, and designates the connection destination image printing apparatus 1A (step S104).

  The image printing apparatus 1B transmits a connection request to the designated image printing apparatus 1A (step S105). When the image printing apparatus 1A acknowledges the connection request, communication between the image printing apparatus 1A and the image printing apparatus 1B is established (step S106).

  After the communication between the apparatuses is established, the charging process is performed in both apparatuses, and the users PA and PB insert a predetermined amount of money (steps S107 and S108).

  After payment of the fee, in the image printing apparatus 1A, the photographing apparatus 12 starts photographing the user PA, cuts out the person image of the user PA from the photographed image, and transmits the person image data to the image printing apparatus 1B (step S109). , S110). Similarly, in the image printing apparatus 1B, the photographing apparatus 12 starts photographing of the user PB, cuts out the person image of the user PB from the photographed image, and transmits the person image data to the image printing apparatus 1A (steps S111 and S112). ).

  The image printing apparatus 1A combines the person image of the user PA cut out from the captured image and the person image of the user PB received from the image printing apparatus 1B, and displays the combined image on the touch panel 13 (step S113, S114). Similarly, the image printing apparatus 1B combines the person image of the user PB cut out from the captured image and the person image of the user PA received from the image printing apparatus 1A, and displays the combined image on the touch panel 13 ( Steps S115 and S116). Thereby, the moving image in which the users PA and PB are synthesized is displayed on both devices.

  The image printing apparatus 1A (1B) transmits the audio data of the user PA (PB) collected by the microphone 15 to the image printing apparatus 1B (1A), and the audio data received from the image printing apparatus 1B (1A). Is output from the speaker 16. Thereby, the users PA and PB can have a conversation via the image printing apparatuses 1A and 1B.

  Each of the users PA and PB can perform editing operations such as adding a stamp and setting a background image, and the editing contents are also notified to a connection destination device (steps S117 to S120). The image printing apparatuses 1A and 1B synthesize editing items based on editing operations by the users PA and PB, and display the synthesized image on the touch panel 13 (steps S121 to S124). Thereby, the editing operations of the users PA and PB are reflected in the display images of the image printing apparatuses 1A and 1B.

  Thereafter, when the user PA presses the shooting instruction button (step S125), the image printing apparatus 1A notifies the image printing apparatus 1B of a shooting instruction (step S126), and both apparatuses perform shooting processing at a predetermined timing. The composite image is displayed as a still image on the touch panel 13 (steps S127 and S128). For example, the time until photographing is counted down on the touch panel 13 of both devices, or a sound such as “yes cheese” is output, and the photographing devices 12 of both devices perform photographing almost simultaneously. Then, a composite image is generated in each of the image printing apparatuses 1 </ b> A and 1 </ b> B and displayed on the touch panel 13.

  When printing an image displayed on the touch panel 13 is desired, the users PA and PB press the approval button on the touch panel, respectively (steps S129 and S131). When the approval button is pressed, the image printing apparatuses 1A and 1B transmit an approval notification to the image printing apparatuses 1B and 1A (steps S130 and S132). If the user PA or PB does not approve and wants to take a picture again, the picture may be taken again.

  When the user PA presses the approval button and receives an approval notification from the image printing apparatus 1B, the image printing apparatus 1A starts to print a composite image (step S133). Similarly, when the user PB presses the approval button and receives an approval notification from the image printing apparatus 1A, the image printing apparatus 1B starts printing a composite image (step S134).

  The users PA and PB can respectively obtain prints of images obtained by combining the personal images of the users PA and PB.

  As described above, according to the present embodiment, by combining and printing human images taken by different users with different image printing apparatuses, an image as if taken together at the same place is printed. Printed material can be provided.

  A person image cut out from the photographed image is transmitted / received between the image printing apparatuses 1A and 1B, and the person image composition processing is performed by each of the image printing apparatuses 1A and 1B. Therefore, it is not necessary to separately provide a server device for composition processing, and the composite image moving image can be smoothly displayed on the touch panel 13.

  In the composition process, the front-rear relationship is determined in advance such that the person image cut out from the captured image of the image printing apparatus 1A is combined before and the person image cut out from the captured image of the image printing apparatus 1B is combined behind. The person image with a large face and body close to the photographing device 12 is placed behind the person image with a small face and body distant from the photographing device 12 and may be combined, resulting in an unnatural finish. . On the other hand, in this embodiment, the front-rear positional relationship of each user is determined from the position of the user in the imaging area of the image printing apparatuses 1A and 1B, and a person image is synthesized. Therefore, it is possible to generate a natural composite image in which all users are in the same place.

  According to the present embodiment, the content of the editing operation performed on one image printing apparatus is notified to the other image printing apparatus and reflected on the displayed composite image. Further, the image printing apparatus includes a microphone 15 and a speaker 16 so that users can have a conversation. For this reason, users of different image printing apparatuses can perform editing operations together while having a conversation.

  As shown in FIG. 7, a connection server device 2 for establishing a connection between the image printing apparatus 1A and the image printing apparatus 1B may be provided. FIG. 8 is a sequence diagram of connection establishment processing using the connection server device 2.

  The users PA and PB enter the shooting areas of the image printing apparatuses 1A and 1B, respectively, and operate the touch panel 13 to start use (steps S201 and S202). When the user PA presses the connection start button displayed on the touch panel 13, the image printing apparatus 1A requests connection registration from the server apparatus 2 (step S203). The user PA notifies the user PB of information for connection such as an authentication code displayed on the touch panel 13 using a mobile terminal or the like (step S204).

  The user PB operates the touch panel 13 of the image printing apparatus 1B and inputs connection information notified from the user PA (step S205). When the image printing apparatus 1B transmits connection information to the server apparatus 2 (step S206), the server apparatus 2 performs an authentication process (step S207). Then, the server apparatus 2 notifies the image print apparatus 1A of the information of the image print apparatus 1B that is the connection destination and instructs connection (step S208). The image printing apparatus 1A transmits a connection start message to the image printing apparatus 1B, thereby establishing communication between the image printing apparatus 1A and the image printing apparatus 1B (step S209).

  In the above embodiment, an example in which the printer 14 prints and outputs a composite image on a printed matter has been described. However, the user may be provided with composite image data. For example, after steps S130 and S132 in FIG. 6, the image data may be transferred to the user's portable terminal by wireless communication such as infrared communication. Alternatively, the user may receive an e-mail address and notify the URL of the website for downloading the image data to the input e-mail address.

  In the example shown in FIG. 6, an example is described in which, when a user of one device presses the shooting button, shooting is performed almost simultaneously on both devices. However, the user of each device performs shooting on each device. You may make it carry out by pushing. In this case, a photographed image (photographing result) from one image printing apparatus may be transmitted to the other image printing apparatus so that the users can confirm each other.

  In the above-described embodiment, the example of superimposing and synthesizing the person images of the users photographed by the two image printing apparatuses 1A and 1B has been described, but a panoramic image may be created by combining them side by side.

  In the above-described embodiment, the image print system including the two image print apparatuses 1A and 1B has been described. However, three or more image print apparatuses may be included.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1, 1A, 1B Image printing apparatus 2 Server apparatus for connection 11 Arithmetic control apparatus 12 Imaging device 13 Touch panel 14 Printer 15 Microphone 16 Speaker 17 Communication part 21 CPU
22 Main memory 23 Disk device 31 Cutout part 32 Position detection part 33 Judgment part 34 Compositing part

Claims (8)

An imaging unit that continuously captures a subject at predetermined time intervals and generates a captured image;
A communication unit for communicating with another image printing apparatus;
An image that cuts out a first person image from the photographed image, combines the second person image received from the other image printing apparatus via the communication unit and the first person image, and generates a plurality of continuous composite images. A processing unit;
A display unit for displaying a moving image using the plurality of composite images;
A printer that prints and outputs a composite image on a print based on an instruction from the subject;
Equipped with a,
When the approval of printing of the composite image is received from the photographed person and the approval notification for approval of printing of the composite image is received from the other image printing apparatus via the communication unit, the printer prints the composite image. An image printing apparatus. The communication unit transmits the first person image to the other image printing apparatus, and transmits an approval notification to the other image printing apparatus upon receiving approval for printing of the composite image from the photographed person. The image printing apparatus according to claim 1.   The image processing unit determines a front-rear positional relationship between a subject corresponding to the first person image and a subject corresponding to the second person image, and generates the composite image based on the determination result. The image printing apparatus according to claim 1, wherein the image printing apparatus is characterized. A microphone that collects the voice of the subject,
A speaker that reproduces and outputs audio data received from the other image printing apparatus by the communication unit;
Further comprising
4. The image printing apparatus according to claim 1, wherein the communication unit transmits audio data collected by the microphone to the other image printing apparatus. 5.   The image processing unit adds an edit item to the composite image based on an editing instruction from the subject or an editing content received by the communication unit from the other image printing apparatus. The image printing apparatus according to any one of 1 to 4.   An image printing system comprising a plurality of image printing apparatuses according to claim 1, wherein each apparatus is connected to be communicable with each other. A photographing unit continuously photographing a person to be photographed at a predetermined time interval to generate a photographed image;
An image processing unit cutting out a first person image from the captured image;
A communication unit receiving a second person image from another image printing apparatus;
The image processing unit combining the first person image and the second person image to generate a plurality of continuous composite images;
A step of displaying a moving image using the plurality of synthesized images;
A printer printing a composite image on a print based on an instruction from the subject and outputting the print;
Equipped with a,
When the approval of printing of the composite image is received from the photographed person and the approval notification for approval of printing of the composite image is received from the other image printing apparatus via the communication unit, the printer prints the composite image. The image printing method characterized by starting .   8. The front-rear positional relationship between a subject corresponding to the first person image and a subject corresponding to the second person image is determined, and the composite image is generated based on the determination result. The image printing method described in 1.

Images