JP6347943B2 - Image output apparatus, image output method, and program - Google Patents

Description

  The present invention relates to an image output device and the like for composing and outputting an image in which a person who wants to photograph with a background is captured.

  2. Description of the Related Art Conventionally, a digital camera or the like that captures an image and acquires an image as a result of the imaging has been developed (see Non-Patent Document 1).

“Digital Camera LUMIX”, [online], Panasonic Corporation, [November 19, 2013 search], Internet [URL; http://panasonic.jp/dc/]

  In a conventional digital camera or the like, an image in which a person to be photographed with a background is not automatically constructed.

An image output apparatus according to the first disclosure includes a person-related image storage unit that stores one or more person-related images that are images related to a person, a background image acquisition unit that acquires a background image that is a captured image, A composite image that composes a composite image, which is a composite image, by combining a person-related image acquisition unit that acquires one or more person-related images from the person-related image storage unit, one or more person-related images, and a background image An image output apparatus includes a configuration unit and an output unit that outputs a composite image.

  With such a configuration, it is possible to automatically configure an image in which a person who wants to shoot with the background is captured.

The image output apparatus of the second disclosure, for the first disclosure, further comprising a corresponding image acquisition unit that acquires the corresponding image is an image corresponding to the background image, the composite image construction unit, one or more The person-related image and the corresponding image are combined, and an image output device that forms a combined image that is a combined image.

  With such a configuration, it is possible to automatically configure an image in which a person who wants to shoot with the background is captured.

The image output apparatus of the third disclosure, for the second disclosed, the background image acquisition unit includes an imaging position information indicating a position at which an image has been captured for the acquisition of the background image The image processing apparatus further includes a corresponding image management information storage unit that acquires a background image, and stores one or more corresponding image management information that is information in which position information corresponding to a position and information corresponding to the position are associated with each other. The image output device acquires a corresponding image corresponding to position information indicating a position that is close enough to satisfy a predetermined condition with respect to a position indicated by the shooting position information included in the background image from the corresponding image management information storage unit. is there.

  With such a configuration, it is possible to automatically configure an image in which a person to be photographed is captured in an image corresponding to a position where a background image is photographed.

The image output apparatus of the fourth disclosure for the second disclosure, the target information is information indicating the photographed is in which target image, one or more of the information that the corresponding image with the corresponding A corresponding image management information storage unit for storing the corresponding image management information; and the corresponding image acquisition unit uses the background image to acquire shooting target information that is information indicating a target imaged in the background image; The image output device acquires a corresponding image corresponding to the same target information as the shooting target information from the corresponding image management information storage unit.

  With such a configuration, it is possible to automatically configure an image in which a person to be photographed is captured in an image corresponding to an object captured in a background image.

The image output apparatus of the fifth disclosure, for the second disclosed, the corresponding image acquisition unit performs a predetermined image processing on the background image is the image which the image processing has been performed This is an image output device that acquires a corresponding image.

  With such a configuration, it is possible to automatically configure an image in which a person to be photographed is captured in an image obtained by processing a background image.

The image output apparatus of the sixth disclosure, for the second to the fifth one of the disclosure, the corresponding image is an image output apparatus an illustration.

  With such a configuration, it is possible to automatically configure an image in which a person to be photographed is captured in an illustration corresponding to a background image.

The present seventh discloses an image output device, for the first to the sixth one of the disclosure, the composite image construction section, superimposed person related image on the background image or the corresponding image, the background image Alternatively, a composite image in a form in which the person-related image can be edited on the corresponding image, a reception unit that receives a person-related image editing instruction that is an instruction to edit the person-related image, and the composite image according to the person-related image editing instruction The image output apparatus further includes a person related image editing unit that edits a person related image.

  With such a configuration, a person image can be edited on a background image.

The image output apparatus of the eighth disclosure, for the first to the seventh one of disclosure, the person-related image storage unit, a photographic image is stored an image including a person-related images, The person-related image acquisition unit acquires a photographic image from the person-related image storage unit, cuts out a person-related image from the photographic image, and the composite image configuration unit includes a person-related image cut out by the person-related image acquisition unit, a background image, Is an image output device that composes a composite image that is a composite image.

  With such a configuration, a person can be cut out from an image in which the person is reflected, and an image in which the person is reflected together with the background can be automatically configured.

The image output apparatus of the ninth disclosure, for the first to the eighth one of disclosure, the person-related image storage unit, the type information corresponding is information indicating the type of a person associated image One or more person-related images attached are stored, and the person-related image acquisition unit acquires type information that is information indicating the type of the background image or the corresponding image, and the person-related image corresponding to the type information is acquired as the person-related image. It is an image output device acquired from a storage unit.

  With such a configuration, it is possible to automatically configure an image in which a person desired to be photographed together with the background is captured using an image of a person according to the type of image that can be a background.

  According to the image output apparatus and the like according to the present invention, it is possible to automatically construct an image in which a person who wants to shoot with the background is captured.

Block diagram of image output apparatus 1 according to Embodiment 1 A flowchart for explaining the overall operation of the image output apparatus 1 Flow chart for explaining the acquisition process of the corresponding image The figure which shows the example of the same background image The figure which shows the example of the same person related picture The figure which shows the example of the same composite image The figure which shows the example of the corresponding image management information The figure which shows the example of the correspondence image The figure which shows the example of the same person related picture The figure which shows the example of the same composite image The figure which shows the example of the corresponding image management information The figure which shows the example of the same composite image The figure which shows the example of the same person related picture The figure which shows the example of the same composite image The figure which shows the example of a movement of the same person related image The figure which shows the example of expansion of the person related image Overview of the computer system in the above embodiment Block diagram of a computer system in the above embodiment

  Embodiments of an image output apparatus and the like according to the present invention will be described below with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again. In addition, the format, content, and the like of each information described in this embodiment are merely examples, and the format, content, and the like are not limited as long as the meaning of each information can be indicated.

(Embodiment 1)
In the present embodiment, an image output apparatus 1 that combines an image acquired by shooting or an image corresponding to the image and information combined with the image and outputs the combined image will be described.

  The image output apparatus 1 in the present embodiment is, for example, a mobile terminal with a camera (such as a mobile phone or a mobile game machine), a digital camera, or the like.

  FIG. 1 is a block diagram of an image output apparatus 1 according to the present embodiment. The image output device 1 includes a person related image storage unit 11, a corresponding image management information storage unit 12, a reception unit 13, a background image acquisition unit 14, a corresponding image acquisition unit 15, a person related image acquisition unit 16, a composite image configuration unit 17, An output unit 18 and a person-related image editing unit 19 are provided.

  The person-related image storage unit 11 stores one or more person-related images that are images related to a person. The person-related image is usually a photograph of a person or an illustration of a person. A person-related image is usually an image in which only a person is captured. An image in which only a person is captured is, for example, an image obtained by cutting out only a person portion from an image in which a person and another subject are captured. In addition, the person is preferably a photographer. The photographer is usually a user who operates the image output apparatus 1.

  Further, the person-related image may be an image in which the whole body of the person is copied or an image in which a part of the person is copied. The part is, for example, the face or the upper body. That is, the part usually includes a human face. The person may be a so-called character, for example.

  Further, for example, type information indicating the type of the person related image may be associated with the person related image. The type information is usually information indicating whether the person-related image is a person photo or a person illustration. In addition, the person-related image may have type information, for example.

  The person-related image storage unit 11 may store a photographic image that is an image including a person-related image. It can be said that the photographic image is, for example, an image in which a person and another subject are captured.

  The corresponding image management information storage unit 12 stores one or more corresponding image management information. Corresponding image management information is information for managing corresponding images. Corresponding image management information is information in which position information is associated with a corresponding image, or information in which target information is associated with a corresponding image.

  The position information is information indicating a position. The position is usually a longitude and latitude, but may include a height (altitude). The corresponding image is an image corresponding to a background image described later. The corresponding image includes, for example, an image corresponding to the position where the image was taken for obtaining the background image, an image corresponding to the object captured in the background image, and image processing determined in advance for the background image. It is the image that was given. The image processing includes, for example, so-called illustration, sepia, and monochrome. The corresponding image may be a so-called illustration. The target information is information indicating a target that is copied in a background image to be described later. The target is information indicating, for example, a subject and contents. The subject is, for example, a person, an animal, a plant, or the like. The contents are, for example, a landscape, a night view, a portrait, and the like.

  The accepting unit 13 accepts an instruction. The instruction is, for example, a background image acquisition instruction, a person related image selection instruction, a person related image editing instruction, or the like. The background image acquisition instruction is an instruction to acquire a background image. The person related image selection instruction is an instruction to select one or more person related images from one or more person related images. The person-related image editing instruction is an instruction to edit a person-related image. The editing includes, for example, movement, enlargement and reduction. That is, the person-related image editing instruction is, for example, a movement instruction that is an instruction to move the person-related image, an enlargement instruction that is an instruction to enlarge the person-related image, a reduction instruction that is an instruction to reduce the person-related image, or the like. . The movement instruction has, for example, image coordinates. The coordinates are information indicating the position of the person-related image in the background image or the corresponding image, for example. The enlargement instruction includes information indicating the size (size) of the person-related image after enlargement, for example. The reduction instruction includes information indicating the size (dimension) of the person-related image after reduction, for example.

  In addition, the reception unit 13 may receive, for example, a power-on instruction or a power-off instruction. When the receiving unit 13 receives these instructions, the image output apparatus 1 normally performs processing according to the instructions.

  Acceptance refers to acquisition of information input from an input device such as a touch panel or a keyboard, acquisition of information stored in a recording medium such as an optical disk, magnetic disk, or semiconductor memory, via a wired or wireless communication line. It is a concept that includes reception of information transmitted in the same manner.

  Moreover, the input means such as information and instructions in the reception unit 13 may be anything such as a menu screen or a keyboard. The accepting unit 13 can be realized by control software for a menu screen, a device driver for input means such as a keyboard, and the like.

  The background image acquisition unit 14 acquires a background image that is an image obtained as a result of shooting. It can be said that the background image is, for example, an image acquired by photographing. The background image is usually a so-called photograph. Moreover, the background image acquisition part 14 acquires a background image normally by imaging | photography. The background image acquisition unit 14 may acquire a background image stored in a predetermined storage area, for example. In this case, the background image is accumulated in the predetermined storage area by, for example, a photographing unit (not shown). Moreover, the said imaging | photography part acquires a background image normally by imaging | photography.

  The background image may be associated with shooting position information, for example. The background image may have shooting position information, for example. The photographing position information is information indicating a position where photographing is performed for obtaining a background image. The shooting position information is position information. Moreover, it can be said that imaging | photography position information is the information which shows the position where the background image was acquired by imaging | photography, for example. Moreover, it can be said that the shooting position information is, for example, a position where a background image is acquired as a result of shooting.

  For example, when acquiring a background image having shooting position information by shooting, the background image acquisition unit 14 acquires, for example, position information indicating the current position, and acquires a background image having the position information as shooting position information. To do. Note that the method and procedure for acquiring position information indicating the current position are well known, and thus detailed description thereof is omitted.

  Further, the background image acquisition unit 14 acquires a background image in response to reception of a background image acquisition instruction by the reception unit 13.

  The background image acquisition unit 14 can be realized by, for example, an image sensor (solid-state imaging device) such as a CMOS or CCD, or a camera (digital still camera, digital video camera) using the image sensor. The composite image construction unit 17 may be realized by, for example, an MPU or a memory. The processing procedure of the background image acquisition unit 14 is usually realized by software, and the software is recorded in a recording medium such as a ROM.

  The corresponding image acquisition unit 15 acquires a corresponding image. The corresponding image acquisition unit 15 acquires a corresponding image using at least the background image. The background image is a background image acquired by the background image acquisition unit 14.

  For example, the corresponding image acquisition unit 15 acquires a corresponding image from the corresponding image management information storage unit 12. For example, when the corresponding image management information is information in which position information and a corresponding image are associated with each other, the corresponding image acquisition unit 15 first acquires shooting position information from the background image. Then, the corresponding image acquisition unit 15 obtains a corresponding image corresponding to position information indicating a position that is close enough to satisfy a predetermined condition (hereinafter, appropriately referred to as a distance condition) with a position indicated by the shooting position information. Acquired from the corresponding image management information storage unit 12. The distance condition is, for example, that the distance is equal to or smaller than a predetermined threshold, or that the distance is equal to or larger than a predetermined first threshold and equal to or smaller than a predetermined second threshold. . Further, the “above” may be “excess”. Further, the “below” may be “less than”.

  For example, when the corresponding image management information is information in which the target information and the corresponding image are associated with each other, the corresponding image acquisition unit 15 first uses the background image to indicate the target imaged in the background image. Information on the subject to be photographed is acquired. Since the method and procedure for acquiring the photographing target information are well known, detailed description thereof will be omitted. The corresponding image acquisition unit 15 acquires the shooting target information by so-called image recognition, for example. Then, the corresponding image acquisition unit 15 acquires a corresponding image corresponding to the same target information as the shooting target information from the corresponding image management information storage unit 12.

  In addition, the corresponding image acquisition unit 15 performs, for example, predetermined image processing on the background image, and acquires a corresponding image that is an image subjected to the image processing. The image processing includes, for example, so-called illustration, sepia, and monochrome. When performing image processing on a background image, for example, the corresponding image acquisition unit 15 detects a target imaged in the background image and acquires an image of only the target image. And the corresponding image acquisition part 15 may perform an image process with respect to the image only of the said object, and may acquire a corresponding image. “Applying image processing” may be rephrased as “applying image processing” as appropriate.

  The person related image acquisition unit 16 acquires one or more person related images from the person related image storage unit 11. There is no limitation on the method or procedure for acquiring the person-related image. For example, the person-related image acquisition unit 16 acquires the person-related image selected by the person-related image selection instruction received by the reception unit 13. The person related image acquisition unit 16 acquires all the person related images stored in the person related image storage unit 11, for example.

  For example, when the background image acquisition unit 14 acquires a background image, the person-related image acquisition unit 16 acquires, for example, a person-related image corresponding to the type of the background image. The background image is usually a photograph. Therefore, when the background image acquisition unit 14 acquires a background image, the person-related image acquisition unit 16 acquires a person-related image that is associated with type information that usually indicates that it is a photograph of a person.

For example, when the corresponding image acquisition unit 15 acquires a corresponding image, the person related image acquisition unit 16 acquires, for example, a person related image corresponding to the type of the corresponding image. The person-related image is usually a photograph of a person or an illustration of a person. Therefore, when the corresponding image acquisition unit 15 acquires the corresponding image, the person related image acquisition unit 16 usually acquires type information indicating the type of the person related image using the person related image. At this time, the person-related image acquisition unit 16 normally determines whether the person-related image is a photograph or an illustration. Since the determination method and procedure are known, detailed description thereof will be omitted. Then, the person related image acquisition unit 16 acquires information indicating the result of the determination as type information. Then, a person associated image acquisition unit 16, the acquired type information same type information and to obtain the association Iteiru person related image.

  For example, when the corresponding image acquired by the corresponding image acquisition unit 15 is a photograph, the person-related image acquisition unit 16 acquires a person-related image associated with type information indicating that it is a photograph of a person. Also. For example, when the corresponding image acquired by the corresponding image acquisition unit 15 is an illustration, the person-related image acquisition unit 16 acquires a person-related image associated with type information indicating that it is an illustration of a person.

  When a photographic image is stored in the person-related image storage unit 11, the person-related image acquisition unit 16 acquires the photographic image, cuts out only the person part from the acquired photographic image, and cuts out the photographic image. Acquire an image as a person-related image. Note that since a method and a procedure for cutting out only a person portion from an image are known, detailed description thereof is omitted.

  The composite image construction unit 17 constructs a composite image. A composite image is an image in which an image and a person-related image are combined. A composite image is an image in which person-related images are arranged on the image. The image is a background image or a corresponding image. That is, the composite image construction unit 17 composes a composite image by, for example, composing a background image and one or more person-related images. The composite image is an image in which one or more person-related images are arranged on the background image. The composite image construction unit 17 composes a composite image by, for example, compositing the corresponding image and one or more person-related images. The composite image is an image in which one or more person-related images are arranged on the corresponding image. The background image is a background image acquired by the background image acquisition unit 14. The corresponding image is a corresponding image acquired by the corresponding image acquisition unit 15. The one or more person-related images are person-related images acquired by the person-related image acquisition unit 16. Also, since a method and a procedure for synthesizing an image and an image (here, a background image or a corresponding image and a person-related image) are known, detailed description thereof is omitted.

  In addition, the composite image construction unit 17 usually superimposes a person related image on the background image or the corresponding image, and forms a composite image in a manner that the person related image can be edited on the background image or the corresponding image. At this time, the position where the person-related image is arranged does not matter.

  The output unit 18 outputs a composite image. Output refers to display on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, processing results to other processing devices or other programs, etc. It is a concept that includes delivery. In addition, regarding transmission, accumulation, and delivery of processing results, an output target is finally presented to the user.

  The output unit 18 may or may not include an output device such as a display or a speaker. The output unit 18 can be implemented by output device driver software, or output device driver software and an output device.

  The person related image editing unit 19 edits the person related image included in the composite image in accordance with the person related image editing instruction. The person-related image editing instruction is a person-related image editing instruction received by the receiving unit 13. The composite image is usually a composite image output by the output unit 18. Further, the composite image is a composite image in a form in which the person-related image can be edited on the background image or the corresponding image. The person-related image editing instruction includes, for example, a movement instruction that is an instruction to move the person-related image, an enlargement instruction that enlarges the person-related image, and a reduction instruction that reduces the person-related image.

  For example, when the reception unit 13 receives a movement instruction, the person-related image editing unit 19 normally moves the person-related image to a position on the image indicated by the movement instruction. That is, the person-related image editing unit 19 usually moves the person-related image to the position indicated by the coordinates included in the movement instruction. When the reception unit 13 receives an enlargement instruction, the person-related image editing unit 19 normally enlarges the person-related image to the size of the image indicated by the enlargement instruction. That is, the person-related image editing unit 19 normally enlarges the person-related image to the size of the image included in the enlargement instruction. For example, when the reception unit 13 receives a reduction instruction, the person-related image editing unit 19 normally reduces the person-related image to the size of the image indicated by the reduction instruction. That is, the person-related image editing unit 19 normally reduces the person-related image to the size of the image included in the reduction instruction.

  The person-related image storage unit 11 and the corresponding image management information storage unit 12 are preferably non-volatile recording media, but can also be realized by volatile recording media. The process of storing predetermined information in the person related image storage unit 11 or the like is not limited. For example, the predetermined information may be stored in the person-related image storage unit 11 or the like via a recording medium, a communication line, an input device, or the like.

  In addition, the corresponding image acquisition unit 15, the person related image acquisition unit 16, the composite image configuration unit 17, and the person related image editing unit 19 can be usually realized by an MPU, a memory, or the like. Further, the processing procedure of the corresponding image acquisition unit 15 or the like is usually realized by software, and the software is recorded on a recording medium such as a ROM. Note that the corresponding image acquisition unit 15 and the like may be realized by hardware (a dedicated circuit).

  Next, the overall operation of the image output apparatus 1 will be described using a flowchart. Note that the i-th information in the predetermined information is described as “information [i]”. FIG. 2 is a flowchart showing the overall operation of the image output apparatus 1.

  (Step S201) The image output apparatus 1 determines whether or not the reception unit 13 has received a power-on instruction. If accepted, the process proceeds to step S202; otherwise, the process returns to step S201.

  (Step S202) The image output apparatus 1 performs power-on processing.

  (Step S203) The background image acquisition unit 14 determines whether the reception unit 13 has received a background image acquisition instruction. If accepted, the process proceeds to step S204, and if not, the process proceeds to step S214.

  (Step S204) The background image acquisition unit 14 acquires a background image.

  (Step S205) The person-related image acquisition unit 16 acquires one or more person-related images from the person-related image storage unit 11.

  (Step S206) The corresponding image acquisition unit 15 determines whether or not to acquire a corresponding image. The determination is made using, for example, information indicating whether or not to obtain the corresponding image is stored in a predetermined storage area. If a corresponding image is acquired, the process proceeds to step S208. If not, the process proceeds to step S207.

  (Step S207) The composite image construction unit 17 composes a composite image by compositing the background image acquired in Step S204 and one or more person-related images acquired in Step S205.

  (Step S208) The corresponding image acquisition unit 15 acquires a corresponding image. Details of this processing will be described with reference to the flowchart of FIG.

  (Step S209) The composite image construction unit 17 composes the composite image by compositing the corresponding image acquired in step S208 and one or more person-related images acquired in step S205.

  (Step S210) The output unit 18 outputs the composite image configured in step S207 or the composite image configured in step S209.

  (Step S211) The person-related image editing unit 19 determines whether or not the output unit 18 is outputting a composite image. If it is being output, the process proceeds to step S212; otherwise, the process proceeds to step S214.

  (Step S212) The person-related image editing unit 19 determines whether the receiving unit 13 has received a person-related image editing instruction. If accepted, the process proceeds to step S213, and if not, the process returns to step S211.

  (Step S213) The person-related image editing unit 19 edits the person-related image included in the composite image being output by the output unit 18 in accordance with the person-related image editing instruction received in step S212.

  (Step S214) The image output apparatus 1 determines whether or not the receiving unit 13 has received a power-off instruction. If accepted, the process proceeds to step S215, and if not, the process returns to step S203.

  (Step S215) The image output apparatus 1 performs a power-off process. Then, the process returns to step S201.

  In the flowchart of FIG. 2, the process may be terminated by powering off or a process termination interrupt.

  FIG. 3 is a flowchart showing the corresponding image acquisition processing in step S208 of the flowchart of FIG. In the flowchart of FIG. 3, it is assumed that m corresponding image management information is stored in the corresponding image management information storage unit 12.

(Step S301) The corresponding image acquisition unit 15 determines whether to use corresponding image management information. The determination is made using, for example, information indicating whether or not to use the corresponding image management information is stored in a predetermined storage area. Then, when using the corresponding image management information, the process proceeds to step S302, otherwise proceeds to step S3 16.

  (Step S302) The corresponding image acquisition unit 15 determines whether the corresponding image management information includes position information. If so, the process proceeds to step S303, and if not, the process proceeds to step S310.

  (Step S303) The corresponding image acquisition unit 15 acquires shooting position information from the background image.

  (Step S304) The corresponding image acquisition unit 15 sets 1 to the counter i.

  (Step S305) The corresponding image acquisition unit 15 uses the shooting position information acquired in step S303 and the position information [i] that is the position information included in the corresponding image management information [i] to indicate the shooting position information. The distance from the position to the position indicated by the position information [i] is calculated.

  (Step S306) The corresponding image acquisition unit 15 determines whether or not the distance calculated in Step S305 satisfies the distance condition. When it satisfies, it progresses to step S307, and when that is not right, it progresses to step S308.

  (Step S307) The corresponding image acquisition unit 15 acquires a corresponding image [i] that is a corresponding image included in the corresponding image management information [i].

  (Step S308) The corresponding image acquisition unit 15 determines whether i is m. If it is m, the process returns to the upper process, and if not, the process proceeds to step S309.

  (Step S309) The corresponding image acquisition unit 15 increments i by 1. Then, the process returns to step S304.

  (Step S310) The corresponding image acquisition unit 15 acquires the shooting target information using the background image.

  (Step S311) The corresponding image acquisition unit 15 sets 1 to the counter i.

  (Step S312) The corresponding image acquisition unit 15 determines whether or not the target information [i], which is target information included in the corresponding image management information [i], is the same as the shooting target information acquired in Step S310. If they are the same, the process proceeds to step S313, and if not, the process proceeds to step S314.

  (Step S313) The corresponding image acquisition unit 15 acquires a corresponding image [i] that is a corresponding image included in the corresponding image management information [i].

  (Step S314) The corresponding image acquisition unit 15 determines whether i is m. If m, the process returns to the upper process, and if not, the process proceeds to step S315.

  (Step S315) The corresponding image acquisition unit 15 increments i by 1. Then, the process returns to step S311.

  (Step S316) The corresponding image acquisition unit 15 applies image processing to the background image, and acquires a corresponding image that is an image to which the image processing is applied. Then, the process returns to the upper process.

  The overall operation of the image output apparatus 1 described above is merely an example. That is, the overall operation of the image output apparatus 1 is not limited to the above description.

(Concrete example)
Next, a specific example of the operation of the image output apparatus 1 will be described. In this specific example, the image output apparatus 1 is assumed to be a smartphone with a camera (hereinafter, referred to as a smartphone as appropriate).

(Example 1)
In this example, an example in which a background image and a person-related image are combined to form a combined image will be described. In this example, it is assumed that the person-related image storage unit 11 stores one or more person-related images. Further, it is assumed that type information is associated with each of the one or more person-related images.

  First, it is assumed that the user operates the smartphone and performs an operation for taking a picture with the camera. Then, the reception unit 13 receives a background image acquisition instruction.

  Next, the background image acquisition unit 14 performs shooting in response to the reception of the background image acquisition instruction by the reception unit 13 and acquires the background image. The background image is, for example, the image shown in FIG.

  Next, the person-related image acquisition unit 16 acquires from the person-related image storage unit 11 a person-related image associated with type information indicating that it is a photograph of a person. The person-related image is assumed to be an image shown in FIG.

  Next, the composite image construction unit 17 combines the background image of FIG. 4 and the person-related image of FIG. 5 so that the person-related image of FIG. 5 is arranged on the background image of FIG. Configure. The composite image is, for example, FIG.

  Next, the output unit 18 outputs the composite image of FIG. The output unit 18 outputs the composite image, for example, on a screen.

(Example 2)
In this example, an example in which a corresponding image and a person-related image are combined to form a combined image will be described. In this example, it is assumed that the person-related image storage unit 11 stores one or more person-related images. Further, it is assumed that the corresponding image management information storage unit 12 stores the corresponding image management information shown in FIG. The corresponding image management information includes an ID for uniquely specifying a record, position information, and a corresponding image. Further, the corresponding image (for example, “AAA.jpg”) in FIG. 7 is a so-called file name. That is, the corresponding image management information storage unit 12 stores a corresponding image identified by the file name.

  Next, in the same manner as in Example 1, it is assumed that the user operates the smartphone and performs an operation for photographing with the camera. Then, the reception unit 13 receives a background image acquisition instruction.

  Next, the background image acquisition unit 14 performs shooting in response to the reception of the background image acquisition instruction by the reception unit 13 and acquires the background image. The background image has shooting position information “(N35.33XX, E135.XX35)”.

  Next, the corresponding image acquisition unit 15 acquires the shooting position information “(N35.33XX, E135.XX35)” from the background image acquired by the background image acquisition unit 14. Then, the corresponding image acquisition unit 15 uses the shooting position information “(N35.33XX, E135.XX35)” and one or more pieces of position information in FIG. 7, the position indicated by the shooting position information, and the 1 The distance from the position indicated by each position information is calculated. Then, the corresponding image acquisition unit 15 determines that the distance calculated using the shooting position information and the position information of “ID = 012” in FIG. 7 satisfies the distance condition. Then, the corresponding image acquisition unit 15 acquires the corresponding image “BBB.jpg” of “ID = 012” in FIG. The corresponding image is assumed to be an image shown in FIG.

  Next, it is assumed that the user selects a smartphone and performs an operation for selecting one person-related image from one or more person-related images stored in the person-related image storage unit 11. Then, the reception unit 13 receives a person-related image selection instruction.

  Next, the person related image acquisition unit 16 acquires the person related image selected by the person related image selection instruction from the person related image storage unit 11. The person-related image is assumed to be an image shown in FIG. The image is an illustration of a person.

  Next, the synthesized image construction unit 17 synthesizes the corresponding image in FIG. 8 and the person-related image in FIG. 9 so that the person-related image in FIG. 9 is arranged on the corresponding image in FIG. Configure. The composite image is, for example, FIG.

  Next, the output unit 18 outputs the composite image of FIG. The output unit 18 outputs the composite image, for example, on a screen.

(Example 3)
In this example, an example in which a corresponding image and a person-related image are combined to form a combined image will be described. In this example, it is assumed that the person-related image storage unit 11 stores one or more person-related images. Further, it is assumed that the corresponding image management information storage unit 12 stores the corresponding image management information shown in FIG. The corresponding image management information includes an ID for uniquely identifying a record, target information, and a corresponding image. Also, the corresponding image in FIG. 11 is the same as the corresponding image in FIG.

  First, in the same manner as in Example 1, it is assumed that the user first operates the smartphone and performs an operation for photographing with the camera. Then, the reception unit 13 receives a background image acquisition instruction.

  Next, the background image acquisition unit 14 performs shooting in response to the reception of the background image acquisition instruction by the reception unit 13 and acquires the background image.

  Next, the corresponding image acquisition unit 15 performs, for example, image recognition on the background image acquired by the background image acquisition unit 14 and acquires shooting target information. It is assumed that the shooting target information is “landscape”. Then, the corresponding image acquisition unit 15 determines that the shooting target information “landscape” is the same as the target information “landscape” of “ID = 012” in FIG. Then, the corresponding image acquisition unit 15 acquires the corresponding image “BBB.jpg” of “ID = 012” in FIG. The corresponding image is assumed to be an image shown in FIG.

  Next, it is assumed that the user selects a smartphone and performs an operation for selecting one person-related image from one or more person-related images stored in the person-related image storage unit 11. Then, the reception unit 13 receives a person-related image selection instruction.

  Next, the person related image acquisition unit 16 acquires the person related image selected by the person related image selection instruction from the person related image storage unit 11. The person-related image is assumed to be an image shown in FIG. The image is an illustration of a person.

  Next, the synthesized image construction unit 17 synthesizes the corresponding image in FIG. 8 and the person-related image in FIG. 9 so that the person-related image in FIG. 9 is arranged on the corresponding image in FIG. Configure. The composite image is, for example, FIG.

  Next, the output unit 18 outputs the composite image of FIG. The output unit 18 outputs the composite image, for example, on a screen.

(Example 4)
In this example, an example in which a corresponding image and a person-related image are combined to form a combined image will be described. In this example, it is assumed that the person-related image storage unit 11 stores one or more person-related images. Further, it is assumed that type information is associated with each of the one or more person-related images. The corresponding image acquisition unit 15 performs image processing on the background image and acquires the corresponding image. The image processing is illustrated.

  First, in the same manner as in Example 1, it is assumed that the user operates the smartphone and performs an operation for photographing with the camera. Then, the reception unit 13 receives a background image acquisition instruction.

  Next, the background image acquisition unit 14 performs shooting in response to the reception of the background image acquisition instruction by the reception unit 13 and acquires the background image. The background image is assumed to be shown in FIG.

  Next, the corresponding image acquisition unit 15 performs image processing for illustration on the background image of FIG. 4 to acquire a corresponding image. The corresponding image is assumed to be an image shown in FIG.

  Next, the person-related image acquisition unit 16 acquires a person-related image associated with type information indicating that it is an illustration of a person from the person-related image storage unit 11. The person-related image is assumed to be an image shown in FIG.

  Next, the synthesized image construction unit 17 synthesizes the corresponding image of FIG. 12 and the person-related image of FIG. 13 so that the person-related image of FIG. 13 is arranged on the corresponding image of FIG. Configure. The composite image is, for example, FIG.

  Next, the output unit 18 outputs the composite image of FIG. The output unit 18 outputs the composite image, for example, on a screen.

(Example 5)
In this example, an example of editing a person-related image included in a composite image will be described. In this example, it is assumed that the composite image construction unit 17 composes the composite image shown in FIG. In the composite image, the person-related image in FIG. 9 is arranged in an editable manner on the corresponding image in FIG.

  First, in a state where the composite image of FIG. 10 is displayed on the smartphone screen, the user operates the smartphone, and the person-related image of FIG. 9 arranged on the corresponding image of FIG. 8 is changed from the lower right to the lower left. Suppose you drag. Then, the reception unit 13 receives a person-related image editing instruction. The person-related image editing instruction is a movement instruction. The movement instruction has coordinates (x, y) at the upper left after the drag.

  Next, the person-related image editing unit 19 moves the person-related image in FIG. 9 to the coordinates (x, y) included in the person-related image editing instruction received by the receiving unit 13. At this time, for example, the person-related image editing unit 19 makes the position (coordinates) in the corresponding image of the person-related image of FIG. 9 selected at the time of dragging coincide with the coordinates (x, y) after the movement. Move a person-related image. The composite image after the movement is, for example, FIG.

  For example, the person-related image editing unit 19 may move the person-related image in accordance with the drag locus.

  In the state where the composite image of FIG. 15 is displayed on the smartphone screen, the user operates the smartphone and performs an operation of enlarging the person-related image of FIG. 9 arranged on the corresponding image of FIG. To do. The operation is, for example, a pinch out. Then, the reception unit 13 receives a person-related image editing instruction. The person related image editing instruction is accepted. The person-related image editing instruction is an enlargement instruction. The enlargement instruction has a size (w, h) after enlargement. The “w” indicates the horizontal width of the image. The “h” indicates the vertical width of the image.

  Next, the person-related image editing unit 19 enlarges the size of the person-related image in FIG. 9 to the above (w, h). The enlarged composite image is, for example, FIG.

  As described above, according to the image output apparatus 1 according to the present embodiment, it is possible to automatically construct an image in which a person to be photographed is photographed together with the background.

  Further, the image output apparatus 1 according to the present embodiment can automatically construct an image in which a person to be photographed is captured in an image corresponding to a position where a background image is photographed. In addition, according to the image output apparatus 1 according to the present embodiment, it is possible to automatically configure an image in which a person to be photographed is captured in an image corresponding to an object captured in a background image.

  As described above, according to the image output apparatus 1 according to the present embodiment, for example, when a photographer shoots a landscape or the like by itself, a photograph in which the photographer himself / herself is reflected together with the landscape or the like is automatically configured. be able to. In addition, according to the image output apparatus 1 according to the present embodiment, for example, even if the person to be photographed is not at the photographing location, an image in which the person is photographed together with the background can be automatically configured.

  Moreover, it can be said that the image output apparatus 1 by this Embodiment can provide the new style of imaging | photography with portable terminals, such as a smart phone and a digital camera, from the above effect. In other words, it can be said that the image output apparatus 1 according to the present embodiment is a new imaging technique different from the conventional one.

  Further, the image output apparatus 1 according to the present embodiment is different from a so-called photokura machine. That is, in the photo booth, the photographed person image is combined with the background image prepared in advance, whereas in the image output apparatus 1, the person prepared in advance is captured in the photographed background image. Are synthesized. Also, in the photo booth machine, the subject of shooting is a person, whereas in the image output apparatus, the subject of shooting is the background. In other words, the photo booth machine synthesizes the captured main person image with the stored secondary background image, whereas the image output apparatus 1 captures the stored main person related image with the captured secondary background image. Composite to the image. Therefore, although the image output apparatus 1 and the photokura machine may have the same resulting image, it can be said that the image output apparatus 1 and the photokura machine are greatly different in the situation to be used and the obtained effect.

  In the present embodiment, the image output apparatus 1 may not include the corresponding image management information storage unit 12. In this case, the corresponding image acquisition unit 15 acquires a corresponding image by performing image processing on the background image acquired by the background image acquisition unit 14.

  Further, in each of the above embodiments, it goes without saying that two or more communication units existing in one apparatus may be physically realized by one medium.

  The image output device in each of the above embodiments may be, for example, a stand-alone device or a server device in a server / client system.

  In each of the above embodiments, each process or each function may be realized by centralized processing by a single device or a single system, or distributed by a plurality of devices or a plurality of systems. It may be realized by being processed.

  In each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  Moreover, the software which implement | achieves the image output apparatus in each said embodiment is the following programs, for example. In other words, this program obtains a background image that is an image obtained as a result of photographing on a computer that can access a person-related image storage unit that stores one or more person-related images that are information combined with the image. An acquisition unit, a person-related image acquisition unit that acquires one or more person-related images from the person-related image storage unit, the one or more person-related images, and the background image are combined and the combined image. It is a program for functioning as a composite image forming unit that forms a composite image and an output unit that outputs the composite image.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware.

  The program may be executed by being downloaded from a server or the like, or a program recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, or the like) is read out. May be executed. Further, this program may be used as a program constituting a program product.

  Moreover, the computer which performs the said program may be single, and plural may be sufficient as it. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 17 is a schematic diagram of a computer system 9 that executes the above-described program to realize the image output apparatus and the like of the above-described embodiment. The above-described embodiments can be realized by computer hardware and a computer program executed thereon.

  In FIG. 17, the computer system 9 includes a computer 901 including a CD-ROM drive 9011, a keyboard 902, a mouse 903, and a monitor 904.

FIG. 18 is a block diagram of the computer system 9. In FIG. 18, in addition to the CD-ROM drive 9011, a computer 901 is connected to an MPU 9013, a ROM 9014 for storing a program such as a bootup program, and an MPU 9013, and temporarily stores an instruction of an application program. comprises a RAM9015 to provide temporary storage space, application programs, system programs, and a hard disk 90 16 for storing data, and a bus 90 17 interconnecting the CD-ROM drive 9011, MPU90 13 or the like. Although not shown here, the computer 901 may further include a network card that provides connection to a LAN.

The computer system 9, a program for executing the function of the image output apparatus such embodiment described above may be stored in a CD-ROM9101, is inserted into the CD-ROM drive 9011 may be further transferred to the hard disk 90 16 . Alternatively, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 9016. Program is loaded into the RAM90 15 at the time of execution. The program may be loaded directly from the CD-ROM 9101 or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the image output apparatus according to the above-described embodiment. The program only needs to include an instruction portion that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 9 operates is well known and will not be described in detail.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the image output apparatus according to the present invention has an effect that an image in which a person who wants to shoot with a background can be automatically configured, and is useful as a portable terminal with a camera.

DESCRIPTION OF SYMBOLS 1 Image output device 11 Person related image storage part 12 Corresponding image management information storage part 13 Reception part 14 Background image acquisition part 15 Corresponding image acquisition part 16 Person related image acquisition part 17 Composite image structure part 18 Output part 19 Person related image edit part

Claims (8)

And persons related image storage unit that human-related image related to human object is stored,
And a receiving unit which receives the background image acquisition instruction you get the background image,
In response to the receiving of the previous SL background image acquisition instruction, the background image acquisition unit that acquires the shoot the background image,
In response to the receiving of the previous SL background image acquisition instruction, and persons associated image acquisition unit for acquiring the person related image storage unit or al the human-related images,
A corresponding image acquisition unit for acquiring a corresponding image corresponding to the background image;
In response to the receiving of the previous SL background image acquisition instruction, to synthesize and the person associated image and said corresponding picture image, a composite image arrangement unit that constitute the synthesis image form 該合,
For example Bei and an output unit configured to output the previous Symbol synthetic image,
The background image acquisition unit acquires the background image having shooting position information indicating a first position where shooting was performed for acquiring the background image;
A corresponding image management information storage unit for storing corresponding image management information in which position information indicating a second position is associated with the corresponding image;
The corresponding image acquisition unit retrieves the corresponding image corresponding to the position information indicating the second position so that the distance from the first position satisfies a predetermined condition from the corresponding image management information storage unit. Image output device to acquire . The corresponding image management information storage unit stores corresponding image management information in which target information indicating a target shown in an image and the corresponding image are associated with each other.
The corresponding image acquisition unit uses the background image to acquire shooting target information indicating a target imaged in the background image, and the corresponding image corresponding to the target information that is the same as the shooting target information, the corresponding image management information you obtained from storage unit according to claim 1 image output apparatus according. The corresponding image acquisition unit, the subjected to predetermined image processing on the background image, the image processing retrieve the corresponding image subjected claim 1 Symbol placing the image output apparatus. The composite image construction unit superimposes the person-related image on the background image or the corresponding image, and composes the composite image in a form in which the person-related image can be edited on the background image or the corresponding image. ,
A reception unit for receiving a person-related image editing instruction for editing the person-related image;
The person related image editing instruction in accordance with the combined image the person related image serial mounting an image output apparatus in any one of claims claims 1-3, further comprising a person-related image editing unit for editing the having. The person-related image storage unit stores a photographic image including the person-related image,
The person-related image acquisition unit acquires the photographic image from the person-related image storage unit, cuts out the person-related image from the photographic image,
The composite image composition unit composes the synthesized image by synthesizing the person-related image cut out by the person-related image acquisition unit and the background image. serial mounting image output device to. The person-related image storage unit stores the person-related image associated with type information indicating the type of the person-related image.
The person-related image acquisition unit acquires type information indicating a type of the background image or the corresponding image, and acquires the person-related image corresponding to the type information from the person-related image storage unit. the image output apparatus according to 5 have shifted one claims. A person-related image storage unit that stores person-related images related to a person, a corresponding image management information storage unit, a reception unit, a background image acquisition unit, a person-related image acquisition unit, a corresponding image acquisition unit, and a composite image configuration And an image output method performed using an output unit,
A receiving step in which the receiving unit receives a background image acquisition instruction for acquiring a background image;
A background image in which the background image acquisition unit acquires the background image having shooting position information indicating a first position where shooting was performed for acquiring the background image in response to reception of the background image acquisition instruction. An acquisition step;
A person-related image acquisition step in which the person-related image acquisition unit acquires the person-related image from the person-related image storage unit in response to reception of the background image acquisition instruction;
A corresponding image acquisition step in which the corresponding image acquisition unit acquires a corresponding image corresponding to the background image;
The composite image composing unit composing the person-related image and the corresponding image in response to receiving the background image acquisition instruction, and composing the composite image;
The output unit includes an output step of outputting the composite image;
In the corresponding image acquisition step, the position information and the corresponding image correspond to the corresponding image corresponding to the position information indicating the second position so that the distance from the first position satisfies a predetermined condition. An image output method for acquiring from the corresponding image management information storage unit in which the corresponding image management information attached is stored. A computer capable of accessing a person-related image storage unit storing a person-related image related to a person and a corresponding image management information storage unit;
A reception unit for receiving a background image acquisition instruction for acquiring a background image;
In response to receiving the background image acquisition instruction, a background image acquisition unit that acquires the background image;
A person-related image acquisition unit that acquires the person-related image from the person-related image storage unit in response to receiving the background image acquisition instruction;
A corresponding image acquisition unit for acquiring a corresponding image corresponding to the background image;
In response to receiving the background image acquisition instruction, the person-related image and the corresponding image are combined, and a combined image configuration unit that forms the combined composite image;
Function as an output unit for outputting the composite image;
Causing the background image acquisition unit to function to acquire the background image having shooting position information indicating a first position at which shooting was performed for acquiring the background image;
The position information and the corresponding image correspond to the corresponding image corresponding to the position information indicating the second position so that the distance to the first position satisfies a predetermined condition. A program for causing a function to acquire from the corresponding image management information storage unit in which the corresponding image management information is stored.