JP6098104B2 - Auxiliary imaging device and program - Google Patents

Description

  The present invention relates to an auxiliary imaging device, a main imaging device, and a program used for them.

An imaging system is known in which a slave camera captures another subject adjacent to a subject captured by a main camera (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent Application Laid-Open No. 2011-101165

  However, in Patent Document 1, since the slave camera follows only the subject adjacent to the subject of the main camera, there are few scene variations that can be taken.

  In the first aspect of the present invention, the information acquisition unit that acquires the imaging history of the main imaging device and the information acquisition unit acquire the imaging history of the main imaging device from the main imaging device that captures a scene by a user operation and generates a captured image. Provided is an auxiliary imaging device that includes an addition determination unit that determines a scene to be added based on an imaging history, and an imaging unit that captures the scene determined by the addition determination unit and generates an image.

  In the second aspect of the present invention, an imaging unit that captures a scene by a user operation and generates a captured image, a history storage unit that stores an imaging history of the imaging unit, and an imaging history stored by the history storage unit By referring to the above, there is provided a main imaging device including an additional determination unit that determines a scene to be added and an output unit that outputs to the auxiliary imaging device that the scene determined by the addition determination unit is to be imaged.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 shows a configuration of an imaging system according to a first embodiment. The example of the group photograph which concerns on this embodiment is shown. A block diagram of main imaging device 10 and auxiliary imaging device 20 concerning this embodiment is shown. An example of the imaging history which concerns on this embodiment is shown. 2 shows a processing flow of an imaging system according to the present embodiment. The block diagram of the main imaging device 10 and the auxiliary imaging device 20 which concerns on 2nd Embodiment is shown. A modification of the auxiliary imaging device 20 is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration of an imaging system according to the first embodiment. The imaging system includes a main imaging device 10 held by a user and an auxiliary imaging device 20 that moves autonomously, and the main imaging device 10 and the auxiliary imaging device 20 capture a plurality of scenes constituting a group photograph. In FIG. 1, the main imaging device 10 images a scene 30 including a subject 34 (mother) and a subject 36 (child).

  2A and 2B show examples of group photographs according to this embodiment. A group photo is a photo showing a plurality of scenes combined to express a specific theme. For example, the group photo may be composed of a plurality of scenes in which the same subject is imaged under different imaging conditions, or a plurality of scenes each including a plurality of subjects associated with a specific common theme.

  Here, the different imaging conditions indicate that, for example, the shooting date / time, the distance between the subject and the photographer, the focal length of the lens, the angle of view, the shutter speed, the F value, the ISO sensitivity, the shooting composition, and the like are different. The composition of shooting may include, for example, an angle, a ratio of the subject in the image, and a position where the subject is arranged in the image.

  As an example, in the case of a group photo of a family consisting of three parents and children, as shown in FIG. 2A, (i) a scene in which a mother is included as a main subject 34, (ii) a main subject A group photo may be composed of a scene including a child as 36 and (iii) a scene including a father who is a user of the main imaging device 10 as a main subject 32.

  As another example, in the case of a group photo with a specific subject 36 as a theme, as shown in FIG. 2B, (i) a scene in which the face of the subject 36 is photographed, (ii) surrounding conditions And (iii) a scene in which the entire body of the subject 36 is photographed large, and a group photo may be configured.

  FIG. 3 is a block diagram of the main imaging device 10 and the auxiliary imaging device 20 according to the present embodiment. In the imaging system according to the present embodiment, the main imaging device 10 and the auxiliary imaging device 20 cooperate with each other to capture an insufficient scene in the combined photograph and complete the combined photograph.

  The main imaging device 10 is an imaging device held by a user, and captures a scene by a user operation to generate a captured image. The main imaging device 10 may be, for example, a single-lens camera, a compact camera, or a mobile terminal with a camera. The main imaging device 10 includes an imaging unit 102, an operation unit 104, a communication unit 106, a history storage unit 108, and a control unit 120.

  The imaging unit 102 captures a scene by a user operation and generates a captured image. The imaging unit 102 may be an imaging unit that obtains image data by causing a light beam to enter and form an image on an element such as a CCD or a CMOS. For example, the imaging unit 102 may include pixels with horizontal 3000 pixels and vertical 2000 pixels. The imaging unit 102 supplies the captured image data of the subject to the control unit 120. The imaging unit 102 may include a single focus lens or a zoom lens. Further, the imaging unit 102 may include a plurality of lenses having different exchangeable functions. In addition, a plurality of imaging units 102 may be provided in the main imaging device 10.

  The operation unit 104 is provided at an arbitrary location on the main imaging apparatus 10 and supplies an operation from the user to the control unit 120. The operation unit 104 inputs various operations including, for example, an imaging instruction for the imaging unit 102, an instruction for the auxiliary imaging device 20, and power ON / OFF. Further, the operation unit 104 may directly remotely control the movement and imaging of the auxiliary imaging device 20. The operation unit 104 may be, for example, an operation button, an operation lever, a touch panel, and a keyboard.

  The communication unit 106 performs wireless communication with the auxiliary imaging device 20. The communication unit 106 includes a communication circuit that performs communication in accordance with a wireless communication standard such as UWB, ZigBee (registered trademark), Wi-Fi, Bluetooth (registered trademark), 3G, and / or LTE. Good. The communication unit 106 transmits the instruction and / or data supplied from the control unit 120 to the auxiliary imaging device 20, receives data from the auxiliary imaging device 20, and supplies the data to the control unit 120.

  The history storage unit 108 stores the feature amount obtained by calculating from the imaging history of the imaging unit 102 and / or the captured image. Specifically, the history storage unit 108 receives data such as an image of a scene captured by the imaging unit 102 and imaging conditions of the scene from the control unit 120, and records these in association with each other as an imaging history. The history storage unit 108 may record other data required by the main imaging device 10.

  The sensor 109 detects information related to the position of the main imaging device 10. The sensor 109 may be, for example, a GPS sensor, an acceleration sensor, an attitude sensor, and / or an orientation sensor. The sensor 109 may supply the detected information to the control unit 120.

  The control unit 120 includes a CPU and the like, and is connected to the imaging unit 102, the operation unit 104, the communication unit 106, and the history storage unit 108, and comprehensively controls the main imaging device 10. For example, the control unit 120 may receive image data captured from the imaging unit 102. The control unit 120 may supply the imaging history to the history storage unit 108.

  The control unit 120 may read out the imaging history and / or the feature amount obtained by calculation from the captured image from the history storage unit 108. The control unit 120 may receive a user instruction from the operation unit 104. Further, the control unit 120 may supply the communication unit 106 with a movement operation instruction to the auxiliary imaging device 20, an imaging instruction and / or imaging history, feature amount data calculated from the captured image, and the like. In addition, the control unit 120 may receive data such as an image transmitted from the auxiliary imaging device 20 via the communication unit 106.

  The auxiliary imaging device 20 is an autonomously movable device equipped with a camera, and may be, for example, a small vehicle or a small rotary wing aircraft. Hereinafter, in the present embodiment, a case where the auxiliary imaging device 20 is a small rotary wing aircraft will be described as an example. The auxiliary imaging device 20 determines a scene that is not captured by the main imaging device 10 among a plurality of scenes constituting the group photograph, and captures the scene. As a method for determining a scene that has not been imaged, for example, a scene with a small number of shots may be extracted based on a bias in shooting history information or a bias in information in a feature amount space. The auxiliary imaging device 20 includes, for example, an imaging unit 202, a communication unit 204, a storage unit 206, a driving unit 208, a sensor 210, and a control unit 220.

  The imaging unit 202 is provided in a part of the auxiliary imaging device 20 and images a subject. The imaging unit 102 may be an imaging unit that obtains image data by causing a light beam to enter and form an image on an element such as a CCD or a CMOS. For example, the imaging unit 102 may include pixels with horizontal 3000 pixels and horizontal 2000 pixels. The imaging unit 202 supplies the captured image data of the subject to the control unit 220. The imaging unit 202 may include a single focus lens or a zoom lens. Further, the imaging unit 202 may be able to change the direction in the vertical direction and / or the horizontal direction. Further, the imaging unit 202 may include a plurality of lenses having different exchangeable functions. In addition, a plurality of imaging units 202 may be provided in the auxiliary imaging device 20.

  The communication unit 204 performs wireless communication with the communication unit 106 of the auxiliary imaging device 20. The communication unit 204 includes a communication circuit that performs communication in conformity with a wireless communication standard such as UWB, ZigBee (registered trademark), Wi-Fi, Bluetooth (registered trademark), 3G, and / or LTE. Good. The communication unit 204 receives data such as a movement operation instruction, an imaging instruction, and / or an imaging history from the communication unit 106 of the main imaging apparatus 10 and supplies the data to the control unit 220. Further, the communication unit 204 transmits the data received from the control unit 220 to the main imaging device 10.

  The storage unit 206 stores an imaging history received from the main imaging device 10, a feature amount calculated from a captured image, and / or an imaging history updated by a scene captured by the imaging unit 202. For example, the feature amount may be a ratio of the main subject of the image in the image.

  In addition, the storage unit 206 stores the types of scene pairs that make up the group photograph. The type of scene set includes information on the composition of the scenes that make up the set photo, for example, information on the combination of subjects related to the scenes that make up the set photo and / or the combination of imaging conditions. It is.

  The types of scene groups are, for example, (i) a group composed of a plurality of scenes each including a plurality of subjects, and / or (ii) a plurality of scenes obtained by imaging the same subject under different imaging conditions. Selected from the set. Examples of the group photo theme (i) include a family, a shooting scene, a landscape, and cooking.

  When the family is a theme, for example, a father, a mother, and a child are set as a plurality of subjects included in the group photo. When the family is a theme, for example, a user holding the main imaging device 10 and a subject of the main imaging device 10 are set as a plurality of subjects included in the group photo. When landscape is the theme, for example, mountains, sky, and climbers are set as a plurality of subjects included in the group photo. When cooking is a theme, for example, a person, a dish, and both a person and a dish are set as a plurality of subjects included in the group photo.

  Examples of the group photo theme of (ii) include angle and angle of view. When the angle is a theme, for example, a low angle, a high angle, and an eye level angle are set as a plurality of imaging conditions included in the group photo. When the angle of view is a theme, for example, a wide angle angle of view, a telephoto angle of view, and a standard angle of view are set as a plurality of imaging conditions included in the group photo. The storage unit 206 may store information such as image data and imaging conditions of these subjects. The storage unit 206 may record other data required by the auxiliary imaging device 20.

  The driving unit 208 moves the auxiliary imaging device 20 by driving the movable member based on an instruction from the control unit 220. The drive unit 208 has a drive circuit for driving a motor that rotates the rotor blades, whereby the auxiliary imaging device 20 flies.

  The sensor 210 detects information related to the position of the auxiliary imaging device 20. The sensor 210 may be, for example, a GPS sensor, an acceleration sensor, an attitude sensor, and / or an orientation sensor. The sensor 210 may supply the detected information to the control unit 220.

  The control unit 220 includes a CPU and the like, and is connected to the imaging unit 202, the communication unit 204, the storage unit 206, the driving unit 208, and the sensor 210, and comprehensively controls the auxiliary imaging device 20. For example, the control unit 220 may receive image data captured from the imaging unit 202. The control unit 220 includes an information acquisition unit 222, an addition determination unit 224, and a position acquisition unit 226.

  The information acquisition unit 222 acquires imaging history information of the main imaging device 10 from the main imaging device 10 via the communication unit 204. The information acquisition unit 222 is obtained by calculating from the image data of the scene captured by the main imaging device 10 and the history information of the imaging conditions of the main imaging device 10 corresponding to the scene, or the captured image as the imaging history information. Get feature information.

  The addition determination unit 224 determines a scene to be added based on the imaging history information acquired by the information acquisition unit 222. The addition determination unit 224 refers to the type of the scene set stored in the storage unit 206, and adds a scene different from the scene composition included in the imaging history among the scenes included in the type of the scene set. Judge the scene to be.

  The addition determining unit 224 may determine a scene to be added based on the bias in the feature amount space of the feature amount calculated from the captured image. For example, the addition determination unit 224 has many scenes in which the ratio of the main subject in the image exceeds a threshold (for example, 50%) (that is, an image captured by zooming in on the main subject) in the imaging history (for example, , 80% or more), it is determined that a scene in which the ratio of the main subject in the image is equal to or less than a threshold value (an image obtained by capturing the main subject small) is a scene to be added.

  Here, the addition determination unit 224 determines a subject included in the scene to be added. As an example, the addition determination unit 224 determines a subject that is not captured by the main imaging device 10 among subjects necessary for the combined photograph as a subject included in the scene to be added.

  Further, the addition determining unit 224 may determine the imaging condition of the imaging unit 202 based on the imaging condition information of the main imaging device 10 included in the imaging history. For example, the addition determination unit 224 may use the same imaging condition as the imaging unit 102 of the main imaging apparatus 10 or a different imaging condition as the imaging condition of the imaging unit 202.

  The position acquisition unit 226 acquires the position of the subject included in the scene to be added. Furthermore, the position acquisition unit 226 determines a shooting position at which the auxiliary imaging device 20 captures images based on the identified position of the subject. Then, the position acquisition unit 226 controls the driving unit 208 to move the auxiliary imaging device 20 to the imaging position, and causes the imaging unit 202 to capture the scene determined by the addition determination unit 224 to generate an image.

  FIG. 4 shows an example of an imaging history according to this embodiment of the present embodiment. FIG. 4 shows an imaging history including (i) a scene including the subject 34 (mother) and the subject 36 (child), and (ii) a scene including the subject 36 (child) and the subject 38 (flower). . As an example, each scene (i) and (ii) of the imaging history includes image data and imaging conditions including imaging date / time, F value, and focal length.

  Next, the processing flow of the imaging system according to the present embodiment will be described with reference to the flowchart shown in FIG. In the following description, the imaging system executes the processes from S102 to S122 to complete the group photo.

  First, in S102, the operation unit 104 of the main imaging apparatus 10 inputs a set photograph set from the user. For example, the operation unit 104 includes (i) a group configured by a plurality of scenes each including a plurality of subjects, and (ii) a group configured by a plurality of scenes obtained by imaging the same subject under different imaging conditions. Enter which user has selected. Furthermore, the operation unit 104 inputs one selected by the user from the theme of the group photo presented to the user in response to the selection of (i) or (ii). The operation unit 104 inputs a type corresponding to the theme selected by the user from the types of scene groups constituting the group photo previously stored in the history storage unit 108 as the group photo setting.

  (I) When a set composed of a plurality of scenes each including a plurality of subjects is selected, the operation unit 104 inputs information on the plurality of subjects from the user. For example, when the theme is a family, the operation unit 104 inputs that a set of scenes including a father, a mother, and a child as subjects is selected as a group photo setting.

  One scene included in the selected group may include a plurality of subjects. For example, the operation unit 104 may be included in a type of a scene including a mother as a subject, a scene including a child, and a scene set including a scene including the mother and the child. As a result, the auxiliary imaging device 20 interpolates between scenes representing a plurality of situations (for example, a situation indicating that the mother is alone and a situation indicating that the child is alone) (a mother and a child). A group photo including a scene of a situation indicating that the user is near can be set.

  The plurality of subjects may include the imager himself and the main imaging device 10 itself. In this case, the auxiliary imaging device 20 can capture a scene that cannot be captured by the main imaging device 10 alone.

  Further, (ii) when a set composed of a plurality of scenes obtained by imaging the same subject under different imaging conditions is selected, the operation unit 104 uses a plurality of shooting conditions for shooting the subject as the theme of the group photo. From the user. As an example, the operation unit 104 includes a set of an imaging condition for imaging a subject at a high angle, an imaging condition for imaging a subject at an eye level angle, and an imaging condition for imaging a subject at a low angle. It may be entered as a setting.

  As another example, the operation unit 104 includes a set of an imaging condition for capturing an entire face of a person, an imaging condition for capturing an image of a person and a surrounding situation, and an imaging condition for capturing an entire body of a person. It may be entered as a setting.

  The operation unit 104 supplies the group photo setting input by the user to the control unit 120. The control unit 120 transmits the group photo setting to the communication unit 204 of the auxiliary imaging apparatus 20 via the communication unit 106. The control unit 120 may further transmit the image of the subject included in the group photograph to the communication unit 204 of the auxiliary imaging device 20 via the communication unit 106.

  The communication unit 204 receives the setting of the group photo and / or the image of the subject included in the group photo and supplies the received image to the control unit 220. The control unit 220 causes the storage unit 206 to store the group photo setting and / or the subject image included in the group photo. Here, instead of the auxiliary imaging device 20 acquiring the group photo setting from the main imaging device 10, the storage unit 206 stores in advance the group photo setting and / or the image of the subject included in the group photo scene. May be.

  Next, in S <b> 104, the user images the subject with the main imaging device 10. Specifically, the operation unit 104 inputs a user's imaging instruction and supplies it to the control unit 120. Then, the control unit 120 causes the imaging unit 102 to capture a scene. The control unit 120 stores an imaging history in which the image data of the scene received from the imaging unit 102 is associated with the imaging conditions when the scene is captured in the history storage unit 108.

  During the process of S104, the auxiliary imaging device 20 may wait on the spot, may wait on a predetermined location, or may move on a predetermined movement route. Instead of this, the auxiliary imaging device 20 may be moved remotely from the user via the operation unit 104 of the main imaging device 10 to an arbitrary location.

  In step S <b> 106, the operation unit 104 of the main imaging apparatus 10 inputs an imaging instruction for the auxiliary imaging apparatus 20 from the user, and supplies the imaging instruction to the control unit 120. The control unit 120 transmits the imaging instruction to the communication unit 204 of the auxiliary imaging device 20 via the communication unit 106. The communication unit 204 receives the imaging instruction and supplies it to the control unit 220.

  Next, in S <b> 108, the control unit 120 transmits an imaging history to the communication unit 204 of the auxiliary imaging device 20 via the communication unit 106. The information acquisition unit 222 acquires the imaging history of the main imaging device 10 via the communication unit 204 and stores it in the storage unit 206. In S <b> 106, the main imaging device 10 may transmit an imaging history to the auxiliary imaging device 20 together with an imaging instruction to the auxiliary imaging device 20.

  Next, in S110, the addition determination unit 224 determines a scene to be added based on the group photo setting and the imaging history. As an example, the addition determining unit 224 reads the group photo setting and the imaging history from the storage unit 206, determines whether a scene included in the imaging history satisfies the group photo setting, and if not, selects the scene. Judge to add.

  Specifically, for example, when (i) the setting of the group photo is to capture a plurality of scenes each including a plurality of subjects (for example, a mother, a father, and a child), the additional determination unit 224 Then, the image of the subject included in the scene of the imaging history is compared with the image of the subject of the combined photograph stored in advance in the storage unit 206, and it is determined whether both are the same person. As a result, the addition determining unit 224 determines whether there is a subject that is not included in the scene of the imaging history among the subjects included in the group photo setting.

  When all the subjects included in the group photo setting are included in the scene of the imaging history, the addition determining unit 224 determines that the group photo setting is satisfied. If a part of the subject included in the group photo setting is not included in the scene of the imaging history, the addition determining unit 224 determines that the group photo setting is not satisfied.

  In addition, for example, (ii) when the group photo setting is to capture the same subject under a plurality of imaging conditions (for example, shooting a specific person at a high angle, an eye level angle, and a low angle) The determination unit 224 determines whether there is an imaging condition that is not included in the shooting conditions of the scene of the imaging history among the plurality of imaging conditions. For example, the addition determination unit 224 analyzes an image included in a scene of the imaging history, and estimates an imaging condition (for example, an angle) when the scene is captured.

  If all of the imaging conditions included in the group photo setting are included in the scene imaging conditions of the imaging history, the addition determining unit 224 determines that the group photo setting is satisfied. When a part of the imaging conditions included in the group photo setting is not included in the scene capturing conditions of the imaging history, the addition determining unit 224 determines that the group photo setting is not satisfied.

  If the addition determining unit 224 determines to add a scene, the process proceeds to S112. If the addition determining unit 224 does not determine that a scene is to be added, the combined photograph is completed, and the process ends.

  In S112, the addition determining unit 224 determines a subject included in the scene to be added as a target subject. For example, if (i) the group photo setting is to capture a plurality of scenes each including a plurality of subjects (for example, a mother, a father, and a child), the additional determination unit 224 is included in the group photo setting. Among the plurality of subjects, subjects that are not included in the scene of the imaging history are determined as target subjects.

  For example, if (ii) the group photo setting is to image the same subject under a plurality of imaging conditions (for example, shooting a specific person at a high angle, an eye level angle, and a low angle), an additional determination unit In step 224, the same subject as the subject included in the imaging history is determined as the target subject.

  The addition determination unit 224 determines the imaging condition of the imaging unit 202 based on the imaging condition information of the main imaging device 10 included in the imaging history. For example, if (i) the group photo setting is to capture a plurality of scenes each including a plurality of subjects (for example, a mother, a father, and a child), the additional determination unit 224 captures images of the main imaging device 10. The same imaging conditions as the history scene may be used as the imaging conditions of the imaging unit 202. Thereby, the auxiliary imaging device 20 can capture an image with an impression similar to the image captured by the main imaging device 10, and complete a combined photograph with a sense of unity together with the image captured by the main imaging device 10. it can.

  In addition, for example, (ii) when the group photo setting is to capture the same subject under a plurality of imaging conditions (for example, shooting a specific person at a high angle, an eye level angle, and a low angle) The determination unit 224 may select an imaging condition that is different from any of the shooting conditions of the scene of the imaging history among the plurality of imaging conditions as the imaging condition of the imaging unit 202.

  When the imaging unit 202 includes a zoom lens, the addition determination unit 224 may determine the zoom amount of the zoom lens as an imaging condition. When the auxiliary imaging device 20 includes a plurality of imaging units 202, the additional determination unit 224 may determine which imaging unit is used for imaging as the imaging condition.

  Next, in S <b> 114, the position acquisition unit 226 acquires the position of the target subject determined by the addition determination unit 224. For example, the position acquisition unit 226 compares and analyzes the live view image acquired from the imaging unit 202 and the image of the subject of the combined photograph stored in advance in the storage unit 206, and specifies the position of the target subject with respect to the auxiliary imaging device 20. To do.

  The position acquisition unit 226 determines an imaging position to be imaged by the imaging unit 202 based on the acquired position of the target subject and the determined imaging condition. For example, the position acquisition unit 226 calculates an imaging position at which imaging can be performed with a camera angle and a field angle included in the imaging condition that determines the target subject. When there are a plurality of target subjects, the position acquisition unit 226 calculates an imaging position where imaging can be performed under the imaging conditions in which the plurality of target subjects are determined.

  When the position acquisition unit 226 cannot identify the position of the target subject, the position acquisition unit 226 may wait on the spot until the target subject can be identified. Alternatively, the control unit 220 may move the auxiliary imaging device 20 until the target subject can be identified. When a zoom lens is mounted on the imaging unit 202, the zoom of the imaging unit 202 may be moved to the wide angle side instead.

  The position acquisition unit 226 may acquire the position of the target subject from the main imaging apparatus 10 instead of acquiring the position of the target subject from the live view image from the imaging unit 202. In this case, as an example, an AR marker is attached to the target subject. Then, the main imaging apparatus 10 acquires the position of the target subject by analyzing the image of the target subject to which the AR marker is attached by the control unit 120. Then, the main imaging device 10 may transmit the position of the target subject to the position acquisition unit 226 via the communication unit 106 and the communication unit 204 of the auxiliary imaging device 20.

  As another example, an RFID may be attached to the target subject, and the main imaging device 10 may detect the target subject in the vicinity of the main imaging device 10 by communicating with the RFID. Then, the main imaging device 10 confirms that the target subject exists in the vicinity of the main imaging device 10 together with its own location acquired by GPS or the like via the communication unit 106 and the communication unit 204 of the auxiliary imaging device 20. 226 may be transmitted.

  Next, in S116, the position acquisition unit 226 controls the drive unit 208 to move the auxiliary imaging device 20 to the imaging position determined in S114. Next, the control unit 220 sets the imaging unit 202 to the imaging condition determined in S114.

  Next, in S120, the addition determining unit 224 determines whether or not the target subject can be imaged by the imaging unit 202. Specifically, the additional determining unit 224 analyzes the live view image obtained from the imaging unit 202, determines that the target subject can be captured when it is determined that the target subject is included, and otherwise determines the target subject. It is determined that the subject cannot be imaged. When the addition determination unit 224 determines that the target subject can be imaged, the control unit 220 advances the process to S122, and otherwise returns the process to S114.

  In S122, the imaging unit 202 images the scene at the imaging position and imaging conditions determined in S114. The control unit 220 acquires image data captured from the image capturing unit 202. The control unit 220 adds a record that associates the image data with the imaging condition at the time of imaging to the imaging history, and updates the imaging history of the storage unit 206. Next, the control unit 220 returns the process to S110. When the processing is completed, the control unit 220 transmits an imaging history including the completed combined photograph from the storage unit 206 to the main imaging device 10 via the communication unit 204.

  As described above, according to FIG. 5, by executing the processing from S102 to S122, the information acquisition unit 222 of the auxiliary imaging device 20 acquires the imaging history of the main imaging device 10, and the additional determination unit 224 The position acquisition unit 226 calculates the position of the auxiliary imaging device 20 for imaging the insufficient scene, and the auxiliary imaging device 20 moves to the position and images the insufficient scene. Thereby, the auxiliary imaging device 20 of the present embodiment can support the completion of the group photo by the main imaging device 10.

  FIG. 6 is a block diagram of the main imaging device 10 and the auxiliary imaging device 20 according to the second embodiment. In the present embodiment, the control unit 120 of the main imaging device 10 has the function of the additional determination unit 224 of the auxiliary imaging device 20 in the first embodiment as the additional determination unit 122. In the present embodiment, the main imaging device 10 includes an output unit 110. Further, in the present embodiment, the history storage unit 108 stores the types of scene groups that make up a group photograph. Here, in the description of the present embodiment, differences from the first embodiment will be described.

  The addition determination unit 122 determines the scene to be added by referring to the type of the scene group constituting the group photograph stored by the history storage unit 108 and the imaging history. Further, the addition determination unit 224 determines the target subject included in the scene to be added and the imaging condition of the scene to be added. The addition determination unit 224 supplies information regarding the target subject and the imaging conditions to the output unit 110.

  The output unit 110 outputs, to the auxiliary imaging device 20 via the communication unit 106, information indicating that the scene determined by the addition determination unit 122 should be captured, along with information regarding the target subject and imaging conditions. The position acquisition unit 226 of the auxiliary imaging device 20 receives information on the target subject and imaging conditions via the communication unit 204, and acquires the position of the target subject.

  In the present embodiment, S108 in the flow described in FIG. 5 may be omitted. In S110, the addition determination unit 122 of the main imaging apparatus 10 determines a scene to be added instead of the addition determination unit 224. In S112, the addition determining unit 122 determines a target subject and an imaging condition included in the scene to be added. Here, the addition determination unit 122 supplies information on the target subject and the imaging conditions to the control unit 220 via the communication unit 106 and the communication unit 204.

  In S <b> 122, the control unit 220 may transmit the image data and imaging conditions of the scene captured by the imaging unit 202 to the main imaging device 10 via the communication unit 204. The control unit 120 of the main imaging device 10 may acquire the imaging data and imaging conditions via the communication unit 106, and thereby update the imaging history of the history storage unit 108.

  As described above, according to the imaging system of the present embodiment according to FIG. 6, the auxiliary imaging device 20 captures a subject that is not captured by the main imaging device 10 among subjects necessary for the combined photograph. The user does not have to capture the entire scene by himself. Thereby, according to the imaging system of the present embodiment, it is possible to save time and effort for the user to determine a necessary scene and to perform imaging.

  In addition, as a modification of the present embodiment, the auxiliary imaging device 20 captures a plurality of subjects at a substantially equal ratio instead of and / or in addition to capturing a scene that is insufficient for a set photograph. May be. For example, in S102 of the process described with reference to FIG. 5, the operation unit 104 may input that the frequency at which the subject included in the group photo is shot is a certain threshold or more as the group photo setting.

  Specifically, when a plurality of children are set as the subject, the operation unit 104 may input that the scene including each child includes (50 / number of children)% or more as the setting of the group photo. . In S110, the addition determination unit 224 determines whether or not there is a subject whose frequency included in the image of the imaging history is less than a threshold (for example, (50 / number of children)%), and the subject that is less than the threshold is found. If it exists, the addition determination unit 224 may determine that the group photo setting is not satisfied. By doing in this way, the auxiliary imaging device 20 can image each child at a frequency that is at least half of the calculated average imaging frequency (100 / number of children)%, and can capture all the children's photos. Can be acquired evenly.

  Furthermore, in S112, the addition determining unit 224 may determine that a subject whose number of captured images is small among specific subjects is included in the scene to be added. For example, when there is a subject that is less than the set threshold, the addition determination unit 224 determines the subject that is less than the threshold as a target subject. Thus, according to the present modification, for example, when a large number of children are imaged on an excursion or the like, it is possible to acquire a photograph in which all children are captured.

  In addition, as a modification of the present embodiment, the auxiliary imaging device 20 replaces and / or in addition to capturing a scene lacking in a set photograph with only the main imaging device 10 and / or the photographer. You may image. For example, the auxiliary imaging device 20 monitors the timing at which the shutter button of the operation unit 104 of the main imaging device 10 is pressed. If the shutter button is not pressed for a certain time, the auxiliary imaging device 20 detects the main imaging device 10 and / or the photographer as a subject. You may image as.

  Furthermore, as a modification of the present embodiment, the control unit 120 may further include an image analysis unit. The image analysis unit analyzes the group photo stored in the history storage unit 108 in advance, and adds the analysis result as a new scene group type. For example, the image analysis unit may analyze the shooting conditions of a set photograph by a professional photographer stored in advance by the user, and store the analyzed set of shooting conditions in the history storage unit 108 as a type of a new scene set.

  FIG. 7 shows a modification of the auxiliary imaging device 22 of the present embodiment. The auxiliary imaging device 22 in this modification is a self-propelled vehicle. In this modification, the drive unit 208 includes a drive circuit for driving a motor that rotates the wheels.

  In the embodiment of the present invention, the control unit 120 and the addition determination unit 122 are realized by a program installed in the computer of the main imaging apparatus 10. A program that causes the computer to function as the main imaging apparatus 10 includes a control module and an additional determination module. In the embodiment of the present invention, the control unit 220, the information acquisition unit 222, the addition determination unit 224, and the position acquisition unit 226 are realized by a program installed in the computer of the auxiliary imaging device 20. A program that causes the computer to function as the auxiliary imaging device 20 includes a control module, a history acquisition module, an additional determination module, and a position acquisition module. These programs or modules work with the CPU of the computer to make the computer as a control unit 120, an additional determination unit 122, a control unit 220, an information acquisition unit 222, an additional determination unit 224, and a position acquisition unit 226, respectively. May function.

  The information processing described in these programs is read by the computer from the history storage unit 108, the storage unit 206, or other storage device realized by a main memory or a hard disk, and the software and the various hardware described above. It functions as a control unit 120, an addition determination unit 122, a control unit 220, an information acquisition unit 222, an addition determination unit 224, and a position acquisition unit 226, which are specific means in cooperation with the hardware resource. Then, by using these specific means, calculation or processing of information according to the purpose of use of the computer in the present embodiment is realized, so that a specific main image pickup device 10 and auxiliary image pickup device 20 according to the purpose of use are constructed. Is done.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

10 main imaging devices, 20 auxiliary imaging devices, 22, auxiliary imaging devices, 30 scenes, 32 subjects, 34 subjects, 36 subjects, 38 subjects, 102 imaging units, 104 operation units, 106 communication units, 108 history storage units, 109 sensors , 110 output unit, 120 control unit, 122 additional determination unit, 202 imaging unit, 204 communication unit, 206 storage unit, 208 drive unit, 210 sensor, 220 control unit, 222 information acquisition unit, 224 additional determination unit, 226 position acquisition Part

Claims (6)

An information acquisition unit that acquires an imaging history of the main imaging device from a main imaging device that images a scene by a user operation and generates a captured image;
Calculating a frequency that a specific subject is included in the scene in the imaging history acquired by the information acquisition unit, and a subject included in a scene to which a subject with a small number of captured images among the specific subjects is to be added; An additional determination unit for determining a scene to be added,
A position acquisition unit for acquiring the position of a subject included in the scene to be added;
An imaging unit that images an object included in the scene to be added determined by the addition determination unit and generates an image;
The position acquisition unit determines an imaging position of an auxiliary imaging device to be imaged by the imaging unit based on the position of a subject included in the acquired scene to be added,
The imaging unit images a subject included in the scene to be added at the imaging position.
Auxiliary imaging device. The information acquisition unit acquires information on imaging conditions of the main imaging device as the imaging history,
The auxiliary imaging apparatus according to claim 1, wherein the additional determination unit determines an imaging condition of the imaging unit based on information on the imaging condition. A storage unit for storing a type of scene set;
The auxiliary imaging apparatus according to claim 1, wherein the addition determination unit determines the scene to be added by referring to a type of the stored set of scenes. The auxiliary imaging apparatus according to any one of claims 1 to 3, wherein the addition determination unit determines that a scene to be added is different from a type of a set of scenes included in the imaging history. The auxiliary imaging apparatus according to any one of claims 1 to 4, further comprising a driving unit for moving, and self-running or flying by the driving unit. A program for causing a computer to function as an auxiliary imaging device,
The program includes an information acquisition unit that acquires an imaging history of the main imaging device from a main imaging device that images the scene by the user's operation and generates a captured image;
Calculating a frequency that a specific subject is included in the scene in the imaging history acquired by the information acquisition unit, and a subject included in a scene to which a subject with a small number of captured images among the specific subjects is to be added; An additional determination unit that determines a scene to be added,
A position acquisition unit for acquiring the position of a subject included in the scene to be added;
An imaging unit that captures an image of a subject included in the scene to be added determined by the addition determination unit;
To function,
The position acquisition unit determines an imaging position of an auxiliary imaging device to be imaged by the imaging unit based on the position of a subject included in the acquired scene to be added,
The imaging unit images a subject included in the scene to be added at the imaging position.
program.

Images