JP2012222787A - Imaging apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve user's usability when imaging continuously a plurality of subjects.SOLUTION: The imaging apparatus comprises: an imaging part for acquiring a captured image; an acceptance part for accepting from a user a designation of a subject included in a reference image captured temporarily by the imaging part; and a control part for causing the imaging part to execute an operation of acquiring a plurality of captured images focused at a plurality of respective subjects included in the designation corresponding to one time imaging instruction when the acceptance part accepts a designation of a plurality of subjects in the reference image.

Description

  The present invention relates to an imaging apparatus and a program.

2. Description of the Related Art An imaging device that recognizes a plurality of subjects in a reference image and performs a plurality of times of imaging by adjusting the focus for each of the plurality of subjects in subsequent main imaging (see, for example, Patent Document 1).
Patent Document 1 Japanese Patent Application Laid-Open No. 2009-81636

  However, in the above imaging device, all the subjects in the reference image are focused, and the shooting order is uniquely determined by the distance from the imaging device. It wasn't easy for users to use.

  In the first aspect of the present invention, an imaging unit (234) that acquires a captured image, a reception unit (248) that receives designation of a subject included in a reference image temporarily captured by the imaging unit from a user, When designation of a plurality of subjects in the reference image is accepted by the accepting unit, a plurality of captured images focused on each of the plurality of subjects included in the designation are acquired in the imaging unit in response to a single imaging instruction. An imaging apparatus is provided that includes a control unit (230) that executes an operation.

  In the second aspect of the present invention, there is provided a program for controlling an imaging device, the step of temporarily capturing a captured image on the imaging device by the imaging unit, and the reference image temporarily captured by the imaging unit When the designation of the subject to be received is received from the user and when the designation of a plurality of subjects in the reference image is accepted, the imaging unit focuses on each of the plurality of subjects included in the designation in response to a single imaging instruction. A program for executing an operation of acquiring a plurality of captured images is provided.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

An appearance of the imaging device 10 of the present embodiment is shown. The functional block of the imaging device 10 of FIG. 1 is shown. 3 is a flowchart showing the operation of the imaging apparatus 10. FIG. 4 is a flowchart showing details of an operation (S20) for accepting designation of a subject in FIG. It is an example of the reference image 12. It is an example of subject information. FIG. 4 is a flowchart showing details of an operation (S30) for performing photographing in FIG. 3. FIG. 6 is an explanatory diagram illustrating an example in which a control unit 250 saves a captured image in a card memory 254. FIG. It is explanatory drawing for demonstrating the other example of the order of imaging of a designated subject. 10 is an example of subject information corresponding to FIG. 9. It is explanatory drawing for demonstrating the other example of the designation | designated subject designation | designated method and the order of imaging of a designated subject. FIG. 12 is an example of subject information corresponding to FIG.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows an appearance of the imaging apparatus 10 of the present embodiment. The imaging device 10 includes a lens unit 100 and a device main body 200 that can attach and detach the lens unit 100 to the front surface. An example of the imaging device 10 is a single-lens reflex camera. The imaging device 10 acquires a plurality of images in which a plurality of subjects designated by the user are sequentially focused on the plurality of subjects by a single imaging instruction.

  The apparatus main body 200 includes a touch panel 220 that is arranged on the back surface and displays an image, and that can be input by user contact, and a release 210 and a cross key 204 that are operated by the user. The apparatus main body 200 further includes a finder 202 that can be visually recognized when the user brings his / her eyes close to the upper side of the touch panel 220.

  FIG. 2 shows functional blocks of the imaging apparatus 10 of FIG. The imaging device 10 is provided with a control unit 230 that controls the entire imaging device 10.

  A program memory 250 and a main memory 252 are connected to the control unit 230. The program memory 250 includes at least one of a nonvolatile recording medium and a read-only recording medium, and stores firmware and the like executed by the control unit 250. The main memory 252 includes a dynamic RAM and is used as a control unit 210 and a work area for image processing.

  An image sensor driving unit 232 and an image processing unit 238 are further connected to the control unit 250. In addition, the image sensor driving unit 232, the image sensor 234, the A / D conversion unit 236, and the image processing unit 238 are connected to each other.

  The image sensor 234 includes a photoelectric conversion element such as a CMOS or a CCD, and is driven by the image sensor driving unit 232 at a specific timing. The image sensor 234 driven by the image sensor drive unit 232 converts the subject luminous flux received at the driven timing into an electrical signal and outputs it.

  The electrical signal output from the image sensor 234 is discretized by the A / D converter 236 and converted into pixel values by the image processor 238 to generate a captured image. The image processing unit 238 adjusts white balance, sharpness, gamma, gradation correction, compression, and the like in the process of generating a captured image.

  The captured image generated in the image processing unit 238 is stored and saved in the memory card 254 under the control of the control unit 230. The memory card 254 can be attached to and detached from the apparatus main body 200.

  The image analysis unit 244 analyzes the captured image and recognizes a subject included in the captured image. For example, the image analysis unit 244 performs face recognition such as a person and a pet and individual recognition thereof. In the contrast AF method, the image analysis unit 224 calculates the contrast from the captured image and outputs the contrast to the control unit 230.

  An AF driving unit 240 is also connected to the control unit 230. The AF drive unit 240 drives the motor 242 to move the focus lens of the lens unit 100, thereby performing a focusing operation for forming the image light of the subject on the imaging surface of the image sensor 234.

  A display driving unit 246 is further connected to the control unit 230. The display drive unit 246 displays the captured image on the display unit 222 of the touch panel 220. When the live view mode is set, the display driving unit 246 sequentially displays the captured image from the image sensor 234 on the display unit 222 as a reference image. Further, the display drive unit 246 also displays the many items read from the program memory 250 on the display unit 222.

  An input unit 280 is also connected to the control unit 210. The accepting unit 248 accepts input from the user through the touch operation unit 224 of the touch panel 220 and the cross key 204. The control unit 210 further receives that the release 210 has been pressed as an imaging instruction, and drives the imaging element driving unit 232 to acquire a captured image.

  FIG. 3 is a flowchart showing the operation of the imaging apparatus 10. The flowchart in FIG. 3 starts when the power switch of the imaging apparatus 10 is turned on.

  First, the control unit 230 determines whether or not continuous shooting is selected (S10). For example, the selection of continuous shooting is performed in advance by causing the user to operate the cross key 204 using the menu displayed on the display unit 222. The selection result is stored in the main memory 252, and the control unit 250 makes the above determination with reference to the main memory 252.

  When the continuous shooting is selected (S10: Yes), the display driving unit 246 displays the reference image on the display unit 222, and receives designation of the subject from the touch operation unit 224 (S20). The control unit 250 waits while receiving a designation until a shooting instruction is received (S22: No), and when there is a shooting instruction (S22: Yes), the control unit 250 performs an operation of focusing and image acquisition according to the designation of the subject. Execute (S30) and end. In this case, the control unit 250 determines that a shooting instruction has been given when the release 210 is fully pressed. On the other hand, if the continuous shooting is not selected (S10: No), the control unit 250 performs a normal shooting operation (S12) and ends.

  FIG. 4 is a flowchart showing details of the operation (S20) for accepting the designation of the subject in FIG. First, the control unit 250 drives the image sensor driving unit 232 to capture a reference image by the image sensor 234 and the like (S210). Here, the reference image is an image that is temporarily acquired for reference by the user, and includes, for example, a through image in a live view operation.

  The image analysis unit 244 analyzes the reference image, detects a subject included in the reference image (S212), and generates subject information regarding the subject. In this case, the image analysis unit 244 may detect a person by face recognition, or may detect a subject other than a person from the shape and color of another predetermined subject. The subject information is stored in the main memory 252, for example.

  The display driving unit 246 displays the reference image on the display unit 222 (S214). In this case, the display driving unit 246 superimposes and displays the information related to the subject detected by the image analysis unit 244 on the reference image.

  FIG. 5 is an example of the reference image 12. In the example illustrated in FIG. 5, a display in which the subject is surrounded by a broken-line circle is attached so that the subjects A to E detected by the image analysis unit 244 can be visually recognized as candidates designated by the user.

  During the display of the reference image in step S214 of FIG. 4, the receiving unit 248 determines whether or not the subject has been designated by the user (S216). The accepting unit 248 determines whether or not a subject has been designated by the operation of the touch operation unit 224.

  When the subject is designated by the user (S216: Yes), the control unit 250 updates the subject information stored in the main memory 252 based on the input from the reception unit 248 (S218).

  FIG. 6 is an example of subject information. The subject information in FIG. 6 includes the imaging order, the XY position in the reference image, the focus lens position that is the position of the focus lens when focused, whether it is in or out of the reference image, associated with the ID that identifies the subject. It has an inside / outside flag indicating. In the example shown in FIG. 6, IDs A to E are assigned to six subjects corresponding to the reference image 12 of FIG. For example, the ID may be assigned in the order in which the subject is detected, or may be assigned in the order of the focus lens position, but does not necessarily determine the shooting order.

  The order of imaging is determined by the control unit 250 based on the designation of the subject by the user in step S216. Hereinafter, an example in which the imaging order is determined to be the same as the order in which the user designates the subject will be described.

  In the example of FIG. 6, the imaging order “1” is assigned in response to the subject B being first selected on the touch panel 220. Similarly, next to subject B on touch panel 220, subjects C and D are selected in this order, and imaging order “2” and “3” are assigned. In the example of FIG. 5, the selection by the user and the assignment of the order are indicated by assigning a number in the vicinity of the broken circle indicating the subject. Note that the subject designated by the user may be referred to as a designated subject.

  The position in the reference image in the subject information is specified and written by the image analysis unit 244. Here, since the operation of step S20 is repeated at a predetermined interval until a shooting instruction is given (S22), the image analysis unit 244 updates the position of the subject every time a new reference image is acquired.

  The focus lens position is calculated by the image analysis unit 244 performing image processing on the reference image, for example. As an example, when the subject is a person, the image analysis unit 244 estimates the distance to the subject based on the size of the subject's face, and calculates the focus lens position that focuses on the distance. Alternatively, when the subject is specified in step S216, the AF driving unit 240 may move the focus lens to focus, and the control unit 230 may write the position in the subject information. Instead of moving the focus lens every time a subject is designated, the focus lens may be moved when the release 210 is half-pressed. In addition, the movement of the focus lens to know the position of the focus lens may be performed after the subject is designated and before the photographing instruction.

  After step S218 in FIG. 4 or when the determination in step S216 is No, the image analysis unit 244 determines whether there is a designated subject that has disappeared or reappeared from the reference image ( S220). When there is a designated subject that has disappeared or reappeared from the reference image (S220), the image analysis unit 244 updates the inside / outside flag of the subject information (S222).

  6 indicates that the designated subject exists in the current reference image, and “1” indicates that the designated subject does not exist in the current reference image. The initial value of the inside / outside flag is “0”. Therefore, “0” is assigned to the inside / outside flag even for a subject not designated.

  In the example shown in FIG. 6, since the designated subject C does not exist in the current reference image, the inside / outside flag “1” is assigned. Further, an invalid value “−” is assigned to the XY position and the focus lens position of the designated subject C.

  After step S222 or when the determination in step S220 is No, the operation in step S20 is terminated. As described above, the operation in step S20 is repeated at predetermined intervals until a shooting instruction is given (S22).

  FIG. 7 is a flowchart showing details of the operation (S30) for performing the shooting in FIG. First, the control unit 250 refers to subject information stored in the main memory 252 (S300), and specifies a designated subject included in the subject information (S302).

  In step S <b> 302, the control unit 250 identifies the designated subject from the subject having the earliest shooting order in the subject information. In the example illustrated in FIG. 6, first, the subject B whose imaging order is “1” is specified.

  Next, the control unit 250 determines whether or not the inside / outside flag of the designated subject specified in step S302 is “0” (S304). When the specified inside / outside flag of the specified subject is “0” (S304: Yes), the AF drive unit 240 drives the motor 242 to focus on the designated subject (S306). In step S306, the AF drive unit 240 Refers to the subject information, reads the focus lens position of the designated subject, and moves the focus lens to the position to perform the focusing operation.

  Subsequently, the image sensor driving unit 232 drives the image sensor 234 to read the captured image (S308), and the control unit 250 acquires the captured image from the image processing unit 238. The control unit 250 temporarily stores the acquired captured image in the main memory 252.

  The control unit 250 determines whether there is a next designated subject in the subject information (S310). If there is a next subject (S310: Yes), the process returns to step S302. In the example illustrated in FIG. 6, when it is the subject B that has been identified this time, the subject C whose imaging order is “2” is identified in step S302.

  Here, since the inside / outside flag of the subject C is “1” in FIG. 6, the determination in step S304 is No, and steps 306 and S308 are omitted. Thereby, when the subject once designated disappears from the later reference image, the control unit 250 omits focusing and imaging on the subject in response to the imaging instruction. Therefore, it is possible to shorten the entire photographing time by eliminating the time required for these operations, and to make the photographing timings between a plurality of photographed images closer.

  In the example of FIG. 6, when the subject B has reappeared in the reference image before the shooting instruction, the inside / outside flag is updated to “0” in step 222. Therefore, the determination in step S304 is Yes, and steps S304 and S306 are executed. As a result, when the designated subject disappears from the reference image and then reappears in a later reference image, the refocusing subject is focused and imaged in response to the imaging instruction. Thereby, the captured image suitable for the user's intention can be obtained.

  When there is no next designated subject in step S310 (S310: No), the control unit 230 stores the captured image (S312). When there are a plurality of designated subjects whose inside / outside flag is “0”, a plurality of captured images are acquired. In this case, for example, the control unit 230 stores a plurality of captured images in one folder. Thus, the operation of step S30 ends.

  FIG. 8 is an explanatory diagram illustrating an example in which the control unit 250 stores the captured image in the card memory 254. In the example of FIG. 8, the control unit 250 assigns a file name “PIC003.jpg” or the like to a plurality of continuously captured images according to the same rule as that of a normal captured image. Further, a plurality of continuously captured images corresponding to one imaging instruction are stored in a folder having a folder name “PIC003-005” using a file name included therein. Thereby, it is possible to make it easy to find a plurality of continuously captured images while distinguishing a plurality of continuously captured images for one imaging instruction from a normal captured image.

  As described above, in the embodiment shown in FIGS. 1 to 8, when designation of a plurality of subjects in the reference image is received, a plurality of subjects included in the designation are designated by the image sensor 234 or the like in response to one imaging instruction. A plurality of captured images focused on each of them are acquired. Therefore, it is possible to omit focusing and imaging operations on a subject that is not intended by the user, thereby eliminating the time required for those operations and shortening the entire imaging time, and imaging timing between a plurality of captured images. Can be brought closer.

  Further, the imaging order is determined by the order in which the user designates the subject. Therefore, according to the present embodiment, continuous shooting can be performed in the order intended by the user, and the imaging timing of the subject recognized by the user as having higher importance can be made closer to the release pressing timing.

  In the above embodiment, the imaging order is determined to be the same as the order in which the user designates the subject. However, the imaging order may be changed until an imaging instruction is given. For example, after specifying up to the fourth subject, the first subject may be specified again so that the order is changed from “4 → 1 → 2 → 3”. Further, when the same subject is designated twice, the fact that it is the designated subject may be canceled.

  FIG. 9 is an explanatory diagram for explaining another example of the imaging order of the designated subject. FIG. 10 is an example of subject information corresponding to FIG. In the example of FIGS. 9 and 10, the designated subject is imaged in the order in which the movement amount of the optical system when focused is reduced as a whole. Hereinafter, differences from the embodiment of FIGS. 1 to 8 will be described.

  In FIG. 9, subjects A to E in the reference image 12 shown in FIG. 5 are arranged in the order of the focus lens position. Here, it is assumed that the subjects A to D are designated in step S20, and the current focus lens position is close to the focus of the subject C. In this case, it is necessary to reciprocate to either one of the subjects A and D farthest in the plus or minus direction, but considering that the other is only required for the forward path, the focus lens is moved in the order of “C → A → D”. The movement amount becomes smaller as a whole. Note that the movement amount of the subject B does not change regardless of whether the image is taken on the forward path or the return path, but it is preferable to capture the image on the forward path because it is closer to the timing of the imaging instruction.

  Therefore, as shown in FIG. 10, “C → B → A → D” so that the movement amount of the focus lens becomes smaller as a whole regardless of the specified order when the subjects A to D are specified. The imaging order is determined. The order of imaging is determined by the control unit 230 every time a new subject is specified in step S216, and subject information is updated (S218). Furthermore, a plurality of captured images are acquired in this order by the operation of step S30.

  As described above, according to the present embodiment, since continuous shooting is performed in the order in which the amount of movement of the optical system decreases with respect to the subject specified by the user, the shooting time of continuous shooting is shortened and the shooting timing of each subject is released. Can be closer to the timing of pressing.

  FIG. 11 is an explanatory diagram for explaining another example of the method of designating the designated subject and the order of imaging the designated subject. FIG. 12 is an example of subject information corresponding to FIG. In the example of FIGS. 11 and 12, a subject is specified by specifying a region on the touch panel 220, and the specified subject is determined according to the XY position from the specified start point of the region. Hereinafter, differences from the embodiment of FIGS. 11 to 12 will be described.

  In FIG. 11, it is assumed that in step S216, the user specifies (x1, y1) from the XY position (x0, y0) of the touch panel 220. In this case, the control unit 230 identifies subjects A to C included in the rectangles (x0, y0) to (x1, y1) as designated subjects, and updates the subject information in step S218.

  In this case, the control unit 230 determines the imaging order of the specific subject along a specific direction in the XY plane within the designated area. For example, the control unit 230 determines the imaging order in the order closer to the start point (x0, y0) of the region. In the example of FIG. 11, the imaging orders “1”, “2”, and “3” are assigned in the order of subjects A, B, and C in accordance with the distance from the starting point (x0, y0).

  FIG. 12 shows subject information updated by the above example. By the operation in step S30, a plurality of captured images are acquired in the order indicated by the subject information.

  As described above, according to the present embodiment, the subject is specified by the user's range specification, the order is automatically set between the specified subjects, and continuous shooting is performed. Therefore, the user can specify the subject and specify the order. Save time and effort.

  The subject designation shown in FIGS. 5 and 6 and the subject designation shown in FIGS. 11 and 12 may be mixed. In this case, the order of image capturing is such that the area designation is regarded as one subject, the order in which the designated subject is designated is set as the order of imaging, and a plurality of designated subjects in the same area are in a specific direction in the XY plane. You may decide automatically according to.

  In the embodiment shown in FIGS. 1 to 12 described above, the touch operation unit 214 of the touch panel 220 is used for specifying the subject, but the present invention is not limited to this. The subject may be specified by another operation member, for example, the cross key 204. In this case, the display unit 222 may also be a liquid crystal monitor other than the touch panel 222. In the above embodiment, the subject to be focused is designated, but instead of this, a subject that does not need to be focused may be selected in the state where the subject candidate is presented. The imaging order may be determined by the method shown in FIG. 9 or the like for a subject that has not been selected from the candidates.

  In the embodiment shown in FIGS. 1 to 12, the subject candidate is detected and displayed when step S20 is executed. Instead, the subject candidate is displayed when the release 210 is half-pressed. May be detected or displayed.

  In the embodiment shown in FIG. 1 to FIG. 12, in step S30, the designated subject is focused and imaged. Instead of this, for the designated subject in the later order included in the depth of field at the time of photographing the designated subject that has already been photographed, the operation of focusing and photographing again may be omitted. In this case, the control unit 230 refers to the subject information and the aperture value of the imaging device 10 in step S300, and updates the subject information by grouping based on the depth of field, that is, the focus range among the designated subjects. . Further, the control unit 230 drives the imaging element driving unit 232 to execute one focusing and imaging for each of the grouped groups. Thereby, the shooting time of continuous shooting can be shortened, and the shooting timing of each subject can be made closer to the timing of pressing the release.

  In the embodiment shown in FIG. 1 to FIG. 12, a plurality of captured images acquired by one imaging instruction are collectively stored in one folder, but the storage format is not limited to this. For example, individual captured images may be stored as in normal shooting, or may be stored as a single file in a multi-picture (MP) format or the like. Note that the operation shown in FIG. 3 may be executed by a computer program stored in the program memory 250.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

10 image pickup device 12 reference image 100 lens unit 200 device main body 202 finder 204 cross key 210 release 220 touch panel 222 display unit 224 touch operation unit 230 control unit 232 image sensor driving unit 234 image sensor 236 A / D conversion unit 238 image processing unit 240 AF drive unit 242 Motor 244 Image analysis unit 246 Display drive unit 248 Reception unit 250 Program memory 252 Main memory 254 Memory card

Claims (13)

An imaging unit for acquiring a captured image;
A receiving unit that receives designation of a subject included in a reference image temporarily captured by the imaging unit from a user;
When designation of a plurality of subjects in the reference image is accepted by the accepting unit, in response to a single imaging instruction, the imaging unit causes the imaging unit to focus on the plurality of subjects included in the designation. An imaging device comprising: a control unit that executes an operation of acquiring a captured image.   The imaging apparatus according to claim 1, wherein the control unit acquires a plurality of captured images by sequentially focusing the plurality of subjects based on an order in which the plurality of subjects are designated by the user.   The control unit calculates an order in which the amount of movement of the optical system when the plurality of subjects are sequentially focused is reduced as a whole, and sequentially focuses the plurality of subjects to obtain a plurality of captured images. The imaging device according to claim 1.   The imaging apparatus according to claim 3, wherein the control unit calculates an amount of movement of an optical system that focuses each of the plurality of subjects based on image processing of the reference image.   The said control part acquires the moving amount | distance of the optical system which focuses each of these several subjects by focusing on the said subject after designation | designated of the said subject and before an imaging instruction | indication. Imaging device.   The imaging apparatus according to claim 1, wherein the reception unit determines that a subject included in the region has been specified by receiving specification of the region of the reference image from a user.   7. The control unit according to claim 1, wherein the plurality of subjects included in the designation are grouped based on a focusing range, and one focusing and imaging are performed for each of the grouped groups. The imaging device according to item.   The imaging device according to any one of claims 1 to 7, wherein the reception unit includes a touch panel, and displays the reference image on the touch panel to receive designation of a subject.   The imaging device according to claim 1, wherein the reception unit presents a subject in the reference image as a designation candidate.   The imaging device according to claim 9, wherein the reception unit receives designation of a subject that does not require focusing during imaging among the presented candidates. The imaging unit updates the reference image until there is an imaging instruction,
The control unit omits focusing and imaging of the disappeared subject in response to the imaging instruction when any of the plurality of subjects once designated disappears from a later reference image. The imaging device according to any one of the above.   If any of the plurality of subjects once specified disappears from a later reference image and then reappears in a later reference image, the control unit determines that the subject that has reappeared in response to the imaging instruction The imaging device according to claim 1, wherein focusing and imaging are performed on the imaging device. A program for controlling an imaging device, wherein the imaging device temporarily captures a captured image by an imaging unit;
Receiving a designation of a subject included in a reference image temporarily captured by the imaging unit from a user;
When designation of a plurality of subjects in the reference image is received, a plurality of captured images focused on each of the plurality of subjects included in the designation are acquired in the imaging unit in response to a single imaging instruction. The program which performs the step which performs the operation to perform.

Images