JP5293769B2 - Imaging apparatus and program thereof - Google Patents

Description

  The present invention relates to an imaging apparatus and a program thereof, and more particularly, to an imaging apparatus having a subject tracking function and a program thereof.

  2. Description of the Related Art In recent years, a technique for taking an image by following a subject has appeared in an imaging apparatus such as an electronic camera (Patent Document 1).

Patent Publication No. 3750499

  However, the conventional technique is an effective technique when one subject is to be photographed, but there is a problem in that it is not easy to use when a plurality of subjects are to be photographed.

  Therefore, the present invention has been made in view of such a conventional problem, and an object thereof is to provide an imaging apparatus capable of improving usability when a plurality of subjects are to be photographed and a program thereof.

In order to achieve the above object, an imaging apparatus according to a first aspect of the present invention includes a display unit, an acquisition unit that sequentially acquires a frame image by controlling the imaging element, and a plurality of frames in the frame image acquired by the acquisition unit. Follow-up means for following the subject at the same time, display control means for displaying a plurality of subjects in the frame image followed by the follow-up means on the display means in a differentially displayed state, and the display means by the display control means A selection unit that selects an arbitrary subject as the specific subject by a user operation, and the selection unit among the plurality of subjects that are differentially displayed on the display control unit a generating means for generating an image that contains only the specific object selected by the particular generated by the generating means Comprising a recording control means for recording in the recording means the image contained only Utsushitai, wherein the display control means further on said display means the specific object selected by the selecting means in a state that discrimination Viewed It is characterized by being displayed .
The invention of claim 2 is an imaging device according to claim 1, wherein a detecting means for detecting a recording instruction of sequentially obtained frame images by the acquisition unit, the recording instruction detected by said detecting means Then, the recording apparatus further includes recording control means for controlling the recording means to record an image including only the specific subject generated by the generating means.
The invention according to claim 3 is the imaging apparatus according to claim 1 or 2 , wherein the generation unit further generates an image including a plurality of subjects, and the recording control unit includes: The recording unit records an image including only the specific subject and an image including all the plurality of subjects.
An invention according to claim 4 is the imaging apparatus according to any one of claims 1 to 3 ,
The generation unit generates an image including only the specific subject by trimming processing.
The invention according to claim 5 is the imaging apparatus according to claim 3 , wherein the generation unit generates an image including only the specific subject and the plurality of subjects by trimming processing and optical zoom processing. An image including all the images is generated.

An invention according to claim 6 is the imaging apparatus according to any one of claims 1 to 5 ,
The display control means displays the movement trajectories of a plurality of subjects in the frame image tracked by the tracking means, thereby displaying the tracked subjects on the display means in a differential display state. It is characterized by that.

The invention according to claim 7 is the imaging apparatus according to any one of claims 1 to 6 ,
The display control means displays the contours of a plurality of subjects in the frame image tracked by the tracking means, thereby causing the display means to display each tracked subject in a differentially displayed state. It is characterized by.

An invention according to claim 8 is the imaging apparatus according to any one of claims 1 to 7 ,
The display control means causes the display means to display a plurality of subjects in the frame image being followed by the follower means in a state in which each subject is discriminated and displayed.

The invention according to claim 9 is the imaging apparatus according to claim 8 , wherein the display control means determines a plurality of subjects in the frame image tracked by the tracking means for each subject. It is characterized in that the subject is displayed on the display means in a state of being discriminated from each other by differentiating colors and line thicknesses.

The invention according to claim 10 is the imaging apparatus according to any one of claims 1 to 9 , wherein the follow-up means is selected when the specific subject is selected by the selection means. It is characterized by following the subject.

The invention according to claim 11 is the imaging apparatus according to any one of claims 1 to 10 , further comprising instruction detection means for detecting an instruction by a user operation, wherein the follow-up means is the instruction When an instruction is detected by the detection means, tracking of a plurality of subjects in the frame image acquired by the acquisition means is started simultaneously.

In order to achieve the above object, the invention described in claim 12 is directed to an acquisition unit that sequentially acquires a frame image by controlling an image sensor and a plurality of subjects in the frame image acquired by the acquisition unit simultaneously. tracking means, display control means for displaying on the display unit while differentiating display a plurality of subjects in the frame image being followed by the following means, a plurality which are differentiated displayed on the display means by said display control means for Among the subjects, a selection unit that selects an arbitrary subject as the specific subject by a user operation, and only a specific subject selected by the selection unit among a plurality of subjects that are displayed differentially on the display unit. Generation means for generating an included image, an image including only the specific subject generated by the generation means Recording control means for recording in the recording means, to function as,
The display control means is further characterized in that the display means displays the specific subject selected by the selection means in a state of differential display .

According to the present invention, it is possible to simultaneously follow a plurality of subjects while discriminatingly displaying them .

1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the digital camera 1 of embodiment. It is a figure which shows the mode of the image displayed on the image display part 15 at a certain timing. It is a figure for demonstrating selection of the tracking subject displayed on the image display part 15 at a certain timing.

Hereinafter, the present embodiment will be described in detail with reference to the drawings as an example in which the imaging apparatus of the present invention is applied to a digital camera.
[Embodiment]
A. Configuration of Digital Camera FIG. 1 is a block diagram showing a schematic electrical configuration of a digital camera 1 that implements the imaging apparatus of the present invention.
The digital camera 1 includes a photographing lens 2, a lens driving block 3, an aperture 4, a CCD 5, a driver 6, a TG (timing generator) 7, a unit circuit 8, an image generation unit 9, a CPU 10, a key input unit 11, a memory 12, a DRAM 13, A flash memory 14, an image display unit 15, and a bus 16 are provided.

  The photographing lens 2 includes a focus lens, a zoom lens, and the like that are constituted by a plurality of lens groups (not shown). A lens driving block 3 is connected to the photographing lens 2. The lens driving block 3 includes a focus motor and a zoom motor that drive the focus lens and the zoom lens along the optical axis direction, respectively, and a focus motor driver that drives the focus motor and the zoom motor according to a control signal sent from the CPU 10. And a zoom motor driver (not shown).

The diaphragm 4 includes a drive circuit (not shown), and the drive circuit operates the diaphragm 4 in accordance with a control signal sent from the CPU 10.
The diaphragm 4 is a mechanism that controls the amount of light that enters from the photographing lens 2.

  The CCD 5 is driven by the driver 6 and photoelectrically converts the intensity of light of each color of the RGB value of the subject image for every fixed period and outputs it to the unit circuit 8 as an imaging signal. The operation timing of the driver 6 and the unit circuit 8 is controlled by the CPU 10 via the TG 7. The CCD 5 has a Bayer color filter and also functions as an electronic shutter. The shutter speed of the electronic shutter is controlled by the CPU 10 via the driver 6 and TG7.

  A TG 7 is connected to the unit circuit 8, a CDS (Correlated Double Sampling) circuit that holds the imaged signal output from the CCD 5 by correlated double sampling, and an AGC that performs automatic gain adjustment of the imaged signal after the sampling. An (Automatic Gain Control) circuit and an A / D converter that converts an analog image pickup signal after the automatic gain adjustment into a digital signal, the image pickup signal output from the CCD 5 passes through the unit circuit 8 as a digital signal. It is sent to the image generator 9.

  The image generation unit 9 performs processing such as γ correction processing and white balance processing on the image data sent from the unit circuit 8, generates a luminance color difference signal (YUV data), and generates the generated luminance color difference. The image data of the signal is stored in the DRAM 13 (buffer memory). That is, the image generation unit 9 performs image processing on the image data output from the CCD 5.

The CPU 10 is a one-chip microcomputer that has functions of performing imaging control on the CCD 5, recording processing on the flash memory 14, and display processing of image data, and controls each part of the digital camera 1. Further, the CPU 10 includes a clock circuit and has a function as a timer.
In particular, the CPU 10 has a function of subject tracking for a plurality of subjects, and a function of discriminatingly displaying subjects subject to the subject tracking.

The key input unit 11 includes a plurality of operation keys such as a shutter button that can be half-pressed and fully pressed, a mode switching key, a display switching key, a cross key, and a SET key, and outputs an operation signal corresponding to a user's key operation to the CPU 10. To do.
The memory 12 stores a control program and necessary data necessary for the CPU 10 to control each unit, and the CPU 10 operates according to the program. The memory 12 is a rewritable nonvolatile memory.

The DRAM 13 is used as a buffer memory for temporarily storing image data sent to the CPU 10 after being imaged by the CCD 5 and also as a working memory for the CPU 10.
The flash memory 14 is a recording medium that stores compressed image data.

  The image display unit 15 includes a color LCD and its driving circuit, and displays the subject imaged by the CCD 5 as a through image when in a shooting standby state, and is read out from the flash memory 14 and decompressed when a recorded image is reproduced. The recorded image is displayed.

B. Operation of Digital Camera 1 The operation of the digital camera 1 in the embodiment will be described with reference to the flowchart of FIG.
When the photographing mode is set by the user's operation of the key input unit 11, the process proceeds to step S <b> 1, and the CPU 10 starts imaging by the CCD 5, and the luminance color difference signal frame sequentially captured by the CCD 5 and generated by the image generation unit 9 Image data (YUV data) is stored in the buffer memory (DRAM 13), and so-called through image display is started in which an image based on the stored frame image data is displayed on the image display unit 15.

Next, in step S2, the CPU 10 determines whether or not the shutter button is half-pressed by the user. This determination is made based on whether or not an operation signal corresponding to a half-press operation of the shutter button is sent from the key input unit 11.
If the operation signal corresponding to the half-pressing operation of the shutter button is not sent in step S2, the process stays in step S2 until the operation signal is sent.

On the other hand, when an operation signal corresponding to a half-press operation of the shutter button is sent in step S2, the process proceeds to step S3, and the CPU 10 starts subject tracking for each subject imaged by the CCD 5. That is, it is detected where each subject imaged when the shutter button is half-pressed is located in the image of the frame image data sequentially imaged.
Since the subject tracking technique is already well-known technology, it will not be described in detail. For example, each subject is recognized by image recognition, and by detecting where each subject is located in sequentially captured frame image data. Subject tracking may be performed, or subject tracking may be performed by detecting the position of each subject using a block matching method or the like.
Thereby, subject tracking can be started when the user wants to prepare for shooting.

  When subject tracking is started in step S3, the process proceeds to step S4, and the CPU 10 starts a process of displaying the movement locus of the subject that is tracking the subject (following subject) on the through image display, and in step S5, The CPU 10 recognizes the contour of the tracking subject by image recognition, and starts processing for displaying the contour on the through image display.

FIG. 3 shows a state of images displayed on the image display unit 15 at a certain timing, and the imaging timing of these images is such that time passes as (a) → (b) → (c). It shall be.
FIG. 3 (a) shows the state of an image that is first picked up and displayed after half-pressing the shutter button. At this time, since each subject has not yet moved, only the outline 21 of each subject is displayed. You can see that it is displayed with
Then, as time passes, it can be seen that, as shown in FIGS. 3B and 3C, the movement locus 22 of each tracking subject is displayed along with the contour 21 of each tracking subject.
In this way, since the tracking subject is displayed in a discriminative manner (display of the contour 21 and the movement track 22), even when the subject tracking is performed on a plurality of subjects, the user can distinguish between the tracking subject and the non-tracking subject. Can be easily distinguished, and usability can be improved when a plurality of subjects are to be imaged.

At this time, although not shown, the line thickness of the contour 21, the type of line, the color of the line, etc. are made different for each tracking subject. In FIG. 3, the type of the line of the movement locus 22 is different for each tracking subject. Similarly to the display of the contour, the movement locus line thickness, Different types, line colors, etc. In short, any method may be used as long as the contour 21 and the movement trajectory 22 displayed for each following subject are different so that the user can easily distinguish each following subject.
Thereby, the user can easily distinguish the following subjects, and the usability when a plurality of subjects are to be photographed can be improved.

In addition, when making the color of the outline 21 and the movement locus | trajectory 22 different, it is preferable to display the outline 21 and the movement locus | trajectory 22 with the same color with respect to the same tracking subject.
In addition, as the time passes, the displayed movement locus 22 becomes longer, and the movement locus 22 of each tracking subject may be difficult to understand. Therefore, the movement locus 22 is a frame a predetermined number of frames before the current frame. The movement trajectory 22 of the subject up to may be displayed.

Next, the process proceeds to step S6, and the CPU 10 determines whether or not a follow subject has been selected by the user.
At this time, the user operates the cross key to move the cursor displayed on the image display unit 15 to the contour 21 of the tracking subject to be selected, and when the cursor is within the contour 21 of the tracking subject, the SET is performed. The follow subject can be selected by operating the key. When the CPU 10 determines that an operation signal corresponding to the series of operations has been sent from the key input unit 11, it determines that the follow subject has been selected. To do.

  If it is determined in step S6 that a tracking subject has been selected, in step S7, the CPU 10 determines whether or not the selected tracking subject is set as a priority tracking subject to be described later. That is, it is determined whether or not information indicating that the selected tracking subject is a priority tracking subject is stored in the priority tracking subject storage area of the buffer memory.

  If it is determined in step S7 that the selected tracking subject is not set as a priority tracking subject, the process proceeds to step S8, and the CPU 10 sets the selected tracking subject as a priority tracking subject. That is, information indicating that the selected tracking subject is a priority tracking subject is stored in the priority tracking subject area of the buffer memory. In step S9, the CPU 10 causes the tracking subject set as the priority tracking subject to be identified and displayed (differential display) from other non-priority tracking subjects (following subjects not set as priority tracking subjects), and then to step S12. move on. As a method for this identification display, for example, the contour subject 21 and the movement locus 22 of the tracking subject can be displayed blinking to be identified and displayed as a non-priority tracking subject.

FIG. 4 is a diagram for explaining selection of the tracking subject displayed on the image display unit 15 at a certain timing.
As shown in FIG. 4A, when a non-priority tracking subject is selected by moving the cursor to an arbitrary tracking subject by operating the cross key and operating the SET key, the selected tracking subject is prioritized tracking. As shown in FIG. 4B, it can be seen that the contour 21 and the movement trajectory 22 of the selected tracking subject are identified and displayed as non-priority tracking subjects by flashing display or the like.
In this way, the user can arbitrarily select a non-priority tracking subject, set the non-priority tracking subject selected by the user as the priority tracking subject, and set the priority tracking subject (the selected non-priority tracking subject). Since the tracking subject) is further identified and displayed (discrimination display), the user can easily distinguish and recognize the selected tracking subject.

  On the other hand, if it is determined in step S7 that the selected tracking subject is set as a priority tracking subject, the process proceeds to step S10, and the setting of the selected tracking subject as a priority tracking subject is canceled. That is, the information indicating that the selected tracking subject is the priority tracking subject stored in the priority tracking subject area is deleted. As a result, the selected following subject is a non-priority following subject. In step S11, the CPU 10 cancels the identification display of the selected (subjected to be canceled) following subject, and proceeds to step S12. As a result, the contour 21 and the movement trajectory 22 of the selected tracking subject as the non-priority tracking subject are normally displayed instead of blinking.

  For example, as shown in FIG. 4B, when a tracking subject (priority tracking subject) that is discriminated by flashing display or the like is selected, the priority tracking subject setting is canceled for the selected tracking subject. Thereafter, as shown in FIG. 4A, the contour 21 and the movement locus 22 of the selected following subject are not blinked.

On the other hand, if it is determined in step S6 that the tracking subject is not selected, the process proceeds to step S12 as it is.
In step S12, the CPU 10 determines whether or not the display switching key has been operated by the user. This determination is made based on whether or not an operation signal corresponding to the operation of the display switching key has been sent from the key input unit 11.
If it is determined in step S12 that the operation of the display switching key has been performed, the process proceeds to step S13, where the CPU 10 displays a zoomed-up moving picture centering on the tracking subject in priority order, and then proceeds to step S14.

  In this priority order, the moving image of the tracking subject (flashing tracking subject) set as the priority tracking subject is displayed first, and then the tracking subject of the non-priority tracking subject (tracking subject not flashing) ). The display of a moving image zoomed up around the tracking subject means trimming the tracking subject to be zoomed up from the frame image data picked up by the CCD 5 and sequentially displaying the trimmed image data (electronic zoom display). . The following subject is trimmed based on the subject position detected by subject tracking.

The display of the moving image zoomed up around the tracking subject in the priority order of step S13 may be a method of automatically switching and displaying the zoomed-up moving image of the tracking subject one by one at a predetermined time in the priority order. Each time the display switching key is operated by the user, the zoom-up moving image of the tracking subject may be displayed in order of priority. When zoomed-in moving images of all the following subjects are displayed regardless of whether they are automatic or manual, the frame image data captured by the CCD 5 is displayed as it is without trimming. That is, as shown in FIGS. 3 and 4, the display returns to the display before the display switching key is operated.
The zoomed-in moving image may be displayed in one display area of the image display unit 15 or may be displayed in the entire area of the image display unit 15. When displaying a zoomed-up moving image in this one display area, a full-screen through image as shown in FIGS. 3 and 4 is displayed as it is in addition to the one display area. When a zoom-up moving image is displayed on the screen, a full-screen through image is not displayed during switching display.
As a result, it is possible to display a moving image in which the tracking subject is zoomed in, and the user can make an accurate determination by seeing the moving image, for example, whether or not the priority tracking subject should be surely selected. Judgment can be prevented. In addition, it is possible to display from the zoom-up moving image of the subject that the user wants to confirm most.

On the other hand, if it is determined in step S12 that the display switch key is not operated, the process proceeds to step S14.
In step S14, the CPU 10 determines whether or not the shutter button has been fully pressed. This determination is made based on whether or not an operation signal corresponding to the full pressing operation of the shutter button is sent from the key input unit 11.
In step S14, when the operation signal corresponding to the full pressing operation of the shutter button is not sent from the key input unit 11, the process returns to step S6 and the above-described operation is repeated.

On the other hand, if an operation signal corresponding to the full press operation of the shutter button is sent from the key input unit 11 in step S14, the process proceeds to step S15, and the CPU 10 performs a still image shooting process.
Next, in step S <b> 16, the CPU 10 generates image data that includes all currently set priority tracking subjects from the still image data obtained by the still image shooting process.

The inclusion of all the currently set priority tracking subjects means "so that all of the currently set priority tracking subjects are within the angle of view", and the currently set priority tracking subjects. This does not mean that any angle of view can be used. The generation of image data including all currently set priority tracking subjects means that all the currently set priority tracking subjects are based on the positions of the priority tracking subjects immediately before the shutter button is fully pressed. Trimming image data with an angle of view that just fits. In other words, the processing of step S15 and step S16 means that still image shooting is performed by electronic zooming so that all of the currently set priority tracking subjects are within the angle of view.
Note that, without trimming, the still image shooting process may be performed by performing optical zoom so that all of the currently set priority tracking subjects are within the angle of view.
As a result, it is possible to eliminate an image of a portion where a useless subject is reflected.

Next, in step S <b> 17, the CPU 10 generates a zoom-up image centered on the currently set priority tracking subject from the still image data obtained by the still image shooting process in step S <b> 15. That is, image data obtained by trimming each priority tracking subject is generated from the still image data based on the position of the priority tracking subject immediately before the shutter button is fully pressed. As a result, it is possible to generate an image in which each main tracking subject (priority tracking subject) is zoomed in, and the user can save time and effort to generate an image in which the priority tracking subject is zoomed by manual operation such as trimming. . Further, an image obtained by zooming up a useless subject is not generated.
Next, in step S <b> 18, the CPU 10 compresses the image data generated in steps S <b> 16 and S <b> 17 and records it in the flash memory 14.

C. As described above, in the embodiment, subject tracking is performed with respect to a plurality of subjects, each tracking subject is displayed in a discriminative manner, and each tracking subject is displayed in a discriminative manner so that the following subjects can be distinguished from each other. Since the line type, line thickness, color, etc. are made different, the user can easily recognize each tracking subject and can distinguish between each tracking subject. Usability of subject tracking with respect to the subject can be improved.

[Modification]
D. The following embodiments may be the following aspects.

  (01) In the above embodiment, subject tracking is started for a plurality of subjects when the shutter button is half-pressed, but when a through image display is started, a plurality of subjects to be imaged are started. Subject tracking may be started.

(02) In the above embodiment, when the shutter button is half-pressed, subject tracking is started for a plurality of captured images, and the tracking subject selected by the user is further identified and displayed (for example, However, when a subject is selected by the user, subject tracking is started for the selected subject for the first time, and the subject is discriminated and displayed (contour 21 and movement locus 22 display, etc.). You may make it do. Also at this time, if a plurality of subjects are selected, subject tracking is performed on the plurality of subjects, so that the following subjects are displayed so as to be distinguished from each other. In this case, the selected subject may be set as the priority tracking subject, or may be set as the priority tracking subject only when the same subject is selected again.
Thereby, it is possible to make the subject follow only for the subject to be followed.

(03) In the above embodiment, when a tracking subject is selected, the selected tracking subject is set as a priority tracking subject, and the set priority tracking subject is distinguished from other non-priority tracking subjects. However, it is also possible to discriminate (discriminate) a tracking subject that has not been selected by canceling the discrimination display (display of the contour 21 and the movement trajectory 22).
In this case, the subject tracking may be stopped thereafter for the non-selected tracking subject. That is, the non-selected tracking subject is no longer a tracking subject, and the selected subject is a tracking subject and is a priority tracking subject.
As a method for selecting the tracking subject at this time, the tracking subject selected until the predetermined time (for example, 5 seconds) elapses from the timing at which the tracking subject is first selected is set as the priority tracking subject, and the predetermined time has elapsed. Discrimination display is canceled for tracking subjects that have not been selected before.

  (04) In the above-described embodiment, the tracking subject is selected by the cursor. However, it is possible to select the subject by another selection method such as a touch panel.

(05) In the above embodiment, when the display switching key is operated, the tracking subject selected as the priority tracking subject is displayed in order of priority in step S13, and then the non-priority tracking subject is displayed. Although displayed, it does not have to be in priority order. That is, a mode in which the following subject is displayed in order regardless of priority or non-priority may be used.
In addition, when the display switching key is operated, in step S13, a zoomed-up moving image with only the priority tracking subject may be displayed. As a result, it is possible to switch and display only a moving image in which the main follow-up subject is zoomed in, and not to display a useless zoom-up moving image.

(06) In the above-described embodiment, image data including all priority tracking subjects is generated in step S16. However, image data including all tracking subjects regardless of priority and non-priority. May be generated.
In step S16, if no priority tracking subject is set, image data including all tracking subjects is generated. If a priority tracking subject is set, all priority tracking subjects are included. Such image data may be generated.

(07) In the above embodiment, the zoomed-up image with the priority tracking subject as the center is generated in step S17, but the zoom with the tracking subject as the center regardless of priority or non-priority is generated. An up image may be generated.
In step S17, if no priority tracking subject is set, a zoom-up image is generated with each tracking subject as the center. If a priority tracking subject is set, only the priority tracking subject is set. You may make it produce | generate the zoom-up image centering on each.

  (08) In the above embodiment, when the still image shooting process is performed in step S15, both the operations in steps S16 and S17 are performed. However, only one of the operations is performed. May be. That is, only one of generation of an image including all of the set priority tracking subjects or generation of a zoom-up image centered on each of the set priority tracking subjects is performed.

(09) In the above-described embodiment, the still image shooting process is performed when the shutter button is fully pressed. However, regardless of whether or not the shutter button is fully pressed, the still image shooting process is performed. Still image capturing processing (automatic still image capturing processing) that includes all priority tracking subjects or tracking subjects may be performed. As a result, it is possible to recognize a series of movements of the tracking subject from a plurality of automatically captured still images, and to determine whether or not there is a shutter chance even if the image happens to be a shutter chance at the time of shooting. Even if it is erroneously determined, there is a possibility that an image with a real photo opportunity is found from a group of images taken at regular intervals later, and even this case can be dealt with.
Further, a priority tracking subject or a zoomed-up image centered on the tracking subject may be generated and recorded from still image data obtained by the automatic still image shooting process.

  (10) In addition, in the modified example (09), the contour of the tracking subject or the priority tracking subject is synthesized with each of the still image data captured at regular intervals, and each still image data is multiplexed in the order of shooting time. The displayed set image data may be generated, and the generated set image data may be recorded. Thereby, a series of operations of the tracking subject or the priority tracking subject can be easily recognized from one set of images.

  (11) In the modification (09), the maximum movement trajectory of the tracking subject or the priority tracking subject is determined based on the still image data captured at regular intervals, and the maximum movement trajectory of the tracking subject is maximum. The two still image data and the maximum movement trajectory may be combined and recorded. Thereby, the maximum movement locus of the tracking subject or the priority tracking subject can be easily recognized from one piece of image data.

  (12) In the above embodiment, subject tracking is started when the shutter button is half-pressed (the operation after step S3 is performed), but provided separately from the shutter button. The subject tracking may be started when the subject tracking start button is operated.

  (13) Moreover, the aspect which combines arbitrarily the said modification (01)-(12) within the range which does not produce contradiction may be sufficient.

(14) The above embodiments of the present invention are merely examples as the best embodiments, and are described in order to better understand the principle and structure of the present invention. And is not intended to limit the scope of the appended claims.
Therefore, it should be understood that all the various variations and modifications that can be made to the above-described embodiments of the present invention are included in the scope of the present invention and protected by the appended claims.

  Finally, in each of the above-described embodiments, the case where the imaging apparatus of the present invention is applied to the digital camera 1 has been described. However, the present invention is not limited to the above-described embodiment, and the point is that an image is processed. Applicable to any device that can be used.

1 Digital Camera 2 Shooting Lens 3 Lens Drive Block 4 Aperture 5 CCD
6 Driver 7 TG
8 Unit circuit 9 Image generator 10 CPU
11 Key input section 12 Memory 13 DRAM
14 Flash memory 15 Image display unit 16 Bus

Claims (12)

Display means;
Acquisition means for controlling the image sensor to sequentially acquire frame images;
Following means for simultaneously following a plurality of subjects in the frame image obtained by the obtaining means;
Display control means for causing the display means to display a plurality of subjects in the frame image tracked by the tracking means in a differentially displayed state;
A selection unit that selects an arbitrary subject as the specific subject by a user operation among a plurality of subjects that are displayed differentially on the display unit by the display control unit;
Generating means for generating an image including only a specific subject selected by the selection means among a plurality of subjects displayed in a differential manner on the display control means;
A recording control unit that causes the recording unit to record an image including only the specific subject generated by the generating unit;
Equipped with a,
The display control means further causes the display means to display the specific subject selected by the selection means in a state of differential display . Detecting means for detecting a recording instruction of the frame images sequentially obtained by the obtaining means;
A recording control means for controlling the recording means to record an image including only a specific subject generated by the generating means when a recording instruction is detected by the detecting means;
Further imaging apparatus according to claim 1, further comprising a. The generating means further generates an image including all of a plurality of subjects,
It said recording control means, the image pickup apparatus according to image the image with the plurality of subjects included the only particular object is all included in claim 1 or 2, characterized in that to record in the recording means. Said generating means, by trimming, the imaging apparatus according to any one of claims 1 to 3, characterized in that to generate the image contained the only particular object. The imaging apparatus according to claim 3 , wherein the generation unit generates an image including only the specific subject and an image including all the plurality of subjects by trimming processing and optical zoom processing. The display control means displays the movement trajectories of a plurality of subjects in the frame image tracked by the tracking means, thereby displaying the tracked subjects on the display means in a differential display state. the imaging apparatus according to any one of claims 1 to 5, characterized in that. The display control means displays the contours of a plurality of subjects in the frame image tracked by the tracking means, thereby causing the display means to display each tracked subject in a differentially displayed state. the imaging apparatus according to any one of claims 1 to 6, wherein. Wherein the display control unit, a plurality of the object in the frame image being followed by the following means, according to claim 1 to 7, characterized in that to be displayed on said display means in a state that discrimination displayed in each subject between The imaging device according to any one of the above. The display control means displays a plurality of subjects in the frame image being followed by the follow-up means in a state where each subject is differentially displayed by changing the color, the thickness of the line, etc. for each subject. The imaging apparatus according to claim 8 , wherein the imaging unit displays the image on the display unit. The follow-up means, when the specific object is selected by the selecting means, the image pickup apparatus according to any one of claims 1 to 9, characterized in that to follow the selected object. It further comprises instruction detection means for detecting an instruction by a user operation,
The follow-up means, when an instruction is detected by said instruction detecting means, any one of claims 1 to 10, characterized in that at the same time to initiate a plurality of tracking the subject in the frame image acquired by the acquisition unit The imaging device described in 1. Computer
Acquisition means for sequentially acquiring frame images by controlling the image sensor;
Following means for simultaneously following a plurality of subjects in the frame image obtained by the obtaining means;
Display control means for causing the display means to display a plurality of subjects in the frame image tracked by the tracking means in a state of being discriminated.
A selection unit that selects an arbitrary subject as the specific subject by a user's operation among a plurality of subjects that are differentially displayed on the display unit by the display control unit;
A generating unit configured to generate an image including only a specific subject selected by the selecting unit among the plurality of subjects displayed in a differential manner on the display unit;
A recording control unit for causing the recording unit to record an image including only the specific subject generated by the generating unit;
To function as,
The display control means further causes the display means to display the specific subject selected by the selection means in a state of being discriminated .

Images