JP2009033450A - Camera apparatus, object tracking zooming method and object tracking zooming program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reliably capture an object within a photographing range. <P>SOLUTION: In an imaging range by use of a lens unit 12 and an image pickup device 13, a control section 22 identifies an arbitrary moving object, tracks the identified object, determines whether or not the tracked object is within a predetermined area of the imaging range, and controls the imaging range including the object to be zoomed out when it is determined that the object is not within the predetermined area. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging device that captures a subject, and more particularly to an imaging device that automatically tracks and captures a subject with movement, a subject tracking zooming method, and a subject tracking zooming program.

  An imaging device, which is a camera device that captures a subject, has various functions that support shooting in response to a photographer's request to reliably capture a desired subject. As a function to support such shooting, an apparatus configured to automatically track a subject for a good shooting purpose of the subject has been devised (see, for example, Patent Document 1 and Patent Document 2).

  Japanese Patent Application Laid-Open No. 2004-151867 discloses a technique for tracking a subject by rotating the camera and tracking the subject by automatically adjusting a zoom lens and an autofocus lens when the rotation range is reached. It is disclosed.

  In Patent Document 2, since the shooting range of the zoom camera is included in the shooting range of the wide-angle camera, when the subject is out of the shooting range of the zoom camera, the center of the shooting range of the wide-angle camera is set. Since it is possible to capture a subject, a technique capable of tracking the subject is disclosed.

JP-A-11-308517 JP 2006-295294 A

  However, the technique disclosed in Patent Document 1 has a problem that tracking according to the movement of the subject becomes difficult when the movement speed of the subject is relatively high. Further, in the method disclosed in Patent Document 2, when the subject is out of the shooting range of the zoom camera and the subject cannot be captured even at the center of the shooting range of the wide-angle camera, a manual operation is performed. There is a problem that it must be executed.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and is an imaging device, an object tracking zooming method, and an object capable of capturing a subject satisfactorily by capturing the object reliably so as to be within the imaging range. The purpose is to provide a tracking zooming program.

  An imaging apparatus according to the present invention includes an imaging unit that captures an imaging range including an object, an object specifying unit that specifies an arbitrary subject that moves within an imaging range captured by the imaging unit, and the subject specifying unit. Subject tracking means for tracking the identified subject, zooming means for zooming in or out the shooting range shot by the shooting means, and shooting for shooting the subject tracked by the subject tracking means by the shooting means A determination unit that determines whether or not the subject falls within a predetermined area within the range; and when the determination unit determines that the subject does not fall within the predetermined region, the shooting range including the subject is zoomed And control means for controlling the zooming means so as to be out.

  In addition, the photographing apparatus of the present invention includes a display unit that displays an image within a photographing range photographed by the photographing unit, and the predetermined region includes a center of a display region that displays the image of the display unit. And

  In the imaging device of the present invention, when all the images within the imaging range imaged by the imaging means are displayed in the display area of the display means, the maximum area of the predetermined area is within the display area of the display means. Stipulate.

  In the imaging apparatus of the present invention, when a part of the image within the imaging range captured by the imaging unit is displayed on the display area of the display unit, the maximum area of the predetermined area is the display area of the display unit. Specified inside or outside the display area.

  In the photographing apparatus of the present invention, the predetermined area is rectangular.

  The photographing apparatus of the present invention further includes speed detection means for detecting the speed of the subject tracked by the subject tracking means, and the control means is configured so that the subject is not within the predetermined area by the determination means. If it is determined, the zooming range including the subject is zoomed at a zoom speed corresponding to the speed of the subject detected by the speed detecting unit or a zoom magnification corresponding to the speed of the subject detected by the speed detecting unit. The zooming means is controlled so as to be out.

  The photographing apparatus of the present invention further comprises intrusion detection means for detecting entry into a predetermined central area in the display area of the display means, and the control means is configured to zoom out the photographing range including the subject. After the zooming means is controlled, the zooming means is controlled to zoom in on the photographing range including the subject when the intrusion detection means detects the entry into the predetermined central area.

  The subject tracking zooming method of the present invention includes a photographing step for photographing a photographing range including a subject, a subject identifying step for identifying an arbitrary subject within the photographing range photographed by the photographing step, and the subject identifying The subject tracking step for tracking the subject specified by the step, the zooming step for adjusting the shooting range shot by the shooting step by zooming in or zooming out, and the subject tracked by the subject tracking step by the shooting step A determination step of determining whether or not the subject is within a predetermined region within the shooting range to be shot, and the subject is included when the determination step determines that the subject is not within the predetermined region And a control step for controlling the zooming step so as to zoom out the photographing range.

  The subject tracking zooming program of the present invention is a subject tracking zooming program applied to a computer provided in a photographing device for photographing a subject, a photographing step for photographing a photographing range including the subject, and a photographing photographed by the photographing step. A subject specifying step for specifying an arbitrary subject within the range, a subject tracking step for tracking the subject specified by the subject specifying step, and a shooting range shot by the shooting step by zooming in or zooming out. A zooming step for adjusting, a determining step for determining whether or not the subject tracked by the subject tracking step is within a predetermined region within the shooting range shot by the shooting step, and the determining step If it is determined not to fall in said predetermined area, to execute a control step of controlling the zooming step to zoom out the shooting range including the subject.

  An imaging apparatus according to the present invention includes an imaging unit that captures an imaging range including an object, an object specifying unit that specifies an arbitrary subject that moves within an imaging range captured by the imaging unit, and the subject specifying unit. Subject tracking means for tracking the identified subject, zooming means for zooming in or out of the shooting range shot by the shooting means, speed detection means for detecting the speed of the subject tracked by the subject tracking means, The speed determination means for determining whether or not the speed of the subject detected by the speed detection means is equal to or higher than a predetermined speed, and the speed determination means determines that the speed of the subject is equal to or higher than the predetermined speed. And a control unit for controlling the zooming means to zoom out the shooting range including the subject. Provided with a door.

  In the photographing apparatus of the present invention, the moving direction detecting means for detecting the moving direction of the subject tracked by the subject tracking means, and the moving direction of the subject detected by the moving direction detecting means are the photographing range. Moving direction determining means for determining whether or not the image is moving in a direction deviating from the angle of view, wherein the control means determines that the speed of the subject is equal to or higher than a predetermined speed by the speed determining means, and further The zooming unit is controlled to zoom out the shooting range including the subject when the direction determining unit determines that the camera is moving in a direction deviating from the angle of view.

  Further, the imaging apparatus of the present invention includes a display unit that displays an image within the imaging range captured by the imaging unit, and an intrusion detection unit that detects an intrusion into a predetermined central region in the display area of the display unit. And the control means controls the zooming means so as to zoom out the photographing range including the subject, and then detects the subject when the intrusion detection means detects the entry into the predetermined central region. The zooming means is controlled to zoom in on the photographing range including it.

  The subject tracking zooming method of the present invention includes a photographing step for photographing a photographing range including a subject, a subject identifying step for identifying an arbitrary subject within the photographing range photographed by the photographing step, and the subject identifying A subject tracking step for tracking the subject specified in the step, a zooming step for zooming in or out of the shooting range shot by the shooting step, and a speed detection step for detecting the speed of the subject tracked by the subject tracking step. And a speed determination step for determining whether the speed of the subject detected by the speed detection step is equal to or higher than a predetermined speed, and the speed determination step determines that the speed of the subject is equal to or higher than a predetermined speed. The zooming step so as to zoom out the shooting range including the subject. And a control step of controlling.

  The subject tracking zooming program of the present invention is a subject tracking zooming program applied to a computer provided in a photographing device for photographing a subject, a photographing step for photographing a photographing range including the subject, and a photographing photographed by the photographing step. Within a range, a subject specifying step for specifying an arbitrary moving subject, a subject tracking step for tracking the subject specified by the subject specifying step, and a shooting range shot by the shooting step are zoomed in or zoomed out. Zooming step, speed detection step for detecting the speed of the subject tracked by the subject tracking step, and speed determination step for determining whether or not the speed of the subject detected by the speed detection step is equal to or higher than a predetermined speed. And said The degrees determination step, in response to the speed of the object is determined to be equal to or higher than a predetermined speed, the shooting range including the object to execute a control step of controlling the zooming step to zoom out.

  According to the present invention, it is possible to capture a subject satisfactorily by capturing the subject reliably so as to be within the photographing range.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, a digital still camera 1 which is a photographing apparatus shown as an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram showing a functional configuration of the digital still camera 1.

  As shown in FIG. 1, the digital still camera 1 includes a motor 11, a lens unit 12, an image sensor 13, a timing generator (TG) 14, a vertical driver 15, and a sample hold circuit (S / H) 16. A / D converter 17, color process circuit 18, DMA (Direct Memory Access) controller 19, DRAM interface (I / F) 20, DRAM 21, control unit 22, VRAM controller 23, and VRAM 24. A digital video encoder 25, a display unit 26, an image processing unit 27, a memory 28, a key input unit 29, an audio processing unit 30, a microphone unit (MIC) 32, and a speaker unit (SP) 33. It has.

  The lens unit 12 is an optical system that includes a plurality of lens groups and forms an image of a shooting area including a desired subject on the image sensor 13. The lens unit 12 includes a shutter unit and a diaphragm unit (not shown), and the focus position and the diaphragm position are moved by driving the motor 11. The lens unit 12 includes a zoom lens that can freely perform zoom-out and zoom-in according to the control of the control unit 22 and change the shooting range.

  The image sensor 13 forms, for example, RGB primary color filters, and is driven by scanning by the timing generator 14 and the vertical driver 15. The photoelectric conversion output corresponding to the light image formed at regular intervals. Is output for one screen.

  An imaging system including the sample hold circuit 16 and the A / D converter 17 performs a desired process on the photoelectric conversion output output from the imaging element 13. Specifically, with respect to the photoelectric conversion output, the gain is appropriately adjusted for each primary color component of RGB in the state of the signal of l analog value, and then sampled and held by the sample and hold circuit 16 and digitally converted by the A / D converter 17. Data is converted and output to the color process circuit 18.

  The color process circuit 18 performs color process processing including pixel interpolation processing, γ correction processing, and matrix calculation, generates a luminance signal Y and color difference signals Cb, Cr as digital values, and outputs them to the DMA controller 19.

  The DMA controller 19 once uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 once. And the DMA transfer to the DRAM 21 used as a buffer memory via the DRAM interface 20.

  The control unit 22 includes a CPU, a ROM in which operation programs executed by the CPU are fixedly stored, a RAM used as a work memory, and the like, and comprehensively controls the digital still camera 1.

  After the DMA transfer of the luminance signal Y and the color difference signals Cb and Cr to the DRAM 21 is completed, the control unit 22 reads the luminance signal Y and the color difference signals Cb and Cr from the DRAM 21 via the DRAM interface 20 and via the VRAM controller 23. Write to VRAM 24.

  The digital video encoder 25 periodically reads the luminance signal Y and the color difference signals Cb and Cr from the VRAM 24 via the VRAM controller 23, generates a video signal based on these data, and outputs the video signal to the display unit 26.

  The control unit 22 controls a normal photographing mode for photographing a desired subject facing the lens unit 12 and an automatic zoom control mode as photographing modes for photographing the subject.

  In the automatic zoom control mode, an arbitrary moving subject is identified from the subjects existing within the photographing range facing the lens unit 12, and it is determined that the subject does not fall within a predetermined area while tracking the identified subject. In this mode, zooming in or out of the shooting range including the subject automatically captures the subject so that it is within the shooting range and performs shooting of a good subject, that is, subject tracking zooming Mode.

  Note that the zoom control by the control unit 22 may be an optical zoom by controlling an optical system such as the lens unit 12 including a zoom lens, or may be a digital zoom that performs zoom in digital image processing. However, it may be a combination of both. The automatic zoom control mode will be described later in detail.

  Although not shown, the display unit 26 is provided, for example, on the back side of the housing of the digital still camera 1, and functions as a monitor display unit (electronic finder) in the shooting mode, and converts the video signal from the digital video encoder 25 into a video signal. By performing the display based on this, an image based on the image information fetched from the VRAM controller 23 at that time is displayed in real time.

  As described above, one of the key input units 29 is displayed at a timing at which a still image is to be captured in a so-called through image display state in which an image at that time is displayed in real time on the display unit 26 as a monitor image. When one shutter key is operated, a trigger signal is generated.

  In response to the trigger signal, the control unit 22 sends the luminance signal Y and color difference signals Cb and Cr for one screen captured from the image sensor 13 at that time via the DRAM interface 20 to the luminance signal Y, color difference signal Cb, For each component of the color difference signal Cr, for example, it is read in a unit called a basic block of 8 vertical pixels × 8 horizontal pixels and written in the image processing unit 27.

  Under the control of the control unit 22, the image processing unit 27 performs ADCT (Adaptive Discrete Cosine Transform) and entropy coding on the written image in accordance with the JPEG (Joint Photograph Coding Experts Group) standard. Data compression is performed by a process such as Huffman encoding which is a method.

  The memory 28 is a recording medium such as a fixed recording medium or a memory card that is detachably attached to the digital still camera 1. Under the control of the control unit 22, the code data obtained by the processing of the image processing unit 27 is read and written into the memory 28 as a data file of one image.

  In response to the completion of the compression processing of the luminance signal Y and the color difference signals Cb and Cr of one frame sentence and the writing processing of all the compressed data to the memory 28 described above, the control unit 22 transfers from the image sensor 13 to the DRAM 21. Start the path again.

  The key input unit 29 is a key group for inputting user operations collectively including a power key, a shutter key, a mode switching key, a menu key, a cross key, a set key, and the like. The key input unit 29 is connected to the control unit 22, and an operation command signal indicating that the key input unit 29 has been operated in response to the operation of each key is output to the control unit 22.

  The audio processing unit 30 includes a sound source circuit such as a PCM sound source, and digitizes the audio signal input from the microphone unit 32 at the time of audio recording, and uses a predetermined data file format, for example, MP3 (MPEG-1 audio layer 3) standard. Therefore, the data is compressed and an audio data file is generated and sent to the memory 28. The audio processing unit 30 expands the compression of the audio data file sent from the memory 28 and converts it into an analog signal during reproduction of the audio, and is provided on the back surface of the casing (not shown) of the digital still camera 1. Sound is emitted through a speaker unit.

  The strobe drive unit 31 charges a strobe large-capacity capacitor (not shown) at the time of still image shooting, and then drives the strobe light emission unit 34 in accordance with the control from the control unit 22.

  In addition, when shooting a moving image instead of a still image, the still image data file compressed by the image processing unit 27 is recorded in the memory 28 when the first shutter key is operated. To start. Thereafter, this processing is continuously executed at a predetermined frame rate, for example, 30 (frames / second), and when the shutter key is operated for the second time or when a predetermined time limit, for example, 30 seconds elapses. These series of still image data files are collectively set as a motion JPEG data file (AVI file).

  In the playback mode, the control unit 22 selectively reads out the image data recorded in the memory 28, and the image data is compressed by a procedure that is completely opposite to the procedure in which the image processing unit 27 compresses the data in the shooting mode. The decompressed image data is held in the DRAM 21 via the DRAM interface 20, the contents held in the DRAM 21 are stored in the VRAM 24 via the VRAM controller 23, and the image data is periodically read out from the VRAM 24. The video signal is generated and displayed on the display unit 26.

  If the selected image data is not a still image but a moving image, playback of individual still image data constituting the selected moving image file is executed continuously in time, and all the still image data is played back. At the time of completion, playback and display are performed using only the still image data positioned at the head until the next playback instruction is given.

  Next, the processing operation in the automatic zoom control mode by the control unit 22 will be described using the flowchart shown in FIG.

  In step S1, the control unit 22 starts processing in the automatic zoom control mode in response to the automatic zoom control mode being turned on by the user operating the key input unit 29.

  In step S <b> 2, the control unit 22 specifies an arbitrary moving subject as a tracking target within a photographing range photographed via the lens unit 12 and the image sensor 13. Specifically, the control unit 22 specifies the focused subject as a tracking target by focusing by half-pressing the shutter key performed by the user while referring to the through-displayed image on the display unit 26. In addition, the control unit 22 may, for example, calculate a motion vector or the like within a shooting range shot through the lens unit 12 and the image sensor 13, and specify an arbitrary subject that moves as a tracking target. Good.

  In step S3, the control unit 22 starts tracking the subject specified in step S2.

  In step S <b> 4, the control unit 22 determines whether the tracked subject is in the zoom-out detection frame. If the subject is in the zoom-out detection frame, the control unit 22 proceeds to step S5. If the subject is not in the zoom-out detection frame, the control unit 22 continues the standby state in step S4. .

  Here, the zoom-out detection frame will be described. The zoom-out detection frame is a predetermined area defined in the display area on the display unit 26 shown in FIG. 1, and automatically zooms out when the subject is in the zoom-out detection frame. This is a detection area that becomes a trigger.

  In the zoom-out detection frame, an area as shown in FIGS. 3 to 5 can be defined according to the definition of the display area in which the display unit 26 displays an image.

  First, as shown in FIG. 3, all images picked up by the CCD image pickup area SA that is the maximum image pickup area of the image pickup device 13 are displayed in the display area DA that is a display area for displaying the image of the display unit 26. The zoom-out detection frame ZO is defined in the display area DA while maintaining a predetermined width along the four sides of the rectangular display area DA.

  The control unit 22 monitors whether or not the tracked subject has entered the zoom-out detection frame ZO. In other words, as shown in FIG. 3, the control unit 22 is an area other than the zoom-out detection frame ZO, and the subject to be tracked is contained in a rectangular area CA including the center C of the display area DA. It can be said that it is monitoring whether or not. That is, if it is determined that the tracked subject does not fall within the area CA, it is synonymous with the determination that the subject being tracked is in the zoom-out detection frame ZO, and therefore the process proceeds to a process of performing zoom-out. .

  In this way, when a trigger for executing zoom-out is defined, zoom-out is started in a state where the tracked subject is displayed on the display unit 26. Therefore, a display image that does not feel uncomfortable without losing the subject is displayed. Can be provided to the user. Therefore, it is possible to realize reliable photographing of the subject.

  Next, as shown in FIG. 4, the image captured in the CCD image capturing area SA, which is the maximum image area of the image sensor 13, is configured to be displayed only partially in the display area DA of the display unit 26. The zoom-out detection frame ZO is defined in the display area DA while maintaining a predetermined width along the four sides of the rectangular display area DA.

  The control unit 22 monitors whether or not the tracked subject has entered the zoom-out detection frame ZO. In other words, as shown in FIG. 4, the control unit 22 is an area other than the zoom-out detection frame ZO, and the maximum area of the rectangular area CA including the center C of the display area DA is the display area DA of the display section 26. It can be said that monitoring is performed to determine whether or not the tracked subject is within this area CA. That is, if it is determined that the tracked subject does not fall within the area CA, it is synonymous with the determination that the subject being tracked is in the zoom-out detection frame ZO, and therefore the process proceeds to a process of performing zoom-out. .

  In this way, when a trigger for executing zoom-out is defined, zoom-out is started in a state where the tracked subject is displayed on the display unit 26. Therefore, a display image that does not feel uncomfortable without losing the subject is displayed. Can be provided to the user. Therefore, it is possible to realize reliable photographing of the subject.

  Further, as shown in FIG. 5, when the image captured in the CCD image capturing area SA, which is the maximum image area of the image sensor 13, is configured to be partially displayed on the display area DA of the display unit 26, The zoom-out detection frame ZO can be defined outside the display area DA while maintaining a predetermined width along the four sides of the rectangular display area DA.

  The control unit 22 monitors whether or not the tracked subject has entered the zoom-out detection frame ZO. In other words, as shown in FIG. 5, the control unit 22 is an area other than the zoom-out detection frame ZO, and the maximum area of the rectangular area CA including the center C of the display area DA is the display area DA of the display section 26. It can be said that monitoring is performed to determine whether or not the subject being tracked is within this area CA. That is, if it is determined that the tracked subject does not fall within the area CA, it is synonymous with the determination that the subject being tracked is in the zoom-out detection frame ZO, and therefore the process proceeds to a process of performing zoom-out. .

  As described above, when the trigger for executing zoom-out is defined, zoom-out is started even when the tracked subject has once disappeared from the display unit 26, so that the user is again given a chance to shoot the subject. Can be provided. Therefore, it is possible to realize reliable photographing of the subject.

  The zoom-out detection frame ZO is not only defined along the four sides of the rectangular display area DA as shown in FIGS. 3 to 5 and FIG. 6 described above, but is also displayed as shown in FIG. You may make it prescribe | regulate in the left-right both ends of area | region DA. In any case, the shape of the area CA for monitoring whether or not the subject being tracked is another definition of the trigger for executing the zoom-out by the control unit 22 is rectangular. By making the area CA into a rectangular shape in this way, the distance until the subject no longer fits in the area CA is extended, so the timing for executing the zoom-out can be extended to the limit, and therefore the zoom-out is performed unnecessarily. Annoyance caused by being done can be prevented.

  Selection of the shape of the zoom-out detection frame ZO as shown in FIGS. 6 and 7 can be performed by the user operating the key input unit 29.

  Returning to the flowchart shown in FIG. 2 again, the processing operation in the automatic zoom control mode by the control unit 22 will be described.

  In step S <b> 5, the control unit 22 detects the speed of the subject at this time in response to the subject being tracked being in the zoom-out detection frame. Specifically, the control unit 22 captures an image captured by the image sensor 13 in units of macroblocks having a predetermined number of pixels, and zooms in the macroblock in which the subject was present before entering the zoom-out detection frame. The position of the subject is calculated as a motion vector from the change in the number of pixels before and after the subject enters the out detection frame. The control unit 22 can grasp the speed and moving direction of the subject from the calculated motion vector.

  In step S6, the control unit 22 determines either the zoom speed for zooming out or the zoom magnification according to the speed of the subject calculated in step S5.

  The control unit 22 determines the zoom speed per unit time when zooming out according to the speed of the subject. That is, if the subject speed is high, the zoom-out is performed at a high zoom speed, and if the subject speed is low, the zoom-out is performed at a slow zoom speed.

  The control unit 22 may determine the zoom magnification according to the speed of the subject. That is, if the subject speed is high, the zoom-out is performed with a large zoom magnification, and if the subject speed is slow, the zoom-out is performed with a small zoom magnification.

  In step S7, the control unit 22 controls to zoom out the shooting range including the tracked subject shot through the lens unit 12 and the image sensor 13 at the determined zoom speed or zoom magnification, and performs zoom-out processing. Execute.

  Thus, as shown in FIGS. 8A and 8B, the control unit 22 controls the zoom-out process at the zoom speed or the zoom magnification determined according to the speed of the subject, so that it becomes extremely natural. In addition, the subject can be reduced to an optimum size without losing sight of the subject displayed on the display unit 26.

  Further, as shown in FIGS. 9A and 9B, the control unit 22 may control to zoom out until the maximum reduction magnification is achieved regardless of the speed of the subject. In this case, the control unit 22 advances the process from step S4 to step S7 without going through the processes of steps S5 and S6 in the flowchart shown in FIG.

  In step S8, the control unit 22 checks the current position of the subject.

  In step S <b> 9, the control unit 22 determines whether the subject being tracked is in the zoom-in detection frame. If the subject is in the zoom-in detection frame, the control unit 22 advances the process to step S10. If the subject is not in the zoom-in detection frame, the control unit 22 returns the process to step S8.

  Here, the zoom-in detection frame will be described. The zoom-in detection frame is defined as a predetermined central region in the display area on the display unit 26 shown in FIG. 1, and is a trigger for automatically executing zoom-in when a subject is in the zoom-in detection frame. This is a detection area. 8 and 9 show a zoom-in detection frame ZI as an example of the zoom-in detection frame. For example, as shown in FIGS. 8 and 9, the zoom-in detection frame ZI is defined as a rectangular area in a predetermined central area of the display area DA.

  The control unit 22 monitors whether or not the tracked subject has intruded into the zoom-in detection frame ZI. That is, if it is determined that the tracked subject has entered the zoom-in detection frame ZI, the process proceeds to a process of executing zoom-in.

  In step S <b> 10, the control unit 22 performs zoom-in processing by controlling to zoom in on an imaging range including the tracked subject imaged via the lens unit 12 and the image sensor 13 until an appropriate zoom magnification is obtained.

  The zoom-out process described above is performed to the extent that the subject after zoom-out does not enter the zoom-in detection frame ZI, and the zoom-in process is performed to the extent that the subject after zoom-in does not enter the zoom-out detection frame ZO. Shall be.

  In this way, as shown in FIG. 10A, the control unit 22 performs zooming as shown in FIG. 10B in response to the fact that the zoom-out detection frame ZO has been applied without being within the predetermined area CA. Out process is executed. Further, as shown in FIG. 10C, the control unit 22 executes zoom-in processing as shown in FIG. 10D in response to entering the zoom-in detection frame ZI.

  That is, the control unit 22 applies the zoomed-out detection frame ZO to the zoomed-in detection frame ZI, which is a predetermined central area of the display unit 26, and the reduced-sized subject. It is determined that there is room for enlargement to an appropriate size, and zoom-in processing is executed. Therefore, it is possible to photograph the tracked subject with an appropriate size.

  Thus, the control unit 22 keeps the tracking subject within the shooting range in order to control to zoom out the shooting range including the subject in response to determining that the tracking subject does not fall within the area CA. So that the subject can be reliably captured. Therefore, the user can photograph the subject satisfactorily by setting the automatic zoom control mode.

  In addition, by setting the area CA to an area that includes the center of the display area of the display unit 26, it is possible to reliably capture a subject that is about to fall outside the shooting range.

  Next, another processing operation in the automatic zoom control mode by the control unit 22 will be described using the flowchart shown in FIG.

  In the processing operation described using the flowchart shown in FIG. 2 described above, the control unit 22 controls the zoom-out process at the zoom speed or the zoom magnification determined according to the speed of the subject. On the other hand, in the processing operation described with reference to the flowchart shown in FIG. 11, the control unit 22 zooms out at a stroke until the maximum reduction magnification is reached in response to the subject speed exceeding a predetermined speed. To control.

  In step S <b> 21, in response to the user turning on the automatic zoom control mode by operating the key input unit 29, the control unit 22 starts processing in the automatic zoom control mode.

  In step S <b> 22, the control unit 22 specifies any moving subject as a tracking target within a photographing range photographed via the lens unit 12 and the image sensor 13. Specifically, the control unit 22 specifies the focused subject as a tracking target by focusing by half-pressing the shutter key performed by the user while referring to the through-displayed image on the display unit 26. In addition, the control unit 22 may, for example, calculate a motion vector or the like within a shooting range shot through the lens unit 12 and the image sensor 13, and specify an arbitrary subject that moves as a tracking target. Good.

  In step S23, the control unit 22 starts tracking the subject specified in step S22.

  In step S24, the control unit 22 detects the speed of the tracked subject. For example, the control unit 22 calculates a motion vector of the subject, and grasps the speed and moving direction of the subject from the calculated motion vector.

  In step S25, the control unit 22 determines whether the detected speed of the subject is equal to or higher than a predetermined speed. If the subject speed is equal to or higher than the predetermined speed, the control unit 22 advances the process to step S26. If the subject speed is not equal to or higher than the predetermined speed, the control unit 22 returns the process to step S24 to 4.

  In step S <b> 26, the control unit 22 checks the current position coordinates (X, Y) on the display area of the subject display unit 26.

  In step S27, the control unit 22 checks the quadrant on the display area of the display unit 26 from the position coordinates (X, Y). Specifically, as shown in FIGS. 12 to 15, XY coordinates having the origin at the center of the display area DA of the display unit 26 are provided. At this time, from the coordinate position (X, Y) of the subject, it can be seen in which quadrant the subject is present. 12 to 15, it can be seen that the subject exists in the first to fourth quadrants.

  In step S28, the control unit 22 checks the movement vector of the tracked subject and determines the movement direction of the subject.

  In step S29, the control unit 22 determines whether the absolute value of the X coordinate or the absolute value of the Y coordinate is moving in the increasing direction. If the absolute value of the X coordinate or the absolute position of the Y coordinate is moving, the control unit 22 proceeds to step S30. If not, the control unit 22 returns the process to step S24. .

  This means that it is determined by the movement direction determined by the control unit 22 whether the tracked subject is moving in a direction deviating from the angle of view that is the shooting range. In other words, if the subject is moving in a direction where either the absolute value of the X coordinate or the absolute value of the Y coordinate increases, the subject moves in a direction away from the origin on the two-dimensional plane, that is, away from the angle of view. It is judged that

  For example, in FIG. 12, it is determined that both the absolute value of the X coordinate and the absolute value of the Y coordinate are moving in a direction larger than the movement vector V1 of the subject located in the first quadrant, You can see that he is moving away from the angle of view.

  In FIG. 13, it is determined that the absolute value of the X coordinate is moving from the vector V2 of the subject located in the second quadrant, and the subject is about to move away from the angle of view. I can see that

  In FIG. 14, it is determined that the absolute value of the X coordinate and the absolute value of the Y coordinate are moving in the direction of decreasing from the vector V3 of the subject located in the third quadrant. You can see that you are moving in a direction that doesn't come off.

  Furthermore, in FIG. 15, it is determined that the absolute value of the Y coordinate is larger than the vector V4 of the subject located in the fourth quadrant, and the subject is about to move away from the angle of view. I can see that

  In step S <b> 30, the control unit 22 performs control to zoom out the shooting range including the tracked subject shot through the image sensor 13 until the minimum magnification is reached, and executes zoom-out processing.

  In step S31, the control unit 22 checks the current position of the subject.

  In step S <b> 32, the control unit 22 determines whether the tracked subject is in the zoom-in detection frame. If the subject is in the zoom-in detection frame, the control unit 22 proceeds to step S33. If the subject is not in the zoom-in detection frame, the control unit 22 returns to step S31.

  In step S <b> 33, the control unit 22 performs control to zoom in on the shooting range including the tracked subject shot through the lens unit 12 and the image sensor 13 until the zoom magnification becomes an appropriate zoom magnification, and executes zoom-in processing.

  The zoom-out process described above is performed to the extent that the subject after zoom-out does not enter the zoom-in detection frame ZI, and the zoom-in process is performed to the extent that the subject after zoom-in does not deviate from the angle of view. And

  In this way, as shown in FIG. 16A, the control unit 22 responds to the movement of the subject at a predetermined speed or more and moving away from the angle of view as shown in FIG. 16B. Then, the zoom-out process is executed. Furthermore, as illustrated in FIG. 16C, the control unit 22 performs zoom-in processing as illustrated in FIG. 16D in response to entering the zoom-in detection frame ZI.

  As a result, the control unit 22 displays the subject being tracked by zooming out to the minimum magnification at a stroke by moving the subject at a predetermined speed or more and moving away from the angle of view. Thus, the user can be provided with a photographing opportunity without disappearing from H.26. Therefore, it is possible to realize reliable photographing of the subject.

  In addition, for example, as shown in FIG. 14 described above, even when the subject moves in a direction in which the absolute values of both the X coordinate and the Y coordinate decrease, the vicinity of the center that is the origin of the display area DA After passing through, it moves in a direction away from the angle of view. Therefore, when the subject is moving at high speed, the subject to be tracked can be erased from the display unit 26 by controlling to zoom out using only the speed as a trigger without considering the moving direction of the subject. In some cases, it is possible to quickly provide the user with a chance of shooting. Therefore, it is possible to realize reliable photographing of the subject.

  As described above, when only the subject speed is used as a trigger for zooming out, the control unit 22 skips the processing steps from step S26 to step S29 and proceeds from step S25 to step S30 in the flowchart shown in FIG. To control.

  Further, the control unit 22 has a room for enlarging the reduced subject to an appropriate size because the zoomed-out subject has entered the zoom-in detection frame ZI that is a predetermined central region of the display unit 26 again. The zoom-in process is executed. Therefore, it is possible to photograph the tracked subject with an appropriate size.

  Note that the width of the zoom-out detection frame ZO and the size of the zoom-in detection frame ZI described above can be freely changed by operating the key input unit 29 by the user.

  Further, although the digital still camera 1 has been described in the present embodiment, the present invention is not limited to this, and a mobile phone with a photographing function, a PDA (Personal Data Assistance), and a video for photographing a moving image. The present invention can also be applied to a camera device.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

It is a block diagram for demonstrating the function structure of the digital still camera shown as embodiment of this invention. It is a flowchart for demonstrating the processing operation of the automatic zoom control mode performed with the said digital still camera. It is a figure for demonstrating an example of the zoom-out detection frame prescribed | regulated to the display area of a display part. It is a figure for demonstrating another example of the zoom out detection frame prescribed | regulated to the display area of a display part. It is a figure for demonstrating another example of the zoom-out detection frame prescribed | regulated to the display area of a display part. It is the figure which showed the shape of the zoom-out detection frame prescribed | regulated to the display area of a display part. It is the figure which showed another shape of the zoom-out detection frame prescribed | regulated to the display area of a display part. It is the figure which showed a mode that it zoomed out according to the speed of a to-be-photographed object. It is the figure which showed a mode that it zoomed out irrespective of the speed of a to-be-photographed object. FIG. 6 is a diagram showing a series of flows from zooming out to zooming in in the automatic zoom control mode. It is a flowchart for demonstrating another process operation | movement of the automatic zoom control mode performed with the said digital still camera. It is the figure which showed a mode that the to-be-photographed object exists in the 1st quadrant when the center of the display area of a display part is made into the origin. It is the figure which showed a mode that the to-be-photographed object exists in the 2nd quadrant when the center of the display area of a display part is made into the origin. It is the figure which showed a mode that the to-be-photographed object exists in the 3rd quadrant when the origin of the center of the display area of a display part is made into the origin. It is the figure which showed a mode that the to-be-photographed object exists in the 4th quadrant when the center of the display area of a display part is made into the origin. FIG. 6 is a diagram showing a series of flows from zooming out to zooming in in the automatic zoom control mode.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Digital still camera 12 Lens unit 13 Image pick-up element 14 Timing generator 15 Vertical driver 16 Sample hold circuit 17 Converter 18 Color process circuit 19 DMA controller 20 DRAM interface 21 DRAM
22 control unit 23 VRAM controller 24 VRAM
25 Digital Video Encoder 26 Display Unit 27 Image Processing Unit 28 Memory 29 Key Input Unit

Claims (14)

Photographing means for photographing a photographing range including a subject;
A subject specifying means for specifying an arbitrary subject that moves within a shooting range shot by the shooting means;
Subject tracking means for tracking the subject specified by the subject specifying means;
Zooming means for zooming in or zooming out a photographing range photographed by the photographing means;
Determining means for determining whether or not the subject tracked by the subject tracking means is within a predetermined area within the shooting range shot by the shooting means;
Control means for controlling the zooming means to zoom out the photographing range including the subject when the judgment means judges that the subject is not within the predetermined area. Shooting device. Display means for displaying an image within the photographing range photographed by the photographing means;
The photographing apparatus according to claim 1, wherein the predetermined area is an area including a center of a display area on which an image of the display unit is displayed. When displaying all the images within the shooting range shot by the shooting means in the display area of the display means,
The photographing apparatus according to claim 2, wherein a maximum area of the predetermined area is defined within a display area of the display means. When displaying a part of the image within the photographing range photographed by the photographing means in the display area of the display means,
The photographing apparatus according to claim 2, wherein a maximum area of the predetermined area is defined within a display area of the display unit or outside the display area. The photographing apparatus according to claim 2, wherein the predetermined area is rectangular. Speed detection means for detecting the speed of the subject tracked by the subject tracking means;
The control means, when the judgment means judges that the subject does not fall within the predetermined area, the zoom speed according to the speed of the subject detected by the speed detection means, or the speed detection means The zooming unit is controlled to zoom out a shooting range including the subject at a zoom magnification corresponding to the speed of the subject detected by the method according to any one of claims 1 to 5. Shooting device. Intrusion detection means for detecting entry into a predetermined central area in the display area of the display means,
The control means, after controlling the zooming means to zoom out the shooting range including the subject,
The zooming unit is controlled to zoom in on a photographing range including the subject when the intrusion detecting unit detects an intrusion into the predetermined central area. The imaging device according to claim 1. A shooting process for shooting a shooting range including the subject;
A subject specifying step for specifying an arbitrary subject in motion within the shooting range shot by the shooting step;
A subject tracking step for tracking the subject specified by the subject specifying step;
A zooming step of adjusting a shooting range shot by the shooting step by zooming in or zooming out;
A determination step of determining whether or not the subject tracked by the subject tracking step is within a predetermined area within the shooting range shot by the shooting step;
And a control step of controlling the zooming step so as to zoom out the shooting range including the subject when it is determined by the determination step that the subject is not within the predetermined area. Subject tracking zooming method. A subject tracking zooming program applied to a computer provided in a photographing apparatus for photographing a subject,
A shooting step for shooting a shooting range including the subject;
A subject specifying step for specifying an arbitrary subject in motion within the shooting range shot by the shooting step;
A subject tracking step for tracking the subject specified in the subject specifying step;
A zooming step of adjusting a shooting range shot by the shooting step by zooming in or zooming out;
A determination step of determining whether or not the subject tracked by the subject tracking step is within a predetermined area within the shooting range shot by the shooting step;
A control step for controlling the zooming step so as to zoom out a shooting range including the subject when the judgment step determines that the subject is not within the predetermined area. Subject tracking zooming program. Photographing means for photographing a photographing range including a subject;
A subject specifying means for specifying an arbitrary subject that moves within a shooting range shot by the shooting means;
Subject tracking means for tracking the subject specified by the subject specifying means;
Zooming means for zooming in or zooming out a photographing range photographed by the photographing means;
Speed detecting means for detecting the speed of the subject tracked by the subject tracking means;
Speed determining means for determining whether or not the speed of the subject detected by the speed detecting means is equal to or higher than a predetermined speed;
Control means for controlling the zooming means to zoom out the photographing range including the subject when the speed judging means judges that the speed of the subject is equal to or higher than a predetermined speed. An imaging device. A moving direction detecting means for detecting a moving direction of a subject tracked by the subject tracking means;
A moving direction determining means for determining whether or not the moving direction of the subject detected by the moving direction detecting means is moving in a direction deviating from an angle of view that is a shooting range;
The control means determines that the speed of the subject is equal to or higher than a predetermined speed by the speed determination means, and further determines that the subject is moving in a direction away from the angle of view by the movement direction determination means. The photographing apparatus according to claim 10, wherein the zooming unit is controlled to zoom out the photographing range including the subject. Display means for displaying an image within the photographing range photographed by the photographing means;
An intrusion detection means for detecting an intrusion into a predetermined central area in the display area of the display means,
The control means, after controlling the zooming means to zoom out the shooting range including the subject,
The zooming unit is controlled to zoom in on a photographing range including the subject when the intrusion detection unit detects an intrusion into the predetermined central region. Shooting device. A shooting process for shooting a shooting range including the subject;
A subject specifying step for specifying an arbitrary subject in motion within the shooting range shot by the shooting step;
A subject tracking step for tracking the subject specified by the subject specifying step;
A zooming step for zooming in or zooming out a photographing range photographed by the photographing step;
A speed detection step of detecting the speed of the subject tracked by the subject tracking step;
A speed determination step of determining whether or not the speed of the subject detected by the speed detection step is equal to or higher than a predetermined speed;
And a control step of controlling the zooming step so as to zoom out the shooting range including the subject when the speed determination step determines that the speed of the subject is equal to or higher than a predetermined speed. The subject tracking zooming method. A subject tracking zooming program applied to a computer provided in a photographing apparatus for photographing a subject,
A shooting step for shooting a shooting range including the subject;
A subject specifying step for specifying an arbitrary subject in motion within the shooting range shot by the shooting step;
A subject tracking step for tracking the subject specified in the subject specifying step;
A zooming step for zooming in or zooming out a shooting range shot by the shooting step;
A speed detecting step for detecting the speed of the subject tracked by the subject tracking step;
A speed determination step for determining whether or not the speed of the subject detected by the speed detection step is equal to or higher than a predetermined speed;
And performing a control step for controlling the zooming step so as to zoom out the shooting range including the subject when the speed determining step determines that the speed of the subject is equal to or higher than a predetermined speed. A featured subject tracking zooming program.

Images