JP2010130488A - Image capturing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve ease of operation of a tracking function when a moving image is recorded by an image capturing apparatus. <P>SOLUTION: A recording I/F unit 145 records video data in a recording medium. A tracking process unit 155 tracks an object in a field based on the video data. An operation unit 180 has a video recording button 180d and a tracking button 180f that are separately provided in a chassis 200. A system control unit 157 controls the recording I/F unit 145 and the tracking process unit 155 according to the operation of the operation unit 180. The video recording button 180d and the tracking button 180f can be independently operated so that the release state is changed and then release state is restored. The system control unit 157 allows either of video data recording start and video data recording stop while the video recording button 180d changes from the release state and then returns to the release state again, and allows both object tracking start and object tracking stop while the operation of the tracking button 180f starts in the release state and then returns to the release state again. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, and more particularly to an imaging apparatus having a subject tracking function.

  A feature amount of a subject specified by a photographer (user) or a subject specified by an imaging device (hereinafter referred to as a “main subject”) is obtained based on a predetermined condition, and image data is obtained from the feature amount. A technique for estimating an area where a main subject exists is known. In particular, the process of sequentially obtaining a region where a main subject exists in moving image data, which is image data that is continuously input, operates to follow the moving main subject and is often called a tracking process or a tracking process. In the present application, chasing the main subject in moving image data is referred to as “tracking”.

  As means for instructing the start and stop of the tracking process, there is a technique of using a button that can be half-pressed and fully pressed, and performing the tracking process when the button is half-pressed (see, for example, Patent Document 1).

  FIG. 10 is an example of a flowchart showing the operation of a conventional digital camera equipped with the tracking function described in Patent Document 1.

  In FIG. 10, when the digital camera enters the shooting mode, a frame image obtained from a CCD (Charge Coupled Device) image sensor is displayed as a through image on a display unit provided in the digital camera. At the same time, a rectangular trace frame used for specifying the main subject and displaying the position of the main subject is displayed at a predetermined position (step S1). In subsequent step S2, it is determined whether or not the shutter button is half-pressed. The process remains at step S2 until the shutter button is half-pressed.

  If it is determined that the shutter button is half-pressed, a trimming frame for trimming an image with the currently displayed trace frame as the center is displayed (step S3). Then, the subject displayed in the trace frame is recognized by known image processing (step S4). The recognized subject is treated as a main subject in subsequent processing. Then, frame image data is acquired from the CCD image sensor (step S5), and the position of the main subject is detected from the acquired frame image data (step S6). If it is determined in step S7 that the main subject has been successfully detected, the display of the trace frame and the trimming frame is updated based on the main subject detection position in step S8 (step S8), and the process proceeds to step S10. . If it is determined in step S7 that the main subject has not been successfully detected, the display unit displays that the main subject has been out of frame in step S9, and the process proceeds to step S10. In step S10, it is determined whether or not the shutter button has been fully pressed.

  If it is determined in step S10 that the shutter button has not been fully pressed, the process proceeds to step S11, and it is determined whether or not the half-press of the shutter button has been released. If the half-press of the shutter button has not been released, the process returns to step S5, new frame image data is acquired from the CCD image sensor, and the main subject position detection process is repeated. If the half-press of the shutter button has been released, it is recognized that the tracking process has been completed, and the display of the trace frame is returned to a predetermined position in step S12. Then, the process returns to step S2, and again enters a state of waiting for half-pressing of the shutter button.

If it is determined in step S10 that the shutter button has been fully pressed, the digital camera enters a shooting operation after step S13. In the photographing operation, first, AF processing is performed on an AF (Auto Focus) area determined based on the position of the trace frame in step S13. Thereafter, still image shooting processing is performed in step S14, and the obtained image data is trimmed based on the trimming frame in step S15, and the trimmed image data is previewed on the display unit in step S16. Is done. Finally, in step S17, the image data is recorded on the recording medium, and the photographing process is completed.
JP 2008-009263 A

  In general, shooting can be broadly classified into recording of still images and recording of moving images, but the technique described in Patent Document 1 assumes recording of still images.

  In the case of still image recording, tracking is executed in the previous stage of still image recording so that the still image recording is performed when the main subject detection is successful by the execution of tracking, and tracking and still image recording are performed. There is a need to execute in conjunction.

  In the digital camera described in Patent Document 1, the configuration that enables the operation to start tracking and the operation to perform still image recording with a common button (shutter button) is adopted when performing still image recording. It can be understood that the purpose is to improve the operability of the tracking function while satisfying the above specific needs.

  In short, the technique described in Patent Document 1 is a technique specialized for still image recording, and is not intended for moving image recording. So far, no proposal has been made to improve the operability of the tracking function when recording a moving image.

  The present invention has been made in view of such a point, and an object of the present invention is to provide an imaging apparatus capable of improving the operability of the tracking function when recording a moving image.

  An imaging apparatus according to the present invention is based on a housing, an imaging unit that creates video data from an optical image of a scene, a recording unit that records the created video data on a recording medium, and the created video data A tracking unit that tracks a subject in the scene, an operation unit that includes a recording operation member and a tracking operation member that are separately provided in the housing, and controls the recording unit and the tracking unit according to the operation of the operation unit. The recording operation member and the tracking operation member can be operated independently of each other so as to change from a predetermined state and return to the predetermined state, and the control unit includes the recording operation member Until the recording unit changes from the predetermined state and returns to the predetermined state, the recording unit is controlled to start or stop recording of video data, and the tracking operation member changes from the predetermined state. Until returning to the predetermined condition Te, it performs control to perform both the start and stop of the tracking of the object to the tracking unit, a configuration.

  According to the present invention, it is possible to improve the operability of the tracking function when recording a moving image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing an internal configuration of a video camera as an imaging apparatus according to Embodiment 1 of the present invention.

  In FIG. 1, a video camera 100 includes an optical system 105, a solid-state imaging device 110, an analog / digital (A / D) conversion unit 115, a video signal processing unit 120, a Y / C conversion unit 125, a system bus 130, and a buffer memory unit 135. A codec unit 140, a recording interface (I / F) unit 145, a socket 150, a tracking processing unit 155, a system control unit 157, an aperture control unit 165, a lens control unit 170, an operation unit 180, and a display unit 190.

  The optical system 105 includes a plurality of lenses and a diaphragm unit that controls exposure. The lens constituting the optical system 105 includes a focus lens that moves along the optical axis for adjusting the in-focus state, and a zoom lens that moves along the optical axis for scaling the optical image of the object field including the subject. Including. An optical image of the object scene is formed on the solid-state image sensor 110 via the optical system 105.

  The solid-state image sensor 110 converts the optical image formed by the optical system 105 into an electrical signal (analog video signal). Examples of the solid-state imaging device 110 include an image sensor such as a CCD image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.

  The A / D converter 115 converts the analog video signal output from the solid-state image sensor 110 into a digital video signal.

  The video signal processing unit 120 performs known video signal processing such as gain adjustment, noise removal, gamma correction, aperture processing, and knee processing on the digital video signal output from the A / D conversion unit 115. A digital video signal in RGB format is generated as video data.

  That is, the optical system 105, the solid-state imaging device 110, the A / D conversion unit 115, and the video signal processing unit 120 receive an optical image of the object scene by the solid-state imaging device 110 via the optical system 105 and receive the light. An imaging unit that generates a digital video signal from the optical image as video data is configured.

  The Y / C conversion unit 125 converts the format of the digital video signal generated by the video signal processing unit 120 from the RGB format to the Y / C format. The Y / C conversion unit 125 outputs a Y / C format digital video signal to the buffer memory unit 135 via the system bus 130.

  The buffer memory unit 135 temporarily stores the digital video signal output from the Y / C conversion unit 125 or the codec unit 140 as digital video information.

  The codec unit 140 acquires the digital video information stored in the buffer memory unit 135 via the system bus 130, and performs irreversible compression processing on the acquired digital video information, for example, MPEG-2. (Moving Picture Experts Group phase 2) or Compressed video data in a predetermined format such as H.264 / MPEG-4 AVC (Moving Picture Experts Group phase 4 Part 10 Advanced Video Coding) is generated. Further, the codec unit 140 records the generated compressed video data on the recording medium 195 electrically connected to the socket 150 via the system bus 130 and the recording I / F unit 145.

  Further, the codec unit 140 acquires the compressed video data recorded on the recording medium 195 electrically connected to the socket 150 and performs a decompression process on the acquired compressed video data, thereby converting the digital video signal. Generate. The codec unit 140 outputs the generated digital video signal to the buffer memory unit 135 via the system bus 130.

  That is, the codec unit 140 and the recording I / F unit 145 have a function of recording the video data generated by the imaging unit on the recording medium 195 and a function of capturing the video data recorded on the recording medium 195 into the video camera 100. A recording unit is also configured.

  In this embodiment, the recording medium 195 is a removable medium that can be inserted into and removed from the socket 150, but may be a recording medium such as a hard disk built in the video camera 100.

  A tracking processing unit 155 as a tracking unit sequentially generates image data by appropriately performing image reduction processing on the digital video signal in RGB format generated as video data by the video signal processing unit 120. Each image data is stored in an internal memory (not shown).

  Further, the tracking processing unit 155 performs a tracking process for tracking the main subject in the object scene based on each image data stored therein when the tracking mode is enabled. The tracking processing unit 155 extracts various feature amounts from each image data stored therein, and performs a tracking process based on the extracted feature amounts.

  Here, feature amount extraction will be described. The tracking processing unit 155 can extract various feature amounts from the image data by a known method.

  As an example of the extracted feature amount, a luminance level value of a specific area in the image data designated by the system control unit 157 can be cited. This is used for exposure control. More specifically, when the tracking processing unit 155 extracts the brightness level value of the specific area, the system control unit 157 calculates an optimum aperture value based on the extracted brightness level value, and calculates the calculated aperture value. Based on this, the aperture control unit 165 is notified of the aperture control amount. The aperture control unit 165 adjusts the aperture of the optical system 105 by driving the aperture adjustment device and the shutter device provided in the optical system 105 based on the aperture control amount notified from the system control unit 157. .

  Another example of the extracted feature amount is high-frequency component information of a specific region in the image data designated by the system control unit 157. This is used for focus control. The high-frequency component included in the video signal corresponds to the degree of focusing, and takes a maximum value at the focal point. Therefore, in the focus detection method generally known as the “mountain climbing method”, the focus detection operation is performed by moving the focus lens and the zoom lens constituting the optical system 105 and obtaining the maximum value of the high frequency component. Is called. That is, when the tracking processing unit 155 extracts the high frequency component information of the specific region, the system control unit 157 controls the focus lens and the zoom lens constituting the optical system 105 based on the extracted high frequency component information. Lens control amount is determined, and the determined control amount is notified to the lens control unit 170. The lens control unit 170 drives the focus lens and the zoom lens constituting the optical system 105 based on the lens control amount notified from the system control unit 157.

  The tracking processing unit 155 can also extract a region where the main subject is likely to exist in the image data (hereinafter referred to as “subject region”) based on a preset feature amount of the main subject. Such processing is generally called subject detection, but may also be called subject identification or subject recognition.

  For example, the tracking processing unit 155 determines the subject region by performing region comparison in units of pixels on the input image using the pixel value itself of the pixel group as a feature amount. This method is generally called template matching.

  Note that a color histogram indicating the color distribution in the image area may be used as the feature quantity instead of the pixel value. In this case, the tracking processing unit 155 selects a region group as a subject region candidate from the input image, creates a color histogram for the selected region group, and calculates the similarity between the created color histograms. The calculation is performed using the intersection method or the like, and the image region that exhibits the highest degree of matching is determined as the subject region as a result of the calculation.

  Further, as the feature amount, a contour may be substituted, or motion information using interframe differences may be substituted.

  Moreover, you may substitute known wavelet feature-values, such as Gabor or Haar-Like, as a feature-value. Alternatively, as a feature amount, a feature amount obtained by performing prior learning using a sample image according to a detection target such as a human face or human body or a specific person or object may be substituted. In this case, the tracking processing unit 155 extracts a region where the detection target exists from the input image as a subject region based on the obtained feature amount.

  Various techniques relating to subject detection as described above have been researched and developed for a long time. The present invention does not depend on a specific feature amount or a specific subject detection method. Therefore, any feature amount and subject detection method can be used, and a plurality of techniques can be used in combination.

  It should be noted that the tracking processing unit 155 dynamically creates feature quantities that do not require prior learning using sample images, such as color histograms and image templates, when instructed by the system control unit 157. The dynamic creation of feature quantities will be described later.

  The system control unit 157 as a control unit includes a CPU (Central Processing Unit), a ROM (Read Only Memory) in which a program is recorded, and a RAM (Random Access Memory) for program execution (none of which is shown), and a system bus The operation of each part of the video camera 100 is controlled via 130.

  More specifically, when the user operates the operation unit 180, the system control unit 157 determines each part of the video camera 100, in particular, the codec unit 140, according to operation information input from the operation unit 180 according to the operation. And a recording unit including the recording I / F unit 145 and a tracking unit including the tracking processing unit 155 are controlled.

  In addition, the system control unit 157 acquires the digital video information stored in the buffer memory unit 135 via the system bus 130, and performs display reduction processing on the acquired digital video information by performing image reduction processing. The generated display data is output to the display unit 190, and the display data is displayed as a video on the display screen of the display unit 190. Therefore, when the shooting mode is selected, since the video data generated by the imaging unit is stored in the buffer memory unit 135, a raw video is displayed on the display unit 190. When the playback mode is selected, since the video data generated by the recording unit is stored in the buffer memory unit 135, the past recorded video is displayed on the display unit 190.

  When generating the display data, the system control unit 157 causes the recording time information, the battery remaining amount information, and various icons that can be intuitively grasped during operation to be superimposed on the video displayed on the display screen. Then, image processing is performed on the generated display data. When the operation unit 180 is operated to display a menu for various settings, image processing is performed on the display data so that the requested menu is displayed on the display screen. . Furthermore, when menu selection, setting, and setting cancellation operations are performed, image processing corresponding to those operations is performed on the display data.

  The display unit 190 includes a thin display panel such as an LCD (Liquid Crystal Display) panel, for example, and an electronic view finder (EVF).

  The operation unit 180 includes a plurality of operation members. The user can operate the operation unit 180 while referring to the video displayed on the thin display panel or the EVF. When the operation unit 180 is operated, the operation information is input from the operation unit 180 to the system control unit 157.

  The operation member is typically a button, a lever or the like. When the operation member is a button, the user changes the button from the released state to the pressed state or returns the button from the pressed state to the released state by performing a pressing operation on the operation member. Note that the operation member may include, for example, a capacitive sensor that can detect contact of the human body part with the operation member. When the operation unit 180 includes such a sensor, the system control unit 157 determines that the operation member is in a pressed state when it is detected that the human body part is in contact with the operation member, and the human body part When it is detected that is not in contact with the operating member, it is determined that the operating member is in the released state.

  Heretofore, the internal configuration of the video camera 100 according to the present embodiment has been described.

  Next, the external configuration of the video camera 100 will be described. FIG. 2 is an external view of the video camera 100 of the present embodiment.

  As shown in FIG. 2, the video camera 100 includes a housing 200 including a body 200a and a door body 200b attached to the body 200a.

  The door body 200b includes a hinge portion 202 that enables opening and closing with respect to the body 200a, and a thin display panel 190a. Since the door 200b can form a state in which the display screen of the thin display panel 190a is closed toward the body 200a, the display screen can be protected when the video camera 100 is not used. Further, since the door 200b can form a state in which the display screen of the thin display panel 190a is opened toward the user holding the video camera 100, the user can display the thin display when using the video camera 100. Various setting operations, tracking and recording (that is, recording of video data) can be performed while referring to the display screen of the panel 190a. Further, the hinge portion 202 has a configuration that can rotate the door body 200b so that the display screen of the thin display panel 190a faces upward or downward when the door body 200b is in an open state.

  The body 200a can be gripped by the user with one hand, and particularly has a shape and dimensions that the user can easily hold with the right hand during imaging or tracking. Except for the thin display panel 190a that constitutes a part of the display unit 190 (see FIG. 1), the internal structure shown in FIG. 1 is housed inside or attached to the body 200a.

  For example, the optical system 105 (see FIG. 1) is attached to the front surface portion 204a of the body 200a, and the EVF constituting a part of the display unit 190 is attached to the back surface portion 204b of the body 200a. 204b, the upper surface portion 204c, and the left side surface portion 204d include menu buttons 180a, a lever 180b, a delete button 180c, a recording button 180d, a zoom lever 180e, and a tracking button 180f as operation members constituting the operation unit 180 (see FIG. 1). Arranged. Note that a mode dial or the like for switching the shooting mode, the playback mode, and the power-off is disposed on the right side surface (not shown) of the body 200a.

  An opening / closing panel 205 for protecting the socket 150 (see FIG. 1) is provided on the left side surface portion 204d of the body 200a. The user can open the open / close panel 205 and insert the recording medium 195 (see FIG. 1) into the socket 150. In addition, a battery 210 that supplies power necessary for driving the video camera 100 is attached to the back surface portion 204b of the body 200a.

  Here, each operation member constituting the operation unit 180 will be described.

  The menu button 180a is a button for displaying a menu on the display screen of the thin display panel 190a and the display screen of the EVF 190b.

  The lever 180b is a lever that can be tilted up and down, left and right and pressed, and is used for selection and determination of a menu.

  The delete button 180c is a button for instructing deletion of recorded video data.

  The recording button 180d as a recording operation member is a button for instructing start or stop of recording. The recording button 180d is a button that is in a pressed state while being pressed, and is in a released state when it is not pressed. Whenever the recording button 180d is pressed with a finger and changes from the released state to the pressed state, the recording start control and the recording stop control are alternately performed by the system control unit 157 (see FIG. 1). Once pressed, recording starts, and when the recording button 180d is pressed again, recording is stopped. That is, only one of recording start and recording stop is recorded in the recording unit (the codec in FIG. 1) until the recording button 180d changes from the released state to the pressed state and returns from the pressed state to the released state by a single pressing operation. The system control unit 157 performs control to be executed by the unit 140 and the recording I / F unit 145).

  In addition, the recording button 180d is disposed at a position where the thumb of the hand to be gripped (for example, the right hand) is positioned when the user grips the torso 200a, that is, the back surface portion 204b. Thus, the user can easily start and stop recording with the thumb of the hand holding the video camera 100 while holding the video camera 100.

  The zoom lever 180e is a lever that instructs zooming in the wide direction or the tele direction by sliding the body 200a in the left-right direction. The zoom lever 180e is disposed at a position where the index finger of the hand to be gripped (for example, the right hand) when the user grips the torso 200a, that is, the upper surface portion 204c. Thus, the zoom operation can be easily performed with the index finger of the hand holding the video camera 100 while the user holds the video camera 100.

  The tracking button 180f as a tracking operation member is a button for instructing start or stop of tracking. The tracking button 180f is a button that exhibits a pressed state while being pressed, and a released state when not pressed. By the control executed by the system control unit 157, tracking is started when the tracking button 180f is pressed with a finger to change from the released state to the pressed state, and tracking is continued while the tracking button 180f is pressed with the finger. Tracking is stopped when the finger is released from the tracking button 108f, and tracking is not performed while the finger is released from the tracking button 180f. That is, both the tracking start and the tracking stop are performed by the tracking unit (tracking process in FIG. 1) until the tracking button 180f changes from the released state to the pressed state and returns from the pressed state to the released state by a single pressing operation. Control executed by the unit 155) is performed by the system control unit 157.

  In addition, the tracking button 180f is disposed at a position where the middle finger of the gripping hand (for example, the right hand) is positioned, that is, the upper surface portion 204c when the user grips the torso 200a. Accordingly, the user can easily start and stop tracking with the middle finger of the hand holding the video camera 100 while holding the video camera 100.

  The external configuration of the video camera 100 according to the present embodiment has been described above.

  According to the above configuration, the recording button 180 d and the tracking button 180 f are provided at different locations on the casing 200 of the video camera 100. As described with reference to Patent Document 1, in the case of still image recording, since linkage is required for still image recording and tracking, it is common to consolidate these functions into a common button. However, in the case of video recording, tracking is not necessary at the start of recording, but tracking is necessary after recording starts, or tracking needs to be continued from before recording to after recording starts. The situation is possible. Thus, it is desirable that the tracking start and stop operations and the recording operation can be executed independently of each other. In addition, it is desirable that the user can avoid the mistake of the tracking operation and the recording operation as much as possible. For these reasons, the video camera 100 of the present embodiment employs a configuration in which the recording button 180d and the tracking button 180f are provided separately.

  Further, according to the above configuration, different operation methods are employed for recording and tracking. That is, for recording, control is performed to perform one of recording start and recording stop after the recording button 180d is pressed by one operation and released. On the other hand, for tracking, control is performed to perform both tracking start and tracking stop between the time when the tracking button 180f is pressed and released after one operation.

  As described above, an imaging device having both a recording function and a tracking function by separately providing an operation member for recording and an operation member for tracking, and adopting different operation methods for recording and tracking. It is possible to improve the operability when performing the tracking operation at.

  Furthermore, according to the above configuration, for tracking, control is performed to cause the tracking unit to perform tracking until the tracking button 180f is pressed by a single operation and then released. Thereby, even if the user does not visually recognize the icon or the like displayed on the display screen, the effect that the tracking is performed can be recognized sensorially and easily with his / her finger.

  When the tracking button 180f is an operation member of a type that changes from the released state to the pressed state when the user presses the finger, and returns from the pressed state to the released state when the user releases the finger, as described above. Therefore, it is possible to reliably obtain the effect that the tracking can be recognized sensorially.

  Note that the same effect can be obtained whether the tracking button 180f is an operation member with a sensor that can detect when the user touches the tracking button 180f with a finger or a toggle type button. Can do. When a toggle-type button is used as the tracking button 180f, the tracking button 180f changes from a released state to a pressed state when the user presses once with a finger, and maintains the pressed state even after the user releases the finger. When the button is pressed again with a finger, the pressed state returns to the released state. By using such a toggle type button, it becomes necessary to start and stop tracking by two operations. Whether or not tracking is in progress can be sensed by simply touching the tracking button 180f with a finger. Can be confirmed easily and easily. In this case, the user's burden that the user keeps pressing the tracking button 180f for tracking can also be reduced.

  Here, a method for acquiring the feature amount of the subject will be described with reference to FIGS.

  FIG. 3 shows an example of the display contents of the display unit 190 in the recording standby state of the video camera 100 according to the present embodiment. In FIG. 3, an OSD (On Screen Display) display 300 superimposes various displays representing the current state of the video camera 100 such as the recording image quality, the remaining shooting time, the recording state, the recording time, and the battery remaining amount on the input image. Is displayed. The designation frame 320 is a frame display for designating the main subject 330, and is displayed at the center of the screen when the tracking mode is enabled. When the tracking button 180f is pressed in a state where the main subject 330 is captured in the designated frame 320, the tracking processing unit 155 uses it for tracking processing based on video data corresponding to the area in the designated frame 320. A feature quantity is generated.

  When the tracking process is started, a tracking frame 410 is superimposed on the main subject 330 and displayed as shown in FIG.

  Next, the flow of processing in the video camera 100 when the subject tracking result is applied to automatic exposure control and automatic focus control will be described with reference to FIG.

  In the flowchart of FIG. 5, it is assumed that the user operates the mode dial constituting the operation unit 180 in advance to shift the video camera 100 to the shooting standby state and enables the tracking mode from the menu. . It doesn't matter whether the camera is in shooting state or in shooting standby state. In the shooting standby state, the video obtained through the optical system 105 is stored in the buffer memory unit 135 and displayed on the display unit 190 via the system control unit 157, but the digital video information is compressed by the codec unit 140. Processing and recording processing on the recording medium 195 are not performed.

  Processing is started in the above state. First, in step S500, a digital video signal is input from the video signal processing unit 120 to the tracking processing unit 155, and based on the input digital video signal, image data in a memory (not shown) of the tracking processing unit 155. Is updated. In subsequent step S501, a designation frame 320 is displayed in order to acquire the feature amount of the main subject. In subsequent step S502, the system control unit 157 confirms whether or not the tracking button 180f is pressed. If the tracking button 180f has not been pressed, it waits for the tracking button 180f to be pressed. If the tracking button 180f has been pressed, the process proceeds to step S503.

  In step S503, the feature amount of the main subject is acquired by the tracking processing unit 155 by the method described above. In step S504, the tracking processing unit 155 detects the subject region that most closely matches the feature amount acquired in step S503 from the image data. The subject area detection result in step S504 is used for branching of the processing in subsequent step S505. If the subject area detection result is unsuccessful, the process proceeds to step S508. If the subject area detection result is successful, the process proceeds to step S506.

  In step S506, exposure control and automatic focus control are performed on the subject area detected in step S504 by the method described above. In the subsequent step S507, the display of the tracking frame displayed superimposed on the main subject is updated. Thereafter, the process proceeds to step S508, and it is determined whether or not the tracking button 180f is being pressed. If the tracking button 180f is being pressed, the process proceeds to step S509. If the tracking button 180f is not pressed, the process proceeds to step S510.

  In step S509, the image data is updated by the same process as step S501, and then the process returns to step S504. In step S510, the tracking frame display is erased, and then the process returns to step S500.

  With the above processing, while the tracking button 180f is pressed, the tracking processing unit 155 continuously performs the subject area detection processing, thereby realizing the tracking processing. If the pressing of the tracking button 180f is stopped, the subject area detection process in the tracking processing unit 155 is not performed, and the tracking process is stopped.

  As described above, according to the present embodiment, the recording button 180d, which is an operation member for recording, and the tracking button 180f, which is an operation member for tracking, are provided separately, and recording and tracking are performed. By adopting different operation methods, it is possible to prevent an erroneous operation when performing the tracking operation in the video camera 100 having both the recording function and the tracking function, and to improve the operability. In particular, this configuration is advantageous in that an erroneous operation during tracking is less likely to occur during recording.

  In addition to this, when the user leaves the framing to the video camera 100 and directly looks at the subject during recording, the user keeps an eye on the subject to check whether or not the automatic framing processing using the tracking processing is performed. Thus, there is an effect that it is not necessary to confirm the display on the display unit 190.

  These effects enhance the effectiveness of the subject tracking function, and therefore the present invention is useful in a video camera having a tracking function.

  Note that the system control unit 157 of the present embodiment may perform erroneous operation relief control in addition to the various controls described above. The erroneous operation relief control is executed for the purpose of prompting the user to perform a correct operation when the user actually performs an erroneous operation, or for the purpose of preventing the operation of the video camera 100 that is expected to be against the user's will. Is. This control can be roughly divided into two types as described below. One is executed when the tracking button 180f is pressed, and the other is executed when the recording button 180d is pressed.

  When the pressing operation of the tracking button 180f is performed, it is determined whether the pressing operation is a short press or a long press. Assuming that the threshold value for determining short press or long press is 2 seconds, when the press operation is completed in less than 2 seconds, it is determined that the press operation is a short press, and the press operation continues for 2 seconds or more. In this case, it is determined that the pressing operation is a long press.

  If the pressing operation of the tracking button 180f is a short press, it is expected that the user has erroneously pressed the tracking button 180f even though the user intends to start or stop recording. Alternatively, it is expected that the user intended to track but misunderstood the operation method. Accordingly, for example, image processing is performed on the display data so that a message such as “Please press and hold the tracking button when performing tracking processing” is displayed superimposed on the video.

  If the pressing operation of the tracking button 180f is a long press, it is determined that the user has performed the operation correctly. Therefore, the image processing for displaying the message is not executed.

  By such erroneous operation relief control, when the user intends to start recording or stop recording but accidentally presses the tracking button 180f, the user can be notified that there has been an erroneous operation. Further, when the user intends to perform tracking but misunderstands the operation method, the user can be made aware of the correct operation method.

  Note that, as erroneous operation relief control when the tracking button 180f is pressed, if the pressing operation of the tracking button 180f is a short press, it is determined that there has been a recording start or recording stop operation, and recording start or recording is started. It is conceivable to perform control to execute the stop. However, in this control, the tracking button 180f substantially has both functions of tracking and recording. If it does so, the operativity improvement effect obtained by providing the operation member for video recording and the operation member for tracking will fade. For this reason, as the erroneous operation remedy control executed when the tracking button 180f is pressed, it is advantageous that the message is displayed as described above and no further aggressive control is performed.

  Even when the recording button 180d is pressed, it is determined whether the pressing operation is a short press or a long press.

  If the pressing operation of the recording button 180d is a long press, it is expected that the user accidentally pressed the recording button 180d even though the user intends to perform tracking. Therefore, particularly during recording, control for invalidating the pressing operation of the recording button 180d is performed so that the recording is not stopped by mistake.

  If the pressing operation of the recording button 180d is a short press, it is determined that the user has performed the operation correctly. Therefore, control for invalidating the pressing operation is not executed.

  If the user accidentally presses the recording button 180d by the erroneous operation relief control, the recording is started or stopped contrary to the intention of the user. Can be prevented.

  Note that, as an erroneous operation relief control when the recording button 180d is pressed, when the pressing operation of the recording button 180d is a long press, it is determined that there is an operation for tracking and tracking is executed. It is possible to do it. However, in this control, the recording button 180d substantially has both the tracking and recording functions. If it does so, the operativity improvement effect obtained by providing the operation member for video recording and the operation member for tracking will fade. For this reason, as the erroneous operation relief control executed when the recording button 180d is pressed, it is advantageous to limit the pressing operation as described above and not to perform any more aggressive control.

(Embodiment 2)
Hereinafter, an imaging apparatus according to Embodiment 2 of the present invention will be described. Note that the basic configuration of the imaging apparatus of the present embodiment is the same as that described in the first embodiment. Therefore, in this embodiment, the same components as those in the first embodiment have the same reference numerals. And detailed description thereof is omitted.

  FIG. 6 is a block diagram illustrating an internal configuration of a video camera as an imaging apparatus according to the present embodiment. As shown in FIG. 6, the video camera 100 of the present embodiment is different from the internal configuration of the video camera 100 of the first embodiment in that it includes a lens barrel 610 and a lens barrel drive unit 620.

  The lens barrel 610 internally supports the optical system 105 described in the first embodiment. The lens barrel 610 is supported by the lens barrel driving unit 620 so that it can be driven and controlled in the pitching direction and the yawing direction with respect to the casing of the video camera 100. That is, the lens barrel 610 can be adjusted in the optical axis direction within a predetermined range under the control of the lens barrel driving unit 620.

  The external configuration of the video camera 100 according to the present embodiment is the same as the external configuration of the video camera 100 according to the first embodiment shown in FIG. 2 except that the optical system 105 is replaced with a lens barrel 610.

  Also in the present embodiment, as in the first embodiment, the subject region detection process is continuously executed by the tracking processing unit 155 while the tracking button 180f is pressed. At this time, the tracking processing unit 155 notifies the system control unit 157 of the center coordinates of the main subject region in the input image as a result of the subject region detection processing. The system control unit 157 notifies the lens barrel drive unit 620 of the drive control amounts in the pitching direction and the yawing direction so that the center coordinates of the subject area are at the center of the screen. The lens barrel driving unit 620 controls driving of the lens barrel 610 in the pitching direction and the yawing direction based on the drive control amount notified from the system control unit 157.

  With the framing control as described above, the main subject is arranged in the center of the screen as much as possible while the tracking button 180f is pressed. Note that a warning may be displayed on the display unit 190 when the main subject is about to go out of the screen or when the main subject comes out of the screen. As the content of the warning display, various forms such as characters, icons, or an arrow indicating the approximate position of the main subject can be considered.

  The driving of the lens barrel 610 by the lens barrel driving unit 620 described above is executed in the step S506 in the flowchart of FIG. At this time, the exposure control and the focus control described in the first embodiment may be performed in parallel.

  Note that the framing control using the result of the subject area detection process can also be realized by an electronic process. That is, framing processing can be realized by extracting a part of the digital video signal by the video signal processing unit 120. Compared with optical processing, such electronic processing has a demerit of image resolution degradation but has the advantage of reducing the number of parts and reducing costs.

(Embodiment 3)
Hereinafter, an imaging apparatus according to Embodiment 3 of the present invention will be described. Note that the basic configuration of the imaging apparatus of the present embodiment is the same as that described in the first embodiment. Therefore, in this embodiment, the same components as those in the first embodiment have the same reference numerals. And detailed description thereof is omitted.

  The internal configuration of the video camera 100 of the present embodiment is the same as the internal configuration of the video camera 100 of the first embodiment shown in FIG.

  FIG. 7 is an external view of the video camera 100 of the present embodiment. As shown in FIG. 7, the video camera 100 according to the present embodiment is the video camera according to the first embodiment in that the tracking button 180f is provided on the outer peripheral portion of the display screen of the thin display panel 190a in the door body 200b. 100 different from the external configuration.

  As with the first embodiment, the recording button 180d is disposed at a position where the thumb of the right hand is positioned when the user holds the torso 200a with the right hand, that is, the back surface portion 204b.

  Unlike the first embodiment, the tracking button 180f is a place where the thumb of the left hand is positioned when the user holds the body 200a with the right hand and simultaneously supports the door 200b with the left hand to reduce the shake of the video camera 100. That is, it is disposed on the outer periphery of the display screen of the thin display panel 190a.

  Thus, according to the present embodiment, the recording button 180d is disposed on the body 200a that is gripped by the right hand, while the tracking button 180f is disposed on the door body 200b that is supported by the left hand. Therefore, it is possible to reduce the possibility of an erroneous operation as compared with the first embodiment in which both the recording button 180d and the tracking button 180f need to be operated with the same hand.

  Furthermore, since the tracking button 180f is provided on the outer periphery of the display screen of the thin display panel 190a that faces the user when in use, the tracking button 180f can be easily pressed with the thumb of the left hand during use. Therefore, the individual operation of the two buttons (the recording button 180d and the tracking button 180f) when the user holds the video camera 100 with both hands can be facilitated by using the left and right thumbs.

  Note that the internal configuration described in Embodiment 2 with reference to FIG. 6 can also be applied to the video camera 100 of this embodiment.

(Embodiment 4)
Hereinafter, an imaging apparatus according to Embodiment 4 of the present invention will be described. Note that the basic configuration of the imaging apparatus of the present embodiment is the same as that described in the first embodiment. Therefore, in this embodiment, the same components as those in the first embodiment have the same reference numerals. And detailed description thereof is omitted.

  The internal configuration of the video camera 100 of the present embodiment is the same as the internal configuration of the video camera 100 of the first embodiment shown in FIG.

  FIG. 8 is an external view of the video camera 100 of the present embodiment. As shown in FIG. 8, the video camera 100 of the present embodiment is different from the external configuration of the video camera 100 of the first embodiment in that a tracking button 180f is provided on the left side surface portion 204d of the body 200a.

  As with the first embodiment, the recording button 180d is disposed at a position where the thumb of the right hand is positioned when the user holds the torso 200a with the right hand, that is, the back surface portion 204b.

  Unlike the first embodiment, the tracking button 180f is a place where the thumb of the left hand is positioned when the user holds the torso 200a with the right hand and simultaneously supports the torso 200a with the left hand from below to reduce the shake of the video camera 100. That is, it is disposed on the left side surface portion 204d of the body 200a.

  As described above, according to the present embodiment, the recording button 180d is disposed on the back surface portion 204b of the trunk 200a held by the right hand, while the tracking button 180f is the left side portion of the trunk 200a supported by the left hand. 204d. Therefore, it is possible to reduce the possibility of an erroneous operation as compared with the first embodiment in which both the recording button 180d and the tracking button 180f need to be operated with the same hand.

  Furthermore, since the tracking button 180f is provided on the left side surface portion 204d of the body 200a, the user can easily press the tracking button 180f with the thumb of the left hand when holding the body 200a with both hands. Therefore, the individual operation of the two buttons (the recording button 180d and the tracking button 180f) when the user holds the video camera 100 with both hands can be facilitated by using the left and right thumbs.

  Furthermore, the tracking button 180f is disposed between the door body 200b and the front surface portion 204a on the left side surface portion 204d. Therefore, even when the video camera 100 is used with the door 200b closed, the tracking button 180f can be operated without being covered by the door 200b, which is convenient for the user.

  The tracking button 180f may be provided on the right side surface (not shown) instead of being provided on the left side surface portion 204d. In this case, when the user supports the torso 200a from below with the left hand, the tracking button 180f can be easily operated with the index finger of the left hand.

  The internal configuration described in Embodiment 2 with reference to FIG. 6 can also be applied to the video camera 100 of this embodiment.

(Embodiment 5)
Hereinafter, an imaging apparatus according to Embodiment 5 of the present invention will be described. Note that the basic configuration of the imaging apparatus of the present embodiment is the same as that described in the first embodiment. Therefore, in this embodiment, the same components as those in the first embodiment have the same reference numerals. And detailed description thereof is omitted.

  The internal configuration of the video camera 100 of the present embodiment is the same as the internal configuration of the video camera 100 of the first embodiment shown in FIG.

  FIG. 9A is an external view of the video camera 100 according to the present embodiment as viewed obliquely from the front, and FIG. 9B is an external view of the video camera 100 according to the present embodiment as viewed from the side. As shown in FIG. 9, the video camera 100 of this embodiment is different from the external configuration of the video camera 100 of Embodiment 1 in that the body 200a has a vertically long shape. Further, the arrangement of the tracking button 180f is also different with the difference in shape. In the present embodiment, the tracking button 180f is provided on the front surface portion 204a of the body 200a.

  As with the first embodiment, the recording button 180d is disposed at a position where the thumb of the right hand is positioned when the user holds the torso 200a with the right hand, that is, the back surface portion 204b.

  Unlike the first embodiment, the tracking button 180f is disposed at a position where the index finger or middle finger of the right hand is positioned when the user holds the torso 200a with the right hand, that is, the front surface portion 204a of the torso 200a.

  Thus, according to the present embodiment, the recording button 180d is disposed on the back surface portion 204b of the body 200a, while the tracking button 180f is disposed on the front surface portion 204a of the body 200a. This configuration is common to Embodiment 1 in that both the recording button 180d and the tracking button 180f need to be operated with the same hand. Therefore, the configuration of the present embodiment can achieve the same effects as those of the first embodiment.

  Note that the internal configuration described in Embodiment 2 with reference to FIG. 6 can also be applied to the video camera 100 of this embodiment.

  The embodiments of the present invention have been described above.

  The above description is an illustration of a preferred embodiment of the present invention, and the scope of the present invention is not limited to this. That is, the description of the configuration and operation of the above apparatus is an example, and it is apparent that various modifications and additions to these examples are possible within the scope of the present invention.

  For example, in each of the above embodiments, a video camera has been described as an example. However, it is obvious that the present invention can be similarly applied to a digital camera and other imaging devices.

  The imaging apparatus according to the present invention can improve the operability of the tracking function when recording a moving image, and is useful as various imaging apparatuses such as a digital camera and a digital video camera.

The block diagram which shows the internal structure of the video camera which concerns on Embodiment 1 of this invention. 1 is an external view of a video camera according to Embodiment 1 of the present invention. The figure which shows the state which displayed the designated frame of the main subject on the display part which concerns on Embodiment 1 of this invention. The figure which shows the state which displayed the tracking frame of the main subject on the display part which concerns on Embodiment 1 of this invention. 6 is a flowchart showing processing of automatic exposure control and automatic focus control in the video camera according to Embodiment 1 of the present invention. The block diagram which shows the internal structure of the video camera which concerns on Embodiment 2 of this invention. External view of a video camera according to Embodiment 3 of the present invention External view of video camera according to Embodiment 4 of the present invention (A) External view of a video camera according to a fifth embodiment of the present invention viewed obliquely from the front, (b) External view of a video camera according to a fifth embodiment of the present invention viewed from the side A flowchart showing the operation of a conventional digital camera

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Video camera 105 Optical system 110 Solid-state image sensor 115 A / D conversion part 120 Video signal processing part 125 Y / C conversion part 130 System bus 135 Buffer memory part 140 Codec part 145 Recording I / F part 150 Socket 155 Tracking processing part 157 System control unit 165 Aperture control unit 170 Lens control unit 180 Operation unit 180a Menu button 180b Lever 180c Delete button 180d Record button 180e Zoom lever 180f Tracking button 190 Display unit 190a Thin display panel 190b EVF
195 Recording medium 200 Housing 200a Body 200b Door body 202 Hinge portion 204a Front surface portion 204b Rear surface portion 204c Upper surface portion 204d Left side surface portion 205 Opening / closing panel 210 Battery 610 Lens barrel 620 Lens barrel driving portion

Claims (11)

A housing,
An imaging unit for creating video data from an optical image of the object scene;
A recording unit for recording the created video data on a recording medium;
A tracking unit that tracks a subject in the scene based on the created video data;
An operation unit having a recording operation member and a tracking operation member separately provided in the housing;
A control unit for controlling the recording unit and the tracking unit according to the operation of the operation unit,
The recording operation member and the tracking operation member are
Independently of each other, it is operable to change from a predetermined state and return to the predetermined state,
The controller is
Until the recording operation member changes from the predetermined state and returns to the predetermined state, the recording unit performs control to perform one of recording start and stop of video data,
Performing control for causing the tracking unit to both start and stop tracking of the subject before the tracking operation member changes from the predetermined state and returns to the predetermined state;
Imaging device. The controller is
Each time the recording operation member changes from the predetermined state, the recording unit performs control to alternately start and stop recording of video data,
When the tracking operation member changes from the predetermined state, the tracking unit starts tracking the subject, and when the tracking operation member returns to the predetermined state, the tracking unit stops tracking the subject. Control
The imaging device according to claim 1. The housing is configured to be grippable,
The recording operation member is provided at a position where the recording operation member can be operated with a thumb of a hand holding the housing,
The tracking operation member is provided at a position where it can be operated with another finger.
The imaging device according to claim 1. The recording operation member is provided on a back surface portion of the housing,
The tracking operation member is provided on the upper surface of the housing.
The imaging device according to claim 3. The housing is
A torso configured to be graspable;
A door body that is openable and closable with respect to the body,
The recording operation member is provided on the body,
The tracking operation member is provided on the door body,
The imaging device according to claim 3. The door has a display screen for displaying the created video data as a video,
The recording operation member is provided on a back surface of the body;
The tracking operation member is provided on an outer periphery of the display screen.
The imaging device according to claim 5. The recording operation member is provided on the back surface of the main body,
The tracking operation member is provided on a side surface of the main body.
The imaging device according to claim 3. The recording operation member is provided on the back surface of the main body,
The tracking operation member is provided on the front surface of the main body,
The imaging device according to claim 3. The housing has a display screen for displaying the created video data as a video,
The controller is
When the tracking operation member is operated, it is determined whether the operation of the tracking operation member is a short press or a long press, and a message is displayed on the display screen on the condition that the operation of the tracking operation member is determined to be a short press. Control to display,
The imaging device according to claim 1. The message is a message requesting the user to press and hold the tracking operation member.
The imaging device according to claim 9. When the operation of the recording operation member is operated, the control unit determines whether the operation of the recording operation member is a short press or a long press, and on the condition that the operation of the recording operation member is determined to be a long press. Performing control to invalidate the operation of the recording operation member,
The imaging device according to claim 1.

Images