JP2018064285A - Imaging apparatus and method for controlling imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of easily performing imaging control that regards important the advance or retreat of a plurality of moving subjects in sports or competitions including a footrace.SOLUTION: The imaging apparatus includes: an imaging part 12 which receives an optical image formed by an imaging optical system 32 and acquires image data; a feature detection part which detects a plurality of feature parts from the image data; a feature instruction part which instructs at least one of the plurality of detected feature parts; a storage part 14 which stores the instructed feature part; a positional change prediction part 11e which detects the positional change in a depth direction of each feature on the basis of the coincidence of the feature part obtained from the newly obtained image data with the plurality of stored feature parts and predicts the positions of the plurality of feature parts after the lapse of a predetermined time; and a control part 11 which performs imaging control in accordance with a depth of field in such a manner that the plurality of feature parts within an image can be focused in accordance with the positional information of the plurality of feature parts after the lapse of the predetermined time predicted by the positional change prediction part and the focal distance of the imaging optical system.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus having a scene mode suitable for an imaging situation in which a plurality of moving subjects are to be imaged, and a method for controlling the imaging apparatus.

  Conventionally, an optical image formed by an imaging optical system is converted into a photoelectric conversion element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. The image signal obtained by the photoelectric conversion using an image pickup device such as an image sensor is stored in a storage medium as image data of a predetermined form (for example, digital image data representing a still image or a moving image), and the digital image An image display device that displays a still image or a moving image based on data, for example, a liquid crystal display (LCD) device, an organic electro-luminescence (OEL) display device, or the like. Imaging devices such as digital cameras and video cameras have been put into practical use and widely used. It is popular.

  In this type of conventional imaging apparatus, for example, an image area including a specific subject moving within the imaging screen is detected, the AF area is moved to the position of the target subject in the detected image area, and the target subject is detected. By moving the AF area following the movement within the imaging screen and continuously performing an automatic focus adjustment operation, a so-called moving body tracking continuous autofocus (Continuous Autoforcus; C-AF) function, and predicts the in-focus position during the release operation based on the change in the subject between the latest in-focus information (ranging information, etc.) and the in-focus information acquired immediately before. So-called automatic focus adjustment (autofocus) that performs control to execute the focus adjustment operation at the predicted position when the release operation is executed AF) that a function has been put into practical use.

  According to this, for example, in an imaging environment in which a plurality of moving objects are imaged, such as athletic meet athletes, focus on a specific moving subject among the plurality of moving objects within the imaging screen. Since the release operation can be performed in consideration of the release time lag by predicting the movement of the specific moving subject from the amount of movement of the target subject within the screen, the specific moving subject to be imaged Can be obtained in an in-focus state.

  In addition, the conventional imaging device has an automatic exposure setting function that automatically sets an appropriate exposure based on image data acquired by the imaging device, and according to the situation (scene) of the subject to be imaged. In general, those equipped with a plurality of so-called scene modes for automatically setting and controlling various settings including optimal exposure values (shutter speed value, aperture value, etc.) are widely used.

  For example, when a plurality of moving subjects are to be imaged, such as athletic meet in the above-mentioned athletic meet, so-called sports that perform exposure control to select and set the fastest shutter speed value in consideration of subject blurring There are scene modes called modes.

  If the user (user) selects and sets a desired scene mode (in this case, a sports mode) in the imaging device prior to performing the imaging operation, the control unit of the imaging device can set the subject with a fast shutter speed setting. An autofocus operation is performed in which a specific moving subject is always in focus while suppressing subject blurring caused by movement of the subject itself. As a result, it is possible to easily and reliably obtain a favorable imaging result at all times.

  On the other hand, in a conventional imaging device, when a moving subject is taken as an imaging subject, for example, when a moving image is taken, zooming control is automatically performed according to the movement of the subject subject, and appropriate framing is always set. For example, Japanese Patent Application Laid-Open No. 2012-124575 discloses a technique for obtaining an imaging result by framing that matches a user's (user) intention.

JP 2012-124575 A

  The means disclosed in the above Japanese Patent Application Laid-Open No. 2012-124575 etc. controls the imaging apparatus in accordance with the movement of the subject. However, the means disclosed in the above publication mainly automates framing by zooming control. For example, technical solution means for ensuring a focused state in a wide range in the front-rear direction is disclosed. I'm not doing it.

  For example, under circumstances such as the athletic meet of the above-mentioned athletic meet, there is a demand for acquiring an image in which a plurality of moving subjects are in focus rather than taking only one specific subject as an imaging target.

  The present invention has been made in view of the above-described points, and an object of the present invention is to easily perform shooting control that emphasizes the bargaining of a plurality of moving subjects in sports and competitions typified by a student race. An imaging device and a method for controlling the imaging device are provided.

  In addition, the present invention considers the depth of field so that it is suitable for a situation in which a plurality of moving subjects existing from the back side to the front side in the imaging screen are to be imaged (for example, athletic competitions). An imaging apparatus capable of automating setting of a focus range and the like according to an imaging situation, ensuring a focused state of a plurality of moving subjects and easily obtaining good imaging results without impairing operability, and an imaging apparatus control method The purpose is to provide.

  In order to achieve the above object, an imaging apparatus according to a first aspect of the present invention includes an imaging unit that receives an optical image formed by an imaging optical system and acquires image data, and a plurality of characteristic units from the image data. A feature detection unit that detects at least one of the detected plurality of feature units, a storage unit that stores the instructed feature unit, and the newly obtained image Based on the coincidence between the feature portion obtained from the data and the plurality of stored feature portions, the position change in the depth direction of each feature is detected, and the position of the plurality of feature portions after a predetermined time has elapsed. The position change prediction unit predicting the position, the position information after a predetermined time of the plurality of feature parts predicted by the position change prediction unit, and the focal length of the imaging optical system Possible depth of field And a control unit for performing corresponding imaging control.

  An imaging apparatus according to a second aspect of the present invention includes an imaging unit that receives an optical image formed by an imaging optical system and acquires image data, a feature detection unit that detects a plurality of feature units from the image data, A feature registration unit for registering information related to the feature unit; a storage unit for storing the plurality of detected feature units; a feature unit obtained from the newly obtained image data; A position change prediction unit that detects a position change in the depth direction of each feature based on a match with the feature unit and predicts positions of the plurality of feature units after a predetermined time has elapsed, and the position change prediction unit At least the registered feature portion in the image can be brought into an in-focus state by the positional information of the plurality of feature portions predicted after the predetermined time and the focal length of the imaging optical system. Shooting according to depth of field And a control unit for performing control.

  According to a first aspect of the present invention, there is provided a control method for an image pickup apparatus, which receives an optical image formed by an image pickup optical system, acquires image data, detects a plurality of feature portions from the image data, and detects the detected features. Specify at least one of the plurality of features, store the specified feature, and match the feature obtained from the newly obtained image data with the stored feature Based on the detection of the position change of each feature in the depth direction, the position of the plurality of feature portions after a predetermined time is predicted, and the predicted position of the plurality of feature portions after the predetermined time has elapsed Shooting control is performed in accordance with the depth of field that can bring the plurality of features in the image into a focused state based on the information and the focal length of the imaging optical system.

  An imaging apparatus according to a third aspect of the present invention includes an imaging unit that receives an optical image formed by an imaging optical system and acquires image data, a feature detection unit that detects a plurality of feature units from the image data, The depth of each feature based on the coincidence between the storage unit storing the plurality of detected feature portions and the feature portion obtained from the newly obtained image data and the plurality of stored feature portions. A position change prediction unit that detects a position change in a direction and predicts the positions of the plurality of feature parts after a predetermined time has elapsed, and after a predetermined time elapses of the plurality of feature parts predicted by the position change prediction unit A control unit that performs shooting control according to the depth of field that can bring the plurality of features in the image into a focused state based on the position information of the image pickup optical system and the focal length of the imaging optical system. Automatic exposure control based on the set aperture value Is to set the shutter speed, if the shutter speed value that has been set is less than a predetermined lower limit value, it resets to the aperture value in accordance with the lower limit shutter speed.

  According to a second aspect of the present invention, there is provided a control method for an image pickup apparatus that receives an optical image formed by an image pickup optical system, acquires image data, detects a plurality of feature portions from the image data, and detects the detected features. A plurality of feature portions are stored, and a position change in the depth direction of each feature is detected based on a match between the feature portion obtained from newly obtained image data and the plurality of stored feature portions. Predicting positions of the plurality of features after a predetermined time elapses, and determining the plurality of features in the image based on position information of the plurality of features after the predetermined time elapses and a focal length of the imaging optical system Shooting control is performed according to the depth of field that can bring the features of the camera into focus, automatic exposure control is performed based on the set aperture value, the shutter speed is set, and the set shutter speed value is a predetermined lower limit. If the value is less than To re-set to the aperture value in accordance with the Potter speed.

  According to the present invention, it is possible to provide an imaging apparatus and an imaging apparatus control method that can easily perform imaging control with emphasis on bargaining of a plurality of moving subjects in sports or competitions typified by an athlete race.

  In addition, according to the present invention, the depth of field is taken into consideration so as to be suitable for a situation in which a plurality of moving subjects existing from the back side to the front side in the imaging screen are to be imaged (for example, athletic competitions). An imaging device that automates the setting of the focusing range, etc. according to the imaging situation, ensures the in-focus state of a plurality of moving subjects, and easily obtains good imaging results without losing operability. A control method can be provided.

1 is a block configuration diagram showing a schematic configuration of an imaging apparatus according to an embodiment of the present invention. FIG. 1 is a conceptual diagram showing how the image pickup apparatus of FIG. 1 is used to image, for example, athletic meet athletes. 1 is a time chart showing an outline of the imaging operation of the imaging apparatus of FIG. The conceptual diagram explaining the focusing operation | movement at the time of imaging operation by the imaging device of FIG. The flowchart which shows the flow of the camera control process in the imaging device of FIG. The flowchart which shows the depth-of-field setting control process (step S107) in the flowchart of FIG. The flowchart which shows in detail the "optimum depth of field calculation process" which is a part of the process in the flowchart of FIG. Formula for calculating depth of field The flowchart which shows the modification of the depth-of-field setting control process in the imaging device of one Embodiment of this invention The conceptual diagram which shows the imaging condition in case the modification of one Embodiment of this invention is applied

  The present invention will be described below with reference to the illustrated embodiments.

  In the imaging apparatus of the present invention, for example, a plurality of moving subjects are to be imaged in sports, competitions, and the like typified by an athlete race. Here, the reason for focusing on a plurality of moving subjects is that a drama is born by drawing the plurality of subjects. Specifically, for example, a situation in which a plurality of subjects move toward the photographer in a competition such as an athlete race can be considered. In this case, in the imaging screen, there are a plurality of moving objects from the back side to the front side. At this time, the distance between the photographer and each of the plurality of subjects varies. Therefore, there is a problem that it is not possible to bring all of the plurality of subjects into focus by simply performing normal autofocus operation control applied in a conventional general imaging apparatus. Therefore, by setting an F value (aperture value) in consideration of the depth of field as appropriate, all of a plurality of subjects (or a part of a range including a specific subject) are in a focused state. Control is illustrated in the following examples.

  On the other hand, as described above, when a moving subject is an imaging target, there is a high possibility of subject blurring due to the movement of the subject itself. In order to suppress this subject blur, it is desirable to set a shutter speed value as fast as possible. In this case, in order to ensure proper exposure, it is inevitably necessary to set the F value (aperture value) to be small (that is, set in a direction to open the aperture). This means that the depth of field becomes shallow. That is, there is a problem that as the depth of field becomes shallower, it becomes more difficult to bring all of the plurality of subjects scattered back and forth within the imaging screen into a focused state. The description will be given in consideration of this area.

  In this embodiment, in view of the above-described points, the object field is suitable for a situation where a plurality of moving subjects existing from the back side to the front side in the imaging screen are to be imaged (for example, athletic meet athletes). The F value (aperture value) for setting the in-focus range in consideration of the depth and the shutter speed value in consideration of subject blurring are automatically set according to the imaging situation, and always desired without impairing operability. The configuration of the imaging apparatus having an operation mode (scene mode) that can easily obtain a good imaging result while ensuring the in-focus state of the subject is particularly emphasized.

  In one embodiment of the present invention, for example, an optical image formed by an imaging optical system is converted into, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) type. A photoelectric conversion device such as an image sensor or the like (hereinafter referred to as an imaging device) sequentially performs photoelectric conversion, and image signals obtained thereby are converted into image data in a predetermined form (for example, digital image data representing a still image or a moving image). As an image display device, for example, a liquid crystal display (LCD) device or an organic electroluminescence (organic EL; Organic Electro-Luminescence). : OEL) an imaging device configured with a display device or the like, such as a digital camera or Examples are video cameras and the like.

  In each drawing used for the following description, each component may be shown with a different scale in order to make each component large enough to be recognized on the drawing. Therefore, according to the present invention, the number of constituent elements, the shape of the constituent elements, the ratio of the constituent element sizes, and the relative positional relationship of the constituent elements described in these drawings are limited to the illustrated embodiments. It is not a thing.

  First, a schematic configuration of an imaging apparatus according to an embodiment of the present invention will be described below with reference to FIG. FIG. 1 is a block configuration diagram showing a schematic configuration of an imaging apparatus according to an embodiment of the present invention. As shown in FIG. 1, the imaging apparatus 1 of the present embodiment is mainly configured by a body 10 and a lens barrel 30. The imaging device 1 according to the present embodiment is a so-called interchangeable lens imaging device in which a lens barrel 30 is detachably attached to a body 10. As described above, in the present embodiment, an example of an imaging apparatus 1 will be described by taking a lens-interchangeable imaging apparatus as an example, but an imaging apparatus to which the present invention can be applied is not limited to this form. As another type of imaging apparatus to which the present invention can be applied, for example, there is a lens fixed type imaging apparatus in which the body 10 and the lens barrel 30 are integrally formed. The present invention can be applied just like the imaging apparatus of the present embodiment.

  The body 10 includes a signal processing control unit 11, an imaging unit 12, a shake correction unit 13, a storage unit 14, an operation unit 15, a touch panel 16, a clock unit 17, a rear display unit 18, an EVF 19, It has an eye sensor 20, a main body communication unit 21 and the like.

  The signal processing control unit 11 has a function as a control unit that comprehensively controls the overall operation of the imaging apparatus 1 and processes a control signal for controlling each component unit including the lens barrel 30. And a circuit unit that functions as a signal processing unit that receives an image signal (image data) acquired by the imaging unit 12 and performs predetermined signal processing or the like.

  Inside the signal processing control unit 11, various circuits such as an operation determination unit 11a, a display control unit 11b, a subject determination unit 11c, a contrast determination unit 11d, a position change prediction unit 11e, a distance measurement unit 11f, and the like. Are provided.

  Among these, the operation determination part 11a is a circuit part which determines the instruction | indication signal input from the operation part 15, and instruct | indicates the operation control corresponding to the instruction | indication signal.

  The display control unit 11b is a control circuit unit that drives and controls the rear display unit 18, the EVF 19, and the like. The display control unit 11 b receives display image data (image signal) acquired by the imaging unit 12 and output through predetermined signal processing in the signal processing control unit 11, and receives information from the rear display unit 18 or the EVF 19. Control for displaying a visually recognizable image using the display panel is performed. Note that the display control unit 11b may be configured to perform image processing for receiving image data from the imaging unit 12 and generating display image data.

  The subject determination unit 11 c is a circuit unit that performs image processing for determining and identifying a specific subject in an image formed based on the image data acquired by the imaging unit 12. Specifically, the subject determination unit 11c identifies, for example, a face of a person or the like based on the image data acquired by the imaging unit 12, for example, by identifying the shape of the subject in the screen, It is determined whether or not the face of the identified person matches a face image stored in advance in the storage unit 14 or the like.

  The contrast determination unit 11d is a circuit unit that performs a contrast determination process based on the image data output from the imaging unit 12 and performs a signal process related to the focus adjustment process.

  The position change prediction unit 11e performs a distance measurement calculation process based on the image data output from the imaging unit 12, or a specific subject image (for example, a face such as a person) identified and determined by the subject determination unit 11c. It is a circuit part which performs the arithmetic processing which detects and estimates the position change in a screen. Note that the position change prediction unit 11e detects a change in position on the screen of the subject in the screen, but may calculate a change in two-dimensional plane coordinates (XY coordinates) in the screen, for example. In addition, a change in the position of the moving subject in the screen may be detected based on a change in the distance from the imaging apparatus 1 to the subject (range measurement calculation result).

  The distance measuring unit 11f is a circuit unit that detects distance information to a subject in an image formed based on image data output from the imaging unit 12, and performs arithmetic processing for measuring the distance to the subject, for example. . The distance measuring unit 11 f also has a function of performing a distance measurement calculation process based on an output from an AF unit 12 a (described later) of the imaging unit 12.

  The imaging unit 12 receives an object image formed by an imaging optical system 32 included in a lens barrel 30 to be described later, performs photoelectric conversion processing, and generates electronic data such as an imaging element, an AF unit 12a, and the like. It is a circuit part containing. As an imaging device in the imaging unit 12, for example, a CCD image sensor using a circuit element such as a CCD (Charge Coupled Device) or a MOS image sensor using a MOS (Metal Oxide Semiconductor) or the like. The photoelectric conversion element etc. which are solid-state image sensors, such as, are applied. The analog image signal output from the image pickup device of the image pickup unit 12 is output to the signal processing control unit 11 for various signal processing.

  The AF unit 12a is, for example, an imaging device in which a plurality of imaging pixels that output signals for forming an image are two-dimensionally arranged over the entire imaging surface (light receiving surface), and at least a part of the imaging surface. The plurality of pixels are used as focus detection pixels for outputting signals for focus detection, and a part of a circuit unit that performs focus detection processing based on the outputs of the plurality of focus detection pixels is configured. The AF unit 12a constitutes a part of a circuit unit that performs an AF (autofocus) control process of the imaging plane phase difference detection method, that is, a so-called image plane phase difference AF process. The image plane phase difference AF processing data generated by the AF unit 12a is output to the distance measuring unit 11f.

  Further, the mode for realizing the AF function in the imaging apparatus 1 of the present embodiment is not limited to the above-described image plane phase difference AF processing, and modes corresponding to various types of AF processing in the conventional mode can be applied. As a form for realizing the AF function in the imaging apparatus, for example, the imaging optical system is driven to detect the contrast difference of the subject image formed on the imaging surface of the imaging device and detect the focused state of the subject image. In addition to the so-called contrast AF process, there is a so-called phase difference detection type AF process in which a phase difference detection sensor is separately provided and a focused state of a subject image is detected using a part of a light beam from an imaging optical system.

  The blur correction unit 13 is a circuit unit that corrects image blur caused by an unstable position of the optical axis or the imaging surface with respect to a subject to be imaged. For this purpose, the blur correction unit 13 is a configuration unit that includes a detection unit that detects a change in posture of the imaging device 1 and a driving unit that moves the position, inclination, and the like of the imaging device. Note that, as a specific configuration of the blur correction unit 13, a well-known technique is applied, and detailed description thereof is omitted.

  The storage unit 14 is a configuration unit that includes a storage medium, a medium drive unit that drives and controls the storage medium, and the like. The storage medium is a device that stores image data, various types of information, various types of programs, and the like. As the storage medium, for example, a card-type detachable or device-embedded semiconductor memory medium or magnetic storage medium is applied.

  The medium driving unit is a circuit unit including a signal processing circuit unit that controls input / output of image data, in addition to the control unit that drives and controls the storage medium. Specifically, the medium driving unit receives image data obtained by, for example, the imaging unit 12 and subjected to predetermined image data processing or the like via the signal processing control unit 11, and performs, for example, signal compression processing or the like. Signal processing for conversion into image data for storage is performed, or signal processing for restoring image data by reading image data stored in a storage medium and performing decompression processing or the like is performed. Note that the compression / decompression process for image data is not limited to the form processed in the medium driving unit, and for example, a similar signal processing circuit unit is provided in the signal processing control unit 11 and executed thereby. It is good also as a form.

  In addition to the above, the storage unit 14 also includes a rewritable nonvolatile semiconductor memory, for example, an EEPROM (Electrically Erasable Programmable Read-Ready) that stores various control programs and various information data in the imaging apparatus 1 in advance. Volatile semiconductor memory, such as SDRAM (Synchronous Dynamic Random), which temporarily stores image data acquired by the imaging unit 12, various information data, and the like, and is used for temporary work purposes. It also includes temporary memory such as (Access Memory).

  The operation unit 15 is a variety of operation members such as a normal push button type, a slide type, a dial type, or the like provided on an exterior portion or the like of the body 10 of the imaging apparatus 1, and specifically, for example, a shutter release button. It indicates a component for operation including various general operation members such as a setting operation member and the like. The instruction signal output from the operation unit 15 is output to the operation determination unit 11a of the signal processing control unit 11, and instructs the corresponding operation control in the operation determination unit 11a.

  The touch panel 16 is an electronic component provided as an operation member of a system different from the operation unit 15. The touch panel 16 is disposed on the display panel of the rear display unit 18 and corresponds to a predetermined area or various icon displays corresponding to an image being displayed on the rear display unit 18 by the user (user) of the imaging apparatus 1. Various operation instruction signals are generated by performing a touch operation or a slide operation on an area or the like. The instruction input signal from the touch panel 16 is sent to the operation determination unit 11a of the signal processing control unit 11, and the operation input is determined.

  The clock unit 17 is an internal clock of a computer called a so-called real-time clock (RTC). The clock unit 17 is used, for example, for giving date / time information such as a data file, or for measuring time or controlling time during control processing.

  The rear display unit 18 and the EVF 19 receive a display image data generated based on, for example, image data acquired by the imaging unit 12 and display a live view image, or display image data stored in the storage unit 14. This is a display unit that performs image reproduction display of a still image or a moving image based on it, and displays a menu display generated by reading various data prepared in advance in the storage unit 14 or the like.

  The rear display unit 18 is, for example, a display unit that is provided on the rear side of the body 10 and employs a relatively large display panel (for example, a size of about 3 types). Further, the EVF 19 is a so-called electronic view finder (EVF) configured by using a small display panel (for example, a size of about 0.5 type) that can be attached to an accessory shoe or the like or can be built in the body 10. It is a display unit of a form. These display units are controlled by the display control unit 11 b of the signal processing control unit 11.

  The display unit (rear display unit 18 and EVF 19) is a display panel such as a liquid crystal display (LCD), a plasma display (PDP), an organic electro-luminescence display (OEL), or the like. And its drive circuit and the like.

  When the operation mode of the imaging apparatus 1 is set to the playback mode under the control of the display control unit 11b of the signal processing control unit 11, the display unit is configured to display an image (still image, moving image) based on image data that has been captured and stored. Function as a display device that reproduces and displays images. Similarly, when the operation mode of the image capturing apparatus 1 is set to the image capturing mode, the signal processing controller 11 obtains a predetermined signal in the same manner under the control of the display controller 11b of the signal processing controller 11. By receiving the processed image data and continuously displaying real-time images sequentially, it functions as an electronic viewfinder that can observe and confirm the imaging range.

  The rear display unit 18 and the EVF 19 as a display unit are used by switching appropriately according to the application. For this purpose, for example, an eye sensor 20 is disposed in the vicinity of the EVF 19.

  The eye sensor 20 is, for example, a detection unit that is provided in the vicinity of the EVF 19 and detects whether the user (user) is using the EVF 19 by detecting the face (eye) of the user (user), for example. .

  Specifically, for example, it is assumed that the rear display unit 18 is used while the imaging apparatus 1 is being used. In this state, for example, when the user (user) uses the EVF 19 to visually recognize the display on the display panel, when the face (eye) is brought close to the display portion of the EVF 19, the eye sensor 20 detects this. In response to this, the signal processing control unit 11 performs control to temporarily stop the display drive of the rear display unit 18 and switch to the display drive of the EVF 19.

  The main body communication unit 21 is a communication signal processing circuit unit provided to exchange control signals, information signals, and the like between the body 10 and the lens barrel 30. When the lens barrel 30 is attached to the body 10, both are configured to be electrically connected. As a result, the main body communication unit 21 and the lens communication unit 37 (described later) on the lens barrel 30 side are electrically connected, so that the signal processing control unit 11 on the body 10 side and the lens barrel 30 side are connected. The lens control unit 31 (described later) is electrically connected. In this state, the two cooperate to control the body 10 and the lens barrel 30 respectively.

  Next, the lens barrel 30 includes a lens control unit 31, an imaging optical system 32, a lens driving unit 33, a state determination unit 34, a lens side operation unit 35, a lens side storage unit 36, and a lens communication unit. 37 and the like.

  The lens control unit 31 is a control circuit unit that controls the operation of each component unit on the lens barrel 30 side under the control of the signal processing control unit 11 on the body 10 side or in cooperation therewith. The lens control unit 31 can be omitted. In that case, what is necessary is just to comprise so that all the control by the side of the lens-barrel 30 may take charge of the signal processing control part 11 by the side of the body 10.

  The imaging optical system 32 is an optical unit that includes a plurality of optical lenses and the like that transmit light from a subject to be imaged to form an optical image of the subject. Although not shown in detail in the drawings, the imaging optical system 32 includes a plurality of holding frame members that hold the optical lens and a plurality of holding frame members that are individually advanced and retracted in the optical axis direction. In addition to the drive member, the zoom drive mechanism unit for zooming, the focus drive mechanism unit for focusing, and a diaphragm unit that adjusts the amount of transmitted light are included.

  The lens driving unit 33 includes a driving member and an actuator that move a plurality of holding frame members and the like included in the imaging optical system 32 in the optical axis direction, and includes the zoom driving mechanism unit, the focus driving mechanism unit, and the like. It is a drive unit which drives.

  The state determination unit 34 includes, for example, a sensor that detects a position on the optical axis of each optical lens or the like included in the imaging optical system 32, and the imaging optics of the lens barrel 30 in the imaging apparatus 1 in use. This is a circuit unit that detects and determines the state of the system 32.

  The lens side operation unit 35 is an operation member for performing various operations on the lens barrel 30 side, for example, an operation ring for performing manual focus adjustment operation and zoom operation, and an operation switch for performing electric focus adjustment operation and zoom operation. In addition to an operation member that is linked to the operation mode, there are an operation member that performs a switching operation between the macro mode and the normal imaging mode.

  The lens-side storage unit 36 is a circuit unit having a semiconductor memory or the like in which various kinds of information such as focal length, open aperture value, and lens characteristics are stored in advance.

  The lens communication unit 37 is a signal processing circuit unit for communication that secures communication between the lens barrel 30 and the body 10 by being electrically connected to the main body communication unit 21 as described above. .

  The constituent elements of the body 10 and the lens barrel 30 are configured to include other various constituent units in addition to the constituent members described above. Since the configuration is not directly related to the present invention, the detailed description and illustration thereof are omitted as having the same configuration as that of a conventional general imaging device.

  For example, the illustration and description of a shutter mechanism for opening and closing the optical path of the imaging optical system and adjusting the amount of light beam transmitted through the imaging optical system during the imaging operation are omitted. 1 also has a normal shutter mechanism similar to a conventional imaging device. In this case, the shutter mechanism may be a focal plane shutter disposed on the body 10 side or a lens shutter disposed on the lens barrel 30 side. Further, instead of or in addition to the mechanical shutter mechanism, an element shutter function that functions as a shutter mechanism by electrically controlling the image sensor in the imaging unit 12 may be provided. When the shutter mechanism is disposed on the body 10 side (including the element shutter), the shutter mechanism is mainly controlled by the control unit on the body side. When the shutter mechanism is disposed on the lens barrel 30 side, the shutter mechanism is controlled via the lens control unit 31 mainly under the control of the body side control unit.

    The action at the time of the imaging operation performed using the imaging apparatus 1 having such a configuration will be described below with reference to a specific example assuming a situation such as an athletic meet.

  Here, the reason for the “competitive race” is because it is a shooting situation that is widely used in many family photos. What is the scene where multiple subjects (persons) compete in various other sports? But first I refuse to apply it. Of course, such bargaining can be seen not only in the race, but also in soccer, basketball and swimming.

  In the following embodiments, it is possible to provide a camera that can easily focus on the tactics of a plurality of subjects. However, a drama is produced by comparing two or more subjects in a focused state. It is important to be able to express it. Here, in order to explain with an example in which the expression and gestures of as many subjects as possible are clearly reproduced, the expression “everyone” is used, but the shooting that emphasizes the difference between the beginning and the back In this case, the top group performing the main bargaining may be focused on “all” as the target. I will also continue to explain that in advance.

  FIG. 2 is a conceptual diagram showing how the image pickup apparatus according to the present embodiment is used to pick up an image for an athletic meet, for example. In FIG. 2, a rectangular frame 20 a is a finder frame of the rear display unit 18 or EVF 19.

  When imaging using the imaging device 1, a user (user) of the imaging device 1 installs the imaging device 1 so that the front surface of the imaging optical system faces the imaging target. At that time, setting is made so that the imaging target object fits in the finder frame of the rear display unit 18 or the EVF 19. In FIG. 2, for example, an athletic meet at an athletic meet is taken as an imaging target, and a plurality of persons indicated by reference numerals 100 a to 100 e (in this figure, five runners are illustrated) are directed toward the user (user) side. It shows the situation of moving in the approaching direction. In this case, the plurality of persons 100a to 100e to be imaged are scattered in the direction (the optical axis direction of the imaging apparatus 1) along the line connecting the user (user) in the front space of the user (user). In the situation, within the finder frame of the image pickup apparatus 1, the subject (person 100c) at a distance close to the user (user) is relatively large and arranged at a lower position on the screen, and from the user (user). A long-distance subject (person 100a) is relatively small and arranged at a position near the top of the screen. In the following description, the subject (person 100c) closest to the user (user) in FIG. In FIG. 2, the subject (person 100a) farthest from the user (user) is referred to as the last subject.

  A schematic flow of the imaging operation of the imaging apparatus 1 under such a situation is as follows. FIG. 3 is a time chart showing an outline of the imaging operation of the imaging apparatus of the present embodiment. FIG. 4 is a conceptual diagram for explaining a focusing operation during an imaging operation by the imaging apparatus according to the present embodiment.

  First, it is assumed that the power supply state of the imaging device 1 is in an on state and the operation mode in which the imaging device 1 can execute an imaging operation (referred to as an imaging mode) is set. At this time, the imaging device 1 continuously displays images based on the image data acquired by the imaging unit 12 on a display screen of either the rear display unit 18 or the EVF 19 at predetermined time intervals. A display operation is performed (FIG. 3A).

  In this state, the user (user) generates an execution instruction signal for focusing operation among the operation members included in the operation unit 15, for example, while observing the live view image display. An operation of an operation member or a touch operation on a predetermined area for performing a focusing operation on the touch panel 16 is performed. For example, it is assumed that the above operation is performed at the timing indicated by the symbol [B1] illustrated in FIG. In response to this, the imaging apparatus 1 starts the AF operation process shown in FIG. 3C, and the AF operation process is continuously executed at a predetermined interval.

  After the focusing operation execution instruction operation, the user (user) observes the live view image display at an arbitrary timing, for example, an imaging operation execution instruction signal among the operation members included in the operation unit 15. An operation of an operation member that generates a touch or a touch operation on a predetermined area for performing an imaging operation on the touch panel 16 is performed. For example, it is assumed that the above operation is performed at the timing indicated by the symbol [B2] illustrated in FIG. Then, in response to this, first, the live view image display operation is temporarily stopped (symbol [A] in FIG. 3A). Thereafter, the result is the same as the result of the AF operation Taf0 (symbol [C1] in FIG. 3C) executed immediately before the generation timing of the imaging operation execution instruction signal (symbol [B2] in FIG. 3B). Based on the result of the AF operation Taf1 (symbol [C2] in FIG. 3C) that is executed immediately after the generation timing of the imaging operation execution instruction signal, the focusing operation (symbol (D (D )) Is executed.

  Here, in the AF operation, the time from the start time of Taf0 (symbol [C1]) to the end time of Taf1 (symbol [C2]) is defined as ΔTaf. Further, the time from the end of the AF operation Taf1 (symbol [C2]) to the actual imaging operation start time including the time related to the focusing operation (symbol [D]) (symbol [ E]) is assumed to be ΔT1.

  In this case, the time required for the focusing operation (symbol [D]) is, for example, the time required for the lens optical system related to the AF operation in the imaging optical system to be driven and moved to a predetermined focusing position. Etc. are included.

  As described above, in a normal case (also in the present imaging apparatus 1), after the arithmetic processing based on the AF operation result and before the actual imaging operation is started, some time is required for the focusing operation. Become. That is, since the mechanical operation for the focusing operation is performed after obtaining the result of the AF calculation process, there is a slight time lag before the actual imaging operation is started. However, in an actual situation, a plurality of subjects to be imaged continue to move even during the time lag occurs. Therefore, when actually performing the focusing operation (FIG. 3D), it is necessary to predict the position of the subject at the start of the imaging operation in anticipation of the amount of movement of the subject moving during the time lag. There is.

  More specifically, in the AF operation Taf0, as shown in FIG. 4A, for example, when there are a plurality of persons on the screen to be imaged (in this figure, the drawing is not complicated). Therefore, the imaging device 1 measures each distance from the imaging device 1 to each of the four runners to be imaged in the screen. Subsequently, in the AF operation Taf1, the imaging device 1 measures each distance to each of the four runners to be imaged in the screen, for example, as shown in FIG. 4B.

  A predetermined time elapses between the measurement time point of the AF operation Taf0 and the measurement time point of Taf1. Therefore, in the meantime, the four runners to be imaged are moved toward the imaging device 1 by a predetermined distance. Therefore, a distance value different from the measurement result of the AF operation Taf0 and the measurement result of Taf1 is calculated.

  In this case, the imaging apparatus 1 can specify four runners (persons) to be imaged by the subject determination unit 11c (see FIG. 1), and the data is temporarily stored in the storage unit 14 or the like. Is remembered. That is, based on the determination result by the subject determination unit 11c, the measurement result of the AF operation Taf0, and the measurement result of Taf1, information such as the movement amount and the movement direction when a specific subject moves in the screen can be obtained. . In this manner, the imaging apparatus 1 of the present embodiment performs a predetermined AF operation (distance measurement processing to each subject) within the time indicated by ΔTaf in FIGS. 3 and 4.

  In the above processing, it has been described that each distance from the imaging device 1 to each of a plurality of subjects (four runners) in the screen is measured. However, the distance is not actually measured. A change in the position of the specific subject in the screen, that is, a relative movement amount in the screen may be calculated. In this case, the data to be handled is, for example, “1 / distance” or the like, but in the following description, it is simply expressed as distance or distance information in order to avoid complication of the description.

  Thereafter, as shown in FIG. 3E, the actual imaging operation is started at, for example, the time indicated by the symbol [E1] in FIG. 3E, and the symbol [E2] in FIG. The process ends at the timing of the code TPhot indicated by 3 (E). During this imaging operation period, the imaging unit 12 is driven and controlled, and image data is acquired by the imaging element of the imaging unit 12. The acquired image data is subjected to predetermined processing in each circuit unit in the signal processing control unit 11. Is given. The image data generated in this way is sent to, for example, the rear display unit 18 or the EVF 19, and REC view display (reproduction display of the acquired image) is performed for a predetermined time. At the same time, the image data is sent to, for example, the storage unit 14 for data storage processing.

  When the imaging operation is completed, the live view image display operation and the AF operation in FIG. 3A are resumed. In this case, the AF operation does not have to be restarted after the imaging operation is completed, and the AF operation may be performed after the next focusing operation execution instruction operation by the user (user).

  In the above example, when the imaging operation execution instruction signal is generated, the focusing operation is executed based on the results of the two AF operations of the immediately preceding AF operation and the immediately following AF operation. It is not limited to. For example, the control may be such that the focusing operation is executed based on the result of the AF operation immediately after the imaging operation execution instruction signal is generated.

  In the imaging apparatus 1 of the present embodiment, when performing an imaging operation under the above-described situation, a focusing operation is performed by predicting the subject position at the start of the imaging operation. That is, the in-focus operation is an operation in which the subject at the predicted position is brought into the in-focus state. Here, the focus prediction target point is indicated by a symbol P0 in FIG. The distance from the imaging device 1 (imaging surface thereof) to the focus prediction target point P0 is indicated by a symbol L in FIG.

  In FIG. 4C, the predicted position of the first subject is indicated by reference symbol P2, and the predicted position of the last subject is indicated by reference symbol P1.

  In this case, the signal processing control unit 11 in the imaging apparatus 1 according to the present embodiment can secure an F-field depth that can ensure that almost all of the first subject P2 to the last subject P1 are in focus as much as possible. (Aperture value) is selected, and automatic exposure control is performed to select and set the fastest possible shutter speed value so as not to cause subject blurring. Such control processing is executed within the time indicated by ΔT1 in FIGS. 3 (E) and 4 (C). Such an operation mode (scene mode) is referred to as an “accompaniment mode” in the imaging apparatus 1 of the present embodiment. The setting of the scene mode in the imaging apparatus 1 may be performed by arbitrarily selecting a desired scene mode by a user (user) operating voluntarily using a predetermined operation member. The imaging apparatus 1 may automatically determine the imaging state based on the captured image data acquired by the imaging unit 12 and automatically switch the scene mode.

  In FIG. 4C, the depth of field is indicated by a symbol Ls, the front depth of field is indicated by a symbol Lf, and the rear depth of field is indicated by a symbol Lr.

  The operation as described above in the image pickup apparatus 1 of the present embodiment, that is, a specific camera control process during the image pickup operation in the “training mode” will be described in detail below.

  FIG. 5 is a flowchart showing the flow of camera control processing in the imaging apparatus of the present embodiment. FIG. 6 is a flowchart showing the depth-of-field setting control process (step S107) in the flowchart of FIG. FIG. 7 is a flowchart showing in detail an “optimum depth of field calculation process” which is a part of the process in the flowchart of FIG. FIG. 8 is a calculation formula for calculating the depth of field.

  When the imaging apparatus 1 is turned on, execution of the flowchart of the camera control process shown in FIG. 5 is started. First, in step S101 of FIG. 5, the signal processing control unit 11 checks whether or not the currently set operation mode is set to an imaging mode capable of executing an imaging operation. Here, if it is confirmed that the imaging mode is set, the process proceeds to the next step S102. If it is set to a mode other than the imaging mode, the process proceeds to step S121.

  In step S102, the signal processing control unit 11 continuously displays images based on the image data acquired by the imaging unit 12 on the display screen of either the rear display unit 18 or the EVF 19 at predetermined time intervals. Perform live view image display processing.

  Subsequently, in step S103, the signal processing control unit 11 controls the subject determination unit 11c to identify a plurality of persons (corresponding faces) to be imaged based on the image data acquired by the imaging unit 12. . Further, the signal processing control unit 11 performs arithmetic processing for measuring the distance information to each of the plurality of persons identified by the subject determination unit 11c using the distance measurement unit 11f. The distance measurement process performed using the distance measuring unit 11f is exactly the same as the calculation process performed in a conventional general imaging apparatus.

  Next, in step S104, the signal processing control unit 11 includes the face information of the subject identified in the process of step S103 and the distance information corresponding to the face information in the storage unit 14, for example. A temporary data storage process for temporarily storing data in a temporary storage memory or the like (not shown) is executed.

  In step S105, the signal processing control unit 11 confirms whether or not a plurality of pieces of face information identical to the face information identified in the process of step S104 described above already exists in the temporarily stored data. If it is confirmed that a plurality of face information identical to the identified face information exists in the temporarily stored data, the process proceeds to the next step S106. If it is not confirmed, for example, at the first distance measurement, the process proceeds to step S111.

  Note that although face detection is performed here, this is not always necessary, and it is needless to say that the movement of the object can be determined based on the correlation between the distance change of a plurality of points and the pattern change.

  In step S106, the signal processing control unit 11 controls the distance measurement unit 11f, the position change prediction unit 11e, and the like, and each temporarily stored measurement corresponding to each face information confirmed in the process of step S105 described above. The distance data (distance information) is compared with the distance measurement data (distance information) corresponding to the face information obtained in the process of step S103 described above, and the position change in the screen (distance to the subject) between them. Change), that is, whether or not a specific subject (person) has moved. If a change in position (change in distance to the subject) in the screen is confirmed, the process proceeds to the next step S107. If no change in position (change in distance to the subject) in the screen is confirmed, the process proceeds to step S111.

  In step S <b> 107, the signal processing control unit 11 switches the operation mode (scene mode) in the imaging mode of the imaging apparatus 1 to the “competitive running mode” (in this example, automatic scene mode switching control is performed). The results obtained in the above-described steps S103 to S106, that is, almost all of the imaging subject (subject) from which the position change in the screen (distance change to the subject) is confirmed, from the first subject to the last subject. A control process (subroutines in FIGS. 6 and 7) for performing various settings for ensuring a depth of field that is in focus as much as possible is executed. Thereafter, the process proceeds to step S111.

  Here, the details of the process in step S107 described above, that is, the depth of field setting control process will be described below using the subroutine of FIG.

  In addition, in the example described here, in order to avoid the complexity of the description, it is described that there are a plurality of persons (runners) to be imaged in the situation in which a student race is to be imaged, It goes without saying that the number of persons may be larger. In that case, a determination step corresponding to each runner may be performed.

  First, in step S201 of FIG. 6, the signal processing control unit 11 determines the speed of the person A who is approaching. In this case, the determination result is Sa, and the data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14.

  The speed determination performed here is based on a moving amount of a specific subject calculated based on a calculation result by a plurality of (twice) distance measurement processes performed in the processes of steps S103 to S106 of FIG. It is a process which determines the moving speed of the to-be-obtained subject.

  Similarly, in step S202, the signal processing control unit 11 determines the speed of the person B approaching. In this case, the determination result is Sb, and the data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14.

  Subsequently, in step S203, the signal processing control unit 11 determines the speed of the approaching person C. In this case, the determination result is Sc, and the data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14.

  Next, in step S204, the signal processing control unit 11 determines the distance to the approaching person A, the determination result in that case is Da, and the data is stored in the temporary storage memory included in the storage unit 14, for example. Etc. (not shown) are temporarily stored. The distance determination performed here determines, for example, the magnitude (far / near) of the distance from the imaging apparatus 1.

  Similarly, in step S205, the signal processing control unit 11 determines the distance to the approaching person B, sets the determination result in this case to Db, and stores the data in, for example, the temporary storage memory included in the storage unit 14 Etc. (not shown) are temporarily stored.

  Subsequently, in step S206, the signal processing control unit 11 determines the distance to the approaching person C, sets the determination result in that case as Dc, and stores the data in, for example, the temporary storage memory included in the storage unit 14 Etc. (not shown) are temporarily stored.

  Next, in step S211, the signal processing control unit 11 determines the distance to the person A after the time ΔT by controlling the position change prediction unit 11e (distance prediction determination), and the determination result in this case is Dat. The data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14.

  Similarly, in step S212, the signal processing control unit 11 controls the position change prediction unit 11e to determine the distance to the person B after time ΔT (distance prediction determination), and the determination result in this case is set to Dbt. The data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14.

  In step S213, the signal processing control unit 11 determines the distance to the person C after the time ΔT by controlling the position change prediction unit 11e (distance prediction determination), and the determination result in this case is Dct, and the data is For example, the data is temporarily stored in a temporary storage memory or the like (not shown) included in the storage unit 14.

  In step S214, the signal processing control unit 11 determines the closest distance from the imaging apparatus 1 among the distance prediction determination results Dat to Dct acquired in each of the above-described processing steps, and the determination result in that case is determined. For example, the data is temporarily stored in a temporary storage memory or the like (not shown) included in the storage unit 14. That is, in this process, the first person among the plurality of persons in the screen is determined.

  Similarly, in step S215, the signal processing control unit 11 determines the distance that is the farthest from the imaging device 1 among the distance prediction determination results Dat to Dct acquired in each of the above-described processing steps. The determination result is Df, and the data is temporarily stored in, for example, a temporary storage memory (not shown) included in the storage unit 14. That is, in this process, the last person among the plurality of persons in the screen is determined.

  Subsequently, in step S216, the signal processing control unit 11 performs a focusing operation between the determination result Df (last predicted distance) and the determination result Dn (first predicted distance) acquired in steps S214 and S215 described above. A target distance (in-focus target distance) is calculated, and the calculation result in this case is set as Dm, and the data is temporarily stored in a temporary storage memory (not shown) included in the storage unit 14, for example. To do. The in-focus target distance Dm corresponds to the symbol L in FIG.

  In step S217, the signal processing control unit 11 calculates a plurality of F values (aperture values) covering the in-focus state from the in-focus target distance Dm to the head predicted distance Dn. Thereafter, the process returns to the original process step of FIG. 5 (return), and proceeds to the process of step S111 of FIG.

  The processing steps of steps S216 to S217 described above will be described in more detail with reference to FIGS. The flowchart “optimum depth of field calculation process” shown in FIG. 7 is a subroutine that details the processes in steps S216 to S217 in FIG.

  In steps S151 to S152 of FIG. 7, the signal processing control unit 11 performs a process of determining the in-focus target distance Dm (corresponding to the process of step S216 of FIG. 6).

  Here, first, the depth of field refers to a distance range from the imaging device 1 on the subject side when the subject image appears to be in focus. This depth of field is a distance range before and after the target position where the focusing operation is performed. In this case, the front depth of field is called the front depth of field, and the rear depth of field is called the front depth of field. For example, in FIG. 4C, when the depth of field is Ls, the forward depth of field Lf and the backward depth of field Lr.

  The in-focus target distance Dm is determined by the distance from the imaging device 1 to the subject (subject distance), that is, the final predicted distance Df (obtained in step S215) and the predicted head distance Dn (obtained in step S214). A predetermined position between both prescribed distances is determined (step S216 in FIG. 6). In this case, the focus target distance Dm is determined based on the focal length f information of the lens barrel 30 attached to the imaging apparatus 1 and the subject distance information.

  Here, in general, the ratio of the front depth of field Lf and the rear depth of field Lr in the depth of field Ls is generally 1: front and 2 after. However, this varies depending on various imaging conditions. For example, when the depth of field Ls is shallow (the range is narrow), it is as follows: front 1: rear 1. Here, it is generally known that, for example, in the case of the same F value (aperture value), a lens having a longer focal length f (long focal lens) tends to have a shallower depth of field. It is also well known that the depth of field tends to increase as the distance to the subject (focus target distance) increases.

  Therefore, for example, table data indicating the relationship between the focal length f of the imaging optical system 32 of the lens barrel 30, the subject distance, and the front / rear ratio of the depth of field is prepared, and by referring to this, The front-to-back ratio of the depth of field is determined (step S151 in FIG. 7). The table data may be prepared by storing in advance, for example, in a temporary storage memory (not shown) included in the storage unit 14.

  Next, the in-focus target distance Dm is determined by proportionally dividing the distance range from the tail predicted distance Df to the head predicted distance Dn by the ratio determined in the process of step S151 (step in FIG. 6). S152).

  Next, in step S153, the signal processing control unit 11 calculates a depth of field corresponding to each F value of the lens barrel 30. Here, the formula shown in FIG. 8 is used to calculate the depth of field. In this case, the numerical value of the allowable circle of confusion δ (mm) is a preliminarily set rule depending on the size of the image sensor and the screen size at the time of observation (display screen or print size of the display device, etc.), that is, the magnification of the image. It is a numerical value. Specifically, for example, an image acquired by an image sensor having a screen size of about 36 mm × 24 mm is displayed on a display device having a display screen size of, for example, a diagonal length of about 10 inches (or, for example, about eight-cut size (6 inches × 8 inches)). In general, when viewing with a size print), it is about 0.03 mm (30 μm).

  Subsequently, in step S154, the signal processing control unit 11 acquires the depth-of-field data for each F value calculated in step S153 described above and the final predicted distance Df (already acquired in step S215 in FIG. 6). ) And the predicted head distance Dn (obtained in step S214 in FIG. 6), the F value (aperture value) when the head runner and the tail runner are included within the depth of field is determined. To do.

  In step S155, the signal processing control unit 11 determines a shutter speed corresponding to the F value (aperture value) determined in step S154 and capable of obtaining an exposure suitable for the imaging state. Thereafter, the process returns to the original processing step (return).

  Returning to FIG. 5, in step S <b> 111, the signal processing control unit 11 monitors an operation instruction signal to the operation unit 15 or the touch panel 16 via the operation determination unit 11 a and instructs an imaging operation (for example, an imaging operation). It is confirmed whether or not a shutter release signal or the like has occurred. If the imaging instruction signal is confirmed, the process proceeds to the next step S112. If the imaging instruction signal is not confirmed, the process returns to step S102 described above.

  In step S112, the signal processing control unit 11 controls the AF unit 12a or the contrast determination unit 11d of the imaging unit 12 based on the image data acquired by the imaging unit 12, and executes a focusing operation. At the same time, the signal processing control unit 11 performs photometric processing based on the same image data acquired by the imaging unit 12. Then, the signal processing control unit 11 calculates an appropriate exposure value such as an F value (aperture value) and a shutter speed to be set based on the photometric result. Based on the calculation result, the signal processing control unit 11 drives and controls the aperture device included in the imaging optical system 32 of the lens barrel 30 in cooperation with the lens control unit 31 of the lens barrel 30.

  Subsequently, in step S113, the signal processing control unit 11 controls the imaging unit 12, and also drives and controls the shutter mechanism provided on either the body 10 side or the lens barrel 30 side, or the imaging element of the imaging unit 12. Then, the imaging process is executed. Thereafter, the signal processing control unit 11 temporarily stores the image data acquired by the imaging unit 12 in a temporary storage unit (not shown) of the storage unit 14 and performs predetermined data processing on the image data. The control processing is executed to generate image data for storage and storage, and store the generated image data for storage and storage in a predetermined area of the storage unit 14.

  Subsequently, in step S114, the signal processing control unit 11 drives and controls the rear display unit 18 or the EVF 19 via the display control unit 11b, and is acquired in the processing of step S113 described above and temporarily stored in the storage unit 14. A so-called REC view display process for displaying the stored image data for a predetermined time is executed. Note that the display time in the REC view display process is usually set to about 1 to 5 seconds, for example. The display time in this case can be set in advance to an arbitrary time within a predetermined range by, for example, a user (user) performing a menu setting operation or the like. Depending on the setting, a setting that does not display is also possible.

  Next, in step S115, the signal processing control unit 11 monitors an operation instruction signal to the operation unit 15 or the touch panel 16 via the operation determination unit 11a, and instructs to switch the power supply state of the imaging apparatus 1 to an off state. It is confirmed whether or not a power off signal is generated. If the power off signal is confirmed, the process proceeds to the next step S116. If the power off signal is not confirmed, the process returns to step S101.

  In step S116, the signal processing control unit 11 executes a predetermined power-off process. Thereby, the camera control process of the imaging apparatus 1 ends (end).

  By the way, when it is confirmed in the process of step S101 described above that the setting is other than the imaging mode and the process proceeds to the process of step S121, the following process flow is performed.

  That is, in step S121, the signal processing control unit 11 confirms whether or not the currently set operation mode is set to a reproduction mode capable of executing an image display / reproduction operation process. If it is confirmed that the playback mode is set, the process proceeds to the next step S122. If it is set to a mode other than the playback mode, the process proceeds to step S101. In this flowchart, the operations in the operation modes other than the imaging mode and the playback mode are not directly related to the present invention, and thus illustration and description thereof are omitted, and the control process returns to the process of step S101. . However, in the actual imaging apparatus, when there are other operation modes other than the imaging mode and the reproduction mode, the control process may proceed to the corresponding control process.

  Next, in step S122, the signal processing control unit 11 drives and controls the rear display unit 18 via the display control unit 11b, and performs a file list display process based on the image data stored in the storage medium of the storage unit 14. Run.

  Next, in step S123, the signal processing control unit 11 monitors an operation instruction signal to the operation unit 15 or the touch panel 16 via the operation determination unit 11a, and instructs a file selection instruction and a reproduction operation of the selected file. It is confirmed whether or not a file selection / playback instruction signal is generated. If the file selection / playback instruction signal is confirmed, the process proceeds to the next step S125. If the file selection / playback instruction signal is not confirmed, the process proceeds to step S124.

  In step S124, the signal processing control unit 11 monitors an operation instruction signal to the operation unit 15 or the touch panel 16 via the operation determination unit 11a, and determines whether or not an instruction signal for instructing the end of the reproduction mode is generated. Confirm. Here, when the reproduction mode end instruction signal is confirmed, the operation control in the reproduction mode is ended, and the process returns to the step S101. If the playback mode end instruction signal is not confirmed, the process returns to step S122.

  On the other hand, when the file selection / playback instruction signal is confirmed in the process of step S123 and the process proceeds to the next step S125, in step S125, the signal processing control unit 11 passes through the display control unit 11b. Selection of controlling (displaying) (reproducing) the image file (selected image) selected in the above-described step S123 on the display screen of the rear display unit 18 by controlling the rear display unit 18 and the storage unit 14 Perform image playback processing. Thereafter, the process proceeds to step S126.

  In step S126, the signal processing control unit 11 monitors an operation instruction signal to the operation unit 15 or the touch panel 16 via the operation determination unit 11a, and generates an instruction signal instructing the end of the currently displayed image display process. Confirm whether or not. Here, when the display end instruction signal is confirmed, the currently displayed image display process is ended, and the process returns to step S121. If the display end instruction signal is not confirmed, the process returns to step S125. That is, the currently displayed image display process is continued until the display end instruction signal is confirmed.

  As described above, in the above-described embodiment, there are a plurality of moving imaging targets (subjects) in one screen, such as an athlete race, and those imaging targets (subjects) are directed toward the photographer. The imaging apparatus 1 provided with the “student race mode” as an operation mode (scene mode) in the imaging mode corresponding to such a situation is illustrated.

  The imaging apparatus 1 according to the present embodiment automatically switches the scene mode when it is confirmed that the image being captured is in a state suitable for the “training mode” based on the image data acquired by the imaging unit 12. Control (scene mode automatic switching control).

  When this scene mode switching is displayed on the display unit or when a switching alarm is issued, it is easy for the user to understand and high visibility.

  Therefore, the user (user) simply continues the imaging operation without being aware of various settings such as the scene mode currently set in the imaging apparatus 1, and the scene mode of the imaging apparatus 1 is appropriate for the imaging situation. Will automatically switch to the correct scene mode.

  In this case, the imaging operation in the “competitive race mode” is as follows. In other words, an F value (aperture value) that can ensure as deep a depth of field as possible is set so that all of the plurality of imaging objects that move within the imaging screen are in focus. At this time, if the F value is set considering only the depth of field, the shutter speed value combined with this tends to decrease in order to obtain an appropriate exposure. Therefore, in the present embodiment, a shutter speed value that does not cause subject blurring is selected in consideration of the depth of field.

  In competitions such as running, etc., the distance between the first runner and the last runner, that is, the standard of the depth of field to be set is not constant for each competition and even during the same competition. Therefore, in the imaging apparatus 1 of the present embodiment, control is performed to calculate the distance between the leading runner and the last runner for each competition to obtain a guide for the depth of field.

  With such a configuration, according to the imaging device 1 of the present embodiment, in the “accompanied race mode”, for example, when taking an academy race or the like as an imaging target, the subject that covers the distance between the leading runner and the last runner is covered. The F value that can secure the depth of field and suppress the decrease in the shutter speed as much as possible is automatically set. As a result, it is possible to easily obtain a good image without subject blurring while ensuring the in-focus state of a plurality of moving subjects to be imaged.

  By the way, in the example demonstrated by one above-mentioned embodiment, the distance between a leading runner and the last runner leaves | separates, and in order to ensure a wider depth of field, the F value must be greatly reduced Is also possible. In this case, a reduction in shutter speed value is unavoidable in order to obtain proper exposure. As described above, the reduction in the shutter speed increases the possibility of subject blurring. Therefore, in such a situation, for example, control for increasing the ISO sensitivity setting value may be performed instead of decreasing the shutter speed. By performing such control, it is possible to suppress a decrease in shutter speed while securing a necessary depth of field, and thus it is possible to acquire a good image while suppressing the possibility of subject blurring. .

  Also, in situations where a wider depth of field cannot be ensured, for example, not all of the first runner to the last runner are covered, but a specific subject (for example, the first subject or a specific subject that is arbitrarily designated) Then, control may be performed to set an aperture value that covers the depth of field so as to cover a subject (for example, at least one person or a plurality that is not all) behind the object.

  In this way, an imaging unit that receives an optical image formed by the imaging optical system and acquires image data, and detects a change in position of a plurality of subjects obtained by the imaging unit, and after a predetermined time has elapsed. The position change prediction unit for predicting the positions of the plurality of subjects, the position information after the predetermined time elapses of the plurality of subjects predicted by the position change prediction unit, and the focal length of the imaging optical system. And a control unit that performs shooting control in accordance with the depth of field that can bring a plurality of subjects into focus. An easy camera can be provided. Of course, such bargaining is seen not only in the race, but also in soccer, basketball, swimming, etc. By comparing two or more subjects in focus, it can be expressed as a drama. Here, we explained an example in which many subjects are clearly reproduced, but there are cases where it is better to shoot with a distinction between the beginning and the back, and in that case, in the leading group playing the main bargaining In some cases, it is more effective to focus, and this is also dealt with by the above-described concept.

  Taking these into account, the modification described below is an example of depth-of-field setting control in a situation where there is a concern about a decrease in shutter speed if a wider depth of field is to be secured. is there.

  FIG. 9 is a flowchart illustrating a modification of the depth-of-field setting control process in the imaging apparatus according to the embodiment. FIG. 10 is a conceptual diagram illustrating an imaging situation when the present modification is applied.

  First, in step S231 in FIG. 9, the signal processing control unit 11 performs speed determination for each of a plurality of approaching persons. In this case, the determination result is S (n) (n is an integer), and the data is temporarily stored. The process of step S231 is a process corresponding to steps S201 to S203 of FIG. 6 in the above-described embodiment.

  Next, in step S232, the signal processing control unit 11 determines the distance to each of a plurality of approaching persons, sets the determination result to D (n) (n is an integer), and temporarily stores the data. Remember. The process in step S232 is a process corresponding to steps S204 to S206 in FIG. 6 in the above-described embodiment.

  Subsequently, in step S233, the signal processing control unit 11 determines the distance for each person after the time ΔT (distance prediction determination), and sets the determination result in this case as Dt (n) (n is an integer). Temporarily store data. The process in step S233 is a process corresponding to steps S211 to S213 in FIG. 6 in the above-described embodiment.

  In step S234, the signal processing control unit 11 determines the distance Dn that is closest to the imaging device 1 from the distance prediction determination results D (n) acquired in the above-described processing steps (determination of the leading runner). ) And temporarily store the data. The process in step S234 is a process corresponding to step S214 in FIG. 6 in the above-described embodiment.

  Similarly, in step S235, the signal processing control unit 11 determines the distance Df that is the farthest from the imaging apparatus 1 among the distance prediction determination results Dt (n) acquired in the above-described processing steps (last) Data of the tail runner) and temporarily store the data. The process in step S235 is a process corresponding to step S215 in FIG. 6 in the above-described embodiment.

  Subsequently, in step S236, the signal processing control unit 11 performs a focusing operation between the determination result Df (last predicted distance) and the determination result Dn (first predicted distance) acquired in steps S234 and S235 described above. A target distance (focusing target distance) Dm is calculated, and the data is temporarily stored. The process in step S236 is a process corresponding to step S216 in FIG. 6 in the above-described embodiment.

  In step S237, the signal processing control unit 11 calculates a plurality of F values (aperture values) that cover in-focus states from the in-focus target distance Dm to the head predicted distance Dn. The processing in step S237 is processing corresponding to step S217 in FIG. 6 (subroutine in FIG. 7) in the above-described embodiment.

  Next, in step S241, the signal processing control unit 11 performs exposure control according to the F value (aperture value) calculated in the above-described processing in step S237, and obtains a setting for obtaining appropriate exposure (for example, a shutter speed value). Etc.) is confirmed. Here, when it is confirmed that the setting for obtaining proper exposure is possible, the process returns to the original processing step (return). If the setting is such that proper exposure cannot be obtained, the process proceeds to the next step S242.

  Here, the setting in which proper exposure cannot be obtained assumes the following case. That is, the F value (aperture value) calculated in the process of step S237 described above is an F value (aperture value) that can bring all of the plurality of moving subjects in the screen into focus. Using this F value (aperture value), exposure control is performed in the processing of the next step S241. In this case, depending on the surrounding environment at that time, the F value (aperture value) of the above calculation result is used. The shutter speed at which a proper exposure can be obtained becomes lower depending on the value), and there is a possibility that the shutter speed value may cause, for example, subject blurring. Therefore, in the “human race mode” in the imaging apparatus 1, a lower limit of a shutter speed value that can be set is set in advance, and when the lower limit value is not reached, it is determined that exposure is impossible in the process of step S <b> 241. Like to do. That is, in the process of step S241, when performing exposure control according to the surrounding environment, exposure control is performed in consideration of the calculated F value and a preset lower limit value of the shutter speed. Yes.

  In step S <b> 242, the signal processing control unit 11 sets an F value that becomes a limit aperture according to a preset lower limit value of the shutter speed among a plurality of F values (aperture values) calculated in the process of step S <b> 237 described above. Set the (aperture value).

  Next, in step S243, the signal processing control unit 11 includes the head predicted distance Dn in consideration of the depth of field corresponding to the F value (aperture value) set in the processing in step S242 described above. The focus target distance Dm1 is set at a predetermined position behind Dn.

  Next, in step S244, the signal processing control unit 11 checks whether or not the distance to a person (D (n)) other than the leading runner (Dn) is covered. Here, when it is confirmed that other persons (D (n)) including the leading runner (Dn) are covered, the process proceeds to the next step S245. On the other hand, if it is confirmed that the person other than the head runner (Dn) (D (n)) is not covered, the process proceeds to step S246.

  In step S245, the signal processing control unit 11 sets the in-focus position to the in-focus target distance Dm1, and executes the in-focus operation. Thereafter, the process returns to the original processing step (return). That is, in this case, the setting is such that a plurality of runners including other persons following the first runner (Dn) can be brought into focus. As an example in this case, as shown in FIG. 10, the setting is such that the leading runner and one runner behind it are included in the depth of field Ls.

  On the other hand, in step S246, the signal processing control unit 11 performs a focusing operation by setting a focusing position at the head predicted distance Dn. Thereafter, the process returns to the original processing step (return). That is, in this case, the setting is such that at least only the leading runner (Dn) can be brought into focus.

  Other configurations and operations are substantially the same as those of the above-described embodiment. In the modified example, in the process of step S243, the in-focus state is set based on the leading runner. However, the present invention is not limited to this example, and the in-focus state is set as a reference. For example, a specific subject (person, runner) may be used as a reference. Specifically, for example, when a pre-registered face image (for example, the face of a child) is recognized, this may be prioritized.

  As described above, according to the above-described modification, the lower limit value of the set shutter speed value is set, and subject blurring is suppressed, and at least a predetermined distance behind the reference with respect to the leading runner or the recognized registrant. The in-focus state of the range can be ensured. Therefore, according to this modification, the same effect as that of the above-described embodiment can be obtained. In addition, according to this modification, at least two of the subjects (persons, runners) behind the first runner or recognized registrant, or at least the first runner or recognized registrant are in focus. Images can be obtained.

  Also in this modified example, the control for increasing the ISO sensitivity setting value may be performed to suppress the decrease in the shutter speed value.

  Each processing sequence described in the above-described embodiment can allow a change in procedure as long as it does not contradict its nature. Therefore, for each of the above-described processing sequences, for example, the order of the processing steps is changed each time the processing order is changed, the processing steps are executed simultaneously, or a series of processing sequences are executed. It may be.

  Of the technologies described here, the control described mainly in the flowchart is often settable by a software program, and this software program is stored in a storage medium, a storage unit, or the like. It is. In addition, the software program may be stored in advance in the storage medium or storage unit in the product manufacturing process, or a distribution storage medium prepared separately from the product may be used. Moreover, even after the product is shipped, it may be downloaded by the user (user) or the like via the Internet or the like.

  Each processing sequence described in the above-described embodiment can allow a change in procedure as long as it does not contradict its nature. Therefore, for each of the above-described processing sequences, for example, the order of the processing steps is changed each time the processing order is changed, the processing steps are executed simultaneously, or a series of processing sequences are executed. It may be.

  That is, regarding the operation flow in the claims, the specification, and the drawings, even if it is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

  Of the technologies described here, many of the controls and functions mainly described in the flowcharts can be set by a program, and the above-described controls and functions can be realized by a computer reading and executing the program. it can. As a computer program product, the program may be stored or stored in whole or in part in a portable medium such as a non-volatile memory such as a flexible disk or a CD-ROM, or in a storage medium such as a hard disk or a volatile memory. It can be distributed or provided at the time of product shipment or via a portable medium or communication line. The user can easily realize the imaging apparatus according to the present embodiment by downloading the program via a communication network and installing the program on the computer, or installing the program from a storage medium on the computer.

  Note that the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications and applications can be implemented without departing from the spirit of the invention. Furthermore, the above-described embodiment includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the above-described embodiment, if the problem to be solved by the invention can be solved and the effect of the invention can be obtained, this constituent requirement is deleted. The configured structure can be extracted as an invention. Furthermore, constituent elements over different embodiments may be appropriately combined.

  The present invention is not limited to an imaging apparatus that is an electronic device specialized for an imaging function such as a digital camera, and other forms of electronic devices having an imaging function, such as a mobile phone, a smartphone, a recording device, and an electronic notebook , Personal computers, tablet terminal devices, game devices, portable TVs, watches, navigation devices using GPS (Global Positioning System), and other electronic devices with various imaging functions.

1 …… Imaging device,
10 …… Body,
11 …… Signal processing control unit,
11a …… Operation determination unit,
11b: Display control unit,
11c …… Subject determination unit,
11d: Contrast judgment unit,
11e …… Position change prediction unit,
11f: Distance measuring unit,
12 ... Imaging unit,
12a …… AF section,
13 …… Blur correction part,
14 ... Memory part,
15 …… Operation part,
16 …… Touch panel,
17 …… Clock part,
18 …… Back display,
20 …… Eye sensor,
21 …… Body communication unit,
30 …… Lens barrel,
32. Imaging optical system,
33 …… Lens drive unit,
34 …… State determination unit,
35 …… Lens side operation section,
36 …… Lens side storage unit,
37 …… Lens communication section

Claims (10)

An imaging unit that receives an optical image formed by the imaging optical system and acquires image data;
A feature detector for detecting a plurality of features from the image data;
A feature instruction unit that instructs at least one of the detected plurality of feature units;
A storage unit for storing the instructed feature unit;
Based on the coincidence between the feature obtained from the newly obtained image data and the plurality of stored features, the position change in the depth direction of each feature is detected, and after a predetermined time has elapsed. A position change prediction unit for predicting the positions of the plurality of features;
The depth of field at which the plurality of feature portions in the image can be brought into focus by the position information of the plurality of feature portions predicted by the position change prediction portion after a predetermined time and the focal length of the imaging optical system. A control unit that performs shooting control according to
An imaging device comprising: An imaging unit that receives an optical image formed by the imaging optical system and acquires image data;
A feature detector for detecting a plurality of features from the image data;
A feature registration unit for registering information related to the feature unit;
A storage unit for storing the plurality of detected characteristic units;
Based on the coincidence between the feature obtained from the newly obtained image data and the plurality of stored features, the position change in the depth direction of each feature is detected, and after a predetermined time has elapsed. A position change prediction unit for predicting the positions of the plurality of features;
At least the registered feature portion from among the plurality of feature portions in the image based on position information after the predetermined time elapses of the plurality of feature portions predicted by the position change prediction portion and the focal length of the imaging optical system. A control unit that performs shooting control according to the depth of field that can be brought into focus;
An imaging device comprising: The control unit includes a subject determination unit that determines a plurality of moving subjects in an image formed based on the image data acquired by the imaging unit;
A subject instruction unit that instructs at least one of the determined subjects,
The imaging apparatus according to claim 1, wherein the imaging apparatus switches to imaging control corresponding to the depth of field based on the instructed subject.   The imaging apparatus according to claim 1, wherein the control unit performs shooting control according to a depth of field at which at least one of the registered feature and the instructed subject can be brought into focus. . Receiving an optical image formed by the imaging optical system to obtain image data,
A plurality of features are detected from the image data,
Indicating at least one of the detected plurality of features;
Memorize the indicated feature,
Based on the coincidence between the feature portion obtained from the newly obtained image data and the plurality of stored feature portions, the position change in the depth direction of each feature is detected, and after a predetermined time has passed, Predict the location of multiple features,
Shooting control according to the depth of field that can bring the plurality of features in the image into a focused state based on the predicted position information of the plurality of features after a predetermined time and the focal length of the imaging optical system A method for controlling an imaging apparatus, comprising: An imaging unit that receives an optical image formed by the imaging optical system and acquires image data;
A feature detector for detecting a plurality of features from the image data;
A storage unit for storing the plurality of detected characteristic units;
Based on the coincidence between the feature obtained from the newly obtained image data and the plurality of stored features, the position change in the depth direction of each feature is detected, and after a predetermined time has elapsed. A position change prediction unit for predicting the positions of the plurality of features;
The depth of field at which the plurality of feature portions in the image can be brought into focus by the position information of the plurality of feature portions predicted by the position change prediction portion after a predetermined time and the focal length of the imaging optical system. A control unit that performs shooting control according to
Have
The control unit performs automatic exposure control based on the set aperture value and sets the shutter speed. An image pickup apparatus that is reset to   The control unit selects the plurality of features that can be brought into a focused state according to the reset aperture value, and performs shooting control according to the depth of field that can bring the selected plurality of features into a focused state The imaging apparatus according to claim 6, wherein:   The control unit selects a closest feature unit or a pre-registered feature unit from the plurality of feature units, and performs shooting control according to a depth of field that can bring the selected feature unit into a focused state. The imaging apparatus according to claim 6. It further has a feature instruction unit that instructs at least one of the detected plurality of feature portions,
The imaging apparatus according to claim 6, wherein the control unit performs shooting control according to a depth of field that can bring the instructed feature into a focused state. Receiving an optical image formed by the imaging optical system to obtain image data,
A plurality of features are detected from the image data,
Storing the plurality of detected features;
Based on the coincidence between the feature portion obtained from the newly obtained image data and the plurality of stored feature portions, the position change in the depth direction of each feature is detected, and after a predetermined time has passed, Predict the location of multiple features,
Shooting control according to the depth of field that can bring the plurality of features in the image into a focused state based on the predicted position information of the plurality of features after a predetermined time and the focal length of the imaging optical system And set the shutter speed by performing automatic exposure control based on the set aperture value. A method for controlling an imaging apparatus, comprising: setting.

Images