JP2011259212A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus that is easy to decide the imaging magnification just as a photographer intended.SOLUTION: An imaging apparatus 100 has: an imaging part 10 that images a subject to acquire first image information; a first detector 41 that detects photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor; a second detector 44 that detects motion information representing the motion of the imaging apparatus 100; a determining part 46 in which a plurality of thresholds (t1-t2, and T1-T3) corresponding to a plurality of zones (z1-z2, and Z1-Z3) divided for each of the magnitudes of the motion information are set, and that compares one of the thresholds, which is set to one of the zones to which the motion information belongs, with the magnitude of the motion information, and carries out determination; and a deciding part 48 that decides an imaging magnification based on the photographing magnification information when the magnitude of the motion information exceeds the one of the thresholds.

Description

  The present invention relates to an imaging device and the like.

  The range of the imaging device that captures an image of a subject at a desired magnification includes an electronic still camera, an electronic video camera, and the like. When the imaging apparatus includes an operation unit such as a zoom lever and a zoom button, the photographer can determine the imaging magnification by operating the operation unit. In order to determine the imaging magnification, the photographer himself needs to operate the operation unit. Therefore, there is a problem that the operation of the operation unit is complicated, such as troublesome to check the operation unit or erroneous operation in the reverse direction.

  As such an imaging apparatus that does not use an operation unit, an imaging apparatus that follows the photographer's intuitive intention has been proposed in, for example, Patent Document 1 and Patent Document 2. In Patent Document 1, the imaging device includes a motion sensor, and the imaging magnification is determined by moving the imaging device in the optical axis direction. In Patent Document 2, a photographer's face image is analyzed, and it is determined whether the photographer is close to or away from the imaging device, and the imaging magnification is determined.

JP 2006-21458 A JP 2009-294728 A

  For example, even when the imaging device is not moving, if the imaging information is analyzed, for example, when the imaging information of the photographer changes, the imaging device is determined only by determining the imaging magnification according to the distance between the photographer and the imaging device. An erroneous determination that the object has moved may occur. In addition, the same problem may occur even when analyzing image information in which the landscape changes or analyzing sensor information from a motion sensor. That is, even when the photographer does not intend to change the shooting magnification, there is a possibility that the shooting magnification is unintentionally changed. As described above, the present inventor has recognized that it is difficult to accurately follow the photographer's intuitive intention only by determining the imaging magnification according to the distance between the photographer and the imaging device.

  According to some aspects of the present invention, it is possible to provide an imaging apparatus that can easily determine the imaging magnification as intended by the photographer.

According to one aspect of the present invention, an imaging unit that captures an image of a subject and acquires first image information;
A first detector for detecting photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor;
A second detection unit for detecting motion information representing the motion of the imaging device;
A plurality of threshold values are set corresponding to a plurality of zones divided for each size of the motion information, and one of the plurality of threshold values set in one of the plurality of zones to which the motion information belongs and the motion A determination unit that compares and determines the size of the information;
A determination unit that determines an imaging magnification based on the imaging magnification information when the motion information exceeds one of the plurality of threshold values;
It is related with the imaging device characterized by including.

  According to one aspect of the present invention, the second detection unit can detect motion information representing the motion of the imaging device. Further, the determination unit sorts the movement of the imaging device into a plurality of zones having different threshold values, and sets the shooting magnification when the motion information exceeds the threshold set for each zone, and otherwise sets the shooting magnification. Can be changed. That is, the threshold value can be lowered when the movement of the imaging apparatus is intended to change the shooting magnification, and the threshold value can be increased when the movement of the imaging apparatus is not intended to change the shooting magnification, such as camera shake. . Accordingly, it is possible to determine whether or not to change the imaging magnification in consideration of not only the imaging magnification information but also whether or not the motion information exceeds a threshold set for each corresponding zone. In this way, it is possible to determine the imaging magnification when the motion information exceeds the threshold value, and it is possible to realize a zoom operation in accordance with the photographer's intention.

In one aspect of the present invention, the determination unit includes a first zone when the motion information is smaller than a first reference value, and a second reference value that is greater than or equal to the first reference value. It is determined whether the motion information belongs to at least three zones including a second zone when the following is true and a third zone when the motion information is larger than the second reference value. , As the at least one threshold value, a first threshold value set in the third zone, a second threshold value set in the first zone and larger than the first threshold value, and the second zone And can include a third threshold value between the first threshold value and the second threshold value,
When the motion information belongs to the third zone, the determination unit may determine the imaging magnification when the motion information exceeds the first threshold value.
When the motion information belongs to the second zone, the determination unit may execute the determination of the imaging magnification when the motion information exceeds the third threshold,
When the motion information belongs to the first zone, the determination unit may determine the imaging magnification when the motion information exceeds the second threshold.

  According to one aspect of the present invention, it is assumed that at least three zones are set to a relatively high second threshold in the first zone that is not intended to change the shooting magnification, and that the shooting magnification is intended to be changed. In the third zone, the first threshold value is set to be relatively low, and a second zone which is a gray zone is provided between the first and third zones. Then, by setting the third threshold value between the first and second threshold values in the second zone, the intention of the photographer to change the photographing magnification can be accurately determined. Therefore, for example, when the imaging device is not moving or when the imaging device is moved slightly, it is difficult to change the imaging magnification, and unnecessary zoom operations that do not match the photographer's intention can be suppressed.

  According to an aspect of the present invention, the third threshold value is between the first threshold value and the second threshold value, corresponding to the magnitude of the motion information in the second zone. It can be a value that varies over a range. The third threshold value may be changed continuously or may be changed in stages (that is, equivalent to four or more zone divisions). This makes it possible to more accurately determine the intention of the photographer to change the photographing magnification in the second zone, which is a gray zone.

  In the aspect of the invention, the photographing magnification information may be a distance between the photographer and the imaging device.

  According to one embodiment of the present invention, the distance between the photographer and the imaging apparatus can be used as the imaging magnification information.

  In the aspect of the invention, the second detection unit may detect the motion information based on at least one of the second image information and the sensor information.

  According to one aspect of the present invention, for example, motion information and photographing magnification information can be detected based on the second image information. Alternatively, it is possible to detect motion information and photographing magnification information based on sensor information. Motion information can be detected based on the second image information, and photographing magnification information can be detected based on the sensor information.

  In the aspect of the invention, the second detection unit may detect a change rate of the photographing magnification information as the motion information.

  According to one aspect of the present invention, the rate of change in photographing magnification information can be used as the motion information.

In one embodiment of the present invention, the imaging apparatus includes a storage unit that stores a history of the shooting magnification information.
May also include
The second detection unit may obtain the history fitting curve and obtain an inclination of the fitting curve at a given time as the rate of change of the photographing magnification information.

  According to one aspect of the present invention, it is possible to obtain a history fitting curve of shooting magnification information (distance between a photographer and an imaging device in a narrow sense, for example, the size of a photographer's face in a narrow sense). . The second detection unit can obtain, for example, the slope of the fitting curve at the current time (moving speed of the imaging device in a narrow sense) as the change rate (motion information) of the shooting magnification information.

In one embodiment of the present invention, the fitting curve may be represented by a quadratic function by a least square method,
When the standard error of the coefficient of the quadratic term of the quadratic function is larger than a given value, the determination unit may execute the determination of the imaging magnification when the inclination exceeds the second threshold value. Good.

  For example, when the imaging apparatus moves regardless of the photographer's intention, the fitting accuracy may be poor. Therefore, when the standard error of the coefficient of the quadratic term of the fitting curve (quadratic function) is larger than a given value, it is difficult to determine the imaging magnification as the fitting accuracy. Thereby, unnecessary zoom operations that do not match the photographer's intention can be suppressed.

2 is a configuration example of an imaging apparatus according to the present embodiment. Another configuration example of the imaging apparatus of the present embodiment. 3A and 3B show examples of setting a plurality of zones. 3 is a flowchart for explaining an operation example of the imaging apparatus in FIG. 1. 5A, 5B, and 5C are examples of changes in the size of the photographer's face. 3 is a specific configuration example of an imaging apparatus according to the present embodiment. 7 is a schematic configuration example of a processing unit in FIG. 7 is a flowchart for explaining a part of an operation example of the imaging apparatus in FIG. 6. 7 is a flowchart for explaining another part of the operation example of the imaging apparatus in FIG. 6. An example of calculating a fitting curve. The example of a threshold value setting with respect to the fluctuation | variation of a photographer's face size. 7 is a modification example of the imaging apparatus in FIG. 6. 13 is a flowchart for explaining a part of an operation example of the imaging apparatus in FIG. 13 is a flowchart for explaining another part of the operation example of the imaging apparatus in FIG. 12. 7 is a setting example of a threshold for fluctuations in the moving distance of the imaging apparatus.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Overview 1.1. Basic Configuration FIG. 1 shows a configuration example of an imaging apparatus according to the present embodiment. As illustrated in FIG. 1, the imaging apparatus 100 includes an imaging unit (first imaging unit) 10, a first detection unit 41, a second detection unit 44, a determination unit 46, and a determination unit 48. Including. In the example of FIG. 1, the imaging device 100 can include, for example, a second imaging unit 49, and the first detection unit 41 is imaging magnification information based on image information (photographer) from the second imaging unit 49. Can be detected. Note that the first detection unit 41 may detect shooting magnification information with image information (photographer) from the imaging unit (first imaging unit) 10.

  FIG. 2 shows another configuration example of the imaging apparatus of the present embodiment. As illustrated in FIG. 2, the imaging device 100 can include, for example, a motion sensor 47 instead of the second imaging unit 49. In the example of FIG. 2, the first detection unit 41 can detect shooting magnification information from the sensor information from the motion sensor 47.

  1 is modified, the first detection unit 41 detects photographing magnification information with a motion sensor such as the motion sensor 47 of FIG. 2, while the second detection unit 44 is a second imaging unit. The image information from 49 may continue to be used. Further, by modifying the example of FIG. 2, the first detection unit 41 detects shooting magnification information from image information from an imaging unit such as the second imaging unit 49 of FIG. 1, while the second detection unit 44 may continue to use sensor information from the motion sensor 47. Further, by modifying the example of FIG. 1, the first detection unit 41 may detect imaging magnification information using the second imaging unit 49 and a motion sensor. Thus, the 1st detection part 41 may detect imaging magnification information based on at least one of image information and sensor information.

  In the example of FIG. 1 and the example of FIG. 2, the second detection unit 44 uses image information (for example, the second imaging unit 49) or sensor information (for example, motion sensor 47) to move the imaging device 100. Is detected. Note that the second detection unit 44 may use both image information and sensor information. In the present embodiment, whether to change the imaging magnification according to the imaging magnification information detected by the first detection unit 41 is determined based on the magnitude of the motion information of the imaging device 100 detected by the second detection unit 44. To do.

  The imaging unit 10 can include an imaging element, for example. In the example of FIG. 1 and the example of FIG. 2, the first detection unit 41, the second detection unit 44, the determination unit 46, and the determination unit 48 are represented as a processing unit 40, and the processing unit 40 includes an ASIC, a DSP, and the like. Of ICs. Note that the configuration of the imaging apparatus 100 is not limited to FIGS. 1 and 2.

  In the example of FIG. 2, the imaging device 100 includes a motion sensor 47, but the motion sensor 47 may be separated from the imaging device 100. In this case, the imaging apparatus 100 may receive sensor information from the motion sensor 47 wirelessly or by wire. The imaging device 100 can include a storage unit (not shown). The imaging apparatus 100 is typically an electronic still camera or an electronic video camera, and converts optical image information into an electrical signal by, for example, an imaging element (imaging unit 10 in a broad sense), and the converted image information. Can be electronically recorded in, for example, a storage unit (work area) in the processing unit 40 or a storage unit (not shown). Note that the imaging apparatus 100 may be portable like a digital camera. Further, in the imaging apparatus 100, the imaging part and the operation part may be separated as in an endoscope or a microscope. Furthermore, the imaging apparatus 100 (imaging unit 10) may be incorporated in an electronic device such as a portable information terminal, a mobile phone, or a portable game machine, and all or a part of the functions of the processing unit 40 may be incorporated into the MPU of the electronic device. It may be realized by a processing unit such as a CPU.

  In the example of FIG. 1 and the example of FIG. 2, the imaging unit 10 captures a subject and acquires image information (first image information). Note that the imaging magnification of the imaging unit 10 can be determined by the determination unit 48. The imaging magnification may be only an optical magnification, or may be both an optical magnification and an electronic magnification (combination). The optical magnification can be determined by adjusting the lens system of the imaging unit 10, and the electronic magnification can be electronically obtained by performing interpolation or thinning between pixels in the image data in the processing unit 40. Image data can be enlarged or reduced. Note that the imaging magnification may be only an electronic magnification.

  The first image information represents a subject, and the first detection unit 41 can use image information (second image information) representing a photographer (user). In the example of FIG. 1, the second image information is captured by the second imaging unit 49, but the second image information may be captured by the imaging unit 10 (first imaging unit). When the imaging unit 10 employs, for example, an omnidirectional (360 °) lens system or a fish-eye lens system, the imaging unit 10 includes first image information representing a subject intended by the photographer and second image information representing the photographer. Can be obtained at the same time.

  The first detection unit 41 determines the distance (photographing magnification information in a broad sense) between the photographer and the imaging device 100 based on at least one of the second image information representing the photographer and the sensor information from the motion sensor 47. To detect. Since the imaging device 100 includes the first detection unit 41, the determination unit 48 can determine the imaging magnification (zoom magnification) according to the distance between the photographer and the imaging device 100. For example, as in Patent Document 2, the imaging magnification change (zoom operation) can be realized by an intuitive operation of pushing the imaging device 100 or pulling it toward the front. If the zoom operation can be realized by an intuitive operation, the first detection unit 41 may detect information (photographing magnification information) other than the distance between the photographer and the imaging device 100.

  The second detection unit 44 detects motion information representing the motion of the imaging device 100. The second detection unit 44 can use at least one of second image information representing the photographer and sensor information from the motion sensor 47. When both the first detection unit 41 and the second detection unit 44 use the same information (for example, second image information), the configuration of the imaging device 100 can be simplified.

  The determination unit 46 determines to which zone of the plurality of zones, for example, three zones the motion information belongs. The determination unit 48 determines the imaging magnification based on the shooting magnification information and the determination result of the determination unit 46. Since the imaging device 100 includes the second detection unit 44 and the determination unit 46, the determination unit 48 not only determines the distance between the photographer and the imaging device 100 (imaging magnification information in a broad sense) but also the corresponding zone. The imaging magnification (zoom magnification) can be determined in accordance with the movement of the imaging device classified into (1). Since the determination unit 48 determines the imaging magnification in consideration of not only the imaging magnification information but also the movement (zone) of the imaging device, it is possible to suppress unnecessary zoom operations that do not match the photographer's intention. .

  An intuitive operation of pushing the imaging device 100 or pulling it toward the front can be detected by the first detection unit 41. In Patent Document 1 and Patent Document 2, it is assumed that such an imaging magnification change (zoom operation) is universal. However, even when the imaging apparatus 100 is not moving, for example, when image information (second image information) in which the photographer's facial expression changes is analyzed, a change in the distance between the photographer and the imaging apparatus 100 is detected. Sometimes. For example, the state in which the imaging apparatus 100 is not moving can be set in the first zone, and a normal intuitive operation can be set in the third zone. A second zone can be set between the first zone and the third zone. By setting these three zones, for example, an unnecessary zoom operation that does not match the photographer's intention is suppressed, a normal intuitive operation is ensured, and a second intuitive operation (for example, fine-tuned) is performed. A simple zoom operation). Thereby, compared with patent document 1 and patent document 2, zoom operation along a photographer's intention can be implemented.

  FIG. 3A shows two zones z1 and z2, and FIG. 3B shows a setting example of the first to third zones Z1, Z2, and Z3. In the example of FIGS. 3A and 3B, the rate of change in the distance between the photographer and the imaging device 100 (imaging magnification information in a broad sense) is adopted as the motion information (movement of the imaging device 100). As the movement of the imaging device 100 becomes faster, the rate of change of the distance between the photographer and the imaging device 100 (imaging magnification information in a broad sense) increases, and a plurality of zones are formed according to the movement of the imaging device 100. Two zones z1, z2 (in the case of FIG. 3A) or at least three first to third zones Z1, Z2, Z3 (in the case of FIG. 3B) are set. In FIG. 3A, the threshold value t1 is set small in the zone z2 where the movement of the imaging device 100 is fast, and the threshold value t2 is set large in the zone z1 where the movement of the imaging device 100 is slow (t1 <t2). Further, as an example of FIG. 3B, in the first zone Z1, the second threshold T2 is set to be high so that the change of the imaging magnification is set to be most difficult to execute. In the third zone Z3, the first zone Z1 It is possible to set the threshold T1 to be low and to change the imaging magnification most easily. In the second zone Z2, an intermediate zone having a third threshold value T3 between the first threshold value T1 and the second threshold value T2 can be set. With such a setting, the slower the movement of the imaging apparatus 100, the more difficult it is to change the imaging magnification. Therefore, for example, when the imaging device is not moving or when the imaging device is slightly moved (zones z1 and Z1), it is difficult to change the imaging magnification, and unnecessary zoom operations that do not match the photographer's intention are suppressed. be able to. In the zones z2 and Z3, a normal zoom operation can be executed. In FIG. 3B, in the second zone Z2, the intention of changing the photographing magnification in the gray zone is determined by an intermediate threshold (third threshold T3) between the first and second thresholds. A zoom operation can be performed.

1.2. Basic Operation FIG. 4 is a flowchart for explaining an operation example of the imaging apparatus 100 of FIG. In the example of step S109 in FIG. 4, the first detection unit 41 (the processing unit 40 in a broad sense) detects the photographer's face based on the image information (second image information) from the second imaging unit 49. To detect. Since the size of the photographer's face depends on the distance between the photographer and the imaging device 100, the first detection unit 41 determines whether the photographer and the imaging device 100 are based on the size of the photographer's face. It is possible to detect the distance between them (photographing magnification information in a broad sense).

  Similarly to the first detection unit 41, the second detection unit 44 (the processing unit 40 in a broad sense) may detect the photographer's face based on the second image information. 44 preferably uses the detection result of the first detection unit 41. In other words, the second detection unit 44 is based on the photographer's face size (second image information in a broad sense) detected by the first detection unit 41, and motion information representing the movement of the imaging device 100. Is preferably detected. In the example of FIG. 4, the change rate of the photographer's face size is adopted as the motion information (step S113). In addition, step S111 is performed in order to obtain the rate of change of the photographer's face size.

  In the example of step S111 in FIG. 4, the second detection unit 44 (processing unit 40 in a broad sense) stores a history of the photographer's face size. By storing the history of the photographer's face size, it is possible to grasp how the photographer's face size changes. Next, in the example of step S113 in FIG. 4, the second detection unit 44 (the processing unit 40 in a broad sense) changes the rate of change in the size of the photographer's face based on the history of the size of the photographer's face. Is detected (calculated).

  FIGS. 5A, 5B, and 5C show examples of changes in the size of the photographer's face. Although the rate of change in the size of the photographer's face varies in various ways, in the example of FIG. 5A, for example, the rate of change in the size of the face is small due to the camera shake of the photographer. The direction in which the number increases or decreases is also different. In the example of FIG. 5B, for example, when the photographer slowly moves the imaging device 100, the change rate of the face size is larger than that of the example of FIG. In the example of FIG. 5C, for example, when the photographer quickly moves the imaging apparatus 100, the change rate of the face size is larger than that in the example of FIG.

  In addition, typical change examples as shown in FIGS. 5A, 5B, and 5C are stored in advance as, for example, first to third change patterns, and the face size actually measured is measured. The change rate of the photographer's face size may be detected by determining which change pattern the change in height is close to.

  In the example of step S113 in FIG. 4, the determination unit 46 (processing unit 40 in a broad sense) performs zone determination based on the rate of change in the size of the photographer's face detected by the second detection unit 44. . Since the rate of change in the size of the photographer's face depends on the rate of change in the distance between the photographer and the imaging apparatus 100, the determination unit 46 determines that the rate of change in the size of the photographer's face is, for example, FIG. It is determined which zone of the two zones z1 and z2 as shown in (A) or the three zones Z1, Z2 and Z3 as shown in FIG.

  In the example of step S120 in FIG. 4, the determination unit 48 (the processing unit 40 in a broad sense), the imaging magnification based on the imaging magnification information (distance between the photographer and the imaging device 100) and the determination result (zone) of the determination unit 46. To decide. The determination unit 48 sets a threshold value (FIG. 3A) according to the rate of change in the size of the photographer's face (the rate of change of the movement of the imaging device 100 in a broad sense and the moving speed of the imaging device 100 in a narrow sense). ) Based on the comparison results with threshold values t1, t2 and threshold values T1, T2, T3 in FIG. 3B, for example, it is determined whether or not to allow the change in imaging magnification, and then the imaging magnification after the change. Can be determined. Note that the operation of the imaging apparatus 100 in FIG. 1 is not limited by FIG.

  Note that the imaging apparatus 100 in FIG. 2 can also perform the same operation as in FIG. For example, by modifying step S109 in FIG. 4, the first detection unit 41 can detect acceleration, for example. The first detection unit 41 can detect the distance between the photographer and the imaging apparatus 100 by integrating the acceleration twice, for example. By modifying steps S111 to S113 in FIG. 4, the second detection unit 44 stores a history of the distance between the photographer and the imaging apparatus 100, and changes in the distance between the photographer and the imaging apparatus 100. The rate can be detected.

2. Specific example 2.1. Configuration FIG. 6 shows a specific configuration example of the imaging apparatus of the present embodiment, and can also be called a specific example or a modification of the imaging apparatus 100 of FIG. Note that the configuration of the imaging apparatus 100 is not limited to that in FIG. 6. Various modifications may be made such as omitting some components of the imaging apparatus 100 in FIG. 6 or adding other components. Is possible. In the example of FIG. 6, the imaging apparatus 100 includes an optical element 11 and an imaging element 13 (for example, a CCD or a CMOS image sensor) as the imaging unit 10. The imaging apparatus 100 can include an image processing unit 30 that processes image information (first image information) from the imaging element 13. The optical element 11 forms a subject image on the imaging surface of the imaging element 13. In the example of FIG. 6, the image sensor 13 has processing blocks such as CDS (Correlated Double Sampling) and A / D conversion, and can output a digital image signal (image information in a broad sense).

  The optical element 11 includes, for example, three lenses 11a, 11b, 11d, and a diaphragm mechanism 11c. In the example of FIG. 6, the lens 11b is a zoom lens that can change the focal length, and the lens 11d is a focus lens. The optical element 11 can be housed in a lens barrel (not shown).

  In the example of FIG. 6, the imaging apparatus 100 can include an optical zoom control unit 17 that controls driving of the lens 11 b (zoom lens) as the control unit 20. Further, the imaging device 10 (the control unit 20 in a narrow sense) can include an AE (Automatic Exposure) control unit 19 that controls driving of the diaphragm mechanism 11c. Furthermore, the imaging apparatus 100 can include an AF (Automatic Focus) control unit 21 that controls driving of the lens 11d (focus lens). Note that the AE control unit 19 may be a control unit that manually controls the driving of the aperture mechanism 11c by a photographer's own operation. Further, the AF control unit 21 may be a control unit that manually controls the driving of the lens 11d by an operation of the photographer himself. In addition, the imaging apparatus 100 can include an imaging element driving unit 23 that drives the imaging element 13.

  The optical zoom control unit 17 can include an electromechanical mechanism for transporting the lens 11b in the optical axis direction. The AE control unit 19 can include an electromechanical mechanism for moving the aperture mechanism 11c in a direction perpendicular to the optical axis direction. The AF control unit 21 can include an electromechanical mechanism for moving the lens 11d in a direction perpendicular to the optical axis direction. The optical zoom control unit 17, the AE control unit 19, and the AF control unit 21 can control the positions of the lens 11 b, the lens 11 d, and the aperture mechanism 11 c in accordance with, for example, a command from the processing unit 40.

  In the example of FIG. 6, the imaging apparatus 100 can include an operation unit 25 for the user to perform various operations. In addition, the imaging apparatus 100 can include a buffer memory 57 (work area) that temporarily stores image data (image information) for the image processing unit 30. Further, the imaging apparatus 100 can display through image information (moving image) that continuously represents image information acquired through the imaging element 13 or captured image information that represents one piece of image information acquired through the imaging element 13 ( A display control unit 39 for displaying a still image on the display unit 29 can be included.

  The display unit 29 can be realized by, for example, a liquid crystal display, a display using a light emitting element such as an organic EL, an electrophoretic display, or the like. The display unit 29 may be configured by a touch panel display (touch screen) and may have all or part of the functions of the operation unit 25.

  In the example of FIG. 6, the imaging apparatus 100 can include a shutter button 25a, a zoom lever 25b, and a mode selection unit 25c as the operation unit 25. For example, the mode selection unit 25c can set the first mode in which the imaging magnification is determined only by the operation amount of the zoom lever 25b. For example, the mode selection unit 25c can set the second mode in which the imaging magnification is determined only by the movement amount of the imaging device 100. Furthermore, the mode selection unit 25c can set, for example, a third mode in which the zoom lever 25b is given priority over the second imaging unit 49. The operation unit 25 may include a switch, a button, a lever, or the like that realizes a function (not shown) that enables various operations.

  In the example of FIG. 6, the imaging apparatus 100 can include a preprocessing unit 31, a resolution adjustment unit 33, a pixel number conversion unit 35, and an image compression unit 37 as the image processing unit 30. In addition, the imaging apparatus 100 can include a memory interface 43 and a processing unit 40. The image processing unit 30 and the processing unit 40 can be configured by an IC such as an ASIC or a DSP. The specific configuration of the processing unit 40 is shown in, for example, FIG. 1 and the like, and functions not shown in FIG. 1 and the like (for example, instructions to the control unit 20 and the like) can be realized.

  The preprocessing unit 31 receives digital image signals (image data and image information) from the image sensor 13 and can perform preprocessing such as white balance correction, gamma correction, and scratch correction. The resolution adjustment unit 33 can perform processing for converting the RGB signal in the pre-processed image information into a YC signal, and can perform processing for adjusting the resolution such as aperture correction. The pixel number conversion unit 35 can perform signal processing for converting the number of pixels of the image signal. The pixel number conversion unit 35 can electronically enlarge or reduce the image information by performing interpolation or thinning between pixels, thereby realizing an electronic change in imaging magnification (electronic zoom function). it can.

  The image compression unit 37 can compress image information in accordance with, for example, the JPEG method. The image information is not limited to the JPEG method, and may be compressed according to another method such as TIFF. The image information compressed by the image compression unit 37 can be stored in the recording medium 55. The display control unit 39 controls image display on the liquid crystal display element. The range of the recording medium 55 includes memory, HDD (hard disk drive), and the like. The memory is, for example, a nonvolatile memory such as a flash memory, and can be configured by a RAM, a rewritable ROM, or the like. The recording medium 55 may be a portable recording medium that is detachable from the imaging apparatus 100, such as an SD card (registered trademark), a compact flash (registered trademark), or the like.

  Note that the image processing unit 30 may use the recording medium 55 as a work area, and may use the storage unit 50 such as the buffer memory 57 and the recording medium 55 as a work area such as the processing unit 40. The recording medium 55 is a medium that can be read by a computer (the image processing unit 30 and the processing unit 40 in a narrow sense), and the storage unit 50 such as the recording medium 55 can store programs and data, and can be rewritten. An optical disc (CD, DVD) may be used. The image processing unit 30 and the processing unit 40 (the imaging device 100 in a broad sense) may perform various processes based on a program (data) stored in the storage unit 50 such as the recording medium 55. That is, the recording medium 55 stores a program for causing a computer (for example, an apparatus including the image processing unit 30, the processing unit 40, and the storage unit 50) to function (a program for causing the computer to execute processing of each unit). Also good.

  In the example of FIG. 6, the preprocessing unit 31, the resolution adjustment unit 33, the pixel number conversion unit 35, the image compression unit 37, and the display control unit 39 access the buffer memory 57 via the memory interface 43, and before each process. Data reading and data writing after each process can be performed as appropriate. The processing unit 40 can control the preprocessing unit 31, the resolution adjustment unit 33, the pixel number conversion unit 35, the image compression unit 37, and the display control unit 39, and can instruct image signal processing and the like. Further, the processing unit 40 can control the operation of the optical system by supervising the control of the optical zoom control unit 17, the AE control unit 19, and the AF control unit 21. The processing unit 40 can manage the control of the image sensor driving unit 23 and execute control such as all pixel readout or thinning readout of the output signal (image information) of the image sensor 13.

  In the example of FIG. 6, the imaging device 100 can include a second imaging unit 49. In order to detect the distance between the photographer and the imaging apparatus 100, the second imaging unit 49 can acquire image information (second image information) representing the photographer (for example, a face). The processing unit 40 (for example, the first detection unit 41 in FIG. 1) performs, for example, face detection using the second image information representing the photographer, and determines between the photographer and the imaging apparatus 100 based on the size of the face. The distance between them can be detected (converted).

  In addition, although description of the detailed structure of the 2nd imaging part 49 is abbreviate | omitted, the structure which is the same as that of all or one part of the imaging part 10 and the image process part 30, or similar can be provided. In addition, the imaging device 100 or the second imaging unit 49 may have a configuration that is the same as or similar to the configuration of all or part of the control unit 20.

  In the example of FIG. 6, when the imaging device 100 is moved in the front-rear direction (optical axis direction), the distance between the photographer and the imaging device 100 changes, and the processing unit 40 (for example, the determination unit 48 in FIG. 1) The imaging magnification may be determined based on the distance between the photographer and the imaging device 100. The imaging magnification change (zoom operation) can be realized using at least one of the optical zoom control unit 17 and the pixel number conversion unit 35. However, if the processing unit 40 (for example, the determination unit 48 in FIG. 1) only determines the imaging magnification according to the distance between the photographer and the imaging device 100, it is possible to accurately follow the photographer's intuitive intention. difficult. Therefore, in the example of FIG. 6, the imaging apparatus 100 implements the functions of the second detection unit 44 and the determination unit 46 of FIG. 1, for example, in the processing unit 40 to realize a zoom operation in accordance with the photographer's intention. be able to.

  In the example of FIG. 6, the processing unit 40 (for example, the second detection unit 44 of FIG. 1) can detect (calculate) the change rate of the face size using, for example, the result of face detection. Next, the processing unit 40 (for example, the determination unit 46 in FIG. 1) determines which zone of at least three zones the face size change rate belongs to. Next, the processing unit 40 (for example, the determination unit 48 in FIG. 1) determines the imaging magnification according to the distance between the photographer and the imaging device 100 in consideration of the determination result (zone). It is possible to suppress unnecessary zoom operations that do not match the user's intention.

  FIG. 7 shows a schematic configuration example of the processing unit 40 of FIG. The processing unit 40 illustrated in FIG. 7 can perform various processes, and FIG. 7 illustrates a schematic configuration example that realizes a representative process. Further, the same components as those in the above-described configuration example are denoted by the same reference numerals, description of coincident points is omitted, and differences will be described below. In the example of FIG. 7, the processing unit 40 (the imaging device 100 in a broad sense) performs the third detection for detecting the operation amount (shooting magnification information in a broad sense) of the operation unit 25 (for example, the zoom lever 25 b in FIG. 6). Part 51 is included. The determination unit 48 can determine the imaging magnification based on the operation amount of the operation unit 25. Further, the determination unit 48 can ignore the operation amount of the operation unit 25 and determine the imaging magnification based on the second image information (imaging magnification information in a broad sense) from the second imaging unit 49. Furthermore, the determination unit 48 can prioritize changing the imaging magnification (zoom operation) by the operation unit 25. Note that the second detection unit 44 can use the result of face detection by the first detection unit 41 (for example, the size of the photographer's face).

2.2. Operation FIG. 8 and FIG. 9 are flowcharts illustrating an operation example of the imaging apparatus 100 of FIG. Each figure represents a part of a flowchart. Hereinafter, the change of the imaging magnification (zoom operation) will be described.

  For example, when the imaging apparatus 100 is powered on, the imaging apparatus 100 (for example, the processing unit 40) sets an initial value of the imaging magnification (Step S101). The initial value can be set to the maximum wide angle value of the imaging unit 10, for example. The initial value may be set to a value set in advance by the photographer. The initial value can be stored in the storage unit 50, for example.

  In the example of FIG. 8, the processing unit 40 (for example, the third detection unit 51 of FIG. 7) detects whether or not the photographer is operating the zoom lever 25b. If the operation signal from the zoom lever 25b satisfies the first reference, the angle of view can be adjusted, for example, to the telephoto side so as to increase the imaging magnification. Also, if the operation signal from the zoom lever 25b satisfies the second reference, the angle of view can be adjusted to, for example, the wide angle (Wide) side so as to reduce the imaging magnification.

  When the photographer is operating the zoom lever 25b, the processing unit 40 (for example, the third detection unit 51 in FIG. 7) detects the operation amount from the zoom lever 25b, and the processing unit 40 (for example, FIG. 7). The determining unit 48) determines (calculates) an imaging magnification based on the detected operation amount (third imaging magnification information) (step S301).

  In the example of step S301 in FIG. 8, the amount of change in imaging magnification is calculated as a method for determining the imaging magnification. The amount of change in the imaging magnification can be determined relatively, and the imaging magnification is determined (changed) based on the set magnification (for example, the maximum wide angle value set as the initial value). Can do. As a method for determining the imaging magnification, a target value for the imaging magnification may be calculated. As the target value of the imaging magnification, the imaging magnification may be determined absolutely, or the imaging magnification may be determined (changed) according to the operation position from the zoom lever 25b.

  In the example of step S303 in FIG. 8, the processing unit 40 (for example, the determination unit 48 in FIG. 7) performs zoom processing according to the calculated change amount of the imaging magnification (determined imaging magnification in a broad sense). Specifically, the determination unit 48 determines the imaging magnification at least one of an optical magnification and an electronic magnification. The determination unit 48 can instruct the control unit 20 in FIG. 7 (in a narrow sense, the optical zoom control unit 17 in FIG. 6) to change the optical magnification, for example. Further, for example, it is possible to instruct the image processing unit 30 in FIG. 7 (in a narrow sense, the pixel number conversion unit 35 in FIG. 6) to change the electronic magnification.

  In the example of step S305 in FIG. 8, the processing unit 40 (for example, the third detection unit 51 in FIG. 7) detects whether the photographer is operating the zoom lever 25b. For example, while the zoom lever 25b is continuously set to the telephoto (Tele) side, the processing unit 40 controls at least one of the control unit 20 and the image processing unit 30 so as to continuously increase the imaging magnification (step S301). -Step S305).

  In the example of step S109 in FIG. 8, the processing unit 40 (for example, the first detection unit 41 in FIG. 7) detects the photographer's face. Further, in the example of step S110 in FIG. 8, the processing unit 40 (for example, the first detection unit 41 in FIG. 7) determines whether or not a face having a size equal to or larger than the reference value has been detected. If a face larger than the reference value can be detected, step S111 and the like can be executed. In addition, the first detection unit 41 can detect the moving distance (imaging magnification information in a broad sense) of the imaging apparatus 100 based on the size of the photographer's face, for example, in step S508 of FIG.

  In the example of step S111 in FIG. 8, the processing unit 40 (for example, the second detection unit 44 in FIG. 7) stores the history of the face size of the photographer in, for example, the buffer memory 57 (storage unit 50 in a broad sense). Remember. When storing the size of the photographer's face, for example, the original image information corresponding to the size (second image information representing the photographer) can be associated with the time when the image was captured. Note that, in the case where a face larger than the reference value cannot be detected in step S110 in FIG. 8, storing the photographer's face size can be omitted. However, even when a face larger than the reference value cannot be detected, step S110 and step S111 in FIG. 8 may be modified to store the photographer's face size as, for example, zero. .

  In the example of step S <b> 112 of FIG. 8, the processing unit 40 (for example, the second detection unit 44 of FIG. 7) refers to the photographer's face size history stored in the storage unit 50. At this time, the second detection unit 44 may refer to the entire history, or may refer to only a part of the history (a given period τ, a given number of samples n). For example, the second detection unit 44 detects the second time (for example, the second image) from the first time (for example, the imaging time t1 returned by the given period τ from the latest imaging time tn of the second image information). Refer to (acquire) the size of the face up to the latest imaging time tn of information. Note that the second detection unit 44 may refer to (acquire), for example, the latest 11 face sizes (a given number of samples n = 11). The change rate of the photographer's face size can be obtained by referring to the photographer's face size history stored in the storage unit 50 (step S504 in FIG. 9).

In the example of step S501 in FIG. 9, the processing unit 40 (for example, the second detection unit 44 in FIG. 7) obtains a fitting curve of the photographer's face size history stored in the storage unit 50. For example, the change in the size of the photographer's face during a given period τ can be approximated by a fitting curve. Such a fitting process can be performed by, for example, the least square method, and the fitting curve is expressed by, for example, a quadratic function. When the vertical axis of the fitting curve is y and the horizontal axis is x, the fitting curve can be expressed as y = a · x ² + b · x + c. Here, a represents the coefficient of the second-order term, b represents the coefficient of the first-order term, and c represents the intercept (y coordinate of the point where the fitting curve intersects the vertical axis).

  FIG. 10 shows a calculation example of the fitting curve. In the example of FIG. 10, the fitting curve indicated by the dotted line is a quadratic function in which the history of the photographer's face size is represented by the least square method. In the example of FIG. 10, 11 samples in a given period τ including the current time tn are employed. In the example of FIG. 10, the fitting curve represents 11 samples with high accuracy.

  However, when the photographer's face size fluctuates drastically, the fitting accuracy deteriorates. Such a situation corresponds to, for example, when the number of times the photographer's face is detected is small in a given period τ. In other words, such a situation corresponds to, for example, when the photographer is not looking at the imaging device 100 (second imaging unit 49), and the history of the photographer's face size is not valid. Even in such a situation, since a fitting curve can be obtained, unnecessary zoom operations that do not match the photographer's intention can be suppressed in steps S502 and S503 in FIG.

  On the other hand, when the accuracy of the fitting is good, the zone determination can be performed based on the change history of the photographer's face size in step S504 in FIG. Even if the accuracy of the fitting is good as a result of the zone determination, an unnecessary zoom operation that does not match the photographer's intention can be suppressed in steps S504 and S503 in FIG.

  In the example of step S502 of FIG. 9, the processing unit 40 (for example, the determination unit 46 of FIG. 7) can determine whether the accuracy of curve fitting as shown in FIG. 10 is poor. Specifically, the determination unit 46 determines whether or not the standard error of the coefficient a of the quadratic term of the quadratic function indicating the fitting curve is larger than a given value. When determining the fitting curve, the standard error of a can also be determined, and the given value can be set to E shown below, for example.

E = (A2-A1) / 2 (Formula 1)
A1 = e / τ (Formula 2)
A2 = b / τ (Formula 3)
Here, e represents, for example, the accuracy of face detection, and is a face size [pixel] that can change with changes in facial expression, for example, even when neither the imaging apparatus 100 nor the photographer is moving. In addition, b is a boundary (for example, a boundary between when the photographer moves the imaging device 100 quickly and when the photographer slowly moves the imaging device 100) in a given period τ (sampling period). The amount of change [pixel] in the size of the face when the imaging apparatus 100 is moved at a speed of.

  If the standard error of the coefficient a of the quadratic term of the quadratic function indicating the fitting curve is larger than E shown in Equation 1, for example, it can be considered that the fitting accuracy is poor. That is, the processing unit 40 (for example, the determination unit 46 in FIG. 7) can generate a determination result indicating that the movement of the photographer's face (movement of the imaging device) always belongs to the first zone. Further, when the standard error of the coefficient a of the quadratic term of the quadratic function indicating the fitting curve is equal to or less than E represented by Equation 1, for example, it can be considered that the fitting accuracy is good. Thereafter, step S504 of FIG. 9 is performed, and the processing unit 40 (for example, the determination unit 46 of FIG. 7) determines which of the first to third zones the movement of the photographer's face (movement of the imaging device) is. A determination result indicating whether it belongs to a zone can be generated.

In the example of step S503 in FIG. 9, the processing unit 40 (for example, the determination unit 48 in FIG. 7) sets the threshold T to the maximum value T2 (second threshold in a broad sense) according to the determination result (first zone). ) Can be set. The threshold T is an index indicating permission or non-permission of change (determination) of the imaging magnification. As the threshold value T is larger, the imaging magnification is less likely to change. The maximum value T2 can be set as follows, for example.
T2 = A2 (Formula 4)

  In the example of step S504 in FIG. 9, the processing unit 40 (for example, the second detection unit 44 and the determination unit 46 in FIG. 7) evaluates the fitting curve. Specifically, the second detection unit 44 detects (calculates) the slope of the fitting curve at the latest imaging time tn (given time in a broad sense) as the change rate of the face size. The slope of the fitting curve is, for example, the slope of a tangent line (tangent line that touches the fitting curve at the latest imaging time tn) as shown in FIG.

  When the absolute value of the tangent slope A is smaller than A1 (first reference value in a broad sense) expressed by Expression 2, the determination unit 46 determines that the movement of the photographer's face (movement of the imaging device) is the first. A determination result indicating belonging to a zone can be generated (step S504). Such a situation corresponds to, for example, a case where a conspicuous tendency is not seen in the face size change. In other words, such a situation corresponds to, for example, when the detection accuracy of the face is slightly exceeded or when shooting is performed in the state of camera shake. In step S504 and step S503 in FIG. 9, such an unnecessary zoom operation can be suppressed.

When the absolute value of the tangent slope A is equal to or greater than A1 and equal to or less than A2 (second reference value in a broad sense) expressed by Equation 3, the determination unit 46 determines the movement of the photographer's face (imaging device Can be generated (step S504). Such a situation corresponds to, for example, when the photographer is slowly moving the imaging apparatus 100. In the example of step S505 in FIG. 9, the processing unit 40 (for example, the determination unit 48 in FIG. 7) sets the threshold T to a value calculated by the following equation, for example, according to the determination result (second zone). be able to.
T = (T2−T1) cos [π (| A | −A1) / 2 (A2−A1)] + T1 (Formula 5)
Here, T1 is the minimum value of the threshold value (first threshold value in a broad sense), and can be set as follows, for example.
T1 = 0 (Formula 6)

  When the absolute value of the tangent slope A is larger than A2, the determination unit 46 can generate a determination result indicating that the movement of the photographer's face (movement of the imaging device) belongs to the third zone ( Step S504). Such a situation corresponds to, for example, when the photographer moves the imaging apparatus 100 quickly. In the example of step S506 in FIG. 9, the processing unit 40 (for example, the determination unit 48 in FIG. 7) can set the minimum value T1 according to the determination result (third zone). As the threshold value T is smaller, the imaging magnification is more likely to change.

  The processing unit 40 (for example, the determination unit 48 in FIG. 7) considers the determination result of the determination unit 46 (movement of the imaging device 100 in a broad sense) in step S507, and in step S508, the face moving distance (from the photographer) Distance from the imaging device 100) can be considered.

  In the example of step S507 in FIG. 9, the determination unit 48 determines whether or not the change in the size of the photographer's face is equal to or greater than the threshold T set in any of step S503, step S505, or step S506. . The variation in the size of the face can be set, for example, as a difference between the size of the face at the latest imaging time tn and the size of the face at the previous imaging time tn. If the change in the size of the photographer's face is greater than or equal to the threshold value T, step S508 and step S509 are performed.

  In the example of step S508 in FIG. 9, the determination unit 48 calculates the change amount of the imaging magnification from the face moving distance. Next, in step S509, the determination unit 48 performs zoom processing as in step S303. Note that the size of the face can be converted into a moving distance of the face (or a distance between the photographer and the imaging device 100) by a known technique. When the power of the imaging apparatus 100 is turned off in step S130 or the zoom operation function is turned off by the operation unit 25, the zoom operation can be terminated.

  FIG. 11 shows an example of setting a threshold for fluctuations in the size of the photographer's face. In the example of FIG. 11, the first to sixth zones can be set not by the absolute value of the tangent slope A relating to the fitting curve but by the tangential slope A itself relating to the fitting curve. When the zone determination is performed using the absolute value of the tangent slope A related to the fitting curve, the fourth to sixth zones can be changed to the first to third zones, respectively. If the fitting accuracy is poor, the threshold T can be set to T2 as in the first zone or the fourth zone.

  In the setting example of the threshold T shown in FIG. 11, when the rate of change in the size of the photographer's face (inclination A in the narrow sense, motion information in the broad sense) belongs to the third zone (or the sixth zone), The determination unit 48 determines the imaging magnification when the variation in the size of the photographer's face (imaging magnification information in a broad sense) exceeds a minimum threshold value T1 (first threshold in a broad sense). When the motion information belongs to the second zone (or the fifth zone), the determination unit 48 determines that the change in the shooting magnification information is between the first threshold value (T1) and the second threshold value (T2). The imaging magnification is determined when the third threshold value (T3) is exceeded. Further, when the motion information belongs to the first zone (or the fourth zone), the determination unit 48 determines the imaging magnification when the variation of the imaging magnification information exceeds the second threshold (T2). In addition, when the standard error of the coefficient a of the quadratic term of the quadratic function representing the fitting curve is larger than a given value (E), the determination unit 48 determines that the variation in the photographing magnification information is the second threshold ( When T2) is exceeded, the imaging magnification is determined.

2.3. Modification FIG. 12 shows a modification of the imaging apparatus of FIG. Further, the same components as those in the above-described configuration example are denoted by the same reference numerals, description of coincident points is omitted, and differences will be described below. In the example of FIG. 12, the imaging apparatus 100 can include a motion sensor 47 instead of the second imaging unit 49. Further, a memory 59 (storage unit 50 in a broad sense) is represented as a work area of the processing unit 40.

  The motion sensor 47 can be composed of an acceleration sensor, for example, and can output acceleration data. The processing unit 40 (for example, the first detection unit 41 in FIG. 2) receives this data, calculates the moving direction and moving amount of the imaging device 100, and detects the distance between the photographer and the imaging device 100 ( Conversion).

  The motion sensor 47 may be a combination of an acceleration sensor and a gyro sensor. The motion sensor 47 includes an acceleration sensor, a gyro sensor, a geomagnetic sensor, a pressure sensor (for example, an atmospheric pressure sensor, a water pressure sensor, etc.), an active sensor (for example, an infrared range sensor, an ultrasonic range sensor, etc.) and a position detection sensor (for example). For example, it may be at least one of GPS, a mobile phone network, a wireless network sensor such as RFID). The motion sensor 47 may be attached to the photographer's wrist or the like.

  13 and 14 are flowcharts illustrating an example of the operation of the imaging apparatus in FIG. Further, the same components as those in the above-described configuration example are denoted by the same reference numerals, description of coincident points is omitted, and differences will be described below.

  The processing unit 40 (for example, the first detection unit 41 in FIG. 2) is acceleration data from the motion sensor 47 (in a narrow sense, acceleration data in the optical axis direction of the imaging device 100 or the imaging unit 10, in a broad sense, a sensor). Based on the information, the moving distance of the imaging device 100 (the distance between the photographer and the imaging device 100) can be calculated (steps S209 and S210 in FIG. 13). For example, the moving distance of the imaging apparatus 100 can be calculated by integrating acceleration. The processing unit 40 (for example, the second detection unit 44 in FIG. 2) stores a history of the moving distance of the imaging device 100 in a given period τ in the memory 59 (the storage unit 50 in a broad sense), and stores the history. The change rate of the moving distance of the imaging apparatus 100 can be calculated with reference (steps S211 and S212 in FIG. 13).

When the processing unit 40 (for example, the second detection unit 44 in FIG. 2) performs step S501 in FIG. 14, step S502 in FIG. 9 can be omitted and step 403 in FIG. 14 can be performed. When the threshold value T is set to T2 in step S404 of FIG. 14, for example, Expression 4 and Expression 7 can be used for T2.
T2 = A2 (Formula 4)
A2 = b ′ / τ (Expression 7)
Here, b ′ is a boundary (for example, when the photographer quickly moves the imaging apparatus 100 and when the photographer slowly moves the imaging apparatus 100 in a given period τ (sampling period)). The change amount [mm] of the moving distance of the image pickup apparatus 100 when the image pickup apparatus 100 is moved at the boundary) speed.

When the threshold value T is set to T1 in step S406 of FIG. 14, for example, Expression 8 and Expression 9 can be used for T1.
T1 = A1 (Formula 8)
A1 = e ′ / τ (Equation 9)
Here, e ′ represents the accuracy of position detection, for example, and is the moving distance [mm] of the imaging apparatus 100 that can change with fluctuations in acceleration data, for example, even when both the imaging apparatus 100 and the photographer are not moving. is there.

In step S405 in FIG. 14, the threshold value T can be set to the value calculated by, for example, Expression 5, and Expressions 4 and 8 are used for T2 and T1.
T = (T2−T1) cos [π (| A | −A1) / 2 (A2−A1)] + T1 (Formula 5)

  Steps S407 to S409 in FIG. 14 are performed using the moving distance of the imaging apparatus 100. Note that the distance between the photographer and the imaging device 100 changes even if the moving distance of the imaging device 100 changes or the moving distance of the photographer's face changes.

  FIG. 15 shows an example of setting a threshold for fluctuations in the moving distance of the imaging apparatus. In the example of FIG. 15, since T1 is not set to zero in Expression 8, it is difficult to change the imaging magnification in the third zone (or the sixth zone) as compared to the example of FIG. However, the example of FIG. 15 may be changed to set T1 to zero. Further, the example of FIG. 11 may be changed to set T1 to a given value. In addition, the threshold value T may be set to T2 when the example of FIG. 14 is changed (addition of the determination as in step S502 of FIG. 9) and the fitting accuracy is poor. Further, the example of FIG. 9 may be changed (step S502 of FIG. 9 is omitted).

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Further, the configuration and operation of imaging are not limited to those described in the present embodiment, and various modifications can be made.

10 imaging unit (first imaging unit), 11 optical element, 11a, 11b, 11d lens,
11c Aperture mechanism, 13 imaging device, 17 optical zoom control unit, 19 AE control unit,
20 control unit, 21 AF control unit, 23 image sensor driving unit, 25 operation unit,
25a Shutter button, 25b Zoom lever, 25c Mode selection section, 29 Display section,
30 image processing unit, 31 preprocessing unit, 33 resolution adjustment unit, 35 pixel number conversion unit,
37 image compression unit, 39 display control unit, 40 processing unit, 41 first detection unit,
43 memory interface, 44 second detection unit, 46 determination unit, 48 determination unit,
49 second imaging unit, 50 storage unit, 51 third detection unit, 55 recording medium,
57 buffer memory, 59 memory, 100 imaging device

Claims (8)

An imaging unit for imaging a subject and acquiring first image information;
A first detector for detecting photographing magnification information based on at least one of second image information representing a photographer and sensor information from a motion sensor;
A second detection unit for detecting motion information representing the motion of the imaging device;
A plurality of threshold values are set corresponding to a plurality of zones divided for each size of the motion information, and one of the plurality of threshold values set in one of the plurality of zones to which the motion information belongs and the motion A determination unit that compares and determines the size of the information;
A determination unit that determines an imaging magnification based on the imaging magnification information when the motion information exceeds one of the plurality of threshold values;
An imaging apparatus comprising: In claim 1,
The determination unit includes a first zone when the motion information is smaller than a first reference value, and a second zone when the motion information is greater than or equal to the first reference value and less than or equal to a second reference value. And at least three zones including the third zone when the motion information is greater than the second reference value, and the at least one threshold is the A first threshold value set in a third zone, a second threshold value set in the first zone and larger than the first threshold value, set in the second zone, and the first threshold value. And a third threshold value between the second threshold value and
When the motion information belongs to the third zone, the determination unit determines the imaging magnification when the motion information exceeds the first threshold,
When the motion information belongs to the second zone, the determination unit executes the determination of the imaging magnification when the motion information exceeds the third threshold,
When the motion information belongs to the first zone, the determination unit determines the imaging magnification when the motion information exceeds the second threshold. In claim 2,
The third threshold value is a value that changes in a range between the first threshold value and the second threshold value, corresponding to the magnitude of the motion information in the second zone. An imaging device that is characterized. In any one of Claims 1 thru | or 3,
The imaging apparatus is characterized in that the photographing magnification information is a distance between the photographer and the imaging apparatus. In any one of Claims 1 thru | or 4,
The imaging device, wherein the second detection unit detects the motion information based on at least one of the second image information and the sensor information. In claim 2,
The image pickup apparatus, wherein the second detection unit detects a change rate of the photographing magnification information as the motion information. In claim 6,
A storage unit for storing a history of the shooting magnification information,
In addition,
The imaging apparatus, wherein the second detection unit obtains the history fitting curve and obtains a slope of the fitting curve at a given time as a change rate of the photographing magnification information. In claim 7,
The fitting curve is represented by a quadratic function by the least square method,
When the standard error of the coefficient of the quadratic term of the quadratic function is larger than a given value, the determination unit performs the determination of the imaging magnification when the inclination exceeds the second threshold value. An imaging device that is characterized.

Images