JP2019075653A - Imaging apparatus - Google Patents

Abstract

To reduce power consumption during the recording operation of a moving image or during the display operation of the moving image.SOLUTION: An imaging apparatus has an image pick-up device for imaging a subject and generating image data, multiple data processing parts where power consumption is different when processing the image data generated by the image pick-up device, a selection part for selecting a specific data processing part, out of the multiple data processing parts, on the basis of selection momentum during the moving image recording or display operation, and an operation control section for controlling the specific data processing part, selected by the selection part, to activation state, and controlling the data processing parts, other than the specific data processing part, to deactivation state.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an imaging device.

  The prior art controls power supply to each processing block according to the operation mode to reduce power consumption (see, for example, Patent Document 1 below). However, the related art reduces power consumption by shutting off the power supply to circuits that are not used. Therefore, the power reduction during the monitoring operation and the power reduction during the moving image recording are insufficient.

JP, 2009-232003, A

  An imaging device disclosed as one aspect in the present invention includes an imaging element that images a subject and generates image data, and a plurality of data processing units having different power consumption when data processing image data generated by the imaging element. And a selection unit for selecting a specific data processing unit among the plurality of data processing units based on a selection opportunity during recording or display of a moving image, and a specific data processing unit selected by the selection unit. And an operation control unit configured to control to an activated state and control other data processing units other than the specific data processing unit among the plurality of data processing units to a deactivated state.

FIG. 1 is a cross-sectional view showing a schematic configuration example of an imaging device. FIG. 2 is a block diagram showing an example of the block configuration of the imaging apparatus. FIG. 3 is an explanatory view showing an example of the activated state and the deactivated state. FIG. 4 is an explanatory view showing the relationship between the demosaicing process and the line memory. FIG. 5 is an explanatory view showing a selection example of the demosaicing process on image data for one frame including the partial enlarged display area. FIG. 6 is a flowchart of a selection control process procedure example 1 of the demosaicing process performed by the imaging apparatus. FIG. 7 is a flowchart illustrating selection control processing procedure example 2 of the demosaicing processing by the imaging device.

<Schematic Configuration Example of Imaging Device>
FIG. 1 is a cross-sectional view showing a schematic configuration example of an imaging device. The imaging device 100 has at least a camera body 102 of the lens unit 101 and the camera body 102. The lens unit 101 is an interchangeable lens that can be attached to and detached from the camera body 102. The imaging device 100 may be an integral type in which the lens unit 101 and the camera body 102 can not be attached and detached.

  The lens unit 101 includes an imaging optical system 111, a stop 112, a drive control unit 113, and a lens side mount unit 114. The imaging optical system 111 includes a lens 111a, a zooming lens 111b, and a focusing lens 111c. The stop 112 is disposed along the optical axis 103 of the imaging optical system 111.

  The stop 112 forms an opening having a variable opening diameter at the center of the optical axis 103 for adjusting the light amount and the blur amount. The lens side mount unit 114 is detachable from the body side mount unit 124. The lens side mount portion 114 has an electrical contact 115. The electrical contact 115 is electrically connected to the drive control unit 113. By mounting the lens side mount portion 114 and the body side mount portion 124, the electrical contact 115 is electrically connected to the electrical contact 125 of the camera body 102.

  The drive control unit 113 includes an unshown lens processor, a memory, and a drive control circuit, and drives and controls the imaging optical system 111. Specifically, for example, the drive control unit 113 is electrically connected to the system control unit 129 on the camera body 102 side via the electrical contacts 115 and 125.

  The drive control unit 113 transmits lens information to the system control unit 129, and transmits and receives control information to and from the system control unit 129. The lens information is information on the optical characteristics of the imaging optical system 111. The control information is information for driving the zooming lens 111b, the focusing lens 111c, and the diaphragm 112.

  The processor in the drive control unit 113 performs driving based on control information (for example, a lens drive command for focusing) transmitted from the system control unit 129 in the camera body 102 in order to adjust the focus of the imaging optical system 111. The drive control circuit in the control unit 113 executes drive control of the focusing lens 111 c.

  The processor of the drive control unit 113 performs zooming on the drive control circuit in the drive control unit 113 based on control information (for example, lens drive command for zooming) transmitted from the system control unit 129 in order to perform zooming adjustment. The drive control of the lens 111b is executed. The processor of the drive control unit 113 controls the drive of the diaphragm 112 based on the control information (for example, the diaphragm drive command) transmitted from the system control unit 129 in the camera body 102 in order to adjust the aperture diameter of the diaphragm 112. It makes the drive control circuit in the drive control unit 113 execute.

  The camera body 102 includes a release button (also referred to as a shutter button) 120, a shutter 121, a finder 122, an operation unit 123, a body side mount unit 124, an electrical contact 125, a display device 126, and an imaging device 127. , An image processing unit 128, a system control unit 129, a recording medium 130, and a battery 131.

  The release button 120 is a device for controlling the opening and closing of the shutter 121. Release button 120 is, for example, a two-step depression type. When the release button 120 is pressed halfway, the shutter 121 is released, and the autofocus and the exposure meter operate. When the release button 120 is further pressed to be fully pressed, the shutter 121 is closed.

  The shutter 121 is provided in front of the imaging device 127, emits subject light to the imaging device 127 at the time of opening, and shields the object light at the time of closing. The shutter 121 may be provided to the lens unit 101.

  The finder 122 is a display device capable of viewing a subject image. When the finder 122 is an optical finder, the user can observe the subject image obtained from the lens unit 101 from the finder 122. When the finder 122 is an electronic finder, the user can view, from the finder 122, a subject image obtained by image processing of the RAW data from the imaging device 127 by the image processing unit 128.

  The operation unit 123 is a physical device such as a button, a switch, or a dial for performing various operations on the imaging apparatus 100. The operation unit 123 may be a touch panel.

  The body side mount portion 124 is removable from the lens side mount portion 114. The body side mount portion 124 has an electrical contact 125. By mounting the lens side mount portion 114 and the body side mount portion 124, the electrical contact 125 is electrically connected to the electrical contact 115 of the lens portion 101.

  The display device 126 is an image (including a still image, a moving image, and a live view image) obtained by performing image processing on the RAW data from the image sensor 127 by the image processing unit 128, the lens information described above, and icons and text information related to shooting. It is a device to display.

  The imaging element 127 receives a light flux (a light flux in an imaging field of view) emitted from the imaging optical system 111 of the lens unit 101. The imaging element 127 has each pixel that outputs a pixel signal for generating an image. Each pixel photoelectrically converts the incident light flux to generate a pixel signal. The imaging device 127 outputs RAW data composed of pixel signals of the respective pixels to the image processing unit 128. RAW data is also an example of image data.

  The image processing unit 128 performs image processing on the RAW data from the imaging element 127, and outputs the image data (for example, JPEG format) subjected to the image processing to the display device 126 and the recording medium 130. When the finder 122 is an electronic finder, the image processing unit 128 reduces the image of the subject and outputs the image to the finder 122. Details of the image processing unit 128 will be described with reference to FIG.

  The system control unit 129 generally controls the imaging device 100. Specifically, for example, the system control unit 129 controls the imaging device 100 in accordance with control instructions from the drive control unit 113, the release button 120, the operation unit 123, and the battery 131.

  The recording medium 130 is detachable from the camera body 102 and records image data. The recording medium 130 may be incorporated in the camera body 102.

  The battery 131 supplies power to each unit in the imaging device 100. The battery 131 may be detachable or built-in. Although power is supplied to only the image processing unit 128 in FIG. 1 for simplification, power is also supplied to the system control unit 129, the imaging device 127, the finder 122, the display device 126, and the recording medium 130.

<Example of Block Configuration of Imaging Device 100>
FIG. 2 is a block diagram showing an example of the block configuration of the imaging device 100. As shown in FIG. In the present embodiment, the imaging apparatus 100 degrades the quality of the demosaicing process during the recording operation of the moving image or the display operation of the image. During the moving image recording operation is a period in which a time-series frame group (image data group) obtained from the imaging device 127 is recorded on the recording medium 130. During image display operation is a period in which an image of a time-series frame group (image data group) obtained from the imaging device 127 is displayed on the display device 126 (or an electronic finder).

  Specifically, the imaging device 100 selects a demosaic processing unit with low quality in the demosaicing processing among the first demosaicing processing unit 203 and the second demosaicing processing unit 204. The low-quality demosaicing unit consumes less power because the circuit scale is smaller than that of the high-quality demosaicing unit.

  Therefore, power consumption is suppressed. Hereinafter, the first demosaicing unit 203 is a high quality (that is, high power consumption) data processing unit, and the second demosaicing unit 204 is a lower quality than the first demosaicing unit 203 (that is, the first demosaicing unit 203). Each block will be described in detail as a data processing unit with lower power consumption).

  The system control unit 129 has a detection unit 200. The detection unit 200 detects a selection opportunity during recording of a moving image on the recording medium 130 or display of an image (including a still image, a moving image, and a live view image) on the display device 126. The selection opportunity is a trigger for reducing the quality of the demosaicing process, that is, reducing the power consumption. A specific example of the selection trigger will be described later.

  The image processing unit 128 includes an image preprocessing unit 201, a selection unit 202, a first demosaicing unit 203, a second demosaicing unit 204, a line memory 205, an operation control unit 206, and an image post-processing unit 207. And. Selection unit 202 includes a switching unit 231 and a determination unit 232. The operation control unit 206 includes a power control unit 261 and a signal control unit 262.

  Specifically, each block (except for the line memory 205) in the detection unit 200 and the image processing unit 128 may be realized by hardware by designing as an integrated circuit, for example. It may be realized in software by interpreting and executing a program for realizing.

  The image preprocessing unit 201 preprocesses the RAW data from the imaging device 127. Specifically, for example, the image preprocessing unit 201 adjusts sensitivity of R (red), G (green), B (blue) of RAW data, white balance adjustment, noise removal, and generation of evaluation value for auto focus. Run.

  The selection unit 202 selects a specific data processing unit among the plurality of data processing units based on a selection opportunity during recording or display of a moving image. Specifically, for example, during data processing of image data of a certain frame, a specific data processing unit is selected and switched. Here, the specific data processing unit is the data processing unit with the lowest quality (low power consumption) among the plurality of data processing units, and is the second demosaicing processing unit 204 in the above-described example. Specifically, for example, the selection unit 202 includes a switching unit 231 and a determination unit 232.

  The switching unit 231 switches output of image data to any one data processing unit among the plurality of data processing units. The switching unit 231 is a switching circuit, and switches the output path of the image data from the image preprocessing unit 201 to the data processing unit that is the output destination instructed by the switching instruction from the determining unit 232.

  The determination unit 232 determines a specific data processing unit as an output destination of the image data based on the selection opportunity. Then, the selection unit 202 gives a switching instruction for setting the specific data processing unit as the output destination to the switching unit 231, and controls the switching unit 231 to switch to the data processing unit that becomes the output destination instructed by the switching instruction.

  The selection unit 202 does not switch the switching unit 231 when the specific data processing unit determined by the determination unit 232 is a data processing unit in an activated state, that is, a data processing unit currently in operation. Specifically, for example, in the case where the specific data processing unit is the second demosaicing unit 204 currently in operation, there is no need to switch the switching unit 231, so there is no switching. As a result, switching trial of the switching unit 231 can be suppressed, and power consumption can be reduced.

  The first demosaicing unit 203 and the second demosaicing unit 204 both perform demosaicing. As described above, the first demosaicing unit 203 is a high quality (that is, high power consumption) data processing unit, and the second demosaicing unit 204 has a lower quality than the first demosaicing unit 203 (that is, the first demosaicing unit 203). The data processing unit consumes less power than the demosaicing unit 203.

  As compared with the second demosaicing unit 204, the first demosaicing unit 203 uses a larger number of peripheral pixels for color interpolation, and hence the amount of calculation increases. For this reason, the first demosaic processing unit 203 has a circuit scale such as a flip flop larger than that of the second demosaic processing unit 204, and power consumption is increased more than that of the second demosaic processing unit 204. In this example, the first demosaicing unit 203 and the second demosaicing unit 204 are exemplified as the plurality of data processing units, but three or more demosaicing units having different power consumption may be used. .

  The operation control unit 206 controls the specific data processing unit selected by the selection unit 202 to an activated state, and deactivates other data processing units other than the specific data processing unit among the plurality of data processing units. Control. In the above example, since the specific data processing unit is the second demosaicing unit 204, the second demosaicing unit 204 is activated, and the first demosaicing unit 203, which is another data processing unit, is deactivated. It becomes a state.

  FIG. 3 is an explanatory view showing an example of the activated state and the deactivated state. Although the first demosaicing unit 203 is described as an example in FIG. 3, the second demosaicing unit 204 is the same. The activation state is a state in which demosaicing can be performed by receiving image data, and specifically, for example, a state in which power is supplied (power supply ON), and a clock signal is supplied. A state (clock signal ON) or a state in which a data signal of image data is not suppressed, that is, a state in which a suppression control signal is not supplied (a suppression control signal OFF).

  On the other hand, the inactive state is a state in which demosaicing can not be performed even if image data is given, and more specifically, for example, a state where power is not supplied (power supply OFF), clock signal A state where it is not supplied (clock signal OFF) or a state where a data signal of image data is suppressed, that is, a state where a suppression control signal is supplied (a suppression control signal ON).

  The suppression of image data is a state in which the data signal of the image data is reset. Specifically, for example, the suppression circuit 300 provided in the previous stage of the flip flop circuit FF suppresses the transition of the data signal when the suppression control signal is input from the selection unit 202, and outputs the suppressed data signal to the FF. Output. On the other hand, when the suppression control signal is not input, the suppression circuit 300 outputs the data signal to the flip flop circuit FF as it is without suppressing the transition of the data signal.

  Returning to FIG. 2, the operation control unit 206 includes a power control unit 261 and a signal control unit 262. The power control unit 261 controls power supply from the battery 131 to the first demosaicing unit 203 and the second demosaicing unit 204. Specifically, for example, in the above-described example, the power control unit 261 supplies power to a specific data processing unit (second demosaicing unit 204), and to another data processing unit (first demosaicing unit 203). Turn off the power supply.

  The signal control unit 262 controls clock signals or inhibition control signals to the first demosaicing unit 203 and the second demosaicing unit 204. Specifically, for example, in the above example, the signal control unit 262 supplies a clock signal to a specific data processing unit (second demosaicing unit 204), and the other data processing unit (first demosaicing unit 203). Stop the supply of the clock signal to Alternatively, in the above example, the signal control unit 262 stops the supply of the inhibition control signal to the specific data processing unit (second demosaicing unit 204), and to the other data processing unit (first demosaicing unit 203). Supply the suppression control signal of

  In the operation control unit 206, which one of the operation control of the power supply, the clock signal supply, and the supply of the suppression control signal is to be applied depends on the user setting when designing the imaging device 100 or after shipping the imaging device 100. You should decide.

  When the power control unit 261 is used, power consumption can be suppressed more than the signal control unit 262. On the other hand, when the suppression control signal is used in the signal control unit 262, the power and clock signal are supplied to any of the demosaicing units, so the recovery operation after the cancellation of the suppression control is the power control unit 261 or the clock signal control Faster than in the case. In addition, when the clock signal is used in the signal control unit 262, the supply of the clock signal is stopped, so power consumption is reduced compared to the suppression control, and power is supplied. Therefore, the recovery operation after the clock signal is supplied Is faster than in the case of power control.

  In addition, the operation control unit 206 may mount both the power control unit 261 and the signal control unit 262, or one of them. Further, the signal control unit 262 may mount at least one of supply control of a clock signal and supply control of a suppression control signal.

  The line memory 205 is formed of, for example, a static random access memory (SRAM), and is used as a work area of the first demosaicing unit 203. Although the second demosaicing unit 204 is not connected to the line memory 205 in FIG. 2, the second demosaicing unit 204 may also use the line memory 205.

  FIG. 4 is an explanatory view showing the relationship between the demosaicing process and the line memory 205. As shown in FIG. In (A), the first demosaicing unit 203 can access the first line memory 251, and the second demosaicing unit 204 can access the second line memory 252 having a smaller memory capacity than the first line memory 251. Example.

  (B) is an example in which the first demosaicing unit 203 and the second demosaicing unit 204 are connected to the line memory 205. In this case, the first demosaicing unit 203 can access the first memory area 271, and the second demosaicing unit 204 can access the second memory area 272, which has a smaller memory capacity than the first memory area 271. is there.

  Returning to FIG. 2, the image post-processing unit 207 executes post-processing such as aberration correction, up-sampling processing, hand-shake correction, and face recognition processing of the demosaiced image data. The face recognition process may be performed by the image preprocessing unit 201 or may be performed in parallel with the demosaicing process.

  Next, the relationship between the selection trigger and the operation control during the operation of recording or displaying a moving image will be specifically enumerated and described.

(1) Selection opportunity: Sensitivity of the imaging device 127 (for example, ISO sensitivity) becomes higher than the sensitivity threshold value by setting from the operation unit 123 or automatic setting by the system control unit 129, It is assumed that the detection unit 200 detects a selection. The image quality of the image when the sensitivity is higher than the sensitivity threshold is worse than the image quality of the image whose sensitivity is below the sensitivity threshold.

  Therefore, the selection trigger is that the sensitivity (for example, ISO sensitivity) of the imaging element 127 has become higher than the sensitivity threshold. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects that the sensitivity (for example, ISO sensitivity) of the image sensor 127 has become equal to or less than the sensitivity threshold value, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed. Ru.

(2) Selection trigger: Aperture value Detection that the aperture value of the imaging optical system 111 for passing light from the subject has become equal to or less than a predetermined aperture value by setting from the operation unit 123 or automatic setting by the system control unit 129 This is a selection opportunity detected by the unit 200. When the f-number is equal to or less than the predetermined f-number (closer to the open position), the depth of field becomes shallow and there is a high possibility that many regions out of focus are included. There is a high possibility that high-quality demosaicing will be wasted on a subject with many areas out of focus.

  Therefore, it is selected that the aperture value has become equal to or less than the predetermined aperture value. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects that the aperture value has become larger than the predetermined aperture value, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

(3) Selection opportunity: Start of focusing operation Selection in which the detection unit 200 detects the start of focusing operation on an object by half-depression of the release button 120 or automatic setting by the system control unit 129 (for example, self timer shooting) It will be an opportunity. At the stage of starting the focusing operation on the subject, since the subject is not in focus, it is useless to perform high-quality demosaicing processing on the out-of-focus subject.

  Therefore, the start of the focusing operation on the subject is used as a selection opportunity. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects focusing after the start of the focusing operation, the first demosaicing processing unit 203 is selected, and high-quality demosaicing processing is performed.

(4) Selection Trigger: Display Resolution of Display Device 126 The detection unit 200 detects that the display resolution of the display device 126 has become equal to or lower than a predetermined resolution by setting from the operation unit 123 or automatic setting by the system control unit 129. Use as a selection opportunity. When the display resolution becomes lower than a predetermined resolution, it is useless to perform high-quality demosaicing. Therefore, it is selected that the display resolution is less than the predetermined resolution. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed.

  When the detection unit 200 detects that the display resolution is higher than the predetermined resolution, the first demosaicing unit 203 is selected, and high-quality demosaicing is performed. In addition, when the resolution of the display device 126 and the electronic finder 122 are different, and the resolution of one of them (for example, the electronic finder 122) is relatively low, for example, the user's face approaches the electronic finder 122. Even when the display destination is switched from the display device 126 to the electronic finder 122, it may be used as a selection trigger to be detected by the detection unit 200.

(5) Selection opportunity: Frame rate A selection opportunity for the detection unit 200 to detect that the frame rate of the display device 126 has become equal to or higher than a predetermined frame rate by setting from the operation unit 123 or automatic setting by the system control unit 129. Do. When the frame rate becomes equal to or higher than the predetermined frame rate, the number of frames in the time direction becomes larger than the number of frames in the case of less than the predetermined frame rate. There is no problem if it is lowered.

  Therefore, it is selected that the frame rate has reached a predetermined frame rate or more. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects that the frame rate has become less than the predetermined frame rate, the first demosaicing unit 203 is selected, and high-quality demosaicing is performed.

(6) Selection opportunity: Reduced display The detection unit 200 detects that the enlarged display in at least a partial area of the display screen of the display device 126 is ended by the setting from the operation unit 123 or the automatic setting by the system control unit 129. As a selection opportunity. When the enlargement display ends, that is, when the enlargement display is reduced, there is no problem in reducing the quality of the image after reduction. Therefore, the end of the enlarged display is used as a selection opportunity. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects the start of the enlarged display, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

  In the above description, when the magnification is larger than 1 is referred to as enlargement display, and when the magnification is less than 1 is referred to as reduction display based on the same magnification (1 magnification) display in which neither enlargement nor reduction is performed. For example, if the magnification is greater than 1 ×, the first demosaicing unit 203 is selected. If the magnification is 1 ×, the second demosaicing unit 204 is selected. If the magnification is less than 1 ×, the first demosaicing unit is not shown. The third demosaicing unit (a lower quality and lower power consumption than the second demosaicing unit 204) is selected.

  In addition, if the magnification after the end of enlargement is relatively smaller than the magnification before detection of the end of enlargement by the detection unit 200, it may be considered as a selection trigger as the reduction display. In addition, if the magnification after the end of reduction is relatively larger than the magnification before detection of the end of reduced display by the detection unit 200, the first demosaicing processing unit 203 may be selected as a selection trigger as the enlarged display. .

(7) Selection Opportunity: Remaining Battery Level It is assumed that the detection unit 200 detects that the battery remaining level of the battery 131 has become equal to or less than a predetermined remaining level. When the battery remaining amount becomes less than a predetermined remaining amount, it is necessary to suppress power consumption as much as possible. Therefore, it is selected that the battery remaining amount becomes less than the predetermined remaining amount. As a result, since the second demosaicing unit 204 is selected, the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects that the battery remaining amount exceeds the predetermined remaining amount due to charging of the battery 131 or replacement of the battery 131, the first demosaicing processing unit 203 is selected, and high-quality demosaicing processing is performed. Is executed.

(8) Selection Trigger: Saturation of Image Data The detection unit 200 detects that the image data has a saturated area, for example, that a predetermined number or more of pixel groups adjacent to each other have become saturated. Use as a selection opportunity. For example, if the saturation of a specific color is too high in a certain area in the image data and the tone difference is within the predetermined value, the image is saturated. It is wasteful to do high quality demosaicing in the saturated state.

  Therefore, the second demosaicing processing unit 204 is selected by using the presence of the region in which the image data is saturated as a selection trigger, so that the quality of the demosaicing processing is reduced and the power consumption is suppressed. In addition, when the detection unit 200 detects that there is no saturated region in the image data, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

(9) Selection Opportunity: Camera Shake Amount The camera shake amount of the imaging device 100 is equal to or greater than a predetermined camera shake amount as a selection trigger detected by the detection unit 200. When the shake amount becomes equal to or more than the predetermined shake amount, the quality of the display image is deteriorated due to the influence of the shake. Therefore, there is no problem even if the image quality is reduced compared to the case of less than the predetermined shake amount. Therefore, the second demosaicing processing unit 204 is selected by selecting that the amount of camera shake has become equal to or more than a predetermined amount of camera shake, so the quality of the demosaicing process is reduced and power consumption is suppressed. When the detection unit 200 detects that the shake amount has become less than the predetermined shake amount, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

(10) Selection Trigger: Specific Object The detection trigger 200 detects the absence of a specific object in image data as a selection trigger. Here, the specific object is, for example, the face of a person. The face of the person is recognized by the face recognition process of the image processing unit 128. When a template of a specific object (a registered specific face, a building, an animal, or the like) is prepared in advance in the imaging device 100, the object corresponds to the template. If a specific object does not exist, this is useless image data for the user who was trying to shoot the specific object.

  Therefore, the second demosaicing processing unit 204 is selected by selecting that there is no specific object in the image data, so the quality of the demosaicing process is reduced and the power consumption is suppressed. When the detection unit 200 detects that a specific object is present in the image data, the first demosaicing unit 203 is selected, and high-quality demosaicing is performed.

(11) Selection opportunity: Release button 120
The fact that the operation period of the release button 120 is out is used as a selection trigger for the detection unit 200 to detect. The operation period of the release button 120 is a period from half depression of the release button 120 (the autofocus and the exposure meter are activated) to full depression (the shutter 121 is released). Outside the operation period of the release button 120, the live view image is displayed on the display device 126, and the quality of the demosaicing processing is lower than that of the image data acquired by the operation of the release button 120.

  Therefore, the second demosaicing processing unit 204 is selected by selecting that the operation period of the release button 120 is outside, thereby reducing the quality of the demosaicing process and suppressing the power consumption. When the detection unit 200 detects that it is the operation period of the release button 120, the first demosaicing unit 203 is selected, and high-quality demosaicing is performed.

(12) Selection Opportunity: Lens Drive Driving of a lens that allows light from an object to pass is used as a selection opportunity to be detected by the detection unit 200. Specifically, the driving of the lens here is, for example, driving of the focusing lens 111c. Since the subject is not in focus during driving of the focusing lens 111c, there is no problem even if the quality of the demosaicing process is low.

  Therefore, the second demosaicing unit 204 is selected by using the drive of the lens that transmits the light from the subject as a selection opportunity, so that the quality of the demosaicing process is reduced and the power consumption is suppressed. When the detection unit 200 detects the stop of driving the lens that passes light from the subject, the first demosaicing processing unit 203 is selected as performing focusing on the subject, and high-quality demosaicing processing is performed.

  (12) During display operation of a moving image on the display device 126, the presence of a specific object in the display screen of the display device 126 is set as a selection trigger for the detection unit 200 to detect. The specific object in the display screen is, for example, a menu display that can be input by the operation unit 123, a grid display for shooting, and a level display. Specific objects in the display screen may be displayed superimposed on part of the live view image or on the live view image. If the specific object in the display screen exists, the user tends to focus on the specific object in the display screen rather than the live view image, so the low quality of the demosaicing does not matter.

  Therefore, the second demosaicing processing unit 204 is selected by selecting the presence of a specific object in the display screen of the display device 126, so the quality of the demosaicing process is reduced, and the power consumption is suppressed. . When the detection unit 200 detects that the specific object in the display screen of the display device 126 does not exist, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

(13) Partial Enlarged Display on Display Screen of Display Device 126 The detection unit 200 detects that there is no partial enlarged display area on the display screen of the display device 126 during display operation of a moving image on the display device 126. As a selection opportunity. The partial enlarged display area is an area which is partially enlarged and displayed by the operation of the operation unit 123 in the display area which is the entire display screen. For example, when the user wants to adjust the focus on a certain area in the display area, the area is partially enlarged. The partially enlarged display area is the same area in successive frames.

  In this case, the imaging apparatus 100 holds the partial enlarged display area in the preceding frame of the current frame in time, makes the demosaicing processing in the partial enlarged display area in the current frame high quality, and the partial enlarged display area Reduce the quality of the demosaicing of the outer area. More specifically, when image data is demosaiced line by line, the first demosaicing process is selected in a section of a partial enlarged display area in a certain line, and the second demosaicing process is selected in a section outside the partial enlarged display area. It is selected.

  FIG. 5 is an explanatory view showing a selection example of the demosaicing process on image data for one frame including the partial enlarged display area. A frame 500 to be a display area has a partially enlarged display area 501 defined by the preceding frame. Here, it is assumed that the demosaicing processing is performed in order of pixels in the scanning direction for each line. The pixel columns of sections A and C of a certain line L are included in the non-partial enlarged display area (a display area of equal magnification) 502, and the pixel columns of section B of line L are included in the partial enlarged display area 501. Since the section A is the non-partial enlarged display area 502, the detection unit 200 detects the leading pixel e1 of the section A as a selection trigger for selecting the second demosaicing processing unit 204, and the selecting unit 202 detects the leading pixel in the section A. A demosaicing process is executed by the second demosaicing unit 204 from e1.

  Next, when the demosaicing processing of the end pixel e2 of the section A is completed, the detection unit 200 detects the first pixel e3 of the section B as a selection trigger for selecting the first demosaicing processing section 203, and the selection unit 202 At the first pixel e3, the first demosaicing unit 203 executes the demosaicing process.

  Next, when the demosaicing processing of the end pixel e4 of the section B is completed, the detection unit 200 detects the top pixel e5 of the section C as a selection trigger for selecting the first demosaicing processing section 203, and the selection section 202 detects the section C. At the second pixel demosaicing unit 204, demosaicing processing is performed from the first pixel e5.

  Since the user pays attention to the partially enlarged display area 501, there is no problem even if the non-partially enlarged display area 502 has a low quality. As a result, since the second demosaicing processing unit 204 is selected in the non-partial enlarged display area 502, the quality of the demosaicing process is lowered and power consumption is suppressed, and the partial enlarged display area 501 is smaller than the non-partial enlarged display area 502. Demosaicing is of high quality. Note that the development result of the area smaller by one turn (for a predetermined number of pixels) than the partial enlarged display area 501 may be enlarged and displayed by the demosaicing process.

(14) Selection Trigger: Aberration Correction Amount of Lens The detection unit 200 detects that the aberration correction amount of the lens unit 101 which passes light from the subject is equal to or more than a predetermined aberration correction amount. When the aberration correction amount becomes equal to or more than the predetermined aberration correction amount, the deterioration of the image quality becomes large according to the aberration correction amount. For this reason, when the amount of aberration correction becomes equal to or more than the predetermined amount of aberration correction, if the demosaicing processing is performed with low quality, deterioration in image quality due to aberration correction may not be noticeable to the user.

  Therefore, the second demosaicing processing unit 204 is selected by selecting that the aberration correction amount has become equal to or more than the predetermined aberration correction amount, so that the quality of the demosaicing process is reduced and the power consumption is suppressed. When the detection unit 200 detects that the aberration correction amount is less than the predetermined aberration correction amount, the first demosaicing unit 203 is selected, and high-quality demosaicing processing is performed.

(15) Selection Trigger: Self-Timer Operation The detection unit 200 detects a detection timer 200 as a selection trigger during operation of a self-timer that captures an image of the subject and acquires image data when a predetermined time has elapsed. While the live view image may be displayed during the operation of the self-timer, there is no problem even if the quality of the demosaicing process is low because there are few people viewing the live view image.

  Therefore, since the second demosaicing processing unit 204 is selected by using the operation of the self timer as a selection trigger, the quality of the demosaicing process is lowered and the power consumption is suppressed. In addition, when the detection unit 200 detects the end time of the operation of the self-timer, since the photographing (acquisition of image data) is performed, the first demosaicing processing unit 203 is selected, and high-quality demosaicing processing is performed.

  When the selection opportunity for reducing the power consumption and the selection opportunity for increasing the power consumption conflict, the second demosaicing processing unit 204 may be selected with priority given to the selection opportunity for reducing the power consumption. In this case, the selection opportunity (for example, the remaining amount of the battery in the above (7)) is set in advance in the determination unit 232 to lower the power consumption, which is prioritized when competing with the selection opportunity to increase the power consumption. While the second demosaicing unit 204 is performing demosaicing by a selection opportunity to lower the power consumption, the selection unit 202 performs a selection opportunity to increase power consumption even if the detection unit 200 detects a selection opportunity to increase power consumption. Do not select. Thereby, the demosaicing process can be executed with priority given to low power consumption.

<Example of selection control processing procedure for demosaicing>
FIG. 6 is a flowchart of a selection control process procedure example 1 of the demosaicing process by the imaging apparatus 100. FIG. 6 shows a selection control process of switching the demosaicing unit during the demosaicing process of one frame. Here, as an example, the output destination to which the switching unit 231 is connected in the initial state is the first demosaicing unit 203. Further, although FIG. 6 describes the case where the clock supply control of the signal control unit 262 is applied as the operation control unit 206, the same applies to the case where the suppression control signal or the power supply control by the power control unit 261 is applied.

  First, the image processing unit 128 inputs RAW data for one frame from the imaging device 127 (step S601). The image processing unit 128 causes the image preprocessing unit 201 to perform image preprocessing on the input RAW data, and outputs the image data subjected to the image preprocessing to the switching unit 231 by a predetermined number of lines (for example, one line). (Step S602).

  Next, the system control unit 129 determines whether the detection unit 200 has detected a selection opportunity to reduce the power consumption of (1) to (15) described above (step S603). When not detecting (step S603: No), it transfers to step S609. On the other hand, when it is detected (step S603: Yes), the image processing unit 128 determines the specific demosaicing unit as the output destination of the image data from the image preprocessing unit 201 by the determination unit 232 in the selection unit 202. (Step S604).

  Then, the image processing unit 128 causes the selection unit 202 to determine whether switching of the switching unit 231 is necessary (step S605). That is, the selection unit 202 determines whether the demosaicing unit in the current operation state is different from the specific demosaicing unit determined this time. If they are different, switching is necessary, and if they are identical, switching is not necessary.

  When switching is unnecessary (step S605: No), it transfers to step S609. On the other hand, when the switching is necessary (Step S605: Yes), the selecting unit 202 causes the switching unit 231 to switch the output destination of the switching unit 231 to a specific demosaicing unit (for example, the second demosaicing unit 204). (Step S606).

  Then, the image processing unit 128 causes the signal control unit 262 in the operation control unit 206 to start supplying a clock signal to a specific demosaicing unit (step S 607), and performs demosaicing other than the specific demosaicing unit The supply of the clock signal to the unit (for example, the first demosaicing unit 203) is stopped (step S608), and the demosaicing process is performed by the specific demosaicing unit (step S609). As a result, power consumption can be reduced as compared with the case where the other demosaicing unit performs the demosaicing process.

  Thereafter, the image processing unit 128 causes the image post-processing unit 207 to execute image post-processing (step S610), and outputs a display image to the display device 126 using the image data after the image post-processing (step S611). When the moving image is being recorded, the image processing unit 128 records the image data after the image post-processing on the recording medium 130 (step S611). Thus, the processing for one frame is completed (step S612).

  As described above, according to the selection control processing procedure example 1, the specific demosaicing processing unit with low power consumption is brought into the operation state according to the selection opportunity during moving image recording or live view image display, and the power consumption is higher. In order to put the other demosaicing unit in the inactive state, it is possible to reduce the power consumption during the recording operation of the moving image or the display operation of the image.

  FIG. 7 is a flowchart illustrating selection control processing procedure example 2 of the demosaicing processing by the imaging device 100. FIG. 7 shows selection control processing for switching the demosaicing unit for the frame obtained next from the imaging device 127 during the demosaicing processing of one frame. As a result, the quality of the demosaicing process can be switched on a frame-by-frame basis, so that it is possible to suppress the mixture of the processing result of high quality demosaicing processing and the processing result of low quality demosaicing processing in one frame.

  As in FIG. 6, as an example, the output destination to which the switching unit 231 is connected in the initial state is the first demosaicing unit 203. Further, as in the case of FIG. 6, the case where clock supply control of the signal control unit 262 is applied as the operation control unit 206 will be described, but the same applies to the case where power supply control by the suppression control signal or the power control unit 261 is applied. The same step number is assigned to the same process as the process used in FIG. 6, and the description thereof is omitted.

  When it is determined in step S605 that switching is necessary (step S605: Yes), the image processing unit 128 sets the switching reservation flag F to F = 1 (step S701). The switching reservation flag F is a flag for reserving switching of the switching unit 231 for the next frame. F = 1 indicates that there is a reservation, and F = 0 indicates that there is no reservation.

  After setting the switching reservation flag F to F = 1 (step S 701), the image processing unit 128 executes steps S 609 to S 611 and then refers to the switching reservation flag F after completion of output or recording for one frame. Then, it is determined whether or not the switching reservation flag F is F = 1 (step S702). When the switching reservation flag F is not F = 1 (step S702: No), the process proceeds to step S613. On the other hand, when the switching reservation flag F is F = 1 (step S702: Yes), the image processing unit 128 causes the signal control unit 262 in the operation control unit 206 to select a specific demosaicing unit for the next frame. The supply of the clock signal to the memory is started (step S607).

  Further, the image processing unit 128 causes the selection unit 202 to switch the switching unit 231 so that the output destination of the switching unit 231 becomes a specific demosaicing unit (for example, the second demosaicing unit 204). Are reset (F = 0) (step S703). Then, in the image processing unit 128, since the other demosaicing units other than the specific demosaicing unit do not operate in the next frame, the other demosaicing units other than the specific demosaicing unit (for example, the first demosaicing unit 203) Stop the supply of the clock signal to (1) (step S608). Then, the processing for one frame ends (step S612). As a result, power consumption can be reduced during a moving image recording operation or an image display operation, as compared to the case where another demosaicing processing unit performs the demosaicing processing.

  In this way, during the input of a frame, it is determined in advance whether or not the demosaicing unit is switched in the next frame, and after the end of the image processing of the frame, the demosaicing is performed before the image processing of the next frame. Selection control (steps S607, S703, and S608) is executed. Therefore, the quality of demosaicing can be switched in frame units, and in one frame, the mixture of the processing result of high quality demosaicing and the processing result of low quality demosaicing can be suppressed. Thus, for example, high quality images will not contain low quality processing results. Therefore, it is possible to achieve both reduction in power consumption and maintenance of a high quality image during the recording operation of the moving image or the display operation of the image.

  Although the above-described imaging device 100 has been described by taking a digital camera (including an interchangeable lens single-lens reflex camera, an interchangeable lens mirrorless camera, a compact digital camera, and a digital video camera) as an example, a smartphone having a camera The present invention is also applicable to a tablet, a drone, a drive recorder of a vehicle, and a surveillance camera.

  When a part or all of the processing of the imaging apparatus 100 described above is realized by software, the program stored in the download server is downloaded to the imaging apparatus 100, and the processor in the imaging apparatus 100 executes the downloaded program. It is also good.

Reference Signs List 100 imaging apparatus, 101 lens unit, 102 camera body, 111 imaging optical system, 111 lens unit 101 imaging optical system, 113 drive control unit, 120 release button, 121 shutter, 122 finder, 123 operation unit, 126 display device, 127 imaging Element, 128 image processing unit, 129 system control unit, 130 recording medium, 131 battery, 200 detection unit, 201 image preprocessing unit, 202 selection unit, 203 first demosaicing unit, 204 second demosaicing unit, 205 line memory , 206 operation control unit, 207 image post-processing unit, 231 switching unit, 232 determination unit, 261 power control unit, 262 signal control unit

Claims (23)

An imaging element that images a subject and generates image data;
A plurality of data processing units having different power consumption when data processing image data generated by the imaging device;
A selection unit that selects a specific data processing unit among the plurality of data processing units based on a selection opportunity during recording or display of a moving image;
An operation of controlling a specific data processing unit selected by the selection unit to an activated state, and controlling another data processing unit other than the specific data processing unit among the plurality of data processing units to a deactivated state A control unit,
An imaging apparatus characterized by having: The imaging apparatus according to claim 1,
The selection unit is
A switching unit configured to switch the image data so as to be outputable to any one of the plurality of data processing units;
The selection unit includes a determination unit that determines the specific data processing unit as an output destination of the image data based on the selection trigger.
An imaging apparatus characterized in that the switching unit is switched such that the specific data processing unit determined by the determination unit becomes an output destination of the image data. The imaging apparatus according to claim 1,
The selection unit is
A switching unit configured to switch the image data so as to be outputable to any one of the plurality of data processing units;
The selection unit has a determination unit that determines the specific data processing unit as an output destination of the next image data output from the imaging device after the output of the image data based on the selection trigger. ,
The switching unit is configured so that the specific data processing unit determined by the determination unit becomes an output destination of the next image data after the data processing unit in the activated state ends data processing on the image data. And an imaging device characterized by switching. An imaging apparatus according to claim 2 or 3, wherein
3. The image pickup apparatus according to claim 1, wherein the selection unit does not switch the switching unit when the particular data processing unit determined by the determination unit is a data processing unit in the activated state. The imaging apparatus according to claim 1,
The operation control unit controls the specific data processing unit to an activated state by supplying an operation clock signal to the specific data processing unit, and does not supply the operation clock signal to the other data processing unit. And controlling the other data processing unit to a non-activated state. The imaging apparatus according to claim 1,
The operation control unit controls the specific data processing unit to an activated state by supplying power to the specific data processing unit, and the other data by not supplying power to the other data processing unit. An imaging apparatus characterized by controlling a processing unit to a non-activated state. The imaging apparatus according to claim 1,
The operation control unit controls the specific data processing unit to an activated state by permitting the input of the image data to the specific data processing unit, and the image data to the other data processing unit An image pickup apparatus characterized in that the other data processing unit is controlled to be in a non-activated state by suppressing the signal transition of The imaging apparatus according to claim 1,
It has a detection part which detects the sensitivity of an image sensor which picturizes the image data as the selection opportunity,
When the sensitivity detected by the detection unit is equal to or higher than a predetermined sensitivity, the selection unit specifies the data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units. An imaging apparatus selected as a data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects the aperture value of the lens which lets the light from the said object pass as said selection opportunity,
The selection unit is a data processing unit that consumes less power than the data processing unit in the activated state among the plurality of data processing units when the aperture value detected by the detection unit is equal to or less than a predetermined aperture value. An image pickup apparatus selected as the specific data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects the start of focusing operation to the subject as the selection trigger,
The selection unit, when the detection unit detects the start of the focusing operation, selects, from among the plurality of data processing units, another data processing unit whose power consumption is lower than that of the data processing unit in the activated state. An imaging apparatus selected as a specific data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects a change indication to the 2nd display device whose display resolution is lower than the 1st display device as the above-mentioned selection opportunity,
The selection unit is configured to perform another data processing that consumes less power than the data processing unit in the activated state among the plurality of data processing units when the switching unit to the second display device is detected by the detection unit. Unit is selected as the specific data processing unit. The imaging apparatus according to claim 1,
And a detection unit that detects a frame rate of the moving image displayed on the display device as the selection trigger,
When the frame rate detected by the detection unit is equal to or higher than a predetermined frame rate, the selection unit is another data processing unit having lower power consumption than the data processing unit in the activated state among the plurality of data processing units. An image pickup apparatus selected as the specific data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects the end of the enlargement display in the field of at least one copy of the display screen of a display device as the selection opportunity,
When the end of the enlarged display is detected by the detection unit, the selection unit selects a data processing unit whose power consumption is lower than that of the activated data processing unit among the plurality of data processing units as the specific data. An imaging apparatus selected as a processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects the battery remaining charge of the above-mentioned imaging device as the above-mentioned selection opportunity,
The selection unit selects a data processing unit having lower power consumption than the data processing unit in the activated state among the plurality of data processing units when the battery remaining amount detected by the detection unit is equal to or less than a predetermined remaining amount. An image pickup apparatus selected as the specific data processing unit. The imaging apparatus according to claim 1,
And a detection unit that detects a saturation state of the image data as the selection trigger.
When the detection unit detects a saturated state of the image data, the selection unit is configured to specify a data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units. An imaging apparatus selected as a data processing unit. The imaging apparatus according to claim 1,
The image capturing apparatus further includes a detection unit that detects a shake amount of the imaging device as the selection trigger.
The selection unit is a data processing unit having lower power consumption than the data processing unit in the activated state among the plurality of data processing units when the camera shake amount detected by the detection unit is equal to or more than a predetermined camera shake amount. An imaging apparatus selected as a specific data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects a specific object from said image data as said selection opportunity,
The selection unit is configured to select a data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units when the specific object is not detected by the detection unit. An imaging apparatus selected as a processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects that it is out of the operation period of the release button as the selection trigger,
The selection unit is a data processing unit that consumes less power than the data processing unit in the activated state among the plurality of data processing units when the detection unit detects that the operation period is outside the operation period of the release button. An image pickup apparatus selected as the specific data processing unit. The imaging apparatus according to claim 1,
And a detection unit configured to detect a drive of a lens that allows light from a subject to pass as the selection trigger,
The selection unit performs the specific data processing on the data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units when the driving of the lens is detected by the detection unit. An image pickup apparatus selected as a unit. The imaging apparatus according to claim 1,
A detection unit configured to detect a specific object in a display screen of the display device as the selection trigger during the operation of displaying the moving image on the display device;
The selection unit performs data processing on the data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units when the specific object is detected by the detection unit. An image pickup apparatus selected as a unit. The imaging apparatus according to claim 1,
A detection unit that detects the presence of a partially enlarged display area in the display screen of the display device during the display operation of a moving image on the display device;
When the partial enlarged display area is detected by the detection unit, the selection unit consumes more than the data processing unit in the activated state among the plurality of data processing units in the display area other than the partial enlarged display area. An image pickup apparatus characterized by selecting a data processing unit with low power as the specific data processing unit. The imaging apparatus according to claim 1,
It has a detection part which detects the amount of aberration corrections of the lens which makes the light from the subject pass as the selection opportunity,
The selection unit is a data processing unit that consumes less power than the data processing unit in the activated state among the plurality of data processing units when the aberration correction amount detected by the detection unit is equal to or greater than a predetermined aberration correction amount. An image pickup apparatus selected as the specific data processing unit. The imaging apparatus according to claim 1,
As a trigger for the selection, the detection unit has a detection unit that detects an operation of a self-timer that images the subject and acquires the image data when a predetermined time has elapsed.
When the detection unit detects that the self-timer is operating, the selection unit is configured to specify a data processing unit whose power consumption is lower than that of the data processing unit in the activated state among the plurality of data processing units. An imaging apparatus selected as a data processing unit.

Images