JP2009081808A - Device, method and program for controlling photographing, and photographing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device, method and program for controlling photographing, and photographing apparatus in which a digital camera is further dounsized by abolishing a mechanical shutter, and a CMOS type image sensor performs sharp photographing. <P>SOLUTION: Upon receipt of a photographing instruction, an image sensor is caused to perform simultaneous shutter-open photographing continuously twice, and a flash is caused to emit flash light while all pixel lines are in an electronic shutter open state during any one of two times of photographing so as to produce a first image signal due to the first time of photographing and a second image signal due to the second time of photographing. A differential for each pixel between the first image signal and the second image signal is determined to produce an image signal representing a subject. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a shooting control device and a shooting control method for controlling shooting in a shooting device, a shooting control program that causes an information processing device to operate as a shooting control device, and a shooting device including the shooting control device.

  Many conventional digital cameras are equipped with a CCD solid-state image sensor as an image sensor. This CCD solid-state imaging device is composed of a plurality of pixel lines. When the electronic shutter is opened, the electronic shutter is opened at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. As for the shutter closing, so-called global shutter photography can be performed in which reading is performed with the same electronic shutter closing timing for the plurality of pixel lines. If global shutter shooting can be performed with the electronic shutter in this manner, shooting similar to that performed by opening and closing the mechanical shutter can be performed, so that the mechanical shutter can be eliminated. If the mechanical shutter can be abolished in this way, it is possible to reduce the size of a digital camera equipped with a CCD solid-state imaging device.

  However, since the CCD solid-state imaging device is provided with a vertical transfer line for each pixel included in each pixel line in order to realize the global shutter photographing, smear is not formed in the vertical transfer line when reading out an image signal. It has the disadvantage that the rate of occurrence is high. If this smear is to be completely prevented, the light receiving surface of the image sensor must be completely shielded using a mechanical shutter, and the digital camera becomes large.

  By the way, recently, considering that the image pickup device and a circuit around the image pickup device are integrated on a single chip, a CMOS type image pickup device has been used. Using this CMOS type image pickup device, the image pickup device, the analog front end at the back of the image pickup device, the digital signal processing unit located at the back of the analog front end, the operation of the image pickup device and the operation of the analog front end All of the photographing control devices including a CPU for controlling the operation of the digital signal processing unit can be configured on one chip, and the digital camera can be further miniaturized.

Furthermore, this CMOS type image sensor has the merit that it is difficult to generate smear because of its structure, so the mechanical shutter can be eliminated.
For this reason, recently, in many cases, a CMOS type image pickup device is mounted on a digital camera instead of the CCD solid-state image pickup device to further reduce the size of the digital camera.

  However, the CMOS image sensor has a drawback that it is not possible to perform global shutter photography using an electronic shutter. In this CMOS image sensor, rolling shutter photography is performed in contrast to the global shutter photography.

  FIG. 1 is a diagram illustrating the rolling shutter shooting operation.

  FIG. 1 shows a pixel configuration of the image sensor, and FIG. 1B shows a shooting operation at the time of rolling shutter shooting. In FIG. 1B, the horizontal axis is time, and the vertical axis is a pixel line.

  As shown in FIG. 1A, the imaging device is composed of a plurality of pixel lines.

  In the CMOS image sensor having the configuration shown in FIG. 1A, an electronic shutter is opened for each pixel line as shown in FIG. 1B, and an electron is output for each pixel line after a predetermined shutter time. Reading is started as the shutter is closed.

  Thus, since reading is sequentially performed for each pixel line, the exposure period is shifted for each line, which makes it difficult to perform photographing with flash light.

  2 and 3 are diagrams for explaining the drawbacks.

  FIG. 2 shows conditions for performing flash photography when rolling shutter photography is being performed. As shown in FIG. 2, when a long shutter time is set during rolling shutter shooting, there is an overlap period between the period of reading the first pixel line and the period of reading the last pixel line. Therefore, when flash light is emitted once by causing an arc tube such as a xenon tube to emit light at a predetermined timing t1 during the overlap period, photographing with flash emission is suitably performed.

  However, as shown in FIG. 3, when the shutter time is short, there is no overlapping exposure period between the first pixel line and the last pixel line, and the flash cannot be emitted. If flash light emission is performed at timing t2 in FIG. 3, a pixel line in which flash light is reflected and a pixel line in which flash light is not reflected are generated.

  For this reason, when the shutter time is short in rolling shutter photography, it is necessary to continually emit flash light in multiple times or to continuously emit flash light during rolling shutter photography using an LED. Comes out.

  However, if the xenon tube continuously emits light, the flash reaches a short distance, and if the flash light is continuously emitted using the LED, the LED power consumption increases. To do.

  Here, the CMOS image pickup device cannot perform global shutter photography with the electronic shutter, but the electronic shutter can be simultaneously opened.

  Therefore, as one means for avoiding the above problem, the electronic shutter is simultaneously opened for opening the shutter, and the shutter is closed with the mechanical shutter for closing the electronic shutter, enabling global shutter photography to perform flash photography. It is conceivable to have a configuration to do.

  FIG. 4 is a diagram for explaining the operation when global shutter photography can be performed using a mechanical shutter.

  As shown in FIG. 4, when the mechanical shutter is opened and the shutter is opened, the charge is reset at the same time and the shutter is simultaneously opened. When the electronic shutter is closed, the mechanical shutter is closed to perform global shutter photography. Can do.

However, as described above, in order to further reduce the size of the digital camera, it is necessary to eliminate the mechanical shutter.
JP 2002-359774 A JP 2002-359774 A

  SUMMARY OF THE INVENTION In view of the above circumstances, the present invention provides an imaging control device that can eliminate a mechanical shutter and further reduce the size of a digital camera and allow a CMOS type imaging device to perform clear imaging, and an imaging control device thereof. It is an object of the present invention to provide a shooting control method to be mounted, a shooting control program for realizing the shooting control method, and a shooting device in which the shooting control device is mounted.

The first imaging control apparatus of the present invention that achieves the above object is constituted by a plurality of pixel lines, and the same operation is performed for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines when the electronic shutter is opened. An image sensor that can perform simultaneous shutter-open shooting that opens the electronic shutter at a timing, and the electronic shutter is closed at different timings for each pixel line and is read at different timings for each pixel line; A shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject,
In response to a shooting instruction, the image sensor is caused to perform two simultaneous shutter-open shootings, and all the pixel lines are opened in the flash in any one of the two shootings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
And subtracting means for generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal.

  The first imaging control apparatus of the present invention is characterized by rolling shutter imaging, and is used for imaging control when, for example, a CMOS image sensor performs global shutter imaging.

  According to the first imaging control device, for example, when the control unit controls the imaging operation of the CMOS image sensor to perform shutter simultaneous opening imaging, the plurality of electronic shutters of the CMOS image sensor are opened. By simultaneously resetting the charges for the pixel lines, the shutters are simultaneously opened for opening the electronic shutter for the plurality of pixel lines at the same timing, and the electronic shutter is closed for reading at different readout timings for each pixel line. In addition, the global shutter is obtained by taking the image twice continuously and subtracting and erasing the state in which the readout timing for closing the electronic shutter is different by the subtracting means, thereby obtaining the same image as that obtained by the global shutter photography. You will be shooting.

  As a result, the imaging control device can cause the CMOS image sensor to perform global shutter imaging even if the mechanical shutter is eliminated.

  In other words, the imaging control means enables the CMOS image sensor to perform global shutter imaging even if the mechanical shutter is abolished. Further, as described above, the control means included in the imaging control means is constituted by a CPU, for example. By configuring the subtracting means with, for example, a conventional digital signal processing unit, the photographing control means can be made into one chip, and the digital camera equipped with the photographing control means can be further miniaturized. It makes it possible.

The second imaging control device of the present invention that achieves the above object is constituted by a plurality of pixel lines. When the electronic shutter is opened, the plurality of pixel lines are simultaneously reset by charge resetting. An image sensor that can perform simultaneous shutter-open shooting that opens the electronic shutter at the same timing, and the electronic shutter is closed at different timings for each pixel line and is read out at different timings for each pixel line. A shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject,
At the time of pre-photographing before the main photographing, the image sensor is made to perform simultaneous shutter-open photographing twice, and all the pixel lines are electronically connected to the flash by any one of the two photographings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while the shutter is open;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation means for
The photographing apparatus includes a main photographing control unit that performs main photographing accompanied by light emission of flash light having a light amount set by the exposure calculating unit.

  The second imaging control device of the present invention is also characterized by rolling shutter imaging, similar to the first imaging control device of the present invention, for example, imaging control when causing a CMOS image sensor to perform global shutter imaging. It is used for.

  According to the second photographing control means of the present invention, after the global shutter photographing is continuously performed twice by the image sensor at the time of pre-photographing under the control of the control means, the exposure calculating means determines the second. The amount of light emission at the time of actual photographing is set by obtaining the difference for each pixel between the first image signal and the second image signal obtained by the number of times of photographing, and the amount of emitted light is set by the photographing control means. The flash light is emitted, and the shutter simultaneous open photographing is performed twice in succession similarly to the first photographing control apparatus of the present invention, and photographing accompanied by the flash light emission is performed. Since the pre-photographing is performed to set the light emission amount at the time of the main photographing, the flash light amount is adjusted more accurately than the first photographing control device and the flash light-emission photographing is performed.

  Also in the second imaging control device, as with the first imaging control device, it is possible to achieve one chip and eliminate the mechanical shutter, and the same effect as in the first invention can be obtained.

The third imaging control device of the present invention that achieves the above object is constituted by a plurality of pixel lines. When the electronic shutter is opened, the plurality of pixel lines are simultaneously reset by charge resetting. It is possible to perform simultaneous shutter-open shooting that opens the electronic shutter at the same timing. Regarding the electronic shutter closing, the timing of closing the electronic shutter is different for each pixel line, and an image sensor that reads at different timing for each pixel line. A shooting control device for controlling shooting in a shooting device including a flash that emits flash light toward a subject,
The image sensor is prohibited from emitting light by the flash and repeats simultaneous shutter-open shooting, and the image sensor is made to perform another simultaneous shutter-open shooting at a predetermined shooting timing, and all pixel lines are opened to the electronic shutter. Control means for generating a first image signal obtained by photographing immediately before the photographing timing and a second image signal obtained by photographing at the photographing timing by emitting flash light during the state of
Subtracting means for generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal is provided.

  The third imaging control device of the present invention is also characterized by rolling shutter imaging, similar to the first imaging control unit of the present invention and the second imaging control unit of the present invention. It is used for shooting control when performing global shutter shooting.

  According to the third photographing control apparatus of the present invention, the control means prohibits light emission by the flash until the photographing timing is reached, and the shutter simultaneous open photographing is continuously performed at a predetermined photographing timing. A first image signal obtained by photographing immediately before the photographing timing and a second image signal obtained by photographing at the photographing timing are generated, and a difference for each pixel of the image signals is obtained to perform photographing accompanied by flash light emission. An image is generated.

  Even with the configuration of the third imaging control device, the same effects as those of the first imaging control device and the second imaging control device can be obtained.

  Here, in the above configuration, since the control unit causes the image sensor to repeatedly perform global shutter shooting until the shooting timing comes after the power switch is turned on, for example, two steps of half pressing and full pressing. When the second photographing control device is mounted on a photographing device provided with a push photographing button, the control means receives the half-pressing operation and prohibits the image sensor from emitting light by the flash. It is preferable that the global shutter photographing be repeated.

The first imaging control method of the present invention that achieves the above object comprises a plurality of pixel lines. When the electronic shutter is opened, the plurality of pixel lines are simultaneously reset by charge resetting. It is possible to perform simultaneous shutter-open shooting that opens the electronic shutter at the same timing. Regarding the electronic shutter closing, the timing of closing the electronic shutter is different for each pixel line, and an image sensor that reads at different timing for each pixel line. A shooting control method for controlling shooting in a shooting apparatus including a flash that emits flash light toward a subject,
In response to a shooting instruction, the image sensor is caused to perform two simultaneous shutter-open shootings, and all the pixel lines are opened in the flash in any one of the two shootings. A control step of generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
A subtracting step of generating an image signal representing a subject by obtaining a difference between each pixel signal of the first image signal and the second image signal,
The second imaging control method of the present invention that achieves the above object is constituted by a plurality of pixel lines, and the electronic shutter is opened for the plurality of pixel lines by performing charge reset simultaneously on the plurality of pixel lines. It is possible to perform simultaneous shutter-open photographing that opens the electronic shutter at the timing. Regarding the electronic shutter closing, the image pickup element that reads out at different timing for each pixel line, and the subject that the electronic shutter closes at different timing for each pixel line, and the subject A shooting control method for controlling shooting in a shooting device including a flash that emits flash light toward
At the time of pre-photographing before the main photographing, the image sensor is made to perform simultaneous shutter-open photographing twice, and all the pixel lines are electronically connected to the flash by any one of the two photographings. A control step of generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while the shutter is open;
The difference between each pixel of the first image signal and the second image signal is obtained, and an image signal representing the subject is generated. Based on the generated image signal, the amount of flash light at the time of actual photographing is set. Exposure calculation step to
A main photographing control step for causing the photographing device to perform a main photographing accompanied by flash light emission of a light amount set by the exposure calculating means,
The third imaging control method of the present invention that achieves the above-described object provides:
Consists of a plurality of pixel lines. With regard to the opening of the electronic shutter, it is possible to perform simultaneous shutter-open photographing with the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. Controls the shooting in an imaging device having an image sensor for reading out at different timing for each pixel line, and a flash for emitting flash light toward the subject. A shooting control method,
The image sensor is prohibited from emitting light by the flash and repeats simultaneous shutter-open shooting, and the image sensor is made to perform another simultaneous shutter-open shooting at a predetermined shooting timing, and all pixel lines are opened to the electronic shutter. A control step for generating a first image signal by photographing completed immediately before the photographing timing and a second image signal by photographing at the photographing timing by emitting flash light while in the state;
And a subtracting step of generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal.

Furthermore, a first shooting control program of the present invention that achieves the above object is executed by an information processing device that executes the program, and the information processing device is configured by a plurality of pixel lines, and the plurality of electronic shutters are opened when the electronic shutter is opened. By simultaneously resetting the charge for each of the pixel lines, it is possible to perform simultaneous shutter-open shooting in which the electronic shutter is opened at the same timing for the plurality of pixel lines. For the electronic shutter closing, the electronic shutter is closed for each pixel line. This is a shooting control program that operates as a shooting control device that controls shooting in a shooting device that includes an image sensor that reads at different timing for each pixel line and a flash that emits flash light toward a subject. ,
The information control device is
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shots. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
Operating as a photographing control device including a subtracting unit that generates an image signal representing a subject by obtaining a difference between each pixel signal of the first image signal and the second image signal;
The second shooting control program of the present invention for achieving the above object is as follows.
The information processing apparatus is executed by an information processing apparatus that executes a program, and the information processing apparatus is configured by a plurality of pixel lines. For the electronic shutter opening, the plurality of pixel lines are the same by performing charge reset simultaneously. It is possible to perform simultaneous shutter-open shooting that opens the electronic shutter at the timing. Regarding the electronic shutter closing, the timing of the electronic shutter closing differs for each pixel line, and the imaging element that reads out at different timing for each pixel line, and the subject A shooting control program that operates as a shooting control device that controls shooting in a shooting device including a flash that emits flash light toward the
The information processing device causes the image sensor to perform shutter simultaneous open shooting twice continuously during pre-shooting before the main shooting, and the flash performs all of the shooting in one of the two shootings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while the pixel line is in the electronic shutter open state;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation means for
The photographing apparatus is operated as a photographing control device including a photographing control unit that performs a photographing with a flash light amount set by the exposure calculating unit.
A third shooting control program of the present invention that achieves the above object provides:
The information processing apparatus is executed by an information processing apparatus that executes a program. The information processing apparatus is configured by a plurality of pixel lines, and the electronic shutter is opened for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. An image pickup device that can perform simultaneous shutter-open shooting that opens the electronic shutter at the timing of, and for electronic shutter closing, the timing of closing the electronic shutter differs for each pixel line, and reading at different timing for each pixel line; A shooting control program that operates as a shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject;
The information processing apparatus is
In response to a shooting instruction, light emission by the flash is prohibited, the image sensor repeatedly performs shutter simultaneous open shooting, and the image sensor performs another shutter simultaneous open shooting at a predetermined shooting timing. Control means for generating flash light while the electronic shutter is open to generate a first image signal obtained by photographing immediately before the photographing timing and a second image signal obtained by photographing at the photographing timing. ,
It is characterized by operating as a photographing control apparatus comprising subtracting means for generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal.

Moreover, the 1st imaging device of this invention which achieves the said objective is as follows.
In a photographing device that forms an image of a subject on an image sensor with a photographing optical system and generates an image signal representing the subject with the image sensor,
The image pickup device is composed of a plurality of pixel lines, and for the opening of the electronic shutter, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of electronic shutter closing differs for each pixel line, and readout is performed at different timing for each pixel line,
Furthermore, the imaging device
A flash that emits flash light toward the subject,
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shots. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
Subtracting means for generating an image signal representing a subject by obtaining a difference for each pixel of the first image signal and the second image signal;
A second imaging device of the present invention that achieves the above-described object is an imaging device that forms an image of a subject on an imaging element with an imaging optical system and generates an image signal representing the subject with the imaging element.
The image pickup device is composed of a plurality of pixel lines, and for the opening of the electronic shutter, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of electronic shutter closing differs for each pixel line, and readout is performed at different timing for each pixel line,
Furthermore, the imaging device
A flash that emits flash light toward the subject,
At the time of pre-photographing before the main photographing, the image pickup device performs the shutter simultaneous open photographing twice in succession, and all the pixel lines are electronically shuttered in the flash by any one of the two photographings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the open state;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal And an exposure calculation means for
The third imaging device of the present invention that achieves the above object provides:
In a photographing device that forms an image of a subject on an image sensor with a photographing optical system and generates an image signal representing the subject with the image sensor,
The image pickup device is composed of a plurality of pixel lines, and for the opening of the electronic shutter, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of closing the electronic shutter is different for each pixel line, and reading is performed at different timing for each pixel line,
Furthermore, the imaging device
A two-press shooting button with half-press and full-press,
A flash that emits flash light toward the subject,
In response to the half-pressing operation of the shooting button, the flash is prohibited from emitting light and the image sensor repeatedly performs simultaneous shutter-open shooting, and the shutter button is fully pressed to perform simultaneous shutter-open shooting. The first image signal and the full-pressing operation by the photographing that is completed immediately before the full-pressing is performed by causing the flash to emit flash light while all the pixel lines are in the electronic shutter-opening state in the simultaneous shutter-open photographing. Control means for generating a second image signal by the photographing performed in response;
And subtracting means for generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal.

  According to the present invention, the mechanical shutter is abolished to further reduce the size of the digital camera, and the above-described CMOS type image pickup device can be used for clear shooting, and is mounted on the shooting control device. An imaging control method, an imaging control program for realizing the imaging control method, and an imaging apparatus equipped with the imaging control device are realized.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 5 is an external perspective view of the digital camera, which is the first embodiment of the photographing apparatus of the present invention, as seen obliquely from the front top. The digital camera shown in FIG. 5 is mounted with the above-described CMOS image pickup device, and together with the CMOS image pickup device, the image pickup control device according to the present invention is integrated into a single chip and integrated into a single device. It is.

  A digital camera 100 shown in FIG. 5 captures subject light and generates image data. A lens barrel 111 including an optical zoom lens and a flash in synchronization with photographing are provided on the front of the digital camera 100. A flash light emission window 112 for emitting light, an AF auxiliary light lamp 113 for improving autofocus (AF) accuracy at low contrast such as in a dark place, and the like are provided.

  On the top surface of the digital camera 100, a power switch 114, a release button 115, and a rotary mode dial 116 are provided around the release button 115. The mode dial 116 can be switched alternately between the still image mode and the moving image mode by turning the dial. Note that the release button 115 of the present embodiment has two operation modes of half-press and full-press.

  6 is an external view showing the back of the digital camera shown in FIG.

  On the back of the digital camera 100 shown in FIG. 6, an LCD panel 117A, a finder 124, a MENU / OK button 118, a DISP / BACK button 119, a photo mode button 120, a playback button 121, a cross button 122, a zoom button 123, and the like are provided. It has been.

  The LCD panel 117A displays an image composed of image data generated by capturing subject light with a photographing lens and information at various settings.

  The MENU / OK button 118 is a button for displaying various menus at the time of shooting or reproduction on the LCD 117A, or selecting and determining a desired menu from the displayed menus.

  The DISP / BACK button 119 is a button for switching the state of the screen displayed on the LCD panel 117A, returning the operation by the MENU / OK button 118 or the like to the previous state, or canceling the operation.

  The photo mode button 120 is a button for setting the number of pixels, sensitivity, color, number of prints, and the like.

  The reproduction button 121 is a button for reproducing and displaying a captured image recorded on a recording medium 1059 described later on the LCD panel 117.

  The role of the cross button 122 changes in various modes. For example, the cross button 122 is a macro button or a flash button in the still image mode, and a thumbnail selection button displayed on the LCD panel 117A in the playback mode. The macro button is a button for switching whether or not to perform macro shooting. When the macro button is pressed once, the macro shooting mode is set, and when pressed again, the macro shooting mode is canceled. The flash button is a button for sequentially switching the flash state, such as auto flash, red-eye reduction flash, forced flash, flash prohibition, slow shutter flash, and auto flash each time the button is pressed.

  The zoom button 123 is a button for zooming in on the telephoto side (tele side) by pressing down to the right and zooming out on the wide angle side (wide side) by pressing down on the left side.

  Next, the circuit configuration of the digital camera 100 shown in FIGS. 5 and 6 will be described.

FIG. 7 is a block diagram illustrating a circuit configuration of the digital camera 100 illustrated in FIGS. 5 and 6.
As the image sensor 137 of the present embodiment, as described above, a CMOS type image sensor that is integrated with an analog front end is used.

  The digital camera 100 operates by receiving power from the battery BT, and the power from the battery BT is supplied to the power supply unit PS, and power necessary for each circuit in FIG. 7 is supplied from the power supply unit PS. It is configured to be supplied separately. In this way, the operation of the digital camera 100 that operates by receiving power from the battery BT is comprehensively controlled by the CPU 130.

  In the present embodiment, in addition to the CPU 130, another processor (for example, a dedicated processor for image processing) 140 is mounted, and the CPU 130 and the dedicated processor for image processing 140 cooperate to perform the photographing control process of the image sensor 137. It is configured to do. The image processing processor 140 operates according to a program in the main memory MEM.

  7 is provided with a memory control circuit 141, a digital signal processing circuit 142, and a compression / decompression circuit 143. The image processing dedicated processor 140 receives a process start signal from the CPU 130. When received, when displaying a through image, the image signal generated by the image sensor 137 in the memory control circuit 141 is read out sequentially in synchronism with vertical scanning by thinning out pixel lines, and the digital processing circuit 142 performs image processing. In the main image, the memory control circuit 141 reads out all the pixel lines in synchronization with the vertical operation in the memory control circuit 141 and performs image processing in the digital processing circuit 142, and further in the compression / decompression circuit 143. Then, an image processing process called compression processing is executed.

  In this embodiment, as described above, in order to eliminate the mechanical shutter, a CMOS type is adopted, and an analog front end integrated with the CMOS image sensor is adopted. The output of the image sensor 137 is directly connected to the data bus 130C so that the memory control circuit 141 in the image processing dedicated processor 140 can directly access the image sensor. With this configuration, in this embodiment, the CPU 130, the image processing dedicated processor 140, and the image sensor drive unit 1303 including the image sensor 137 can be integrated into one chip.

  Here, with reference to FIG. 7, first, the configuration in the digital camera 100 will be briefly described.

  An operation unit OP is connected to the CPU 130. Within the operation unit OP, the MENU / OK button 118, the DISP / BACK button 119, the photo mode button 120, the playback button 121, the cross button 122, and the zoom shown in FIG. A button 123, a release button 114, and the like are provided.

  The CPU 130 is connected to the image processing dedicated processor 140, the audio processing circuit 160, the media control circuit 150, the display control circuit 1170, the power supply unit PS, and two buses, an address bus 130B and a data bus 130C. Using the address bus 130B of the two buses, the CPU 130B accesses the image processing dedicated processor 140, the media control circuit 150, the display control circuit 1170, etc., or the image processing dedicated processor 140 directly accesses the image sensor. Or Further, the instruction content from the CPU 130 is notified to the image processing dedicated processor 140 or the like via the data bus 130C of the two buses 130B and 130C, and conversely the process progress status from the image processing dedicated processor 140 or the like. Is notified to the CPU 130.

  Here, the configuration and operation of the digital camera 100 that is comprehensively controlled by the CPU 130 will be described with reference to FIG.

  In the photographing optical system 1110 shown in the upper left of FIG. 7, a photographing lens 1111 and a diaphragm 1112 are provided.

  The taking lens 1111 includes a zoom lens and a focus lens. These lenses are driven by a lens driving unit 1301 to move in the optical axis direction, and the operation of the lens driving unit 1301 is controlled by the CPU 130. The diaphragm 1112 is driven by the diaphragm driving unit 1302, and the operation of the diaphragm driving unit 1302 is also controlled by the CPU 130. Further, the image sensor 137 is driven by the image sensor drive unit 1303, and the operation of the image sensor drive unit 1303 is also controlled by the CPU 130. Image data is generated by the image sensor 137 in response to driving by the image sensor drive unit 1303, and the generated image data is sequentially guided to the bus for each pixel line by the memory control circuit 141 at the subsequent stage. In FIG. 7, an infrared cut filter 1113 and an LPF 1114 are inserted in a path for guiding subject light to the image sensor 137.

  Further, a flash FL that emits flash light toward the subject is provided. When the CPU 130 determines that the field brightness is darker than a predetermined brightness, the flash FL is controlled by the CPU 130 to perform flash shooting. Done. In the present embodiment, the CPU 130 constitutes an example of the control means referred to in the present invention.

  Here, the flow of processing of the through image data for displaying on the LCD panel 117A (see FIG. 2) of the LCD 117 a subject captured by the photographing optical system 1110 when the power is turned on will be described.

  The CPU 130 instructs the image sensor driving unit 1303 to drive the image sensor 136 for each pixel line included in the image sensor 137 to perform exposure for each line, and in the image processing processor 140 at the end timing of exposure. The memory control circuit 141 guides the image data onto the data bus 130C. That is, as shown in FIG. 1B, the memory control circuit 141 sequentially reads out image data in the image sensor while thinning out each pixel line.

  The through image data read onto the data bus 130C by the memory control circuit 141 is first supplied to the digital signal processing circuit 142 via the data bus 130C. In the digital signal circuit 142, the live view data is subjected to YC conversion processing after shading correction and the like. The YC conversion process is performed to generate a YC signal from the through image data, and the generated YC signal is supplied to the display control circuit 1170 via the data bus 130C under the control of the CPU 130. A through image based on the YC signal is displayed on 117A.

  On the other hand, the digital signal processing circuit 142 generates a contrast signal using the Y signal from the YC signal. The CPU 130 accesses the image processing dedicated processor 140 using the address bus, acquires the contrast signal and the Y signal from the digital signal processing unit 142 in the image processing dedicated processor 140 using the data bus 130C, and detects the in-focus position. Processing is performed, or photometry processing is performed using the Y signal. The CPU 130 instructs the lens drive unit 1301 to move the focus lens 1111 to the focus position according to the detection result of the focus position, or instructs the aperture drive unit 1302 to change the aperture diameter. Therefore, a through image based on the through image data adjusted to an appropriate exposure at any time is displayed on the LCD panel 117A.

  Here, when the photographer presses the release button 115 (see FIGS. 5 and 6) in the operation unit by referring to the through image on the LCD panel 117A, the CPU 130 receives the pressing operation of the release button 115 and performs the shooting process. Start.

  The CPU 130 instructs the image sensor driving unit 1303 to cause the image sensor 137 to perform rotary shutter photography. At this time, the image processing processor 140 receives the process start signal from the CPU 130, and the memory control circuit 141 in the image processing processor 140 directly accesses the image sensor 137 one after another to read out the image signal and perform digital signal processing. This is supplied to the circuit 141. In the digital signal processing circuit 141, after shading correction is performed, conversion processing to a YC signal is performed. The YC signal generated by the conversion process is supplied to the compression / decompression circuit 142 via the data bus 130C. The compression / decompression circuit 142 compresses the YC signal. The compression information at this time is transmitted to the CPU 130 via the data bus 130C. The YC signal compressed by the compression / decompression circuit 143 is supplied to the media control circuit 150 via the bus 130C, and further compression information is supplied from the CPU to the media control circuit 150 via the data bus 130C. An image file composed of YC signals is recorded on the recording medium 151.

  In this way, photographing processing is performed in cooperation with the internal CPU 130 and the image processing dedicated processor 140.

  Here, flash photography when the field luminance is dark will be described.

  As described above, in the CMOS type imaging device 137 of the present embodiment, since the rotary shutter photographing is performed as described in FIG. 1, when flash light is emitted, the flash light is continuously emitted using the LED. It was impossible to shoot with flash emission unless the light was emitted or the flash light was emitted in multiple times with the arc tube.

  Therefore, in the present embodiment, the photographing control means referred to in the present invention is configured by the CPU 130, the image sensor driving unit 1301, and the image processing dedicated processor 140, and the photographing control means controls the photographing control of the CMOS type image sensor 137. Thus, the image pickup device 137 is devised so that the flash photographing can be performed in the same manner as before by causing the image sensor 137 to perform the simultaneous shutter photographing.

  FIG. 8 is a diagram for explaining shooting control processing at the time of flash shooting performed by the shooting control means according to the present invention, which includes the CPU 130, the image sensor driving unit 1301, and the image processing dedicated processor 140. The horizontal axis in FIG. 8 is time, and the vertical axis is the pixel line of the image sensor.

  As shown in FIG. 8, in the CMOS type image pickup device 137, when the electronic shutter is opened, the shutters are simultaneously opened at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. Since photography is possible, in this embodiment, the CPU 130 instructs the image sensor driving unit 1301 to first open the electronic shutter at the same timing TP.

  Here, in the CMOS type imaging device 137, the electronic shutter closing timing is different for each pixel line after the predetermined shutter speed TS has elapsed, and reading is performed at a different timing for each pixel line. It will be done by all means. In FIG. 8, it is shown by hatching that reading is different.

  Therefore, as shown in FIG. 8, upon receiving a release button shooting instruction, the CPU 130 instructs the image sensor drive unit 1303 to cause the CMOS type image sensor 137 to perform simultaneous shutter-open shooting twice, and also to flash. By causing the FL to emit flash light while all the pixel lines are in the electronic shutter open state (time indicated by reference A in FIG. 8) in any one of the two shootings, A first image signal (IMAGE1) by the second shooting and a second image signal (IMAGE2) by the second shooting are generated, and the first image signal is sent to the digital signal processing circuit 143 in the image signal processor 140. An image signal (horizontal line in the figure) representing a subject is obtained by obtaining a difference (IMAGE1-IMAGE2) for each pixel of the second image signal. And so as to produce the Aru) indicated by etching.

  In this way, as shown in FIG. 8, it is possible to obtain the same image as when the global shutter shooting was performed.

  FIG. 9 is a flowchart illustrating a shooting control method performed in cooperation between the CPU 130 and the image processing dedicated processor 140.

  First, in step S901, the CPU 130 receives a shooting instruction, instructs the image sensor driving unit 1303 to cause the image sensor 137 to perform two simultaneous shutter open shooting, and causes the flash FL to perform the two shooting operations. The flash light is emitted while all the pixel lines are in the electronic shutter open state in any one of the shootings, whereby the first image signal by the first shooting and the second image by the second shooting. Generate a signal.

  In step S902, the image processing dedicated processor 140 sequentially reads out the image signal from the image sensor 137 and obtains an image signal representing the subject by obtaining a difference for each pixel between the first image signal and the second image signal. Generate and end the processing of this flow.

  When the CPU 130 and the image processing processor 140 cooperate to execute the processing of the above flow, the CMOS type image sensor 137 can perform global shutter shooting without a mechanical shutter, and clear flash shooting can be performed. be able to.

  Further, in the present embodiment, as described above, the CPU 130, the image sensor driving unit 1303, and the image processing dedicated processor 140 constitute an example of the imaging control means according to the present invention, and an analog front end is integrated with the image sensor 137. By using the built-in one, the image pickup device 137, the CPU 130, the image pickup device driving unit 1303, and the image processing dedicated processor 140 are integrated into one chip so as to reduce the size of the image pickup control apparatus. That is, with the configuration of FIG. 7, the advantage of using the CMOS image sensor can be maximized to reduce the size of the imaging control device, and further to reduce the size of the digital camera.

  As described above, the mechanical shutter is abolished to further reduce the size of the digital camera, and the imaging control device that can make the CMOS type imaging device perform clear imaging, and the imaging control device are mounted. Realized imaging device.

  FIG. 10 is a diagram showing a configuration when the flash FL of FIG. 3 is changed to a light emitting device FL1 capable of pre-emission. The digital camera shown in FIG. 10 has the appearance of the digital camera shown in FIGS. The configuration of FIG. 10 is the same as that of FIG. 3 except that the flash FL of FIG. 3 is changed to a light emitting device FL1 capable of pre-emission.

  FIG. 11 is a diagram for explaining a flash light emission photographing operation in a case where pre-light emission is performed to obtain a light emission amount at the time of main photographing and photographing at the time of main light emission is performed.

  As shown in FIG. 11, the CPU 130 instructs the image sensor driving unit 1303 to cause the image sensor 137 to perform two simultaneous shutter-open photographing at the time of pre-photographing, and pre-light emission at one pre-photographing time. To calculate the amount of light emitted during the main flash, and simultaneously perform two simultaneous shutter-open shooting during the main shooting, and then use the flash light to emit the flash light during the first shooting. Let it be done.

  In this way, the amount of emitted light is accurately calculated, and shooting with flash emission is performed more clearly.

  FIG. 12 is a diagram for explaining a photographing control process performed by the CPU 130 and the image processing dedicated processor 140 in cooperation with each other in order to realize the operation of FIG.

  In step S1201, during the pre-photographing before the main photographing, the image sensor is made to perform the shutter simultaneous open photographing twice in succession, and the flash FL1 has the entire pixel line in any one of the two photographings. When the electronic shutter is open, flash light is emitted to generate a first image signal from the first shooting and a second image signal from the second shooting.

  In the next step 1202, the image processing-dedicated processor 140 obtains a difference for each pixel between the first image signal and the second image signal, thereby generating an image signal representing the subject, and based on the generated image signal. The flash light quantity at the time of shooting is set to the flash FL1. Then, in the last photographing step S1203, the image sensor driving unit 1303 is instructed to cause the image sensor 137 to perform the shutter simultaneous open photographing twice in succession, and the flash light with the light emission amount set by the CPU 130 is set in the flash FL1. Make the main flash by emitting light.

  When the CPU 130 and the image processing processor 140 cooperate to execute the above processing, the CMOS type image sensor can perform global shutter shooting without a mechanical shutter, and flash shooting with pre-flash has been performed so far. Can be done as expected.

  Further, in the present embodiment, as described above, the CPU 130, the image sensor driving unit 1303, and the image processing dedicated processor 140 constitute an example of the imaging control means according to the present invention, and an analog front end is integrated with the image sensor 137. Thus, the image pickup device 137, the CPU 130, the image pickup device driver 1303, and the image processing dedicated processor 140 are integrated into a single chip, thereby reducing the size of the image pickup control apparatus. That is, with the configuration of FIG. 7, the advantages of using the CMOS image sensor can be maximized to reduce the size of the imaging control device, and further the size of the digital camera can be reduced.

  As described above, the mechanical shutter is abolished to further reduce the size of the digital camera, and the imaging control device that can make the CMOS type imaging device perform clear imaging, and the imaging control device are mounted. Realized imaging device.

  FIG. 13 shows a case where the image signal obtained by photographing immediately before the photographing timing is used as the first image signal, the image obtained by photographing at the photographing timing is used as the second image signal, and the difference between the images is obtained to generate the flash photographed image. It is a figure explaining operation | movement of.

  In FIG. 13, the first image signal generation process is performed in response to the half-press in response to the operation of the two-press release button, that is, half-press (S1) and full-press (S2). An example in which the second image generation process is performed is shown.

  As shown in FIG. 13, starting from the half-pressed timing (S1) as a starting point, the image sensor is allowed to repeatedly perform simultaneous shutter-open shooting while prohibiting flash emission. Next, at the fully-pressed shooting timing S2, the image pickup device performs another simultaneous shutter-open shooting, and flash light is emitted while all the pixel lines are in the electronic shutter open state. The first image signal (IMAGE1) obtained by the completed photographing and the second image signal (IMAGE2) obtained by the photographing at the photographing timing are generated. An image signal representing the subject is generated by obtaining a difference for each pixel between the first image signal (IMAGE1) and the second image signal (IMAGE2).

  FIG. 14 is a flowchart illustrating the procedure of the imaging control process performed by the CPU 130 and the image processing dedicated processor 140.

  In step S1401, when the release button is half-pressed (S1), the image sensor is made to repeatedly perform simultaneous shutter-open shooting by prohibiting light emission by the flash, and the image sensor is made to perform the predetermined shooting timing (full press S2). The first image signal obtained by the photographing completed immediately before the photographing timing (S1) is performed by performing the shutter simultaneous open photographing once and emitting the flash light while all the pixel lines are in the electronic shutter open state. (IMAGE1) and a second image signal (IMAGE2) obtained by photographing at the photographing timing are generated.

  In the next step S1402, the image processing dedicated processor 140 obtains a difference for each pixel between the first image signal (IMAGE1) and the second image signal (IMAGE2), thereby generating an image signal representing the subject.

  When the CPU 130 and the image processing dedicated processor 140 cooperate to execute the processing of the above-described flow, it is possible to cause the CMOS type image pickup device to perform global shutter shooting without a mechanical shutter, and to perform flash shooting as before. Will be able to.

  Even if it does in this way, the effect similar to the said 1st Embodiment and the said 2nd Embodiment is acquired.

  As described above, the mechanical shutter can be abolished to further reduce the size of the digital camera, and the imaging control device that can make the CMOS type imaging device perform clear imaging, and is mounted on the imaging control device. A photographing control method and a photographing device equipped with the photographing control device are realized.

  Finally, in order to monitor a predetermined place, an imaging unit having an imaging element is arranged at another location, and the imaging unit is controlled by a personal computer (hereinafter referred to as a PC) as an information processing apparatus. A configuration when the imaging control apparatus according to the present invention is applied to a monitoring system for monitoring the situation near the unit will be described.

  FIG. 15 is a diagram for explaining an example in which the imaging control device according to the present invention is applied to a monitoring system.

  The imaging control device 20 in FIG. 15 is configured by a PC, and an imaging control program for realizing the imaging control method shown in FIG. 4 is installed therein as an application. The PC 20 is provided with a CPU 200 corresponding to the photographing control means referred to in the present invention. In the present embodiment, the image processing boat further includes an image sensor driving unit and an image processing dedicated processor in a slot included in the PC 200. Is incorporated.

  The imaging unit 21 includes a CMOS type imaging device 210, a flash 211, and an infrared sensor 212 that detects that a person has approached.

  When the infrared sensor 212 detects that a person is approaching, the PC 20 is notified of this, and the CPU 200 in the PC 20 instructs the image sensor driving unit 201 in the image processing board to send a drive signal to the image capturing unit 21. Supply the shutter and simultaneously perform shutter simultaneous open photographing twice. The CPU 200 causes the flash 210 to emit flash light at the time of one of the two shootings, and the dedicated processor 202 for image processing in the PC performs the first image signal and the second image signal. The image signal is read from the imaging unit 21. The image processing dedicated processor 202 obtains a flash photographed image by taking the difference between the first image signal and the second image signal.

  As described above, by mounting the shooting control program on the PC that is the information processing apparatus and causing the PC that is the information processing apparatus to operate as the shooting control apparatus, it is also possible to suitably control the remote imaging unit.

  As described above, the mechanical shutter can be abolished to further reduce the size of the digital camera, and the imaging control device that can make the CMOS type imaging device perform clear imaging, and is mounted on the imaging control device. A photographing control method, a photographing control program for realizing the photographing control method, and a photographing device equipped with the photographing control device are realized.

It is a figure explaining operation | movement of a rolling shutter. It is a figure explaining the fault of rolling shutter photography. It is a figure explaining the fault of rolling shutter photography. It is a figure explaining operation | movement at the time of enabling it to perform global shutter imaging | photography using a mechanical shutter. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an external perspective view of a digital camera that is a first embodiment of a photographing apparatus according to the present invention when viewed obliquely from the front top. It is an external view which shows the back surface of the digital camera shown in FIG. FIG. 7 is a block diagram illustrating a circuit configuration of the digital camera 100 illustrated in FIGS. 5 and 6. It is a figure explaining the imaging | photography control processing at the time of the flash imaging | photography which the imaging | photography control means said to this invention comprised by CPU130, the image pick-up element drive part 1301, and the image processing exclusive processor 140 performs. 10 is a flowchart illustrating a shooting control method performed in cooperation between a CPU and a dedicated image processing processor. It is a figure which shows a structure when the flash FL of FIG. 3 is changed into the light-emitting device FL1 which can pre-emit. It is a figure explaining the imaging | photography operation | movement of flash light emission when performing pre light emission and calculating | requiring the light emission quantity at the time of main imaging | photography, and imaging | photography at the time of main light emission. FIG. 12 is a diagram for explaining a photographing control process performed by the CPU 130 and the image processing dedicated processor 140 in cooperation with each other in order to realize the operation of FIG. The operation in the case where the image signal obtained by photographing immediately before the photographing timing is set as the first image signal, the image obtained by photographing at the photographing timing is set as the second image signal, and the difference is obtained to generate the flash photographed image will be described. It is a figure to do. It is a flowchart which shows the procedure of the imaging | photography control processing which CPU and a processor only for image processing perform. It is a figure explaining the example at the time of applying the said imaging | photography control apparatus to the imaging | photography system for monitoring.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Digital camera 1110 Shooting optical system 1111 Shooting lens 1112 Aperture 111 Zoom lens barrel 112 Flash emission window 113 AF auxiliary light lamp 114 Power switch 115 Release button 116 Mode dial 117 LCD
117A LCD panel 118 MENU / OK button 119 DISP / BACK button 120 Photo mode button 121 Playback button 122 Cross button 123 Zoom button 124 Viewfinder 130 CPU
1301 Lens drive unit 1302 Aperture drive unit 1303 Image sensor drive unit 140 Dedicated processor for image processing 141 Memory control circuit 142 Digital signal processing circuit 143 Compression / decompression circuit FL Flash

Claims (12)

Consists of a plurality of pixel lines, and for the electronic shutter opening, simultaneous shutter opening for opening the electronic shutter for the plurality of pixel lines at the same timing is possible by simultaneously performing charge reset for the plurality of pixel lines, With regard to electronic shutter closing, in an imaging device including an image pickup device that reads out at different timing for each pixel line, and a flash that emits flash light toward a subject. A shooting control device for controlling shooting,
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shootings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
An imaging control apparatus comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. Consists of a plurality of pixel lines. With regard to the opening of the electronic shutter, it is possible to perform simultaneous shutter-opening photography in which the electronic shutter is opened at the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. Regarding the electronic shutter closing, an imaging device including an image pickup device that performs reading at different timing for each pixel line, and a flash that emits flash light toward the subject A shooting control device for controlling shooting in
At the time of pre-photographing before the main photographing, the image sensor is made to perform simultaneous shutter-open photographing twice, and all the pixel lines are electronically connected to the flash by any one of the two photographings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while the shutter is open;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation means for
An imaging control apparatus, comprising: an imaging control unit that causes the imaging apparatus to perform actual imaging accompanied by flash light emission of a light amount set by the exposure calculation unit. Consists of a plurality of pixel lines, and for simultaneous opening of the shutter, the electronic shutter is opened at the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. With regard to electronic shutter closing, in an imaging device including an image pickup device that reads out at different timing for each pixel line, and a flash that emits flash light toward a subject. A shooting control device for controlling shooting,
The image sensor is prohibited from emitting light by the flash and repeats simultaneous shutter-open shooting, and at the predetermined shooting timing, the image sensor performs another simultaneous shutter-open shooting, and all pixel lines are open to the electronic shutter. Control means for generating a first image signal by photographing completed immediately before the photographing timing and a second image signal by photographing at the photographing timing by emitting flash light while in a state;
An imaging control apparatus comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. Consists of a plurality of pixel lines, and for simultaneous opening of the shutter, the electronic shutter is opened at the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. With regard to electronic shutter closing, in an imaging device including an image pickup device that reads out at different timing for each pixel line, and a flash that emits flash light toward a subject. A shooting control method for controlling shooting,
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shots. A control step of generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
An imaging control method comprising: a subtracting step of generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. Consists of a plurality of pixel lines. With regard to the opening of the electronic shutter, it is possible to perform simultaneous shutter-open shooting at the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. Controls image capturing in an image capturing apparatus having an image sensor that reads out at different timings for each pixel line, and a flash that emits flash light toward the subject. A shooting control method,
At the time of pre-photographing before the main photographing, the image sensor is made to perform simultaneous shutter-open photographing twice, and all the pixel lines are electronically connected to the flash by any one of the two photographings. A pre-shooting control step for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while the shutter is open;
By calculating a difference for each pixel between the first image signal and the second image signal, an image signal representing the subject is generated, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation step to
A photographing control method comprising: a photographing control step for causing the photographing device to perform a photographing with a flash light amount set by the exposure calculation means. Consists of a plurality of pixel lines, and for simultaneous opening of the shutter, the electronic shutter is opened at the same timing for the plurality of pixel lines by simultaneously resetting the charge for the plurality of pixel lines. With regard to electronic shutter closing, in an imaging device including an image pickup device that reads out at different timing for each pixel line, and a flash that emits flash light toward a subject. A shooting control method for controlling shooting,
The image sensor is prohibited from emitting light by the flash and repeats simultaneous shutter-open shooting, and the image sensor is caused to perform another simultaneous shutter-open shooting at a predetermined shooting timing, and all pixel lines are opened to the electronic shutter. A control step of generating a first image signal by photographing completed immediately before the photographing timing and a second image signal by photographing at the external photographing timing by emitting flash light while in the state of
An imaging control method comprising: a subtracting step of generating an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. The information processing apparatus is executed by an information processing apparatus that executes a program. The information processing apparatus is configured by a plurality of pixel lines, and the electronic shutter is opened for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. An image pickup device that can perform simultaneous shutter-open shooting that opens the electronic shutter at the timing of, and for electronic shutter closing, the timing of closing the electronic shutter differs for each pixel line, and reading at different timing for each pixel line; A shooting control program that operates as a shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject;
The information processing apparatus;
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shootings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
Shooting control comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. program. The information processing apparatus is executed by an information processing apparatus that executes a program. The information processing apparatus is configured by a plurality of pixel lines, and the electronic shutter is opened for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. An image pickup device that can perform simultaneous shutter-open shooting that opens the electronic shutter at the timing of, and for electronic shutter closing, the timing of closing the electronic shutter differs for each pixel line, and reading at different timing for each pixel line; A shooting control program that operates as a shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject;
The information processing apparatus;
At the time of pre-photographing before the main photographing, the image pickup device performs two simultaneous shutter-open photographings, and all the pixel lines are electronically shuttered in the flash in any one of the two photographings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the open state;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation means for
An imaging control program that causes the imaging apparatus to operate as an imaging control device that includes an imaging control unit that performs an imaging operation with a flash light amount set by the exposure calculation unit. The information processing apparatus is executed by an information processing apparatus that executes a program. The information processing apparatus is configured by a plurality of pixel lines, and the electronic shutter is opened for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. An image pickup device that can perform simultaneous shutter-open shooting that opens the electronic shutter at the timing of, and for electronic shutter closing, the timing of closing the electronic shutter differs for each pixel line, and reading at different timing for each pixel line; A shooting control program that operates as a shooting control device that controls shooting in a shooting device including a flash that emits flash light toward a subject;
The information processing apparatus;
In response to a shooting instruction, light emission by the flash is prohibited, the image sensor repeatedly performs shutter simultaneous open shooting, and the image sensor performs another shutter simultaneous open shooting at a predetermined shooting timing. Control means for generating flash light while the electronic shutter is open, thereby generating one image signal obtained by photographing immediately before the photographing timing and a second image signal obtained by photographing at the photographing timing. ,
Shooting control comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. program. In a photographing device that forms an image of a subject on an image sensor with a photographing optical system and generates an image signal representing the subject with the image sensor,
The image pickup device is composed of a plurality of pixel lines, and when the electronic shutter is opened, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of electronic shutter closing differs for each pixel line, and readout is performed at different timing for each pixel line,
Furthermore, the imaging device
A flash that emits flash light toward the subject,
In response to a shooting instruction, the image sensor is caused to perform simultaneous shutter-open shooting twice, and all the pixel lines are opened in the flash in any one of the two shots. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the state;
An imaging apparatus comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal. In a photographing device that forms an image of a subject on an image sensor with a photographing optical system and generates an image signal representing the subject with the image sensor,
The image pickup device is composed of a plurality of pixel lines, and when the electronic shutter is opened, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of electronic shutter closing differs for each pixel line, and readout is performed at different timing for each pixel line,
Furthermore, the imaging device
A flash that emits flash light toward the subject,
At the time of pre-photographing before the main photographing, the image pickup device performs two simultaneous shutter-open photographings, and all the pixel lines are electronically shuttered in the flash in any one of the two photographings. Control means for generating a first image signal by the first shooting and a second image signal by the second shooting by emitting flash light while in the open state;
An image signal representing a subject is generated by obtaining a difference for each pixel between the first image signal and the second image signal, and the amount of flash light at the time of actual photographing is set based on the generated image signal Exposure calculation means for
A photographing apparatus comprising: a main photographing control unit that performs a main photographing accompanied by emission of flash light having a light amount set by the exposure subtracting unit. In a photographing device that forms an image of a subject on an image sensor with a photographing optical system and generates an image signal representing the subject with the image sensor,
The image pickup device is composed of a plurality of pixel lines, and when the electronic shutter is opened, the shutter is simultaneously opened for performing the electronic shutter opening at the same timing for the plurality of pixel lines by simultaneously performing charge reset for the plurality of pixel lines. With regard to electronic shutter closing, the timing of electronic shutter closing differs for each pixel line, and readout is performed at different timing for each pixel line,
Furthermore, the imaging device
A two-press shooting button with half-press and full-press,
A flash that emits flash light toward the subject,
In response to the half-pressing operation of the shooting button, the flash is prohibited from emitting light and the image sensor is repeatedly subjected to simultaneous shutter-open shooting. By performing the photographing that is completed immediately before the photographing timing by causing the flash to emit light while the shutter is simultaneously opened and the flash is caused to emit light while all the pixel lines are in the electronic shutter open state. Control means for generating a first image signal and a second image signal by photographing at the photographing timing;
An imaging apparatus comprising: a subtracting unit that generates an image signal representing a subject by obtaining a difference for each pixel between the first image signal and the second image signal.

Images