JP5496028B2 - Read control device, read control method, program, and imaging device - Google Patents

Description

  The present invention relates to a technique for reading an image signal from pixels arranged on a solid-state imaging device.

  2. Description of the Related Art Conventionally, imaging devices such as a digital still camera and a digital video camera (hereinafter collectively referred to as “digital camera”) that can acquire both moving images and still images are known. In general, such an imaging apparatus has an operation mode for acquiring a still image and an operation mode for acquiring a moving image, and these operation modes can be switched by a user operation. It has become. There has also been proposed an imaging apparatus that can acquire both a moving image and a still image within the same period so that a moving image frame is not lost by giving a predetermined instruction within the moving image shooting period (for example, (See Patent Document 1).

JP 2005-311665 A

  In the above-mentioned Patent Document 1, in order to prevent missing in the moving image frame, the pixels on the solid-state imaging device are divided into moving image pixels and still image pixels, and the moving image signal and the still image read from each pixel are divided. The image signal is output by another output system. In order to obtain a higher-definition still image, it is also possible to configure a still image by using image signals read from both moving image pixels and still image pixels.

  However, the above Patent Document 1 does not disclose a condition determination for switching between still image shooting using only still image pixels and still image shooting using both moving image pixels and still image pixels. Even if the user decides to switch, the operation may be complicated for the user.

  The present invention has been made in view of the above-described problems, and is for obtaining a still image as high-definition as possible according to shooting conditions while acquiring both a moving image signal and a still image signal. The purpose is to obtain a still image signal.

  A readout control apparatus according to an aspect of the present invention includes a first output system that outputs a still image signal read from a first pixel among a plurality of pixels arranged on a solid-state imaging device, and the plurality of pixels. A second output system for outputting a still image signal and a moving image signal read from the second pixel, and the charge accumulated in the first pixel during the first exposure period by the first output system A first readout mode in which the still image signal is output based on the second output system, and the second output system outputs the moving image signal based on the charge accumulated in the second pixel during a second exposure period; The first output system outputs the still image signal based on the charge accumulated in the first pixel during a third exposure period, and the second output system outputs the first image during the third exposure period. The still image signal based on the charge accumulated in the two pixels and the previous Based on the comparison result between the exposure period of the still image and the frame period period of the moving image, the reading mode setting unit that sets one of the second reading modes for outputting the moving image signal, and the reading mode setting unit And a selection unit for selecting a reading mode to be set.

  In a readout control method according to another aspect of the present invention, a first output system that outputs a still image signal read from a first pixel among a plurality of pixels arranged on a solid-state imaging device has a first exposure. Outputting the still image signal based on the charge accumulated in the first pixel during a period, and outputting a still image signal and a moving image signal read from the second pixel among the plurality of pixels A first readout mode in which the output system outputs the moving image signal based on the charge accumulated in the second pixel during a second exposure period; and the first output system is configured to output the first signal during the third exposure period. The still image signal based on the electric charge accumulated in one pixel is output, and the second output system outputs the still image signal based on the electric charge accumulated in the second pixel during the third exposure period. And a second readout mode for outputting the video signal; And setting one of out, based on the result of comparison between still image exposure period and video frame cycle period, characterized in that it comprises the steps of: selecting a read mode to be set.

  In the program according to another aspect of the present invention, the first output system for outputting the still image signal read from the first pixel among the plurality of pixels arranged on the solid-state imaging device is in the first exposure period. A second output system for outputting the still image signal based on the electric charge accumulated in the first pixel and outputting a still image signal and a moving image signal read from the second pixel among the plurality of pixels. Outputs a video signal based on the charge accumulated in the second pixel during the second exposure period, and the first output system outputs the first signal during the third exposure period. Outputting the still image signal based on the charge accumulated in the pixel, and the second output system includes the still image signal based on the charge accumulated in the second pixel during the third exposure period, and The second readout mode that outputs video signals And setting one of, based on the result of comparison between still image exposure period and video frame cycle period, to execute the steps of selecting a reading mode for setting, to the computer.

  An imaging apparatus according to another aspect of the present invention includes a plurality of pixels, a first output system that outputs a still image signal read from a first pixel among the plurality of pixels, and the plurality of pixels. A second output system for outputting a still image signal and a moving image signal read from the second pixel, and the first output system is based on charges accumulated in the first pixel during a first exposure period; A first readout mode for outputting the still image signal, and wherein the second output system outputs the moving image signal based on charges accumulated in the second pixel during a second exposure period; One output system outputs the still image signal based on the charge accumulated in the first pixel during a third exposure period, and the second output system outputs the second image during the third exposure period. The still image signal and the moving image signal based on the charge accumulated in the pixel A readout mode setting unit that sets one of the second readout modes to be output, and a readout that is set by the readout mode setting unit based on a comparison result between the exposure period of the still image and the frame period of the moving image And a selection unit for selecting a mode.

It is a block diagram which shows the structure of the camera system by one Embodiment of this invention. It is a block diagram which shows the structure of the solid-state image sensor with which the camera system by one Embodiment of this invention is provided. It is a block diagram which shows the connection of each pixel on a solid-state image sensor with which the camera system by one Embodiment of this invention is provided, and two vertical scanning circuits. It is a flowchart which shows operation | movement of the camera system by one Embodiment of this invention. 6 is a timing chart illustrating an operation in a first read mode according to an embodiment of the present invention. 6 is a timing chart showing an operation in a second read mode according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the camera system by one Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following detailed description includes specific details in one example. A person skilled in the art can naturally understand that even if various variations and modifications are added to the following detailed contents, the contents of the variations and modifications do not exceed the scope of the present invention. Accordingly, the various embodiments described below do not lose the generality of the claimed invention and do not limit the claimed invention.

  FIG. 1 shows a configuration example of the camera system according to the present embodiment. The camera system shown in FIG. 1 is mounted on various imaging devices. The imaging device according to one embodiment of the present invention may be an electronic device having an imaging function, and may be a digital video camera, an endoscope, or the like in addition to a digital camera.

  The camera system shown in FIG. 1 includes an imaging lens system 1, a solid-state imaging device 2, an image processing unit 3, a control unit 4, a liquid crystal monitor 5, a storage medium 6, and an operation input unit 7. Each block shown in FIG. 1 can be realized by various parts such as an electrical circuit part such as a computer CPU and memory, an optical part such as a lens, an operation part such as a button and a switch in terms of hardware. Although it can be realized by a computer program or the like, it is illustrated here as a functional block realized by their cooperation. Accordingly, those skilled in the art can naturally understand that these functional blocks can be realized in various forms by a combination of hardware and software.

  The imaging lens 1 forms a subject image formed by light from the subject on a two-dimensional pixel array disposed on the solid-state imaging device 2. The solid-state imaging device 2 outputs an image signal based on a subject image formed on a two-dimensional pixel array composed of a large number of pixels.

  The image processing unit 3 includes a first signal processing circuit 31 that processes a signal output from a first output circuit 201 of the solid-state imaging device 2 described later, and a signal output from a second output circuit 202 of the solid-state imaging device 2. And a second signal processing circuit 32 for processing. The image processing unit 3 performs signal processing such as color signal processing, gain processing, and white balance processing on the signal output from the solid-state imaging device 2 by these two signal processing circuits, and the liquid crystal monitor 5 It has a function of converting into a signal of a format that can be displayed or stored in the storage medium 6.

  The control unit 4 is electrically connected to each part of the camera system and controls the camera system. The operation of the control unit 4 is defined by a program stored in a ROM built in the camera system. The control unit 4 reads this program and performs various controls according to the contents defined by the program. The solid-state imaging device 2 and the control unit 4 constitute a read control unit that is an example of a read control device according to an aspect of the present invention.

  The liquid crystal monitor 5 displays a moving image based on the moving image signal processed by the image processing unit 3. The storage medium 6 stores still image data based on the still image signal processed by the image processing unit 3. The operation input unit 7 includes buttons and switches operated by the user. A user operation result is input to the control unit 4 as a signal via the operation input unit 7. For example, setting of a shooting mode, shutter release of a still image, and instructions for starting and ending moving image shooting are performed via the operation input unit 7.

  FIG. 2 shows a configuration example of the solid-state imaging device 2 shown in FIG. The solid-state imaging device 2 has a large number of pixels arranged in a two-dimensional matrix on a semiconductor substrate, and two output circuits (readout circuits), that is, a first output circuit 201 and a second output circuit 202, and two vertical scans. A circuit, that is, a first vertical scanning circuit 209, a second vertical scanning circuit 210, and the like are provided.

  A number of pixels include a first pixel 203 connected to the first output circuit 201 via the first vertical signal line 205 and a second pixel connected to the second output circuit 202 via the second vertical signal line 206. Divided into 204. The first pixel 203 and the second pixel 204 include a photoelectric conversion element (photodiode) that converts light into electric charge, a charge holding unit that accumulates and holds electric charge generated in the photoelectric conversion element, and the like. The first pixel 203 is used to obtain a still image signal, and the second pixel 204 is used to obtain a still image signal and a moving image signal. In the example of the present embodiment, the pixels in the first, fourth, and seventh columns of the third, sixth, ninth, and twelfth rows are the second pixels 204.

  All the pixels are included in a read target area from which an image signal is read. It is desirable that the read target area includes at least all pixels in the effective pixel area. Further, the read target area may include an optical black pixel (a pixel that is always shielded from light) arranged outside the effective pixel area. The image signal read from the optical black pixel is used for correcting a dark current component, for example.

  In FIG. 2, control signal lines that connect each pixel to the first vertical scanning circuit 209 and the second vertical scanning circuit 210 are not shown. FIG. 3 shows control signal lines that connect each pixel to the first vertical scanning circuit 209 and the second vertical scanning circuit 210. In FIG. 3, only some pixels and control signal lines are shown, and the remaining pixels and control signal lines are omitted.

  Control of exposure and signal readout in the first pixel 203 is performed by a control signal supplied from the first vertical scanning circuit 209 connected to the first pixel 203 via the first control signal line 207. The first output circuit 201 reads a signal from the first pixel 203 via the first vertical signal line 205 and outputs the signal to the outside of the solid-state imaging device 2. Control of exposure and signal readout in the second pixel 204 is performed by a control signal supplied from the second vertical scanning circuit 210 connected to the second pixel 204 via the second control signal line 208. The second output circuit 202 reads a signal from the second pixel 204 via the second vertical signal line 206 and outputs the signal to the outside of the solid-state imaging device 2. The first output circuit 201 and the second output circuit 202 can output signals independently of each other.

  The first vertical scanning circuit 209 outputs a control signal to the first pixel 203 via the first control signal line 207, and controls exposure and signal readout in the first pixel 203. The second vertical scanning circuit 210 outputs a control signal to the second pixel 204 via the second control signal line 208, and controls exposure and signal readout in the second pixel 204.

  Next, the operation of the camera system according to the present embodiment will be described. FIG. 4 shows a flow of shooting a still image to be recorded on the storage medium 6 during shooting of a moving image for displaying a moving image on the liquid crystal monitor 5.

  When shooting of a moving image is started, the camera system enters a state of waiting for a still image acquisition instruction while shooting the moving image (step S1). When a signal for instructing acquisition of a still image is input from the operation input unit 7 to the control unit 4 by a user's shutter release operation, the control unit 4 displays the preset exposure period and moving image frame of the still image. The period periods are compared (step S2). Note that the exposure period of the still image can be changed, and a predetermined exposure time is set in advance before shooting the still image.

  In the present embodiment, a first readout mode and a second readout mode, which will be described later, are prepared as readout modes of the solid-state imaging device 2. When the exposure period of the still image is longer than the moving picture frame period period, the control unit 4 selects the first readout mode, and sets the value of the mode flag inside the control unit 4 to a value corresponding to the first readout mode. To do. Thereafter, the control unit 4 outputs a necessary command to the solid-state imaging device 2 so as to perform still image shooting in the first readout mode (step S3). When the exposure period of the still image is equal to or shorter than the moving image frame period, the control unit 4 selects the second readout mode, and sets the value of the mode flag in the control unit 4 to a value corresponding to the second readout mode. Set. Thereafter, the control unit 4 outputs a necessary command to the solid-state imaging device 2 so as to perform still image shooting in the second readout mode (step S4).

  Next, the first read mode and the second read mode will be described with reference to timing charts shown in FIGS.

  FIG. 5 shows the operation in the first read mode. Before and after setting the first readout mode, the camera system always captures a moving image with a fixed frame period using the signal output from the second pixel 204. The control unit 4 controls the solid-state imaging device 2 so as to sequentially perform exposure and readout of a moving image signal for each row in the second pixel 204. In the example shown in FIG. 5, after the exposure is started at the second pixel 204 in the third row, the exposure is started at the second pixel 204 sequentially in the order of the sixth row, the ninth row, and the twelfth row. In each row, after a certain exposure time based on the moving image frame cycle period has elapsed since the start of exposure, the third row, the sixth row, the ninth row, and the twelfth row are sequentially ordered from the second pixel 204 for moving images. The signal is read out.

  The moving image signal read from the second pixel 204 is output from the second output circuit 202 and input to the second signal processing circuit 32 in the image processing unit 3. The second signal processing circuit 32 performs image processing necessary for displaying as a moving image on the moving image signal, and then outputs it to the liquid crystal monitor 5. The liquid crystal monitor 5 displays a moving image based on the moving image signal. Thereafter, the operation relating to the moving image shooting is continued.

  When a signal instructing acquisition of a still image is input at time T1, the control unit 4 compares the exposure period of the still image with the moving image frame period period, and selects the first readout mode as the readout mode of the solid-state imaging device 2. To do. Subsequently, the control unit 4 resets the first pixel 203 at the same time and starts exposure regardless of the operation state of the second pixel 204 and the second output circuit 202, and starts the exposure. To control. At the time of resetting, the potential of the photoelectric conversion element provided in each pixel is set to a predetermined potential.

  It is assumed that the imaging parameters related to the conditions of the imaging lens system 1, such as the F value that determines the aperture, cannot be changed from the start of exposure of the first pixel 203 to the end of exposure. When a predetermined exposure time elapses after the exposure is started, the control unit 4 ends the exposure of the first pixel 203, sequentially reads out the still image signal from the first pixel 203 for each row, and outputs the first output circuit. The solid-state imaging device 2 is controlled so that a still image signal is output from the 201. In the example shown in FIG. 5, the still image signal is read from the first pixel 203 sequentially in the order of the first row, the second row, the third row,.

  The still image signal output from the first output circuit 201 is input to the first signal processing circuit 31 in the image processing unit 3. The first signal processing circuit 31 performs image processing necessary for storing the still image as a still image in the storage medium 6, and then outputs the processed still image data to the storage medium 6. This still image data is stored in the storage medium 6. In the image processing, the signal for the still image obtained from the first pixel 203 has a resolution corresponding to the second pixel 204 in terms of resolution. Therefore, the first signal processing circuit 31 includes the second pixel 204. A process for interpolating corresponding signals is performed.

  As described above, in the first readout mode, still image exposure and signal readout in the first pixel 203 and moving image exposure and signal readout in the second pixel 204 are performed independently. The still image signal acquired in the first readout mode is a signal based on the electric charge accumulated in the first pixel 203 during the still image exposure period, and the moving image signal acquired in the first readout mode is This is a signal based on the charge accumulated in the second pixel 204 during the exposure period for moving images. Note that the still image exposure period is a period from the start of pixel reset to the end of signal readout of the first row for reading a still image signal (first row in FIG. 5).

  FIG. 6 shows the operation in the second read mode. Operations related to moving image shooting until a signal indicating a still image acquisition instruction is input to the control unit 4 are the same as those in the first readout mode. When a signal instructing acquisition of a still image is input at time T2, the control unit 4 compares the exposure period of the still image and the moving image frame period period, and selects the second readout mode as the readout mode of the solid-state image sensor 2. To do. After the reading of the moving image signal of the most recent frame is completed for all the second pixels 204, the control unit 4 resets the first pixel 203 and the second pixel 204, that is, all the pixels at the same time to perform exposure. The solid-state imaging device 2 is controlled to start.

  When a predetermined exposure time elapses after exposure is started for all pixels, the control unit 4 ends the exposure of the first pixel 203 and the second pixel 204, and the first pixel 203 and the second pixel 204 are independent. Thus, the solid-state imaging device 2 is controlled so as to read out still image signals sequentially for each row. With respect to the first pixel 203, a still image signal is read out from the first pixel 203 in order of the first row, the second row, the third row,. Is output. For the second pixel 204, a moving image signal is sequentially read from the second pixel 204 and output from the second output circuit 202 in the order of the third row, the sixth row, the ninth row, and the twelfth row. . In the second pixel 204, after the readout of the still image signal is finished, the exposure is started at the time according to the frame period (time T13 in FIG. 5) independently of the signal readout in the first pixel 203, Movie shooting continues again.

  The still image signal output from the first output circuit 201 is input to the first signal processing circuit 31 in the image processing unit 3, and the still image signal output from the second output circuit 202 is input to the image processing unit 3. Input to the second signal processing circuit 32. The first signal processing circuit 31 and the second signal processing circuit 32 perform image processing necessary for storing the still image in the storage medium 6 as a still image. The still image signals processed by the first signal processing circuit 31 and the second signal processing circuit 32 are combined as still image data relating to one still image and stored in the storage medium 6.

  The still image signal read from the second pixel 204 is also used as a moving image signal constituting a moving image frame between time T12 and time T13. That is, the second signal processing circuit 32 performs image processing necessary for displaying as a moving image on the still image signal output from the second output circuit 202, that is, the moving image signal, and then outputs it to the liquid crystal monitor 5. .

  As described above, in the second readout mode, during the still image exposure period, still image exposure and signal readout at the first pixel 203, and still image and movie exposure and signal at the second pixel 204 are performed. Reading is performed independently. The still image signal acquired in the second readout mode is a signal based on the charges accumulated in the first pixel 203 and the second pixel 204 during the still image exposure period, and is acquired in the second readout mode. The moving image signal is a signal based on the charge accumulated in the second pixel 204 during the moving image exposure period and the still image exposure period. Note that the still image exposure period is a period from the start of pixel reset to the end of signal readout for the first row from which the still image signal is read (the first row in FIG. 6).

  In the second readout mode, the signal read from the second pixel 204 is commonly used for moving images and still images, so that a still image with as high a resolution as possible can be obtained while preventing missing frames in the moving image frame. Realize to get. In order to use the signal read from the second pixel 204 for moving images and still images, it is necessary to perform exposure for still images within a moving image frame period. Therefore, the reading mode is selected based on the exposure period of the still image and the moving image frame period. If the exposure period of the still image is equal to or shorter than the moving image frame period period, the exposure for the still image can be performed within the moving image frame period period, and the signal read from the second pixel 204 is common to the moving image and the still image. Can be used in

  Next, a modification of the operation of the camera system according to the present embodiment will be described with reference to the flowchart of FIG. This modification is different from the above-described operation in the conditions for selecting the first read mode and the second read mode and the operation in the first read mode, and is otherwise the same.

  When shooting of a moving image is started, the camera system enters a state of waiting for a still image acquisition instruction while shooting the moving image (step S21). When a signal for instructing acquisition of a still image is input from the operation input unit 7 to the control unit 4 by a user's shutter release operation, the control unit 4 displays the preset exposure period and moving image frame of the still image. The period periods are compared (step S22).

  When the exposure period of the still image is the same as or longer than the moving image frame period period, the control unit 4 selects the first readout mode, and the value of the mode flag in the control unit 4 corresponds to the first readout mode. Set to value. Thereafter, the control unit 4 outputs a necessary command to the solid-state imaging device 2 so as to perform still image shooting in the first readout mode (step S23). When the exposure period of the still image is shorter than the moving picture frame period period, the control unit 4 selects the second readout mode, and sets the value of the mode flag in the control unit 4 to a value corresponding to the second readout mode. Set to. Thereafter, the control unit 4 outputs a necessary command to the solid-state imaging device 2 so as to perform still image shooting in the second readout mode (step S24).

  The operation of the solid-state imaging device 2 in the first readout mode is the same as the operation in the first readout mode described above, but the operation of the first signal processing circuit 31 in the image processing unit 3 is the same as that in the first readout mode described above. Different from operation in read mode. As described above, the first signal processing circuit 31 performs the image processing necessary for storing the still image signal output from the first output circuit 201 as a still image in the storage medium 6. At the time of this image processing, the signal for the still image obtained from the first pixel 203 has a missing portion of the second pixel 204 in terms of resolution, so the first signal processing circuit 31 corresponds to the second pixel 204. A process for interpolating the signal of the amount to be performed is performed.

  However, the length of the exposure time (charge accumulation time) of the first pixel 203 is the same as the length of the exposure time (charge accumulation time) of the second pixel 204, and the exposure start time (charge accumulation of the first pixel 203) If the difference between the start time) and the exposure start time (charge accumulation start time) of the first row (third row) of the second pixel 204 is within a predetermined time, the video signal obtained by the second pixel 204 is It can be used as a still image signal. The control unit 4 makes a determination related to the exposure time and the exposure start time, and when the above condition is satisfied, the still image signal processed by the first signal processing circuit 31 and the second signal processing circuit 32 process it. The image processing unit 3 is controlled to synthesize the moving image signal as still image data related to one still image.

  In the present embodiment, for the sake of simplicity, an example in which the pixel array is 9 pixels in the horizontal direction × 12 pixels in the vertical direction has been described, but the pixel array is not limited to this.

  As described above, according to the present embodiment, the first read mode and the second read mode are prepared, and the two read modes are selected according to the result of comparing the exposure period for the still image and the moving picture frame period period. By switching, it is possible to acquire a still image signal for constructing a still image as high as possible according to the shooting conditions while acquiring both a moving image signal and a still image signal. In the first readout mode, still image shooting can be performed without being affected by reading out a moving image signal, and moving image shooting can be performed without being affected by reading out a still image signal. In the second readout mode, the signal read from the second pixel 204 can be used in common for moving images and still images, and a higher-definition still image can be acquired.

  Further, by keeping the imaging parameter (F value in the above example) constant during the still image exposure period, still image shooting can be performed while preventing changes in exposure conditions during still image shooting.

  Further, by providing two output circuits (the first output circuit 201 and the second output circuit 202), it is possible to perform optimum signal reading according to the type of required signal.

  Further, in the first readout mode, the length of the exposure time of the first pixel 203 and the length of the exposure time of the second pixel 204 are the same, and the exposure start time of the first pixel 203 and the second pixel 204 When the deviation from the exposure start time of the first row is within a predetermined time, a higher-definition still image can be obtained by using the moving image signal obtained by the second pixel 204 as a still image signal. Can do.

  The first output system according to the present invention corresponds to, for example, the first output circuit 201 and the first vertical signal line 205, and the second output system corresponds to, for example, the second output circuit 202 and the second vertical signal line 206. To do. The first readout circuit according to the present invention corresponds to, for example, the first output circuit 201, and the second readout circuit corresponds to, for example, the second output circuit 202. A read mode setting unit and a selection unit according to the present invention correspond to the control unit 4, for example. The exposure control unit according to the present invention corresponds to the first vertical scanning circuit 209 and the second vertical scanning circuit 210, for example. A generation unit according to the present invention corresponds to the image processing unit 3, for example.

  As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments, and includes design changes and the like without departing from the gist of the present invention. .

For example, a read control device according to an aspect of the present invention includes:
“A first output system for outputting a still image signal read from a first pixel among a plurality of pixels arranged on a solid-state imaging device;
A second output system for outputting a still image signal and a moving image signal read from a second pixel among the plurality of pixels;
The first output system outputs the still image signal based on the electric charge accumulated in the first pixel during the first exposure period, and the second output system outputs the second image during the second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the first pixel, and the stationary based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout that outputs an image signal, and the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. Read mode setting means for setting any of the mode,
Selection means for selecting a readout mode set by the readout mode setting unit based on a comparison result between an exposure period of a still image and a frame period of a moving image;
A reading control apparatus comprising: "
It may be.

In addition, an imaging device according to another aspect of the present invention includes:
“Multiple pixels,
A first output system for outputting a still image signal read from a first pixel among the plurality of pixels;
A second output system for outputting a still image signal and a moving image signal read from a second pixel among the plurality of pixels;
The first output system outputs the still image signal based on the electric charge accumulated in the first pixel during the first exposure period, and the second output system outputs the second image during the second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the first pixel, and the stationary based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout that outputs an image signal, and the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. Read mode setting means for setting any of the mode,
Selection means for selecting a readout mode set by the readout mode setting unit based on a comparison result between an exposure period of a still image and a frame period of a moving image;
An imaging apparatus comprising: "
It may be.

  A computer program product that realizes any combination of the above-described components and processing processes is also effective as an aspect of the present invention. A computer program product includes a recording medium (DVD medium, hard disk medium, memory medium, etc.) on which a program code is recorded, a computer on which the program code is recorded, and an Internet system (for example, a server and a client terminal) on which the program code is recorded. A recording medium, a device, a device, or a system in which a program code is incorporated. In this case, each component and each process described above are mounted in each module, and a program code including the mounted module is recorded in the computer program product.

For example, a computer program product according to an aspect of the present invention is:
“Charge accumulated in the first pixel during the first exposure period by the first output system that outputs the still image signal read from the first pixel among the plurality of pixels arranged on the solid-state imaging device A second output system that outputs the still image signal based on the second image and outputs the still image signal and the moving image signal read from the second pixel among the plurality of pixels in the second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the first pixel, and the stationary based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout that outputs an image signal, and the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. Module to set one of the mode and
A module for selecting a reading mode to be set based on a comparison result between the exposure period of the still image and the frame period of the moving image;
A computer program product in which a program code is recorded. "
It may be.

  A program for realizing any combination of each component and each processing process according to the above-described embodiment is also effective as an aspect of the present invention. The object of the present invention can be achieved by recording the program on a computer-readable recording medium, causing the computer to read and execute the program recorded on the recording medium.

  Here, the “computer” includes a homepage providing environment (or display environment) if the WWW system is used. The “computer-readable recording medium” refers to a storage device such as a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a hard disk built in the computer. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included.

  The program described above may be transmitted from a computer storing the program in a storage device or the like to another computer via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting a program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Further, the above-described program may be for realizing a part of the above-described function. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer, what is called a difference file (difference program) may be sufficient.

  Although the preferred embodiments of the present invention have been described above, various alternatives, modifications, and equivalents can be used as the above-described components and processing processes. In the embodiments disclosed herein, one part may be replaced with a plurality of parts, or a plurality of parts may be replaced with one part to perform one or more functions. Such substitutions are within the scope of the invention unless such substitutions do not work properly to achieve the objectives of the invention. Accordingly, the scope of the invention should not be determined by reference to the above description, but should be determined by the claims, including the full scope of equivalents. In the claims, each component is one or more quantities unless explicitly stated otherwise. Except where expressly stated in a claim using words such as “means for”, the claim should not be construed as including means plus function limitations.

  The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, even when a term is used in the singular, the term includes the plural unless the context clearly indicates otherwise.

  DESCRIPTION OF SYMBOLS 1 ... Imaging lens system, 2 ... Solid-state image sensor, 3 ... Image processing part, 4 ... Control part, 5 ... Liquid crystal monitor, 6 Storage medium, 7 ... Operation input part, 31 ... first signal processing circuit, 32 ... second signal processing circuit, 201 ... first output circuit, 202 ... second output circuit, 203 ... first pixel, 204 ... Second pixel, 205 ... first vertical signal line, 206 ... second vertical signal line, 207 ... first control signal line, 208 ... second control signal line, 209 ... first Vertical scanning circuit, 210 ... second vertical scanning circuit

Claims (13)

A first output system for outputting a still image signal read from the first pixel among a plurality of pixels arranged on the solid-state imaging device;
A second output system for outputting a still image signal and a moving image signal read from a second pixel among the plurality of pixels;
The first output system outputs the still image signal based on the electric charge accumulated in the first pixel during the first exposure period, and the second output system outputs the second image during the second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the first pixel, and the stationary based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout that outputs an image signal, and the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. A read mode setting section for setting one of the modes,
A selection unit that selects a readout mode set by the readout mode setting unit based on a comparison result between an exposure period of a still image and a frame period of a moving image;
A reading control apparatus comprising:   The reading control apparatus according to claim 1, wherein when the exposure period of the still image is longer than a frame period period of the moving image, the selection unit selects the first reading mode.   2. The read control apparatus according to claim 1, wherein the selection unit selects the second read mode when an exposure period of the still image is equal to or shorter than a frame cycle period of the moving image.   The readout control apparatus according to claim 1, wherein imaging parameters for capturing a still image or a moving image are maintained constant during a still image exposure period.   The readout control apparatus according to claim 4, wherein the imaging parameter is an F value.   2. The exposure control unit according to claim 1, further comprising an exposure control unit configured to control an exposure start time and an exposure end time for obtaining the still image signal to be the same between pixels from which the still image signal is read. The reading control apparatus according to the description.   In the second readout mode, the second output system uses a common signal based on the electric charge accumulated in the second pixel during the third exposure period as the still image signal and the moving image signal. The read control apparatus according to claim 1, wherein the read control apparatus outputs the read control apparatus.   The first output system includes a first readout circuit that reads out the still image signal from the first pixel when the first readout mode is set, and the second output system includes the second output system, The readout control apparatus according to claim 1, further comprising a second readout circuit that reads out the video signal from the second pixel when the first readout mode is set.   The first output system includes a first readout circuit that reads out the still image signal from the first pixel when the second readout mode is set, and the second output system includes the second output system, The readout control apparatus according to claim 1, further comprising a second readout circuit that reads out the still image signal and the moving image signal from the second pixel when a second readout mode is set. . A first output system that outputs a still image signal read from the first pixel among a plurality of pixels arranged on the solid-state imaging device has a charge accumulated in the first pixel during the first exposure period. A second output system for outputting a still image signal based on the second image and outputting a still image signal and a moving image signal read out from a second pixel of the plurality of pixels in a second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the pixel; and the still image based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout mode in which the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. And setting one of
Selecting a readout mode to be set based on a comparison result between the exposure period of the still image and the frame period of the moving image;
A read control method comprising: A first output system that outputs a still image signal read from the first pixel among a plurality of pixels arranged on the solid-state imaging device has a charge accumulated in the first pixel during the first exposure period. A second output system for outputting a still image signal based on the second image and outputting a still image signal and a moving image signal read out from a second pixel of the plurality of pixels in a second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the pixel; and the still image based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout mode in which the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. And setting one of
Selecting a readout mode to be set based on a comparison result between the exposure period of the still image and the frame period of the moving image;
A program that causes a computer to execute. A plurality of pixels;
A first output system for outputting a still image signal read from a first pixel among the plurality of pixels;
A second output system for outputting a still image signal and a moving image signal read from a second pixel among the plurality of pixels;
The first output system outputs the still image signal based on the electric charge accumulated in the first pixel during the first exposure period, and the second output system outputs the second image during the second exposure period. A first readout mode for outputting the moving image signal based on the charge accumulated in the first pixel, and the stationary based on the charge accumulated in the first pixel during the third exposure period by the first output system. A second readout that outputs an image signal, and the second output system outputs the still image signal and the moving image signal based on the charge accumulated in the second pixel during the third exposure period. A read mode setting section for setting one of the modes,
A selection unit that selects a readout mode set by the readout mode setting unit based on a comparison result between an exposure period of a still image and a frame period of a moving image;
An imaging apparatus comprising:   When the first readout mode is set, the charge accumulation time of the first pixel is the same as the charge accumulation time of the second pixel, and the charge accumulation start time of the first pixel is If the difference from the charge accumulation start time of the second pixel is within a predetermined time, the moving image signal is used for both moving image and still image, and the still image signal and the moving image signal are stopped. The imaging apparatus according to claim 12, further comprising a generation unit that generates image data.

Images