JP2015122779A - Imaging apparatus and imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable imaging a still picture while imaging a moving image by setting imaging regions for the moving image and the still picture.SOLUTION: The imaging apparatus includes: an imaging unit including a plurality of pixels, and including a photoelectric converter unit for converting light into an electric charge and a readout unit for reading out a signal generated by the electric charge obtained through the photoelectric conversion in the photoelectric converter unit; a setting unit for setting a first mode to read out a signal, generated in the photoelectric converter unit, relative to a pixel included in a first region of the imaging unit in a manner to be different from a second mode to read out a signal, generated in the photoelectric converter unit, relative to a pixel included in a second region of the imaging unit; and a control unit for controlling the readout unit in a manner to read out the signal, generated in the photoelectric converter unit, relative to the pixel included in the second region in the second mode, while reading out the signal, generated in the photoelectric converter unit, relative to the pixel included in the first region in the first mode.

Description

  The present invention relates to an imaging device and an imaging element.

  Conventionally, a camera configured to be able to change the size of a rectangular portion selected as an imaging area from the imaging surface of a solid-state imaging device according to the frame speed and to be able to change the readout start position of the imaging area for each frame Is known (for example, Patent Document 1).

JP-A-5-30437

  However, there is a problem in that still images cannot be taken while shooting moving images by setting the imaging areas for moving images and still images.

The imaging device according to claim 1, wherein the imaging unit includes a plurality of pixels including a photoelectric conversion unit that converts light into electric charges, and a reading unit that reads a signal generated by the electric charge photoelectrically converted by the photoelectric conversion unit. First mode for reading out signals generated by the photoelectric conversion units of the pixels included in the first area of the imaging unit, and second mode for reading out signals generated by the photoelectric conversion units of the pixels included in the second area of the imaging unit. A setting unit that is set differently from the mode, and a photoelectric conversion unit for a pixel included in the second region when a signal generated by the photoelectric conversion unit for the pixel included in the first region is read in the first mode And a control unit that controls the reading unit so as to read out the signal generated in step 2 in the second mode.
The imaging device according to claim 10, wherein the imaging unit includes a plurality of pixels including a photoelectric conversion unit that converts light into electric charge, and a readout unit that reads out a signal generated by the photoelectric conversion performed by the photoelectric conversion unit. First mode for reading out signals generated by the photoelectric conversion units of the pixels included in the first area of the imaging unit, and second mode for reading out signals generated by the photoelectric conversion units of the pixels included in the second area of the imaging unit. A setting unit that is set differently from the mode, and a photoelectric conversion unit for a pixel included in the second region when a signal generated by the photoelectric conversion unit for the pixel included in the first region is read in the first mode The moving image data is generated using the control unit that controls the reading unit so as to read the signal generated in the second mode and the signal read from the reading unit of the pixels included in the first region, Read from the readout section of the pixels included in the area Using the signals, comprising a generator for generating a still image data, a moving image represented by moving image data, still image represented by the still image data, a display control unit for displaying on the display device, and the.
The imaging device according to claim 15 is set to read in a first mode a first photoelectric conversion unit that converts light into electric charge, and a first signal generated by the electric charge photoelectrically converted by the first photoelectric conversion unit. A first region having a first reading unit, a second photoelectric conversion unit that converts light into electric charges, and a second signal when the first signal is read by the first reading unit. And a second region having a second readout unit set to read out the second signal generated by the converted charge in a second mode different from the first mode.

The block diagram explaining the principal part structure of the digital camera by embodiment of this invention The figure explaining the detail of the image pick-up element of the digital camera of embodiment Diagram explaining the area specification operation The figure which shows the various examples of the area | region which can be divided | segmented by area | region designation | designated operation The figure which illustrates typically an example of the read-out of the image signal in a moving image and still image simultaneous imaging mode The figure which illustrates typically the correspondence of reading of an image signal and the display of a liquid crystal display Flowchart for explaining operation of digital camera according to embodiment Conceptual diagram for explaining a reading area by a rolling shutter system according to a modification.

  A camera according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a main configuration of the digital camera 1. The digital camera 1 includes a photographing lens L1, an image sensor 101, a control circuit 102, an LCD drive circuit 103, a liquid crystal display 104, a touch panel 105, an operation unit 106, and a memory card interface 107.

  The imaging element 101 is an XY address type photoelectric conversion element having a large number of pixels arranged in a matrix. The image sensor 101 is driven in accordance with the control of the control circuit 102 described later to capture a subject image input through the photographing lens L1, and outputs an image signal obtained by the imaging to the control circuit 102. In the present embodiment, the image sensor 101 is driven by a method of sequentially releasing the shutter for each scanning line (so-called rolling shutter method). The imaging device 101 outputs a pixel signal for generating still image data from pixels included in an arbitrary partial region according to a user operation in a moving image / still image simultaneous shooting mode described later. An image signal for generating moving image data can be output from the pixels included in this area.

  The control circuit 102 includes a CPU, a ROM, a RAM, and the like (not shown), and is an arithmetic circuit that controls each component of the digital camera 1 and executes various data processes based on a control program. The control program is stored in a nonvolatile memory (not shown) in the control circuit 102. The control circuit 102 functionally includes an image processing unit 110 and an area dividing unit 112. The image processing unit 110 converts an image signal input from the image sensor 101 into a digital image signal, performs various image processing on the digital image signal to generate image data, and gives additional information or the like to generate an image. Generate a file. Then, the image processing unit 110 records the generated image file on a recording medium such as a memory card 108 described later. Further, the image processing unit 110 generates display image data to be displayed on the liquid crystal display 104 described later, based on the image data recorded on the memory card 108.

  The image processing unit 110 functionally includes a still image processing unit 110a, a moving image processing unit 110b, and a combining unit 110c. The still image processing unit 110a generates still image data and a still image file using the image signal output from the image sensor 101, and records them in the memory card 108. The moving image processing unit 110 b generates moving image data and a moving image file using the image signal output from the image sensor 101 and records the generated data in the memory card 108. The combining unit 110c generates a combined file using the still image data generated by the still image processing unit 110a and the moving image data generated by the moving image processing unit 110b in the moving image / still image simultaneous shooting mode described later, Record on the card 108. The synthesizing unit 110 c generates display image data using the still image data generated by the still image processing unit 110 a and the moving image data generated by the moving image processing unit 110 b and outputs the display image data to the LCD drive circuit 103. The still image processing unit 110a, the moving image processing unit 110b, and the combining unit 110c will be described later.

  When the moving image / still image simultaneous shooting mode is set, the region dividing unit 112 divides the shooting region of the image sensor 101 into a moving image region and a still image region in accordance with an operation of designating a region by the user. Details of the area dividing unit 112 will be described later.

  The LCD drive circuit 103 is a circuit that drives the liquid crystal display 104 based on a command from the control circuit 102. The liquid crystal display 104 corresponds to the display image data created by the image processing unit 110 based on the image data recorded on the memory card 108 together with the live view display that displays the image captured by the image sensor 101 in real time. Displays an image. The liquid crystal display 104 displays a menu screen for various settings of the digital camera 1 based on the operation of the touch panel 105 or the operation unit 106. The contents that can be set on the menu screen include setting of an area (still image area) for generating a still image in the moving image / still image simultaneous shooting mode described later.

  The liquid crystal display 104 is provided with a touch panel 105. When the user presses the surface of the liquid crystal display 104 with a finger, the touch panel 105 outputs an operation signal for operating the digital camera 1. The touch panel 105 has a fine input area divided in a grid pattern on the display range. When the user presses the touch panel 105 with a finger or a touch pen, the input area at the pressed position is turned on. The touch panel 105 outputs information for identifying the position of the input area on the touch panel 105, for example, coordinate values, to the control circuit 102 as an operation signal of the touch panel 105. In the present embodiment, touch panel 105 accepts an operation for designating a still image area, which will be described later, by the user, and controls the coordinate value of a position (for example, two vertices) that defines a still image shooting area (for example, a rectangular area). Output to the circuit 102.

  The operation unit 106 includes various switches provided corresponding to various operation members operated by the user, and outputs an operation signal corresponding to the operation of the operation member to the control circuit 102. The operation member is selected by, for example, a movie release button, a still image release button, a menu button for displaying the above menu screen, a cross key operated when selecting various settings, and a cross key. A determination button for determining settings and the like, a mode switching button for switching the operation of the digital camera 1 between the shooting mode and the playback mode, and the like are included. Further, the operation unit 106 can set a still image shooting mode, a moving image shooting mode, and a moving image / still image simultaneous shooting mode as the imaging mode.

  The memory card interface 107 is an interface to which the memory card 108 can be attached and detached. The memory card interface 107 is an interface circuit that writes an image file to the memory card 108 and reads an image file recorded on the memory card 108 based on the control of the control circuit 102. The memory card 108 is a semiconductor memory card such as a compact flash (registered trademark) or an SD card.

  Next, the image sensor 101 will be described in detail with reference to FIG. As shown in FIG. 2, the image sensor 101 includes a plurality of pixels 101 </ b> P, a vertical scanning circuit 120, and a horizontal scanning circuit 121. Each pixel 101P includes a pixel photodiode (PD), a floating diffusion (FD), a transfer gate switch (TX), a reset switch (RESET), a pixel amplifier (AMI), and the like, and irradiates the pixel photodiode (FD). The subject light to be photoelectrically converted according to the intensity thereof is output as an image signal. Each pixel 101P is provided with a pixel selection switch 122. The pixel selection switch 122 is a switch for individually selecting the pixels 101P from which image signals are read. The pixel selection switch 122 is controlled to be turned on / off by the vertical scanning circuit 120.

  The image sensor 101 includes a vertical signal line Ln for each pixel column, and a vertical line selection switch 123 and a CDS (correlated double sampling) circuit 124 for each vertical signal line Ln. The vertical line selection switch 123 is a switch for selecting the pixel 101P from which the pixel signal is read out for each pixel column. The vertical scanning circuit 120 and the horizontal scanning circuit 121 control ON / OFF of the pixel selection switch 122 and the vertical line selection switch 123, respectively, in accordance with instructions from the control circuit 102.

  The operation of the digital camera 1 in the present embodiment will be described. Hereinafter, an operation for specifying a still image region (region specifying operation) when the moving image / still image simultaneous shooting mode is set by the operation of the operation unit 106 of the user, and the image sensor 101 according to the region specifying operation The still image area setting process will be mainly described.

  When the menu button of the operation unit 106 is operated by the user after the moving image / still image simultaneous shooting mode is set, the control circuit 102 causes the liquid crystal display 104 to display a menu screen via the LCD driving circuit 103. When the still image area setting included in the menu screen is selected, the control circuit 102 receives an area designation operation by the user. In the present embodiment, it is assumed that the user performs an area specifying operation by the following method.

  The user presses, for example, two points that are diagonal points of the rectangular area desired to be cut out from the touch panel 105. As a result, the user can designate a still image display area SDR for displaying a still image on the screen of the liquid crystal display 104. On the touch panel 105 shown in FIG. 3A, when the user presses the position P1 (FIG. 3B), for example, which is the upper left corner of the still image display area SDR, the touch panel 105 moves to the pressed position P1. An operation signal indicating the coordinate value (x1, y1) is output to the control circuit 102.

  Next, as illustrated in FIG. 3B, when the user presses the position P2 that is the lower right corner of the still image display area SDR, the touch panel 105 indicates the coordinate value (x2, y2) of the pressed position P2. An operation signal is output to the control circuit 102. When an operation signal indicating the coordinate values of the positions P1 and P2 is input, the control circuit 102 stores the two coordinate values (x1, y1) and (x2, y2) in a memory (not shown) as still image area information. . On the liquid crystal display 104, the area not set as the still image display area SDR by the user as described above is a moving image display area MDR for displaying a moving image.

  After the user performs the region designation operation for the still image display region SDR as described above, when the user operates, for example, the determination button of the operation unit 106, the operation unit 106 outputs a determination signal indicating the region determination to the control circuit 102. To do. When the determination signal is input, the area dividing unit 112 of the control circuit 102 sets the area on the image sensor 101 corresponding to the still image display area SRD specified by the area specifying operation as shown in FIG. A still image area setting process is performed by setting the area SR. That is, the area dividing unit 112 selects pixels 101P for reading out image signals for generating still image data from all the pixels 101P constituting the image sensor 101 based on still image area information stored in a memory (not shown). Set. In this case, the region dividing unit 112 converts the coordinate value stored in the memory as still image region information into the pixel position on the image sensor 101, and stores the converted coordinate value in a memory (not shown). In other words, the area dividing unit 112 divides the imaging surface of the imaging element 101 into a plurality of imaging areas in accordance with an area specifying operation by the user. Then, as shown in FIG. 3C, the region dividing unit 112 converts a region that is not set as the still image region SR by the region specifying operation and the still image region setting process described above into a moving image shooting region (moving region) MR. Set as.

  In the above description, the case where the image sensor 101 is divided into the left and right parts of the moving image region MR and the still image region SR has been described. However, the present invention is not limited to this example. For example, as shown in FIG. 4A, the area dividing unit 112 divides the image sensor 101 into four rectangular areas. For example, the upper left and lower right are set as a still image area SR, and the other two areas are animated. It may be divided into regions MR. Further, as shown in FIG. 4B, the region dividing unit 112 may perform division so that the outer peripheral portion of the image sensor 101 is set as the still image region SR and the vicinity of the central portion is set as the moving image region MR. . Further, as shown in FIG. 4C, the region dividing unit 112 divides the image sensor 101 into three in the pixel row direction, and sets the image sensor 101 to be a still image region SR, a moving image region MR, and a still image region SR, respectively. May be. That is, in the digital camera 1 of the present embodiment, an arbitrary number of still image regions SR can be set at an arbitrary position on the image sensor 101 in accordance with a user operation.

  Furthermore, in the above description, the region designation operation is performed by a pressing operation on the touch panel 105 by the user. However, the region specifying operation may be performed by the user operating the operation unit 106. In this case, for example, the user operates the cross key to perform the area specifying operation while confirming the cursor displayed on the liquid crystal display 104, and operates the enter button when the desired still image area SR is specified. That's fine.

  When an operation signal instructing the start of moving image shooting is output from the operation unit 106 in response to the user's operation of the release button for moving image after the imaging region is divided, that is, after the region setting process is completed, the control circuit Reference numeral 102 controls the image sensor 101 to output an image signal. At this time, the control circuit 102 controls the vertical scanning circuit 120 and the horizontal scanning circuit 121 to output an image signal for generating moving image data, for example, every three pixel rows among all the pixels 101P constituting the image sensor 101. (1/3 thinning readout).

  FIG. 5 schematically shows a pixel 101P to which an image signal is output after moving image shooting is started. In FIG. 5, the pixel row including the pixel 101 </ b> P that outputs an image signal is indicated by hatching. FIG. 5A shows an example in the case of the above-mentioned 1/3 decimation readout. In this case, the control circuit 102 uses the first pixel row, the fourth pixel row,..., The (3n-2) pixel row as a selected row, and generates moving image data for the pixel 101P included in the selected row. The image signal for output is output every predetermined cycle (for example, 1/30 second cycle). As shown in FIG. 5A, when the moving image / still image shooting mode is set and the release button for moving images is operated, the imaging element 101 of the image sensor 101 is independent of the divided state of the still image region SR and the moving image region MR. Moving image shooting is performed using all the imaging regions.

  The image signal output from the image sensor 101 by the 1/3 decimation readout is input to the moving image processing unit 110b of the image processing unit 110. The moving image processing unit 110b performs various types of image processing on the input image signal to generate moving image data, and stores it in a predetermined work memory (not shown). Further, the image processing unit 110 generates display image data using the moving image data generated by the moving image processing unit 110 b and outputs the display image data to the LCD driving circuit 103. As a result, a moving image corresponding to the generated moving image data is displayed on the entire screen (all regions) of the liquid crystal display 104.

  Next, in a state where moving image shooting is started in the moving image / still image simultaneous shooting mode, an operation signal instructing the start of still image shooting is output from the operation unit 106 in response to the user's operation of the release button for still images. The case will be described. At this time, the control circuit 102 is arranged in the pixel 101P arranged in the region on the image sensor 101 corresponding to the still image region SR and the other region, that is, the region on the image sensor 101 corresponding to the moving image region MR. Image signals are output from the pixels 101P in different reading modes.

  As shown in FIG. 5B, the control circuit 102, for the pixels 101P from the first column to the X-th column corresponding to the still image region SR, receives image signals from the pixels 101P included in all the pixel rows. Is output. The range from the first column to the X-th column is the coordinate value of the pixel 101P that reads the image signal for generating still image data set by the region dividing unit 112 based on the still image region information. Corresponding. In other words, the control circuit 102 controls the vertical scanning circuit 120 and the horizontal scanning circuit 121, and all the pixels 101P included in the coordinate value range (that is, the still image region SR) set corresponding to the still image region information. Output an image signal (read out still image area all pixels).

  The image signal output by the still image area all-pixel readout is input to the still image processing unit 110a of the image processing unit 110. The still image processing unit 110a performs various types of image processing on the input image signal to generate still image data, and stores it in a predetermined work memory (not shown). Furthermore, the still image processing unit 110a stores information related to the time when the still image data was generated in the working memory in association with the still image data. Note that the information regarding the time includes the time when the still image shooting instruction is performed, or the frame number indicating how many frames of moving image data are generated when the still image shooting instruction is performed.

  On the other hand, as shown in FIG. 5B, the control circuit 102 causes the pixel 101P to output an image signal every three pixel rows for the pixels 101P in the (X + 1) th column and subsequent columns corresponding to the moving image region MR. That is, the control circuit 102 controls the vertical scanning circuit 120 and the horizontal scanning circuit 121 to output image signals to the pixels 101P included in the moving image region MR by 1/3 thinning-out reading (moving image region 1/3). Thinning out reading). The image signal output by the moving image region 1/3 decimation readout is input to the moving image processing unit 110b of the image processing unit 110. The moving image processing unit 110b performs various types of image processing on the input image signal to generate moving image data, and stores it in a predetermined work memory (not shown).

  The synthesizer 110c generates display image data using still image data and moving image data stored in the work memory. Then, the combining unit 110c outputs the generated display image data to the LCD driving circuit 103 and causes the liquid crystal display 104 to display a corresponding image. As a result, the LCD drive circuit 103 displays a still image in the still image region SDR and a moving image in the moving image display region MDR among the entire screen of the liquid crystal display 104.

  When the output of the image signal from the still image region SR described above is completed, the control circuit 102 thereafter outputs the image signal from the pixel 101P included in the moving image region MR by 1/3 decimation readout. That is, the control circuit 102 controls the image sensor 101 to prohibit the output of image signals from the pixels 101P included in the still image region SR. As a result, an image signal is output from the pixel 101P included in the hatched pixel row shown in FIG. The synthesizing unit 110 c generates new display image data using the newly generated moving image data and the still image data that is already generated and stored in the working memory, and outputs the generated display image data to the LCD driving circuit 103. . In other words, the LCD driving circuit 103 continuously displays the generated still image on the still image display area SDR of the liquid crystal display 104. As a result, the moving image is updated and displayed at a predetermined frame rate in the moving image display area MDR of the liquid crystal display 104, but the still image is displayed as a freeze image in the still image display area MDR.

  When the user performs an operation for instructing to capture a still image again, as described above, the control circuit 102 displays the image from all the pixels 101P included in the still image region SR as shown in FIG. Output a signal. The still image processing unit 110a newly generates still image data using an image signal newly input from the pixel 101P in the still image region SR, and stores the still image data in association with time information. Further, the combining unit 110c generates display image data using the still image data newly generated by the still image processing unit 110a and the moving image data generated by the moving image processing unit 110b, and the LCD driving circuit 103. Output to. As a result, a still image corresponding to the newly generated still image data is displayed in the still image region SDR of the liquid crystal display 104.

  With reference to FIG. 6, the relationship between the output of the image signal of the image sensor 101 and the display of the liquid crystal display 104 when the moving image / still image simultaneous shooting mode is set will be described. FIG. 6 illustrates an area for outputting an image signal M for generating moving image data from the image sensor 101, an area for outputting an image signal S for generating still image data (still image area SR), and the liquid crystal display 104. The relationship between the moving image display MD and still image display SD1 and SD2 and the time is shown. When the start of moving image shooting is instructed at time t0 in FIG. 6A, the image signal M is output by 1/3 decimation readout from the pixels 101P included in the entire imaging region of the imaging device 101. Then, the moving image display MD is performed in response to the image signal M in the entire display area of the liquid crystal display 104.

  If the start of still image shooting is instructed at time t1 (when the fourth frame of moving image data is generated) after the generation of moving image data of the third frame, it is included in the still image region SR of the image sensor 101. The image signal S is output from the pixel 101P, that is, the region indicated by S in FIG. 6 (the left half of the image sensor 101) by reading out all pixels of the still image region. Further, the image signal M is output by thinning out the moving image region 1/3 from the pixel 101P included in the moving image region MR of the image sensor 101, that is, the region indicated by M in FIG. 6 (the right half of the image sensor 101). Thereafter, the image signal M is a pixel in the right half region of the image sensor 101 indicated by M in FIG. 6 until the time when the moving image release button is operated again by the user and the photographing end signal is output from the operation unit 106. 101P is output by thinning out the moving image area 1/3. The moving image display area MDR (the right half of the liquid crystal display 104) of the liquid crystal display 104 displays the moving image display MD, and the still image display area SDR (the left half of the liquid crystal display 104) displays the still image display SD1. .

  Between time t1 and time t2 (during the generation of moving image data of the fifth and sixth frames), as described above, the image signal M for generating moving image data is transferred from the pixel 101P in the region indicated by M to the moving image. It is output by reading out the area 1/3. In other words, neither the image signal S nor the image signal M is output from the pixel 101P included in the still image region SR. The moving image display area MDR of the liquid crystal display 104 (the right half of the liquid crystal display 104) displays the fifth and sixth frames of the moving image display MD, and the still image display area SDR is generated at time t1. The still image display SD1 corresponding to the still image data is continuously performed.

  When a second still image shooting instruction is given by the user at time t2 (when the seventh frame of moving image data is generated), the image signals S and M are output in the same manner as at time t1. The moving image display area MDR (the right half of the liquid crystal display 104) of the liquid crystal display 104 displays the moving image display MD, and the still image display area SDR (the left half of the liquid crystal display 104) displays the still image display SD2. . This still image display SD2 is continued until a photographing end operation is performed at time t3.

  When a signal instructing the end of shooting is output from the operation unit 106 in response to the re-operation of the moving image release button by the user, the control circuit 102 controls the image sensor 101 to end the output of the image signal. The synthesizing unit 110c generates a synthesized image file using the generated moving image data and still image data, and records the synthesized image file on the memory card 108 via the memory card interface 107. At this time, the synthesizing unit 110c records information on the time when the still image data was captured in the additional information portion of the synthesized image file. That is, in the example illustrated in FIG. 6, the combining unit 110c records information indicating that the first still image data corresponds to the times t1 to t2, and the second image data corresponds to the times t2 to t3. Record information indicating what to do. The combining unit 110c may record the frame number of the moving image data corresponding to the still image data.

  When the playback mode is set by the user and the playback of the composite file generated as described above is instructed, the image processing unit 110 displays the video by referring to the moving image data, still image data, and time information of the composite file. Image data is generated. As a result, as in the display example of the liquid crystal display 104 shown in FIG. 6, from the time t0 to t1, moving images corresponding to the moving image data from the first frame to the third frame are displayed in the entire display area of the liquid crystal display 104. Is done. From time t1 to time t2, the image processing unit 110 generates display image data using the first still image data and the moving image data of the fourth to sixth frames. As a result, as in the display example of the liquid crystal display 104 shown in FIG. 6, the first still image is displayed in the still image display area SDR of the image liquid crystal display 104 and the fourth to fourth in the moving image display area MDR. A moving image corresponding to 6 frames of moving image data is displayed. Furthermore, from time t2 to t3, the image processing unit 110 generates display image data using the second still image data and the moving image data from the fifth to the seventh frames. As a result, as shown in the display example of the liquid crystal display 104 in FIG. 6, the second still image is displayed in the still image display area SDR of the image liquid crystal display 104, and the fifth to fifth in the moving image display area MDR. A moving image corresponding to 7 frames of moving image data is displayed.

The operation of the digital camera 1 according to the embodiment will be described with reference to the flowchart shown in FIG. The processing in FIG. 7 is performed by executing a program in the control circuit 102. This program is stored in a memory (not shown), and is activated and executed by the control circuit 102 when the user simultaneously sets the moving image / still image simultaneous shooting mode.
In step S1, an area designation operation by the user is accepted, an area setting process is performed, and the process proceeds to step S2. In step S2, a timer is activated to start time measurement when the release button for moving images is not operated, and the process proceeds to step S3.

  In step S3, it is determined whether or not the moving image release button has been operated by the user. When the release button for moving images is operated and a signal instructing the start of moving image shooting is input from the operation unit 106, an affirmative determination is made in step S3 and the process proceeds to step S4. If the release button for moving images is not operated and a signal for instructing start of moving image shooting is not input from the operation unit 106, a negative determination is made in step S3, and the process proceeds to step S10 described later.

  In step S4, moving image data is generated by outputting an image signal by 1/3 decimation readout to the pixels 101P included in the entire imaging region of the image sensor 101, and stored in the work memory. Then, the moving image corresponding to the generated moving image data is displayed in the entire display area of the liquid crystal display 104, and the process proceeds to step S5. In step S5, it is determined whether or not the user has operated the still image release button. When the still image release button is operated and a signal instructing the start of still image shooting is input from the operation unit 106, an affirmative determination is made in step S5 and the process proceeds to step S6. If the still image release button is not operated and a signal for instructing the start of still image shooting is not input from the operation unit 106, a negative determination is made in step S5, and the process proceeds to step S7 described later.

  In step S6, still image data is generated using the image signal output from the pixel 101P included in the still image region SR set by the region setting process in step S1, and is associated with time-related information in the work memory. Store. Also, moving image data is generated using the image signal output from the pixel 101P included in the moving image region MR, and stored in the work memory. Then, the moving image corresponding to the generated moving image data is displayed in the moving image display area MDR of the liquid crystal display 104 and the moving image corresponding to the still image data is displayed in the still image display area SDR of the liquid crystal display 104, and the process proceeds to step S7.

  In step S7, it is determined whether or not the moving image release button has been operated by the user to instruct the end of shooting. If a signal instructing the end of shooting is input from the operation unit 106 in response to the operation of the release button for moving images, an affirmative determination is made in step S7 and the process proceeds to step S8. In step S8, a composite file is generated using the moving image data, still image data, and information related to time stored in the work memory, and the process ends. If the release button for moving images is not operated and a signal for instructing the end of shooting is not input from the operation unit 106, the process proceeds to step S9 where a negative determination is made in step S7. In step S9, moving image data is generated using the image signal output from the pixel 101P included in the moving image region MR, stored in the work memory, and the process returns to step S5.

  In step S10, which is advanced after a negative determination is made in step S3, it is determined whether the user has operated the still image release button, as in step S5. If the still image release button is operated, an affirmative determination is made in step S10 and the process proceeds to step S11. In step S11, in the moving image / still image simultaneous shooting mode, for example, “operate the release button for moving images first” to warn that still image shooting cannot be performed if movie shooting has not started. And the like are displayed on the liquid crystal display 104, and the process proceeds to step S12. If the release button for still images is not operated by the user, a negative determination is made in step S10 and the process proceeds to step S12. In step S12, it is determined whether or not a predetermined time has elapsed since the start of time measurement in step S2. If the predetermined time has not elapsed, a negative determination is made in step S12 and the process returns to step S3. If the predetermined time has elapsed, an affirmative determination is made in step S12 and the process ends.

According to the digital camera 1 according to the embodiment described above, the following functions and effects can be obtained.
(1) The image sensor 101 includes a plurality of pixels 101P which are a plurality of photoelectric conversion elements that receive light incident through the photographing lens L1 and output an image signal. The area dividing unit 112 divides the imaging surface of the image sensor 101 into a moving image area MR and a still image area SR. The moving image processing unit 110b generates moving image data using the image signal output from the pixel 101P included in the moving image region MR. Furthermore, the still image processing unit 110a generates still image data when moving image data is generated using the image signal output from the pixel 101P included in the still image region SR different from the moving image region MR. . Therefore, since a still image and a moving image can be simultaneously photographed for each region desired by the user on the same image sensor 101, an editing operation by the user such as inserting a still image into a part of the moving image photographing region after the photographing is completed. It can be omitted. As a result, the editing operation can be performed simultaneously with the photographing, so that it is possible to cope with various photographing methods desired by the user.

(2) The area dividing unit 112 divides the image pickup surface of the image pickup element 101 into a plurality of image pickup areas, that is, a moving image area MR and a still image area SR, before the user performs an operation to instruct the start of shooting. Therefore, the user can perform shooting in the moving image / still image simultaneous shooting mode in a state where a region where a still image can be shot is grasped in advance during moving image shooting.

(3) The LCD driving circuit 103 uses the same liquid crystal display to display a moving image corresponding to the moving image data generated by the moving image processing unit 110b and a still image corresponding to the still image data generated by the still image processing unit 110a. 104 is displayed. Then, the LCD drive circuit 103 displays a moving image in the moving image display area MDR of the liquid crystal display 104 corresponding to the moving image area MR, and displays a still image in the still image display area SDR of the liquid crystal display 104 corresponding to the still image area SR. Displayed. However, the moving image processing unit 110b uses the image signals output from the pixels 101P included in all the imaging regions of the image sensor 101 until the user performs an operation to instruct the start of still image shooting. Generate data. The LCD driving circuit 103 displays the moving image in all display areas of the liquid crystal display 104 from the start of moving image shooting in the moving image / still image simultaneous shooting mode until the start of shooting of the still image is instructed. did. Furthermore, after the still image data is generated by the still image processing unit 110a in response to an operation instructing the user to start capturing a still image, the LCD drive circuit 103 continues to display the still image in the still image display area SDR. I tried to make it. When the user instructs to shoot a new still image, the still image processing unit 110a generates new still image data, and the LCD driving circuit 103 generates a new still image corresponding to the new still image data. Is displayed in the still image display area SDR. Therefore, it is possible to confirm an image equivalent to an edited image in which a still image obtained by cutting off the moment of movement of the subject during video shooting is inserted while shooting.

(4) The combining unit 110c records the still image data generated by the still image processing unit 110a and the moving image data generated by the moving image processing unit 110b in the memory card 108 as a combined file that is the same moving image file. did. Therefore, it is possible to omit an editing operation by the user such as inserting a still image into a part of the moving image shooting area after shooting.

The digital camera 1 of the embodiment described above can be modified as follows.
(1) Instead of generating a combined file by the combining unit 110c, a table for associating moving image data and still image data generated in the moving image / still image simultaneous shooting mode may be created based on time-related information. . In this case, the synthesizer 110c may record the moving image file generated from the moving image data, the still image file generated from the still image data, and the above table on the memory card 108.

(2) In the moving image / still image simultaneous shooting mode, the moving image and the still image may be displayed on a monitor of an external device (for example, a personal computer) instead of the one displayed on the liquid crystal display 104. In this case, the synthesis unit 110c may output the display image data to an external device connected via an external interface (not shown).

(3) The readout area by the rolling shutter system may be set by the area designation operation according to the embodiment. As shown in FIG. 8A, in response to a region specifying operation by the user, the region dividing unit 112 assigns the entire region of the image sensor 101 to the first pixel row to the first n / 2th pixel row. It is assumed that the region R1 is divided into a second region R2 from the (n / 2 + 1) th pixel row to the nth pixel row. In this case, as shown in the timing chart of FIG. 8B, the control circuit 102 makes the pixel 101P in the first pixel row and the pixel 101P in the (n / 2 + 1) th pixel row the same as the start of shooting. Charge accumulation is started at the timing. Thereafter, the control circuit 102 starts charge accumulation at the same timing for the second pixel row and the (n / 2 + 2) pixel row, the third pixel row and the (n / 2 + 3) pixel row,.

  That is, the control circuit 102 performs charge accumulation and image signal reading independently by the rolling shutter method within the same time T as the first region R1 and the second region R2. Therefore, the output of the image signal can be completed in half the time compared to the time 2T when reading from the first pixel row to the n-th pixel row shown in the timing chart of FIG. 8C by the rolling shutter method. it can. As a result, it is possible to reduce the influence of the rolling shutter distortion that occurs on the image data due to the shift of the charge accumulation start time.

  In addition, the present invention is not limited to the above-described embodiment as long as the characteristics of the present invention are not impaired, and other forms conceivable within the scope of the technical idea of the present invention are also within the scope of the present invention. included. The embodiments and modifications used in the description may be configured by appropriately combining them.

101 image sensor, 102 control circuit,
103 LCD driving circuit, 104 liquid crystal display,
110 image processing unit, 110a still image processing unit,
110b moving image processing unit, 110c combining unit,
112 Region division unit

Claims (15)

An imaging unit including a plurality of pixels including a photoelectric conversion unit that converts light into electric charge, and a reading unit that reads out a signal generated by the electric charge photoelectrically converted by the photoelectric conversion unit;
The first mode for reading the signal generated by the photoelectric conversion unit of the pixel included in the first region of the imaging unit is generated by the photoelectric conversion unit of the pixel included in the second region of the imaging unit. A setting unit configured to set differently from the second mode for reading the signal;
When the signal generated by the photoelectric conversion unit of the pixel included in the first region is read in the first mode, the signal is generated by the photoelectric conversion unit of the pixel included in the second region. A control unit that controls the reading unit to read the signal in the second mode;
An imaging apparatus comprising: The imaging device according to claim 1,
The pixel further includes a selection unit that selects whether to read the signal,
The said control part is an imaging device which controls the said selection part and reads the said signal produced | generated by the said photoelectric conversion part of some said pixels among the said pixels contained in the said 1st area | region. The imaging device according to claim 2,
The said control part is an imaging device which controls the said selection part and thins out the said pixel contained in a said 1st area | region, and reads the said signal. In the imaging device according to any one of claims 1 to 3,
The imaging apparatus sets the area of the imaging unit designated by the user as the second area and sets the area of the imaging unit other than the second area as the first area. The imaging apparatus according to claim 4,
The second area is an imaging device that is specified using an image displayed on a display. In the imaging device according to any one of claims 1 to 5,
Using the signal read from the readout unit of the pixel included in the first region, moving image data is generated, and the signal read from the readout unit of the pixel included in the second region An image pickup apparatus further comprising a generation unit that generates still image data using. The imaging device according to claim 6,
The setting unit sets the first area and the second area before the start of shooting,
The generation unit uses the signals read from the reading unit of the pixels included in the first area and the second area until the generation of the still image data is instructed, and uses the video data An imaging device that generates In the imaging device according to claim 6 or 7,
An imaging apparatus further comprising: a recording control unit that records the moving image data and the still image data generated by the generation unit in association with each other on a recording medium. The imaging device according to claim 8,
The recording control unit is an imaging apparatus that records the moving image data and the still image data on the recording medium as the same moving image file. An imaging unit including a plurality of pixels including a photoelectric conversion unit that converts light into electric charge, and a reading unit that reads out a signal generated by the electric charge photoelectrically converted by the photoelectric conversion unit;
The first mode for reading the signal generated by the photoelectric conversion unit of the pixel included in the first region of the imaging unit is generated by the photoelectric conversion unit of the pixel included in the second region of the imaging unit. A setting unit configured to set differently from the second mode for reading the signal;
When the signal generated by the photoelectric conversion unit of the pixel included in the first region is read in the first mode, the signal is generated by the photoelectric conversion unit of the pixel included in the second region. A control unit that controls the reading unit to read the signal in the second mode;
Using the signal read from the readout unit of the pixel included in the first region, moving image data is generated, and the signal read from the readout unit of the pixel included in the second region A generation unit for generating still image data using
A display controller that displays a moving image indicated by the moving image data and a still image indicated by the still image data on a display;
An imaging apparatus comprising: The imaging device according to claim 10.
The display control unit displays the moving image in a first display area of the display corresponding to the first area, and displays the still image in a second display area of the display corresponding to the second area. Imaging device. In the imaging device according to claim 10 or 11,
The display control unit uses the signals read from the readout unit of the pixels included in the first region and the second region until the display of the still image data is instructed, to display the display An imaging apparatus for displaying a moving image in the first display area and the second display area of a container. The imaging device according to any one of claims 10 to 12,
The display apparatus, wherein the display control unit continues displaying the still image in the second display area after the generation unit generates the still image data in response to an instruction to generate the still image data. The imaging device according to claim 13.
When the generation unit is instructed to generate new still image data, the generation unit generates new still image data;
The said display control part is an imaging device which displays the new still image corresponding to the said new still image data produced | generated by the said production | generation part on the said 2nd display area. A first photoelectric conversion unit that converts light into electric charge; and a first reading unit that is set to read in a first mode a first signal generated by the electric charge photoelectrically converted by the first photoelectric conversion unit. A first region having;
A second photoelectric conversion unit that converts light into electric charge, and a second signal generated by the electric charge photoelectrically converted by the second photoelectric conversion unit when the first reading unit reads the first signal. A second region having a second reading unit set to read in a second mode different from the first mode;
An imaging device comprising:

Images