JP2020031255A - Image selection device, camera, and image selection method - Google Patents

Abstract

To provide an image selection device capable of selecting an image that matches the user's intention from multiple nondestructive reading images taken at the same time with different exposure times.SOLUTION: An image selection device 700 includes: a storage part 320 that stores multiple nondestructive reading images which are acquired from a solid-state image pickup device 100 by multiple times of nondestructive reading; a display part 500 for displaying an image for selection, which is a nondestructive reading image for selecting a nondestructive reading image that matches the user's intention from multiple nondestructive reading images, and which is an image corresponding to at least two or more nondestructive reading images among multiple nondestructive reading images; a reception part 600 that receives a selection of an image for the selection made by a user; and a processing part 330 that performs a series of processing on the nondestructive reading image corresponding to the image for selection selected by the user.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to an image selection device, a camera including the image selection device, and an image selection method thereof.

  2. Description of the Related Art Conventionally, an imaging device that captures an image using an image sensor (solid-state imaging device) is known (for example, see Patent Document 1). Generally, an imaging apparatus is provided with a monitor (for example, a liquid crystal monitor), and the user checks the monitor to select an image that meets the user's intention from the captured images.

JP 2008-042180 A

  In recent years, various types of image sensors such as an image sensor using an organic photoelectric conversion film or the like have been proposed. For example, by using these image sensors, a plurality of non-destructive read images having different exposure times can be obtained at the same time. However, there has not been proposed an image selection device that selects an image that meets a user's intention from a plurality of non-destructive readout images captured using these image sensors.

  Therefore, the present disclosure provides an image selection device, a camera, and an image selection method that can select an image that meets a user's intention from a plurality of nondestructive readout images captured at the same time and having different exposure times.

  In order to achieve the above object, an image selection device according to an aspect of the present disclosure includes a storage unit that stores a plurality of nondestructive readout images obtained by performing a plurality of nondestructive readouts from a solid-state imaging device, An image corresponding to each of at least two or more non-destructive read images of the plurality of non-destructive read images, and a non-destructive read image that is intended by the user is selected from the plurality of non-destructive read images. For displaying a selection image, which is a non-destructive readout image, a receiving unit for receiving selection by the user for the selection image, and a nondestructive readout image corresponding to the selection image selected by the user And a processing unit that performs processing.

  Further, a camera according to an aspect of the present disclosure includes the image selection device described above and a solid-state imaging device having a plurality of pixels arranged in a matrix and capable of nondestructive readout.

  Further, the image selection method according to an aspect of the present disclosure is an image selection method corresponding to at least two or more images among a plurality of non-destructive readout images acquired from a solid-state imaging device by a plurality of non-destructive readouts. Displaying a selection image that is a non-destructive read image for allowing the user to select a non-destructive read image that matches the user's intention from the plurality of non-destructive read images, and obtains a selection made by the user for the select image. Then, a process is performed on the non-destructive readout image corresponding to the selection image selected by the user.

  According to the image selection device, the camera, and the image selection method according to an embodiment of the present disclosure, an image that is intended by the user is selected from a plurality of nondestructive readout images captured at the same time and having different exposure times. You can choose.

FIG. 1 is a block diagram illustrating a configuration of a camera in which the image selection device according to the first embodiment is built. FIG. 2 is an external view of a camera including the image selection device according to the first embodiment. FIG. 3 is a block diagram illustrating an overall configuration of the imaging device according to Embodiment 1. FIG. 4 is a diagram illustrating an example of a circuit configuration of the pixel according to the first embodiment. FIG. 5 is a diagram illustrating a relationship between an exposure time and a nondestructive readout image according to the first embodiment. FIG. 6 is a flowchart illustrating the operation of the image selection device according to the first embodiment. FIG. 7A is a diagram illustrating an example of a selection image displayed on the display unit according to Embodiment 1. FIG. 7B is a diagram illustrating an example of an image displayed on the display unit when the selection image according to Embodiment 1 is selected. FIG. 8A is a diagram illustrating an example in which a part of the non-destructive readout image corresponding to the selected selection image according to Embodiment 1 is displayed in an enlarged manner. FIG. 8B is a diagram illustrating an example in which a part of the non-destructive readout image corresponding to the selected selection image according to Embodiment 1 is displayed in an enlarged manner. FIG. 9 is a diagram illustrating another example of the selection image displayed on the display unit according to the first embodiment. FIG. 10 is a flowchart showing the operation of the image selection device according to the second embodiment. FIG. 11A is a diagram illustrating an example of an imaging selection image displayed on the display unit according to Embodiment 2. FIG. 11B is a diagram illustrating an example in which a non-destructive readout image corresponding to the selected imaging selection image according to Embodiment 2 is displayed. FIG. 11C is a diagram illustrating an example in which a selection image corresponding to the selected imaging selection image according to Embodiment 2 is displayed. FIG. 11D is a diagram showing a state in which a selection image according to Embodiment 2 is selected. FIG. 11E is a diagram illustrating an example of an image displayed on the display unit when the selection image according to Embodiment 2 is selected. FIG. 12 is a diagram showing an example in which an image for selecting content according to another embodiment is displayed.

  Hereinafter, an image selection device, a camera, and an image selection method according to the present disclosure will be described in detail with reference to the drawings. Each of the embodiments described below shows a preferred specific example of the present disclosure. Therefore, the numerical values, shapes, materials, constituent elements, arrangement and connection forms of the constituent elements, steps, order of steps, and the like shown in the following embodiments are merely examples, and do not limit the present disclosure. Therefore, among the components in the following embodiments, components that are not described in the independent claims that indicate the highest concept of the present disclosure are described as arbitrary components.

  It is noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the claimed subject matter. In addition, each drawing is a schematic diagram, and is not necessarily strictly illustrated.

(Embodiment 1)
Hereinafter, the present embodiment will be described with reference to FIGS. 1 to 8B.

[1-1. Overall configuration of camera]
First, the overall configuration of the camera 1 including the image selection device 700 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration of a camera 1 in which an image selection device 700 according to the present embodiment is built. The camera 1 shown in FIG. 1 includes an imaging device 10 including a solid-state imaging device (image sensor) 100 and a signal processing unit 300, a lens (optical system including a lens) 400, a display unit 500, and a reception unit. 600. As shown in the figure, in the present embodiment, the image selection device 700 includes a signal processing unit 300, a display unit 500, and a reception unit 600.

  The light that has passed through the lens 400 enters the solid-state imaging device 100. The image selection device 700 acquires a pixel signal (digital value) from the solid-state imaging device 100 according to the amount of received light. Specifically, the signal processing unit 300 acquires pixel signals for a plurality of images from the solid-state imaging device 100. Then, the signal processing unit 300 is an image (selection image) for selecting a desired image that is intended by the user from among the plurality of images, the images corresponding to the plurality of images generated by the pixel signals. (Also referred to as an image) on the display unit 500. When receiving unit 600 receives a selection of a selection image from a user, signal processing unit 300 performs a process according to the user's selection. The processing performed by the signal processing unit 300 will be described later.

  Further, as an example of the camera 1 in which the image selection device 700 is incorporated, for example, a digital still camera 1A shown in FIG. 2A and a digital video camera 1B shown in FIG. Can be

[1-1-1. Configuration of solid-state imaging device]
Next, the configuration of the solid-state imaging device 100 will be described with reference to FIG. FIG. 3 is a block diagram illustrating the overall configuration of the imaging device 10 according to the present embodiment.

  As shown in FIG. 3, the solid-state imaging device 100 includes a pixel array unit 110, a column AD conversion unit 120, a row scanning unit 130, a column scanning unit 140, and a drive control unit 150. In the pixel array section 110 and its peripheral region, a column signal line 160 is arranged for each pixel column, and a scanning line 170 is arranged for each pixel row.

  The pixel array unit 110 is an imaging unit in which a plurality of pixels 210 are arranged in a matrix.

  The column AD conversion (analog / digital converter) unit 120 obtains, holds, and outputs a digital value corresponding to the amount of light received by the pixel 210 by digitally converting a signal (analog signal) input from each column signal line 160. This is a conversion unit. The column AD converter is configured by AD converters 121 provided for each column signal line 160. The AD converter 121 is, for example, an 8-bit AD converter.

  The row scanning unit 130 has a function of controlling the reset operation, the charge accumulation operation, and the read operation of the pixel 210 on a row-by-row basis.

  The column scanning unit 140 causes the signal processing unit 300 to output the digital values for one row held in the column AD conversion unit 120 sequentially to the row signal line 180.

  The drive control unit 150 controls each unit by supplying various control signals to the row scanning unit 130 and the column scanning unit 140. The drive control unit 150 supplies various control signals to the row scanning unit 130 and the column scanning unit 140 based on a control signal from the signal processing unit 300, for example.

  Subsequently, the pixel 210 will be described in detail with reference to FIG. FIG. 4 is a diagram illustrating an example of a circuit configuration of a pixel according to the present embodiment.

  The pixel 210 includes a photoelectric conversion element 211, a reset transistor 212, an amplification transistor 213, a selection transistor 214, and a charge storage unit 215.

  The photoelectric conversion element 211 is a photoelectric conversion unit that performs photoelectric conversion of received light into signal charges (pixel charges). Specifically, the photoelectric conversion element 211 includes an upper electrode 211a, a lower electrode 211b, and a photoelectric conversion film 211c sandwiched between both electrodes. The photoelectric conversion film 211c is a film formed of a photoelectric conversion material that generates electric charge in accordance with received light, and in this embodiment, is formed of an organic photoelectric conversion film including an organic molecule having a high light absorption function. ing. In other words, the photoelectric conversion element 211 according to the present embodiment is an organic photoelectric conversion element having an organic photoelectric conversion film, and the solid-state imaging device 100 is an organic sensor using the organic photoelectric conversion element. Note that the organic photoelectric conversion film is formed over a plurality of pixels 210. Each of the plurality of pixels 210 has an organic photoelectric conversion film.

  The thickness of the photoelectric conversion film 211c is, for example, about 500 nm. The photoelectric conversion film 211c is formed by using, for example, a vacuum evaporation method. The organic molecule has a high light absorption function over the entire range of visible light having a wavelength of about 400 nm to about 700 nm.

  Note that the photoelectric conversion element 211 included in the pixel 210 according to the present embodiment is not limited to the above-described organic photoelectric conversion film, and may be, for example, a photodiode including an inorganic material. .

  The upper electrode 211a is an electrode facing the lower electrode 211b, and is formed on the photoelectric conversion film 211c so as to cover the photoelectric conversion film 211c. That is, the upper electrode 211a is formed over the plurality of pixels 210. The upper electrode 211a is made of a transparent conductive material (for example, ITO: indium / titanium / tin) to make light incident on the photoelectric conversion film 211c.

  The lower electrode 211b is an electrode for extracting electrons or holes generated in the photoelectric conversion film 211c between the lower electrode 211b and the upper electrode 211a. The lower electrode 211b is formed for each pixel 210. The lower electrode 211b is made of, for example, Ti, TiN, Ta, Mo, or the like.

  The charge storage unit 215 is connected to the photoelectric conversion element 211, and stores the signal charge extracted via the lower electrode 211b.

The reset transistor 212 has a drain supplied with the reset voltage V _RST , a source connected to the charge storage unit 215, and resets (initializes) the potential of the charge storage unit 215. Specifically, when a predetermined voltage is supplied (turned on) from the row scanning unit 130 to the gate of the reset transistor 212 via the reset scanning line 170A, the reset transistor 212 causes the potential of the charge storage unit 215 to change. Reset. By stopping the supply of the predetermined voltage, signal charges are stored in the charge storage unit 215 (exposure is started).

The amplification transistor 213 has a gate connected to the charge storage unit 215, a power supply voltage _VDD supplied to the drain, and outputs a pixel signal corresponding to the amount of signal charge stored in the charge storage unit 215.

  The selection transistor 214 has a drain connected to the source of the amplification transistor 213, a source connected to the column signal line 160, and determines a timing at which a pixel signal is output from the amplification transistor 213. Specifically, when a predetermined voltage is supplied to the gate of the selection transistor 214 from the row scanning unit 130 via the selection scanning line 170B, a pixel signal is output from the amplification transistor 213.

  The pixel 210 having the above structure can perform nondestructive readout. Here, the non-destructive readout means reading out a pixel signal corresponding to the amount of charge (signal charge) stored in the charge storage unit 215 during exposure without destroying the charge (signal charge). The term “during exposure” is used to mean an arbitrary timing within the exposure time.

  Note that the solid-state imaging device 100 is not limited to the above-described configuration, and may be any configuration that allows nondestructive readout.

[1-1-2. Configuration of Image Selection Device]
Next, the image selection device 700 will be described with reference to FIG. The image selection device 700 shown in FIG. 7 includes a signal processing unit 300, a display unit 500, and a reception unit 600. The signal processing unit 300 includes a control unit 310, a storage unit 320, and a processing unit 330.

  The signal processing unit 300 performs predetermined image processing on an image acquired from the solid-state imaging device 100, or performs processing such as storing the image. Further, the signal processing unit 300 causes the display unit 500 to display the selection image, and performs processing on the non-destructive readout image corresponding to the selection image selected by the user. Here, the image acquired from the solid-state imaging device 100 is a non-destructive readout image acquired by the solid-state imaging device 100 by non-destructive readout. Further, the selection image is an image corresponding to each of at least two or more of the non-destructive read images acquired from the solid-state imaging device 100, and matches the user's intention from the non-destructive read images. This is an image for selecting a non-destructive readout image. The selection image is, for example, a thumbnail image obtained by reducing the non-destructive readout image. Further, the solid-state imaging device 100 according to the present embodiment has an organic photoelectric conversion film. In other words, the non-destructive readout image is an image captured by the solid-state imaging device 100 having the organic photoelectric conversion film.

  The control unit 310 reads a program from the storage unit 320, for example, and executes the read program. In the above description, the control unit 310 controls the drive control unit 150. However, the control unit 310 may control other units. For example, when receiving unit 600 receives a predetermined instruction from a user, control unit 310 may perform control according to the instruction. For example, when the receiving unit 600 receives an instruction for imaging from the user, the control unit 310 controls the lens 400 (specifically, a motor that controls the position of the lens 400) and adjusts the focus of the subject and the like. Good. Note that the control unit 310 only needs to be included in the imaging device 10 and does not need to be included in the image selection device 700.

  The storage unit 320 stores, for example, a plurality of non-destructive read images acquired from the solid-state imaging device 100 by a plurality of non-destructive read operations. That is, the storage unit 320 stores a plurality of non-destructive readout images acquired by one imaging. It should be noted that one imaging is an example of imaging at the same time. In other words, the storage unit 320 stores a plurality of non-destructive read images captured at the same time and having different exposure times. Further, the storage unit 320 may function as a work memory of the processing unit 330. Note that the storage unit 320 only needs to be included in the image selection device 700, and does not need to be included in the signal processing unit 300.

  The processing unit 330 causes the display unit 500 to display the selection image, and performs processing on the non-destructive readout image corresponding to the selection image selected by the user. Although details will be described later, for example, the processing unit 330 displays the non-destructive readout image corresponding to the selected selection image on the display unit 500 or identifies the nondestructive readout image corresponding to the selected selection image. And store it in the storage unit 320. The identification method is not particularly limited. For example, the nondestructive readout image corresponding to the selection image selected by the user is moved to a predetermined file or stored with additional information.

  Further, the processing unit 330 may generate a selection image for allowing the user to select a non-destructive read image intended by the user from a plurality of non-destructive read images stored in the storage unit 320. The processing unit 330 may cause the storage unit 320 to store the generated selection image in association with the non-destructive readout image from which the selection image is generated.

  Here, a non-destructive read image acquired from the solid-state imaging device 100 will be described with reference to FIG. FIG. 5 is a diagram showing the relationship between the exposure time and the nondestructive read image according to the present embodiment. An example is shown in which N nondestructive readouts are performed N times in one exposure, and N nondestructive readout images of images 1 to N are acquired. For example, the exposure time (time from the start of exposure to the end of exposure) is 1/16 second. Image N is a non-destructive read image obtained by non-destructive read when the exposure time is 1/16 second. Images other than the image N are non-destructive read images obtained by non-destructive read when the exposure time is shorter than the image N. For example, the exposure time of the image 1 is 1/1000 second, the exposure time of the image 2 is 1/500 second, and the exposure time of the image 3 is 1/250 second. Images acquired when the exposure time is short (for example, image 1, image 2 and image 3) are dark as a whole because the amount of accumulated signal charges is small, but when the subject is moving Shows an image with less motion blur. On the other hand, an image acquired when the exposure time is long (for example, the image N) becomes a bright image as a whole due to a large amount of accumulated signal charges. Image. That is, the image generated differs depending on the exposure time (timing at which nondestructive reading is performed). Although FIG. 5 shows two non-destructive readout images, Image 1 and Image N, Image 1 is an image on which the brightness gain has been corrected. That is, the image 1 and the image N are images having substantially the same brightness and different motion blur. The exposure time for performing non-destructive readout is not limited to the above.

  Here, the correction of the brightness gain will be described. Since the non-destructive readout image acquired when the exposure time is short as described above is a dark image as a whole, the processing unit 330 performs image processing such as gain correction for brightness on the nondestructive readout image. You may. For example, image processing such as gain correction may be performed on each of the plurality of nondestructive readout images. For example, a calculation is performed from an exposure time (for example, 1/16 second) of an image having a long exposure time and an exposure time (for example, 1/1000 second) of an image having a short exposure time, and the correction value of the brightness gain is calculated. You may decide. By performing the correction of the brightness gain (specifically, the correction for increasing the brightness), the non-destructive readout image (for example, image 1) acquired when the exposure time is short becomes longer in the exposure time. As compared with the non-destructively read image (for example, the image N) acquired at that time, the image has substantially the same brightness and has less motion blur. That is, it is possible to generate a plurality of images having substantially the same brightness and different motion blurs due to the difference in the exposure time. When the brightness gain is corrected for the nondestructive readout image, the selection image generated from the image is also the corrected image. The non-destructive readout image obtained by the non-destructive readout during exposure is a dark image as described above, but is an in-focus image.

  The display unit 500 is a display device that displays the correction image and the like generated by the signal processing unit 300, and is, for example, a liquid crystal monitor. For example, the display unit 500 is a selection image for selecting a user's favorite non-destructive read image from the non-destructive read images, the images corresponding to at least two or more of the non-destructive read images. Images for display at the same time. The display unit 500 can display various setting information. For example, the display unit 500 can display shooting conditions (aperture, ISO sensitivity, and the like) at the time of shooting.

  The receiving unit 600 is a user interface that receives a user operation, and is a touch panel, a push button, or the like. For example, when the receiving unit 600 is a touch panel, the receiving unit 600 is bonded to the display unit 500 (for example, a liquid crystal monitor). According to the receiving unit 600, the user can select an image to be processed. Note that the receiving unit 600 may receive a user operation such as an imaging instruction or a change in imaging conditions. Then, the control unit 310 controls each unit according to a user operation.

  Note that the image selection device 700 may include an interface (not shown) for performing communication between an external circuit and the signal processing unit 300. The interface is, for example, a communication port including a semiconductor integrated circuit.

[1-2. Processing of Image Selection Device]
Next, processing performed by the image selection device 700 will be described.

[1-2-1. Processing flow of image selection device]
The processing flow of the image selection device 700 will be described with reference to FIG. FIG. 6 is a flowchart showing the operation of the image selection device 700 according to the present embodiment.

  First, the processing unit 330 causes the storage unit 320 to store a plurality of non-destructively read images acquired from the solid-state imaging device 100 by a plurality of non-destructive read operations (S1). The processing unit 330 may cause the storage unit 320 to store a plurality of non-destructively read images on which the above-described correction of the brightness gain has been performed. Note that, in the present embodiment, a plurality of non-destructive read images obtained by a plurality of non-destructive read operations are images obtained by performing a plurality of non-destructive read operations in one imaging. The number of non-destructive read images is the same as the number of non-destructive read operations.

  Then, the processing unit 330 is an image corresponding to each of at least two or more non-destructive read images among the plurality of non-destructive read images stored in the storage unit 320, and A selection image for allowing the user to select a desired non-destructive readout image is generated (S2). That is, the selection image does not need to be generated for all of the plurality of non-destructive readout images stored in the storage unit 320. For example, an image for selection corresponding to a non-destructive read image at intervals of a predetermined exposure time may be generated, or another method may be used. Thereby, the processing time in the processing unit 330 can be reduced.

  Next, the processing unit 330 causes the display unit 500 to display the generated selection image (S3). For example, the processing unit 330 may cause the display unit 500 to display the selection images side by side. More specifically, the processing unit 330 may arrange the selection images in the order of the exposure time and simultaneously display the images on the display unit 500. Accordingly, the user can gradually select from the selection images arranged with different degrees of motion blur, so that an image suitable for the user's preference (intention) can be easily selected. More specifically, it is possible to easily select an image having the degree of motion blur desired by the user.

  Then, when a specific selection image is selected by the user via the reception unit 600 (Yes in S4), the processing unit 330 displays a non-destructive read image corresponding to the selection image selected by the user on the display unit 500. It is displayed on the display unit 500 (S5). The fact that the selection image is selected in step S4 means that the user has selected a specific selection image by, for example, a touch operation on a touch panel. Displaying the non-destructive readout image corresponding to the selected image for selection on the display unit 500 is an example of a process performed by the processing unit 330.

  Since the selection image is an image obtained by reducing the nondestructive readout image, the size of the image is smaller than that of the nondestructive readout image. Therefore, by displaying the non-destructive readout image corresponding to the selection image selected by the user on the display unit 500, the user can check the clearer nondestructive readout image and, for example, save (record) the image. Can be selected. That is, the user can easily select an image to be stored.

  When the user has not selected a specific selection image (No in S4), the processing unit 330 does not perform any processing. That is, the selection image remains displayed.

  Then, when an image to be stored (saved) is selected by the user via the receiving unit 600 (Yes in S6), the processing unit 330 stores the non-destructively read image corresponding to the selected image for selection in the storage unit 320. (S7). Here, the processing unit 330 generates a copy of the non-destructive readout image stored in the storage unit 320 and generates a copy of a file different from the file in which the original nondestructive readout image is stored (for example, a file selected by the user). (A file storing the non-destructive read image), or the selected non-destructive read image may be moved to the file. That is, the identification in such a manner that the image is the non-destructive readout image selected by the user is also included in the storage in step S7. When the image to be stored is selected by the user, for example, in the selection of whether to save the displayed non-destructive readout image (see selection display C1 in FIG. (“Yes” is selected with respect to a selection display C1 in FIG. 7B described later). Storing the non-destructive readout image corresponding to the selection image selected by the user is an example of a process performed by the processing unit 330. Further, the non-destructive read image not selected by the user may be deleted, or may be kept stored in the storage unit 320.

[1-2-2. Details of processing of image selection device]
Subsequently, the processing of the image selection device 700 will be described in more detail with reference to FIGS. 7A and 7B. FIG. 7A is a diagram illustrating an example of a selection image displayed on display unit 500 by processing unit 330 according to the present embodiment. FIG. 7B is a diagram illustrating an example of an image displayed on display unit 500 when a selection image is selected by a user. Hereinafter, an example in which the user selects an image using a touch panel, which is an example of the reception unit 600, will be described, but the selection method is not limited to this. For example, it may be selected by a button or the like.

  FIG. 7A shows an example in which thirteen selection images are displayed side by side below display unit 500. More specifically, a selection image group P1 in which selection images including selection images P11, P17, and P113 are arranged is displayed. Further, adjacent selection images are displayed so as to partially overlap each other. Thus, more selection images can be displayed on the display unit 500, and the user can easily select an intended image. The position and the number of the selection images displayed on the display unit 500 are not particularly limited. Further, the present invention is not limited to the display in which a part of the adjacent selection images is displayed so as to overlap. The images included in the selection image group P1 are images corresponding to at least two or more non-destructive read images of the plurality of non-destructive read images, respectively. 5 is an example of an image for selecting a non-destructive readout image that is intended by the user.

  In FIG. 7A, the images for selection are displayed in order of the exposure time. For example, the selection image P11 displayed on the leftmost in the selection image group P1 is a selection image corresponding to the nondestructive readout image (for example, image 1 in FIG. 5) when the exposure time is the shortest. is there. That is, the image has a small motion blur. Further, for example, the selection image P113 displayed on the rightmost in the selection image group P1 is a selection image corresponding to the nondestructive readout image (for example, the image N in FIG. 5) when the exposure time is longest. It is an image. That is, the image has a large motion blur. The selection images are displayed side by side so that the exposure time gradually increases from the selection image P11 to the selection image P113. In other words, the images from the selection image P11 to the selection image P113 are displayed side by side so that the motion blur gradually increases. Thereby, the user can easily select the selection image on which the intended motion blur is displayed.

  FIG. 7A shows a state in which a specific selection image has not been selected by the user. In this case, for example, the display unit 500 may display a non-destructive readout image corresponding to one of the thirteen selection images. FIG. 7A shows an example in which a non-destructive read image P2 corresponding to the selection image P11 is displayed. For example, the non-destructive readout image is displayed on the display unit 500 so as not to overlap with the selection image (selection image group P1). The non-destructive read image P2 is an image corresponding to each of at least two or more non-destructive read images among the plurality of non-destructive read images, and matches the user's intention from the plurality of non-destructive read images. 9 is an example of a selection image for selecting a nondestructive readout image.

  As illustrated in FIG. 7B, for example, when the accepting unit 600 is a touch panel, a specific selection image is selected by the user touching a specific selection image (in FIG. 7, a selection image P17). Then, the processing unit 330 causes the display unit 500 to display the non-destructive read image P2 corresponding to the selection image. For example, the non-destructive readout image P2 is displayed so as not to overlap with the selection image (selection image group P1). This allows the user to select an image to be stored while checking the non-destructive readout image P2 corresponding to the selected selection image P17. Therefore, the user can check only the selectable image obtained by reducing the nondestructive readout image P2. It is easier to select an image intended by the user than when selecting an image.

  When a specific selection image is selected by the user, the selected selection image (selection image P17 in FIG. 7B) may be displayed larger than other selection images. Thus, even if the user stops the touch operation (for example, touching the selection image), the user checks which non-destructive readout image displayed on the display unit 500 corresponds to which selection image. be able to. Further, when the displayed non-destructive readout image displays a more desired nondestructive readout image instead of an image intended by the user, the nondestructive readout image more intended for the user with reference to the enlarged selection image. It becomes easy to select a selection image corresponding to. When there are 13 or more selection images, the user may select a selection image displayed in the selection image group P1 by performing a swipe operation in the arrangement direction of the selection images.

  Then, when the receiving unit 600 receives an instruction to save a specific non-destructive read image from the user (for example, a touch of “Yes” in the selection display C1 shown in FIG. 7B), the processing unit 330 The read image is stored in the storage unit 320. Note that the storage here means that the stored nondestructive readout image is distinguished from other nondestructive readout images so that the user can recognize that the image is selected by the user. It is intended to include: For example, moving the selected non-destructive readout image to a specific file or adding additional information indicating that the image is selected is also included in the storage.

  For example, when a specific selection image is selected by the user, the processing unit 330 displays, on the display unit 500, an enlarged image obtained by enlarging a partial area of the non-destructive readout image corresponding to the selected selection image. It may be displayed. This case will be described with reference to FIGS. 8A and 8B. The area to be enlarged is determined, for example, by the user. For example, when the user performs a predetermined operation on the displayed non-destructive readout image, an enlarged image is displayed.

  First, a case where a part of the non-destructive readout image corresponding to the selected selection image is displayed in an enlarged manner will be described with reference to FIG. 8A. FIG. 8A is a diagram illustrating an example in which a part of the non-destructive readout image corresponding to the selected selection image is displayed in an enlarged manner. FIG. 8A shows an example in which an enlarged image in which the area of the non-destructive readout image corresponding to the area R of the selected selection image P17 is enlarged is displayed. By displaying an enlarged image in which a part of the non-destructive readout image is enlarged, the user can confirm an image in an area that is particularly important in selecting a desired image and select an image to be saved.

  Next, FIG. 8B shows a case where after displaying an enlarged image obtained by enlarging a part of the non-destructive readout image P2 corresponding to the selection image P17, the user selects a selection image P110 different from the selection image P17. This will be described with reference to FIG. FIG. 8B is a diagram illustrating an example in which a part of the non-destructive readout image P2 corresponding to the selected selection image P110 is displayed in an enlarged manner. When the user selects the selection image P110, the processing unit 330 causes the display unit 500 to display the non-destructive read image P2 corresponding to the selection image P110. At this time, the processing unit 330 causes the display unit 500 to display an enlarged image of the non-destructive read image P2 corresponding to the same region R in the selection image P17 in the selection image P110. With this, when the user confirms an enlarged image obtained by enlarging a partial area of the nondestructive readout image and selects an image to be saved, the user does not need to set the area to be enlarged every time the selection image is selected. Therefore, the operability is improved. That is, an image suitable for the user's intention can be easily selected.

  In the above description, an example in which the selection image group P1 and the non-destructive readout image P2 are displayed as the selection image has been described, but the present invention is not limited to this. As the selection image, at least one of the selection image group P1 and the non-destructive read image P2 may be displayed. For example, only the non-destructive readout image P2 may be displayed on the display unit 500 as the selection image. An example in which only the non-destructive read image P2 is displayed on the display unit 500 as the selection image will be described with reference to FIG. FIG. 9 is a diagram illustrating another example of the selection image displayed on the display unit 500.

  As shown in FIG. 9, a non-destructive read image P2 is displayed on the display section 500 as a selection image. The user can select an image from a plurality of non-destructive read images by checking the clear selection image (non-destructive read image P2). This allows the user to select an image that meets the user's intention.

  First, the processing unit 330 causes the display unit 500 to display a predetermined non-destructive read image from a plurality of non-destructive read images. The predetermined nondestructive readout image is, for example, a nondestructive readout image having an intermediate exposure time among a plurality of nondestructive readout images having different exposure times (an example of one nondestructive readout image). The user checks one non-destructive readout image displayed on the display unit 500. When the nondestructive readout image is stored, the user gives an instruction to store the nondestructive readout image through selection display (not shown) or the like, as in the first embodiment. When receiving section 600 receives an instruction to store from the user, processing section 330 causes storage section 320 to store the non-destructively read image P2.

  On the other hand, when confirming (displaying) a non-destructive read image of another exposure time, the user changes the non-destructive read image P2 to be displayed, for example, by a swipe operation in the left-right direction. The swipe operation in the left-right direction by the user is an example of a predetermined operation received by the receiving unit 600.

  When a user's predetermined operation is received from the receiving unit 600, the processing unit 330 causes the display unit 500 to display a non-destructive read image having a different exposure time from one non-destructive read image. Thus, non-destructive read images having different exposure times can be confirmed, so that an image that meets the user's intention can be selected.

  For example, the processing unit 330 may cause the display unit 500 to display non-destructively read images in the order of the exposure time in accordance with a predetermined operation. Specifically, in FIG. 9, when the user performs a swipe operation in the right direction (from left to right), the processing unit 330 performs a non-destructive read image having a longer exposure time (having a large degree of blur) than one non-destructive read image. Is displayed on the display unit 500. More specifically, the non-destructive readout image is displayed on the display unit 500 from among the plurality of nondestructive readout images, the nondestructive readout image having the longest exposure time after the exposure time for acquiring one nondestructive readout image.

  When the user performs a swipe operation in the left direction (right or left) in FIG. 9, the processing unit 330 displays a non-destructive read image having a shorter exposure time (a smaller degree of blur) than one non-destructive read image on the display unit. 500 may be displayed. More specifically, the display unit 500 displays a non-destructive read image having the shortest exposure time after the exposure time for acquiring one non-destructive read image from a plurality of non-destructive read images.

  This allows the user to check a plurality of non-destructive readout images in the order of the exposure time, so that an image suitable for the user's intention can be easily selected.

[1-3. Effects]
As described above, the image selection device 700 according to the present embodiment includes the storage unit 320 that stores a plurality of nondestructive readout images acquired from the solid-state imaging device 100 by a plurality of nondestructive readouts, An image corresponding to at least two or more non-destructive read images among the non-destructive read images, and a non-destructive read image for allowing the user to select a non-destructive read image from a plurality of non-destructive read images. A display unit 500 that displays a selection image that is a destructive readout image, a receiving unit 600 that receives a selection of a selection image by a user, and a process that performs processing on a nondestructive readout image corresponding to the selection image selected by the user. A part 330.

  Thus, when the subject is moving, an image having a different motion blur depending on the exposure time is obtained. For example, if the exposure time is short, a non-destructive read image with little motion blur is obtained, and if the exposure time is long, a non-destructive read image with many motion blur is obtained. In other words, the user intentionally checks the selection image that is a non-destructive read image from among a plurality of non-destructive read images having different degrees of motion blur in the same time imaging (one imaging). A non-destructive readout image can be selected. Therefore, the image selection device 700 according to the present embodiment can select an image that meets the user's intention from a plurality of nondestructive readout images captured at the same time and having different exposure times.

  Further, as long as the image is a non-destructive read image acquired by non-destructive readout from the solid-state image pickup device 100 capable of non-destructive read-out, even if the image is picked up using various types of solid-state image pickup devices, The image selection device 700 according to the embodiment can select an image that meets the user's intention.

  Further, when a specific selection image is selected by the user (the receiving unit 600 receives the user's selection), the processing unit 330 performs processing on the non-destructive readout image corresponding to the selected selection image. When the processing unit 330 performs a process of displaying the nondestructive readout image corresponding to the selected image for selection on the display unit 500, the user can check the selection image and the nondestructive readout image and select an image. Since it is possible, it is easy to select a non-destructive readout image that is intended by the user. In addition, the processing unit 330 performs a process of storing the nondestructive readout image corresponding to the selected image for selection in the storage unit 320, thereby saving the nondestructive readout image corresponding to the selection image selected by the user. Can be.

  Further, the selection image is an image corresponding to each of at least two or more non-destructive read images of the plurality of non-destructive read images, and the user's intention is selected from the plurality of non-destructive read images. An image for selecting a non-destructive readout image is included.

  Thus, the user can check two or more images for selecting the non-destructive readout image and select an image that meets the user's intention. That is, after confirming two or more images at a time, an intended image can be selected. Therefore, the image selection device 700 according to the present embodiment can select an image that meets the user's intention from a plurality of nondestructive readout images captured at the same time and having different exposure times.

  In addition, the processing unit 330 causes the display unit 500 to display the selection images arranged in order of the exposure time.

  Accordingly, the selection images are displayed on the display unit 500 in the order of the degree of motion blur. In other words, the selection images are displayed side by side so that the motion blur gradually changes, so that the user can more easily select an image that meets the user's intention.

  In addition, the processing unit 330 causes the display unit 500 to display the selection images that are adjacent to each other so as to partially overlap each other.

  Accordingly, a large number of selection images can be displayed on the display unit 500, so that the user can easily select an image that meets the user's intention.

  Further, the processing unit 330 causes the display unit 500 to display a non-destructive read image corresponding to the selection image selected by the user among the selection images.

  Thus, the user can check the selection image and the non-destructive readout image and select an image, so that the user can more easily select an image that meets the user's intention.

  Further, the selection image is one non-destructive read image of the plurality of non-destructive read images.

  Thereby, the user can select an image by checking one non-destructive read image from a plurality of non-destructive read images captured at the same time and having different exposure times (different degrees of motion blur). Can be. The user can select an image by confirming a clear non-destructive readout image, and thus can select an image that meets the user's intention.

  Further, when the receiving unit 600 receives a predetermined operation for one non-destructive read image, the processing unit 330 replaces one non-destructive read image with one non-destructive read image as a process. A non-destructive read image having a different exposure time from the two non-destructive read images is displayed on the display unit 500.

  Thus, non-destructive read images having different exposure times can be confirmed, so that an image that meets the user's intention can be selected.

  The non-destructive readout image is an image on which gain correction for brightness has been performed (reflected).

  Thus, a plurality of non-destructive readout images having different exposure times become images having substantially the same brightness. For example, in the case of an image having a short exposure time, it may be difficult to confirm the image as a whole, but the confirmation is more easily performed by correcting the gain for the brightness. Further, the selection image generated from the non-destructive readout image is also an image on which the gain has been corrected. That is, when the selection image is confirmed, the confirmation becomes easier.

  The non-destructive readout image is an image captured by the solid-state imaging device 100 having the organic photoelectric conversion film.

  Thus, an image suitable for the user's intention can be easily selected from the nondestructive readout images acquired from the solid-state imaging device 100 having the organic photoelectric conversion film.

  Further, the camera 1 according to the present embodiment includes the image selection device 700 described above and the solid-state imaging device 100 having a plurality of pixels 210 arranged in a matrix and capable of nondestructive readout.

  Accordingly, the user's intention such as motion blur is selected from a plurality of non-destructive readout images acquired by a plurality of non-destructive readouts in one image pickup from the solid-state imaging device 100 capable of nondestructive readout provided in the camera 1. Can be selected.

  In addition, even if the camera 1 includes various types of solid-state imaging devices, if a non-destructive readout image obtained by non-destructive readout from the solid-state imaging device is used, an image that meets the user's intention can be selected. Can be.

  Further, the image selection method according to the present embodiment is an image corresponding to each of at least two or more of the non-destructive read images obtained by the non-destructive read from the solid-state imaging device 100 a plurality of times, A selection image, which is a non-destructive read image for allowing the user to select a non-destructive read image that matches the user's intention, from the non-destructive read images, obtains a selection for the selection image by the user, and is selected by the user. The non-destructive readout image corresponding to the selected image is processed.

  Thus, when the subject is moving, an image having a different motion blur depending on the exposure time is obtained. For example, if the exposure time is short, a non-destructive read image with little motion blur is obtained, and if the exposure time is long, a non-destructive read image with many motion blur is obtained. That is, the user can select an image from a plurality of non-destructive readout images having different degrees of motion blur in one imaging. Therefore, with the image selection method according to the present embodiment, an image that meets the user's intention can be selected from a plurality of non-destructive readout images captured at the same time and having different exposure times.

(Embodiment 2)
Hereinafter, the present embodiment will be described with reference to FIGS. 10 to 11E. Note that the configuration of the camera is the same as that of the first embodiment, and a description thereof will be omitted.

[2-1. Processing of Image Selection Device]
In the first embodiment, the description has been given of selecting a non-destructive readout image intended by the user from a plurality of non-destructive readout images acquired in one imaging. In the present embodiment, a description will be given of selecting an image suitable for a user's intention from a plurality of non-destructive readout images acquired in each of two or more imagings. For example, there is a case in which continuous shooting or a moving image is taken of a fast-moving subject, and a non-destructive readout image intended by the user is selected from the images. A plurality of non-destructive readout images can be obtained by performing a plurality of nondestructive readouts in each of continuous shooting and moving image capturing. With the image selection device 700 according to the present embodiment, the user can select a nondestructive readout image that the user intends from among the huge number of nondestructive readout images. The details will be described below. Note that imaging by a predetermined number of continuous shootings or imaging of a moving image in a predetermined period is an example of imaging at the same time.

[2-1-1. Process flow of image selection device]
The processing flow of the image selection device 700 will be described with reference to FIG. FIG. 10 is a flowchart showing the operation of the image selection device 700 according to the present embodiment.

  First, the processing unit 330 causes the storage unit 320 to store a plurality of non-destructive read images acquired by the non-destructive read from the solid-state imaging device 100 a plurality of times (S11). In step S11, the processing unit 330 causes the storage unit 320 to store a plurality of non-destructive readout images obtained by performing the non-destructive readout from the solid-state imaging device 100 a plurality of times in each of the two or more times of imaging.

  Then, the processing unit 330 generates an imaging selection image for allowing the user to select an imaging intended by the user from two or more imagings stored in the storage unit 320 (S12). Note that the processing unit 330 generates, for example, in each of two or more imagings, one imaging selection image from among a plurality of non-destructive readout images. The imaging selection image is, for example, a thumbnail image obtained by reducing a non-destructive read image, like the selection image of the first embodiment.

  The processing unit 330 causes the display unit 500 to display the generated imaging selection image (S13). Then, when a specific imaging selection image is selected by the user via the reception unit 600 (Yes in S14), the processing unit 330 displays a non-destructive read image corresponding to the selected imaging selection image on the display unit 500. It is displayed (S15). Note that, when the specific imaging selection image is not selected by the user (No in S14), the processing unit 330 does not particularly perform the processing. That is, the imaging selection image remains displayed. Displaying the non-destructive readout image corresponding to the selected imaging selection image on the display unit 500 is an example of a process performed by the processing unit 330.

  Then, when the user selects an imaging (specific imaging selection image) that displays the selection image via the reception unit 600 (Yes in S16), the processing unit 330 responds to the selected imaging selection image. A selection image corresponding to each of at least two or more non-destructive read images among the plurality of non-destructive read images acquired in the imaging to be performed is generated and displayed on the display unit 500 (S17). For example, the processing unit 330 causes the display unit 500 to display the imaging selection image in a predetermined direction in the order of the exposure time.

  Subsequently, steps S18 to S21 are performed, but are the same processes as steps S4 to S7 according to the first embodiment, respectively, and description thereof will be omitted.

[2-1-2. Details of processing of image selection device]
Subsequently, the processing of the image selection device 700 will be described with reference to FIGS. 11A to 11E. FIG. 11A is a diagram illustrating an example of an imaging selection image displayed on display unit 500 by processing unit 330 according to the present embodiment. In the drawing, as an example, a case is shown in which an imaging selection image group P3 in which nine imaging selection images including the imaging selection images P31, P35, and P39 are arranged is displayed. That is, nine images for imaging selection at different imaging timings are displayed. It should be noted that the number of imaging selection images to be displayed is not particularly limited.

  For example, the processing unit 330 may generate an imaging selection image from a nondestructive read image acquired at substantially the same exposure time in each of two or more imagings. In FIG. 11A, nine imaging selection images having different imaging timings but substantially the same exposure time are displayed. This allows the user to check the imaging selection image that has substantially the same degree of motion blur and that is generated from the non-destructive readout image that has different imaging timings. It becomes easy to select an image in imaging at the imaging timing. In addition, in each of the two or more imagings, if there is no non-destructive readout image acquired at substantially the same exposure time, for example, the processing unit 330 performs the two or more imagings so as to minimize the difference in the exposure time. A non-destructive readout image that generates an image for image pickup selection may be selected in each of the image pickups.

  For example, the processing unit 330 may cause the display unit 500 to display the imaging selection images in a predetermined direction in the order in which the imaging was performed. FIG. 11A shows an example in which imaging selection images are displayed side by side below the display unit 500. Accordingly, the user can check the image for confirming the image capturing in the order in which the images were captured, so that it is possible to more easily select the image capturing at the image capturing timing that is intended by the user.

  Although FIG. 11A shows a case where the image for imaging selection is not selected by the user, as an example, a case where a non-destructive readout image P2 corresponding to the image for imaging selection P31 is displayed on the display unit 500 is shown. ing. Note that, when the imaging selection image has not been selected by the user, the non-destructive readout image may not be displayed.

  FIG. 11B is a diagram illustrating an example in which a non-destructive readout image corresponding to the selected imaging selection image is displayed on the display unit 500 by the processing unit 330 according to the present embodiment. FIG. 9 shows a case where the user selects the imaging selection image P35 from the nine imaging selection images. The non-destructive readout image P2 corresponding to the selected imaging selection image P35 is displayed on the display unit 500 by the processing unit 330. This allows the user to select the imaging by checking the imaging selection image P35 and the non-destructive readout image P2. Therefore, compared to the case where only the imaging selection image is checked and imaging is selected, It is possible to easily select a suitable imaging. The displayed non-destructive read image P2 may be an image obtained by enlarging a part of the non-destructive read image.

  Further, when the imaging selection image is selected by the user, the processing unit 330 may cause the display unit 500 to display the selected imaging selection image P35 larger than the other imaging selection images. For example, the selected imaging selection image P35 is enlarged and displayed so as not to overlap the displayed non-destructive readout image P2.

  FIG. 11C is a diagram illustrating an example in which a selection image corresponding to the selected imaging selection image according to the present embodiment is displayed. For example, the user selects a specific imaging (imaging timing) by performing a swipe operation on an imaging selection image corresponding to an imaging to be selected. For example, the swipe operation is performed in a direction substantially orthogonal to the arrangement direction of the imaging selection images.

  Then, the processing unit 330 generates a selection image in the selected imaging, and causes the display unit 500 to display the selected image. For example, the processing unit 330 displays the selection images side by side in a direction substantially orthogonal to the arrangement direction of the imaging selection images. For example, a selection image having the same size as the selected and displayed imaging selection image is displayed. In FIG. 11C, a selection image group P1 in which the selection images are arranged in order such that the movement gradually increases from the lower side of the display unit 500 to the upper side and the blur becomes larger (exposure time becomes longer) is displayed. When the selection image and the imaging selection image are generated at substantially the same reduction ratio, the selected imaging selection image may be used as the selection image.

  Although FIG. 11C shows an example in which the selection image group P1 is displayed so as to overlap the non-destructive read image P2, the present invention is not limited to this. For example, the selection image group P1 may be displayed at a position where the selection image group P1 does not overlap with the nondestructive readout image P2 or the overlap is reduced.

  FIG. 11D is a diagram illustrating a state in which the selection image according to the present embodiment is selected. The user selects a selection image that meets the user's intention from the displayed selection image group P1. For example, a selection image is selected by performing a touch operation. In other words, the receiving unit 600 receives a selection of a specific selection image by the user. FIG. 11D shows a case where the selection image displayed in the middle is selected from among the five selection images displayed side by side. Then, when the selection image is selected, the processing unit 330 causes the display unit 500 to display a non-destructive readout image corresponding to the selected selection image.

  FIG. 11E is a diagram illustrating an example of an image displayed on display unit 500 when the selection image according to the present embodiment is selected. In FIG. 11E, the selection image displayed at the position overlapping the non-destructive read image in the select image group P1 is deleted, and the non-destructive read image P2 is displayed so as to be easily viewed. Note that the selection image group P1 does not need to be deleted, and may be displayed in a reduced size, for example.

  When the receiving unit 600 receives an instruction to save the non-destructively read image displayed by the user (for example, touching “Yes” in the selection display C1 shown in FIG. 11E), the processing unit 330 performs the non-destructive reading. The read image is stored in the storage unit 320. Note that the storage here means that the previously stored nondestructive readout image is distinguished from another nondestructive readout image so that the user can recognize that the image is selected by the user. It is intended to include: For example, moving the selected non-destructive readout image to a specific file or adding additional information indicating that the image is selected is also included in the storage.

  When the brightness gain is corrected for the non-destructive readout image, the gain correction is performed (reflected) not only on the selection image but also on the imaging selection image. This makes it possible to confirm the imaging selection image having substantially the same brightness when confirming the imaging selection image, thereby facilitating confirmation.

[2-2. Effects]
As described above, the storage unit 320 included in the image selection device 700 according to the present embodiment stores a plurality of non-destructive images obtained by performing the non-destructive readout from the solid-state imaging device 100 a plurality of times in each of the two or more times of imaging. The read image is stored. Then, the processing unit 330 causes the display unit 500 to display the imaging selection images for selecting the imaging intended by the user in a predetermined direction in the order in which the imaging was performed, and display the specific imaging by the user. When selected, the image for selection corresponding to each of at least two or more non-destructive read images among the non-destructive read images acquired in the selected imaging is orthogonal to the direction in which the imaging selection images are arranged. In the direction, the display time is displayed on the display unit 500 in the order of the exposure time.

  Thus, even when two or more imagings are performed, the imaging (imaging timing) is selected by selecting the imaging selection image, and the non-destructive readout image acquired in the selected imaging is selected. The non-destructive read image to be saved can be selected by selecting the selection image to be performed. In other words, the user can select a non-destructive read image intended by the user from among a plurality of non-destructive read images having different imaging timings and exposure times. can do. In addition, by displaying the image for selection of image pick-up or the image for selection in line with the order of exposure time, the user can select the image for image selection or selection corresponding to the intended non-destructive readout image. Image can be easily selected.

  Further, the processing unit 330 causes the display unit 500 to display an image corresponding to the non-destructive read image when the exposure time is the same among the non-destructive read images acquired for each image capture, as an image for selecting an image.

  Thereby, the image for selection of imaging having the same degree of motion blur and different imaging timing is displayed on the display unit 500, so that the user can easily select the intended imaging timing.

(Other embodiments)
As described above, the embodiments have been described as examples of the technology in the present disclosure. For that purpose, the accompanying drawings and the detailed description have been provided.

  Therefore, among the components described in the accompanying drawings and the detailed description, not only components that are essential for solving the problem, but also components that are not essential for solving the problem, in order to illustrate the above technology. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential based on the fact that the non-essential components are described in the accompanying drawings and the detailed description.

  Further, since the above-described embodiments are for exemplifying the technology according to the present disclosure, various changes, replacements, additions, omissions, and the like can be made within the scope of the claims or the equivalents thereof.

  For example, in the above embodiment, the case where the image selecting device 700 is built in the camera 1 has been described, but the present invention is not limited to this. For example, the image selection device 700 may be built in a device including an imaging device. For example, the image selection device 700 may be built in a smartphone, a tablet, or the like. As a result, an image suitable for the user's intention can be selected from non-destructive readout images captured by a smartphone or the like. Further, the image selection device 700 may be built in a device that does not include an imaging device. For example, it may be built in a personal computer without an imaging device. Thus, using a personal computer, an image that meets the user's intention is selected from a plurality of nondestructive readout images acquired from an apparatus (for example, a camera) having an imaging device having a nondestructive readout solid-state imaging device. can do.

  Further, for example, an example has been described in which the image processing performed by the processing unit 330 on a plurality of non-destructive read images is correction of brightness gain, but the image processing is not limited to this. For example, gradation correction or camera shake correction may be performed, or other image processing may be performed.

  Further, for example, in the above-described embodiment, the receiving unit 600 is a touch panel, and receives an image selection by a user's touch operation. However, the receiving unit 600 is not limited to a touch panel. For example, the receiving unit 600 is a button or the like, and may receive a selection from the user using the button or the like. When the image selecting device 700 is incorporated in a personal computer, the receiving unit 600 is, for example, a mouse or a keyboard.

  Further, in the above-described embodiment, an example has been described in which one non-destructive readout image corresponding to the selected image for selection is displayed, but the present invention is not limited to this. For example, a plurality of non-destructive readout images corresponding to a plurality of selected images for selection may be displayed on the display unit 500 at the same time. The nondestructive readout image may be appropriately reduced and displayed according to the number of nondestructive readout images to be displayed. Accordingly, when there are a plurality of images to be stored, the user can compare the nondestructive readout images (images obtained by reducing the nondestructive readout images) and select the nondestructive readout image to be stored. A suitable image can be selected more easily.

  Further, in the above-described embodiment, an example has been described in which one non-destructive read image to be stored is selected in one imaging, but the number of non-destructive read images to be stored is not particularly limited.

  Further, in the above embodiment, an example in which the selection image or the imaging selection image is selected has been described, but the content to be selected is not limited to this. The image selection device 700 according to the present disclosure is applicable to any application in which a specific nondestructive readout image is selected from a plurality of nondestructive readout images acquired by a plurality of nondestructive readouts. For example, the image selection device 700 of the present disclosure is also applicable when selecting content to be displayed on the display unit 500 from a plurality of contents (contents including a plurality of non-destructive read images). FIG. 12 is a diagram showing an example in which an image for selecting content according to another embodiment is displayed. Specifically, an example is shown in which the content to be displayed on the display unit 500 is selected from the content A (automobile), the content B (horse), and the content C (bird). The selection device 700 is applicable. As a result, it is possible to select a non-destructive read image intended by the user from a plurality of non-destructive read images in the selected content. In FIG. 12, the content B is selected, and the non-destructive readout image corresponding to the content B and the selection display C2 are displayed on the display unit 500. When the user selects “Yes” for the selection display C2, a selection image corresponding to the content B is displayed on the display unit 500. Displaying a non-destructively read image corresponding to the selected content on the display unit 500 is an example of a process performed by the processing unit 330.

  Further, in the above-described modified example, the example in which the non-destructive read images with different exposure times are displayed by the left and right swipe operations has been described, but the present invention is not limited to this. For example, non-destructive read images with different exposure times may be displayed by swiping left and right, and non-destructive read images with different imaging timings may be displayed by swiping up and down.

  Thus, even when two or more imagings are performed, the user can select the imaging intended by the user (imaging timing) and the exposure time (degree of blur) in the imaging by checking the nondestructive readout image. can do.

  In addition, each component (functional block) in the image selection device 700 may be individually formed into one chip by a semiconductor device such as an IC (Integrated Circuit) or an LSI (Large Scale Integration), or may include a part or the whole. As described above. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. After manufacturing the LSI, an FPGA (Field Programmable Gate Array) that can be programmed or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used. Furthermore, if an integrated circuit technology that replaces the LSI appears due to the progress of the semiconductor technology or another derived technology, the functional blocks may be integrated using the technology. The application of biotechnology and the like is possible.

  In addition, all or a part of the above various processes may be realized by hardware such as an electronic circuit, or may be realized by using software. Note that the processing by software is realized by a processor included in the imaging device 10 executing a program stored in a memory. Further, the program may be recorded on a recording medium and distributed or distributed. For example, by installing a distributed program on a device having another processor and causing the processor to execute the program, the device can perform the above-described processing.

  Further, a mode realized by arbitrarily combining the components and functions described in the above-described embodiments is also included in the scope of the present disclosure.

  INDUSTRIAL APPLICATION This indication is widely applicable to the image selection apparatus which selects the non-destructive read-out image acquired by the solid-state imaging device. Specifically, the present disclosure is applicable to information terminal devices such as cameras, smartphones, mobile phones with a camera function, tablet computers, and personal computers.

Reference Signs List 1 camera 1A digital still camera 1B digital video camera 10 imaging device 100 solid-state imaging device 110 pixel array unit 120 column AD conversion unit 121 AD converter 130 row scanning unit 140 column scanning unit 150 drive control unit 160 column signal line 170 scanning line 170A Reset scanning line 170B Selection scanning line 180 Row signal line 210 Pixel 211 Photoelectric conversion element 211a Upper electrode 211b Lower electrode 211c Photoelectric conversion film 212 Reset transistor 213 Amplification transistor 214 Selection transistor 215 Charge storage unit 300 Signal processing unit 310 Control unit 320 Storage unit 330 Processing unit 400 Lens 500 Display unit 600 Reception unit 700 Image selection device P1 Selection image group P11, P17, P110, P113 Selection image P2 Non-destructive read image 3 captured selected image group P31, P35, P39 captured selected image C1, C2 selection display area R

Claims (13)

A storage unit that stores a plurality of non-destructive readout images obtained from the solid-state imaging device by a plurality of non-destructive readouts,
An image corresponding to each of at least two or more non-destructive read images of the plurality of non-destructive read images, and a non-destructive read image intended by the user is selected from the plurality of non-destructive read images. A display unit for displaying a selection image that is a non-destructive readout image for causing
A receiving unit that receives a selection for the selection image by the user,
A processing unit that performs processing on a non-destructive readout image corresponding to the selection image selected by the user. The selection image is an image corresponding to each of at least two or more non-destructive read images of the plurality of non-destructive read images, and is selected from the plurality of non-destructive read images according to a user's intention. The image selection device according to claim 1, wherein the image selection device includes an image for selecting the non-destructive readout image. The image selection device according to claim 2, wherein the processing unit arranges the selection images in order of exposure time and causes the display unit to display the images. 4. The image selection device according to claim 3, wherein the processing unit causes the display unit to display the selection images arranged adjacent to each other so as to partially overlap each other. 5. 5. The processing unit according to claim 1, wherein, as the processing, a non-destructive readout image corresponding to the selection image selected by the user among the selection images is displayed on the display unit. An image selection device according to claim 1. The storage unit stores a plurality of non-destructive readout images obtained by the non-destructive readout from the solid-state imaging device a plurality of times in each of two or more imagings,
The processing unit, the imaging selection image for selecting the imaging of the imaging timing that is intended by the user, in the order in which the imaging was performed, arranged in a predetermined direction and displayed on the display unit, by the user When a specific image is selected, the images for selection corresponding to at least two or more non-destructive read images among the non-destructive read images acquired in the selected image are arranged. The image selection device according to any one of claims 1 to 5, wherein the images are displayed on the display unit in the direction orthogonal to the direction in which the exposure times are arranged. The processing unit causes the display unit to display an imaging selection image corresponding to the non-destructive read image when the exposure time is substantially the same among the plurality of non-destructive read images acquired for each imaging. 7. The image selection device according to 6. The image selection device according to claim 1, wherein the selection image is one non-destructive read image of the plurality of non-destructive read images. When the receiving unit receives a predetermined operation for the one non-destructive read image, the processing unit replaces the one non-destructive read image with the one non-destructive read image, and The image selection device according to claim 8, wherein a nondestructive readout image having a different exposure time from the one nondestructive readout image is displayed on a display unit. The image selection device according to any one of claims 1 to 9, wherein the plurality of nondestructive readout images are images on which gain correction for brightness has been performed. The image selection device according to any one of claims 1 to 10, wherein the plurality of nondestructive readout images are images captured by a solid-state imaging device having an organic photoelectric conversion film. An image selection device according to any one of claims 1 to 11,
A solid-state imaging device having a plurality of pixels arranged in a matrix and capable of nondestructive readout. An image corresponding to each of at least two or more of a plurality of non-destructive readout images obtained by a plurality of non-destructive readouts from a solid-state imaging device. Display a selection image that is a non-destructive read image for selecting a non-destructive read image that matches the intention,
Obtaining a selection for the selection image by the user,
An image selection method for performing a process on a non-destructive readout image corresponding to the selection image selected by the user.

Images