Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/70—Circuitry for compensating brightness variation in the scene
  • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/70—Circuitry for compensating brightness variation in the scene
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/70—Circuitry for compensating brightness variation in the scene
  • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time

Definitions

• the present invention relates to an image pickup apparatus and an image pickup method, a program and a program recording medium, a data structure and a data recording medium, and an image pickup control apparatus, and particularly, for example, in a digital video camera and the like.
• the present invention relates to an imaging device and an imaging method, a program and a program recording medium, a data structure and a data recording medium, and an imaging control device which enable an image of a subject having a strong contrast to be obtained without losing details.
• a digital video camera for example, light from a subject is condensed by a lens on a light receiving surface of a photoelectric conversion element such as a CCD (Charge Coupled Device), and is converted into an image signal, which is an electrical signal by being photoelectrically converted there. It is said.
• a photoelectric conversion element such as a CCD (Charge Coupled Device)
• an object of the present invention is to provide an imaging apparatus capable of photographing a subject having a strong contrast without losing its details.
• An imaging method, a program, a program recording medium, a data structure, a data recording medium, and an imaging control device are provided.
• An imaging apparatus has a light receiving surface that receives light from a subject and performs photoelectric conversion, and outputs an image value obtained as a result of the photoelectric conversion, and an evaluation unit that evaluates the pixel value. And control means for controlling the exposure time to the light receiving surface in pixel units based on the evaluation result by the evaluation means.
• An imaging method includes an evaluation step of evaluating a pixel value obtained from an imaging unit having a light receiving surface for receiving light from a subject and performing photoelectric conversion and outputting a pixel value obtained as a result of the photoelectric conversion. And a control step of controlling the exposure time to the light receiving surface on a pixel-by-pixel basis based on the evaluation result in the evaluation step.
• the program according to the present invention includes: a light receiving surface that receives light from a subject and performs photoelectric conversion, and evaluates a pixel value obtained from an imaging unit that outputs a pixel value obtained as a result of the photoelectric conversion.
• the program recording medium has a light receiving surface that receives light from a subject and performs photoelectric conversion, and evaluates a pixel value obtained from an imaging unit that outputs a pixel value obtained as a result of the photoelectric conversion.
• a program having a step and a control step of controlling an exposure time to a light receiving surface in pixel units based on an evaluation result by the evaluation step. Is recorded.
• a plurality of pixel values output by an imaging device for imaging a subject and a plurality of pixel values and an exposure time for each pixel used in the imaging device to obtain each pixel value are represented by Are associated.
• a plurality of pixel values output by an imaging device for imaging a subject correspond to a plurality of pixel values and an exposure time for each pixel used in the imaging device to obtain each pixel value. Recorded.
• An imaging control device includes: an evaluation unit that evaluates a pixel value; and a control that outputs, to the imaging unit, a control signal that controls an exposure time to a light receiving surface in a predetermined plane unit based on an evaluation result by the evaluation unit. Means.
• An imaging apparatus has a light receiving surface that receives light from a subject and performs photoelectric conversion, and controls an exposure unit that outputs a pixel value obtained as a result of the photoelectric conversion, and a plurality of exposure times for the light receiving surface.
• a control unit that performs a plurality of exposure times at each pixel position and a pixel value corresponding to the plurality of exposure times obtained by imaging the subject with a plurality of exposure times based on the control of the control unit. Selecting means for selecting a value.
• the imaging method has a light receiving surface that receives light from a subject and performs photoelectric conversion, and sets a plurality of exposure times for the light receiving surface in the imaging unit that outputs a pixel value obtained as a result of the photoelectric conversion.
• a control step for controlling, and an image pickup unit based on the control in the control step, obtains one pixel from a plurality of exposure times at each pixel position and a corresponding pixel value obtained by imaging the subject with a plurality of exposure times. Selecting a value.
• a program according to the present invention has a light receiving surface that receives light from a subject and performs photoelectric conversion, and controls a plurality of exposure times for the light receiving surface in an imaging unit that outputs pixel values obtained as a result of the photoelectric conversion. Steps for evaluating a plurality of exposure times at each pixel position and the corresponding pixel values obtained by performing the above-mentioned operations, and calculating a plurality of exposure times and corresponding pixel values based on the evaluation results obtained by the evaluation steps. And a selection step for selecting one pixel value.
• the program recording medium receives light from a subject and performs photoelectric conversion.
• a plurality of exposure times at each pixel position and corresponding pixels obtained by controlling a plurality of exposure times for the light receiving surface in the imaging unit having a light receiving surface and outputting a pixel value obtained as a result of the photoelectric conversion.
• a program is recorded which has an evaluation step of evaluating a value and a selection step of selecting one pixel value from a plurality of exposure times and corresponding pixel values based on the evaluation result of the evaluation step.
• a pixel value obtained from an imaging unit that has a light receiving surface that receives light from a subject and performs photoelectric conversion and outputs a pixel value obtained as a result of the photoelectric conversion is evaluated, and based on the evaluation result, The exposure time to the light receiving surface is controlled in pixel units.
• a plurality of pixel values output by an imaging device that images a subject and a plurality of pixel values and an exposure time for each pixel used in the imaging device to obtain each of the plurality of pixel values are associated with each other. ing.
• the pixel value is evaluated, and a control signal for controlling the exposure time to the light receiving surface in a predetermined plane unit is output to the imaging unit based on the evaluation result.
• a plurality of exposure times for the light receiving surface of the image pickup means having a light receiving surface for receiving light from the subject and performing photoelectric conversion and outputting a pixel value obtained as a result of the photoelectric conversion are controlled. Based on the control, one pixel value is selected from a plurality of exposure times at each pixel position and a corresponding pixel value obtained by imaging the subject with a plurality of exposure times.
• FIG. 1 is a block diagram showing a configuration example of a digital video camera system to which the present invention is applied.
• m 2 is the digital video camera 101 according to the first embodiment of the present invention. It is a figure showing the example of composition.
• FIG. 3 is a block diagram showing a configuration example of a second embodiment of a digital video camera 101 to which the present invention is applied.
• FIG. 4 is a block diagram showing a configuration example of the controller 5 in FIGS. 2 and 3.
• FIG. 5 is a block diagram showing a configuration example of the image evaluation unit 11 of FIG.
• FIG. 6 is a block diagram illustrating a configuration example of the evaluation unit 23 in FIG.
• FIG. 7 is a flowchart for explaining the operation of the digital video camera 101 of FIG. 4 (FIGS. 2 and 3).
• FIGS. 8A, 8B, and 8C are diagrams showing the contents stored in memories 6 and 25.
• FIG. 8A, 8B, and 8C are diagrams showing the contents stored in memories 6 and 25.
• FIG. 9 is a block diagram showing a configuration example of the display device 102 in FIG.
• FIG. 10 is a flowchart for explaining the processing of the display device 102 in FIG.
• FIG. 11 is a block diagram showing a configuration example of a third embodiment of a digital video camera 101 to which the present invention has been applied.
• FIG. 12 is a block diagram showing a configuration example of the controller 33 of FIG.
• FIG. 13 is a flow chart for explaining the operation of the digital video camera 101 of FIG.
• FIG. 14 is a diagram illustrating a relationship between a pixel value and an exposure time.
• FIG. 15 is a diagram illustrating correction of a pixel value using an approximate curve that approximates the relationship between the pixel value and the exposure time.
• FIG. 16 is a diagram showing pixel values obtained by a plurality of exposure times.
• FIG. 17 is a diagram showing corrected pixel values.
• FIG. 18 is a diagram showing an image composed of corrected pixel values obtained by correcting the pixel values closest to the reference pixel value.
• FIG. 19 is a block diagram showing a configuration example of an embodiment of a computer to which the present invention is applied.
• BEST MODE FOR CARRYING OUT THE INVENTION FIG. 1 shows a digital video camera system according to an embodiment of the present invention. 2 shows a configuration example.
• the digital video camera 101 captures an image of a predetermined subject and outputs image information including image data.
• This image information is recorded on a recording medium 103 such as a semiconductor memory, a magneto-optical disk, a magnetic disk, an optical disk, a magnetic tape, a phase change disk, or the like, or, for example, a terrestrial wave, a satellite line, a CATV (Cable Television)
• the data is transmitted via a transmission medium 104 including a network, the Internet, a public line, a bus, and the like, and provided to the display device 102.
• the display device 102 receives image information provided via the recording medium 103 or the transmission medium 104 and displays a corresponding image based on the image information.
• the digital video camera 101, the display device 102, and the recording medium 103 or the transmission medium 104 can be configured as one device.
• FIG. 2 shows a configuration example of the first embodiment of the digital video camera 101 of FIG.
• Light from a subject enters the lens 1, and the lens 1 condenses the light on the light receiving surface of the CCD 3 via the shutter 2.
• the shirt 2 is controlled by the controller 5, and controls the exposure to each pixel of the CCD 3 by reflecting the light from the lens 1 for each pixel constituting the light receiving surface of the CCD 3, for example. That is, in FIG. 2, the shirt 2 is composed of, for example, a DMD (Digital Micromirror Device) in which a number of ultra-small reflecting mirrors are formed on a semiconductor substrate, and each mirror is transmitted from the controller 5. By rotating according to the control, the direction of reflection of the light incident on it can be changed in units of one mirror.
• DMD Digital Micromirror Device
• each mirror constituting the DMD corresponds to each pixel constituting the CCD 3. Therefore, by turning each mirror, the direction of reflection of light from each mirror to each pixel of the CCD 3 can be changed, so that light incidence on the corresponding pixel can be turned on / off. It has become.
• the DMD is disclosed, for example, in Japanese Patent Application No. 7-73952 (priority claim number: US 2 217 739, priority date: March 31, 1994).
• the CCD 3 receives the light from the shirt 2 in each pixel constituting the light receiving surface, and charges the electric charge corresponding to the light amount. Then, CCD 3 calculates the charge (charge integrated by the integration effect) in each pixel. By performing bucket brigade, an electric signal of a corresponding voltage level is output to an A / D (Analog / Digital) converter 4.
• a CCD is used as a photoelectric conversion element for receiving light from the shirt 2 and performing photoelectric conversion, but a BBD (Bucket Brigede Device) or the like may be used.
• the A / D converter 4 samples the electric signal from the CCD 3 at a timing corresponding to the pixel, and further quantizes the signal, thereby providing the pixel value of each pixel constituting the digital image data to the controller 5. Supply.
• the A / D converter 4 outputs, for example, an 8-bit pixel value.
• the controller 5 evaluates the pixel value of each pixel supplied from the CCD 3 via the A / D converter 4. Further, based on the evaluation result, the controller 5 controls the shirt 2 by setting the exposure time for the shirt 2 in each pixel unit. Further, the controller 5 converts the pixel value of each pixel supplied from the CCD 3 through the A / D converter 4 as necessary based on the exposure time set when obtaining the pixel value. And outputs the image data consisting of the corrected pixel values, for example, in units of one frame (or one field) as image information. Further, the controller 5 outputs the pixel value and the exposure time set when obtaining the pixel value as image information. The image information output by the controller 5 is received by an I / F (Interface) 7.
• the memory 6 temporarily stores data necessary for the processing of the controller 5.
• the I / F 7 supplies the image information from the controller 5 to the recording unit 8 or the communication unit 9 according to, for example, an instruction from a user.
• the recording unit 8 records the image information from the I / F 7 on the recording medium 103.
• the communication unit 9 transmits the image information from the I / F 7 via the transmission medium 104.
• FIG. 3 shows a configuration example of a second embodiment of the digital video camera 101 of FIG. Note that, in the drawing, the same reference numerals are given to portions corresponding to the case in FIG. 2, and the description thereof will be appropriately omitted below.
• the digital video camera 101 in FIG. 3 is basically configured in the same manner as the digital video camera 101 in FIG.
• shirt 2 is composed of a liquid crystal panel (LCD shirt).
• Shirt 2 composed of liquid crystal panels is controlled by controller 5,
• the light from the lens 1 is transmitted, for example, in units of pixels constituting the light receiving surface of the CCD 3, thereby controlling the exposure of each pixel of the CCD 3.
• the direction of the liquid crystal molecules constituting the liquid crystal panel as the shutter 2 changes in units corresponding to the pixels under the control of the controller 5, so that light transmission in that unit is limited.
• the incidence of light on the corresponding pixel of the CCD 3 can be turned on / off.
• a transmissive liquid crystal panel is used as the shirt 2 here, a reflective liquid crystal panel can also be used.
• FIG. 4 shows a configuration example of the controller 5 of FIGS. 2 and 3.
• the controller 5 includes an image evaluation unit 11 and a shutter control unit 12.
• the pixel values supplied from the CCD 3 to the controller 5 via the A / D converter 4 are received by the image evaluation unit 11.
• the image evaluator 11 performs necessary processing on the pixel values supplied thereto, and constructs and outputs one frame of image data. Further, the image evaluation unit 11 evaluates the pixel value supplied thereto, and sets the exposure time by the shutter 2 on a pixel basis based on the evaluation result.
• the shirt control unit 12 controls the shutter 2 in accordance with the exposure time set for each pixel in the image evaluation unit 11.
• FIG. 5 shows a configuration example of the image evaluation unit 11 of FIG.
• the pixel value supplied from the CCD 3 to the controller 5 via the A / D converter 4 is received by the buffer 21, and the buffer 21 temporarily stores the pixel value.
• the pixel value correction unit 22 reads out the pixel value stored in the sofa 21, reads out the exposure time for the pixel when the pixel value was obtained from the memory 25, and associates the readout time with the memory 6. To be stored. Further, when a set of, for example, a pixel value and an exposure time for one frame is stored in the memory 6, the pixel value correction unit 22 reads out the set of the pixel value and the exposure time, and stores the pixel value in the exposure time. And outputs one frame of image data composed of the corrected pixel values.
• the evaluation unit 23 evaluates the pixel value stored in the buffer 21 and supplies the evaluation result to the exposure time determination unit 24.
• the exposure time determination unit 24 sets the exposure time for the pixel of the pixel value stored in the buffer 21 based on the evaluation result from the evaluation unit 23. You. That is, the evaluation unit 23 evaluates the pixel value stored in the buffer 21 to determine whether the pixel value is equal to or greater than a predetermined upper limit value or equal to or less than a lower limit value, and the evaluation result such as the amount of movement of the subject. Then, the evaluation result is supplied to the exposure time determination unit 24.
• the exposure time determination unit 24 shortens the exposure time for the corresponding pixel.
• the exposure time determination unit 24 sets a longer exposure time for the corresponding pixel.
• the exposure time determination unit 24 sets a short exposure time for the corresponding pixel, for example, when the amount of motion of the subject is large and motion blur (motion blur) occurs. Also, for example, when the movement amount of the subject is small (no) and there is no motion blur (blur), the exposure time determination unit 24 keeps the exposure time of the corresponding pixel at the current value. .
• the exposure time determination unit 24 supplies the exposure time set for the pixel to the memory 25.
• the subject itself hardly moves. Therefore, it is assumed that the motion blur referred to here is mainly caused by what is called a camera shake of a user who performs photographing.
• the present invention is also applicable when shooting a subject having a large movement.
• the memory 25 stores (overwrites) the exposure time for each pixel from the exposure time determination unit 24 in the address at the corresponding position.
• the exposure time for each pixel stored in the memory 25 is supplied to the shutter control unit 12.
• the shutter control unit 12 calculates the exposure time according to the exposure time for each pixel.
• Control shirt 2 As a result, the light incident time on the CCD 3 via the shirt 2 is controlled for each pixel.
• exposure time and shirt evening speed are synonyms.
• a long exposure time corresponds to a low shirt speed
• a short exposure time corresponds to a high shirt speed. In the following, description will be made using the exposure time, but it is of course possible to use the shirt speed.
• FIG. 6 illustrates a configuration example of the evaluation unit 23 of FIG.
• the reading unit 51 The pixel value of the pixel stored in the file 21 (FIG. 5) is read out, supplied to the buffer 52, and stored. Further, the reading unit 51 sequentially sets the pixels whose pixel values have been read from the buffer 21 as a target pixel, and uses the pixel value (target pixel value) of the target pixel as the motion determining unit 53 and the pixel value determining unit 54. To supply.
• the buffer 52 has, for example, a storage capacity capable of storing pixel values for a plurality of frames, and sequentially stores the pixel values supplied from the reading unit 51. After storing the pixel values for the storage capacity, the buffer 52 stores the new pixel values, for example, overwriting the oldest pixel values.
• the motion determining unit 53 receives the pixel value of the pixel of interest from the readout unit 51, and, for example, receives 3 X 3
• the 3 ⁇ 3 pixel corresponding to the pixel in the frame one frame before the frame of interest (hereinafter, appropriately referred to as the previous frame) is read from the buffer 52. Further, the motion determination unit 53 calculates the absolute difference between the pixel value of each 3 ⁇ 3 pixel of the frame of interest and the corresponding 3 ⁇ 3 pixel in the previous frame, and further calculates the sum of the differences.
• the motion determination unit 53 determines the magnitude of the motion of the target pixel based on the sum of the absolute differences, and determines the determination result as the target pixel.
• the evaluation result is supplied to the exposure time determination unit 24 (FIG. 5). That is, the motion determination unit 53 determines that the motion is large when the difference absolute value is large, and that the motion is small when the difference absolute value is small. This is supplied to the time determination unit 24.
• the motion determination unit 53 additionally performs, for example, the 3 ⁇ 3 pixels of the above-described frame of interest, performs a pattern matching with the previous frame, and based on the resulting motion vector, It is also possible to determine the magnitude of the movement.
• the pixel value determination unit 54 determines whether or not the pixel value of the target pixel is within a predetermined range defined by a predetermined lower limit and upper limit, and determines the determination result as the evaluation of the target pixel. The result is supplied to the exposure time determination section 24.
• the pixel value determination unit 54 determines whether the pixel value of the target pixel is within the range from the lower limit to the upper limit.
• the pixel value determination unit 54 determines that the pixel value is equal to or less than the lower limit (or less than the lower limit). If the value is larger than the lower limit and smaller than the upper limit, the fact is supplied to the exposure time determination unit 24 as the evaluation result of the target pixel.
• the exposure time determination unit 24 of FIG. 5 receives the evaluation result of the target pixel as described above from the motion determination unit 53 and the pixel value determination unit 54, and based on the evaluation results, as described above, Set the exposure time.
• FIG. 4 the operation of the digital video camera in FIG. 4 (FIGS. 2 and 3) will be described with reference to the flowchart in FIG.
• step S1 the exposure time determination section 24 of the controller 5 (FIG. 5) sets a default exposure time for each pixel, transmits the default exposure time to the memory 25, and stores it in the corresponding address.
• the same exposure time is set for all pixels as a default exposure time.
• the default exposure time for example, it is possible to set the exposure time of each pixel at the end of the previous shooting.
• the default exposure time can be set by the user, for example.
• FIG. 8A shows the contents stored in the memory 25. As described above, in the memory 25, the exposure time for each pixel is stored at an address corresponding to the pixel position of each pixel.
• the shutter controller 12 controls the shutter 2 in accordance with the exposure time for each pixel stored in the memory 25, so that when light enters the CCD 3 via the shutter 2.
• the charge is charged to each pixel of the CCD 3 while the interval is controlled for each pixel.
• step S2 the reading is started from CCD3.
• the pixel value read from the CCD 3 is supplied to the buffer 21 of the controller 5 (FIG. 5) via the A / D converter 4 and stored therein.
• the pixel value stored in the buffer 21 is read by the pixel value correction unit 22 in step S3. Further, in step S3, the pixel value correction unit 22 The pixels having the pixel values read from the buffer 21 are sequentially set as the target pixel, and the exposure time stored in the address of the memory 25 corresponding to the target pixel, that is, the exposure used to obtain the pixel value of the target pixel The time is read out, supplied to the memory 6 and stored in association with the pixel value of the target pixel.
• the exposure time as shown in FIG. 8A is stored in the memory 25, for example, as shown in FIG. 8B, the memory 6 stores the exposure time shown in FIG.
• the obtained pixel values are stored in association with each other.
• the evaluation unit 23 uses the motion determination unit 53 and the pixel value determination unit 54 to calculate the pixel value of the target pixel stored in the buffer 21 as described above.
• the evaluation result is supplied to the exposure time determination unit 24.
• the exposure time determination unit 24 resets the exposure time of the target pixel to an appropriate value based on the evaluation result from the evaluation unit 23 as described above. Further, the exposure time determination section 24 supplies the reset exposure time to the memory 25, and stores (overwrites) the address in the address corresponding to the target pixel. That is, for example, in FIG.
• the pixel value “250” is a value equal to or larger than the above-described upper limit value “250”, and it is considered that the pixel value is “blown out”.
• the exposure time determination unit 24 calculates the exposure time of the pixel having the pixel value “250” (exposure time of the address n + 1 of the memory 25) “1/100 seconds” by the shorter “1 / 120 seconds, ”and store it in memory 25 as shown in FIG. 8C.
• step S6 it is determined by the control unit (not shown) whether or not the reading of all the pixel values constituting one frame from the buffer 21 has been completed. If it is determined that there is no pixel value, the process proceeds to step S7, the pixel value of the next pixel is obtained from the buffer 21, and the process returns to step S3. Then, the process of step S3 and subsequent steps is repeated with the pixel having that pixel value as a new target pixel. On the other hand, if it is determined in step S6 that reading of all the pixel values constituting one frame has been completed, that is, the memory 6 stores the pixel values of all the pixels constituting one frame and their corresponding values.
• step S8 the pixel value correction unit 22 (FIG. 5) reads out each pixel value from the memory 6, and associates each pixel value with the pixel value. Compensation based on the exposure time The image data of one frame composed of the pixel values of is output.
• the pixel values constituting one frame are not obtained at the same exposure time. Therefore, if such a pixel value is used as it is to constitute an image of one frame, the brightness is reduced. It becomes an image. Therefore, the pixel value correction unit 22 corrects each pixel value based on the exposure time, thereby forming an image having a sense of unity of brightness and in which all pixels are photographed with the same exposure time. It is supposed to.
• the pixel value correction unit 22 is, for example, among the exposure times stored in the memory 6
• the short exposure time (hereinafter referred to as the shortest exposure time) 1 / S e " e [second] is used as a reference, and the pixel value associated with each exposure time 1ZS [second] is calculated according to S D S B
• the combination of the pixel value p and the exposure time 1 / S [second] is represented as (p, 1 / S)
• the combination of the pixel value and the exposure time stored in the memory 6 is, for example, ( 2 55, 1/10), (200, 1/5), (150, 1/20), (100, 1/100)
• each exposure time is set based on the shortest exposure time 1 / S cauliflower
• the pixel value associated with 1 / S is corrected to be S / S times.
• the longest exposure time among the exposure times stored in the memory 6 hereinafter, the longest exposure time
• the above set of pixel values and exposure time (255, 1/10), (200, 1/5), (150, 1/20), (100, 1/100) ),
• the pixel value correction unit 22 also uses other exposure times other than the shortest exposure time and the longest exposure time as a reference. It is possible to correct the pixel value.
• the pixel value of the corrected image output by the pixel value correction unit 22 exceeds M bits It may be the number of bits. That is, here, the pixel value output by the A / D converter 4 is set to 8 bits, but the pixel value constituting the corrected image output by the pixel value correction unit 22 exceeds 8 bits It is the number of bits.
• the image in which the contrast is sufficiently expressed that is, the dynamic range is output from the A / D converter 4. An image larger than the number of bits is output.
• the shortest exposure time is set as a reference, but the reference exposure time can be set to an arbitrary value. That is, the reference exposure time may be an exposure time other than the shortest exposure time stored in the memory 6, or may be an exposure time not stored in the memory 6. Therefore, the pixel value can be corrected based on, for example, 1/1 second.
• the pixel value p is obtained by multiplying the pixel value p by the reciprocal S of the associated exposure time 1 / S. The pixel value obtained is the pixel value after correction.
• step S8 as described above, when the image data composed of the corrected pixel values is output, the process proceeds to step S9, and the processes in steps S4 to S7 are repeated, so that the memory 2
• the exposure time for each pixel stored in 5 is transmitted to the shirt control unit 12, and the process returns to step S2, and the same processing is repeated for the next frame. Therefore, for the next frame, an image is shot with the exposure time for each pixel stored in the memory 25.
• the pixel value output by the CCD 3 is evaluated, and based on the evaluation result, the exposure time of the CCD 2 to the light receiving surface of the CCD 3 is set for each pixel, and the subject is imaged. Therefore, even if the subject has strong contrast, it is possible to obtain an image that does not impair the details.
• the dynamic range of a CCD is not very wide, but as described above, by controlling the exposure time for each pixel, the dynamic range of the CCD 3 (or A / D converter 4) is extended. The same effect as described above can be obtained.
• each pixel value stored in the memory 6 is corrected and output based on the exposure time associated with the pixel value, but each pixel value stored in the memory 6 is output.
• the value can be directly output together with the exposure time associated with the pixel value, and can be recorded on the recording medium 103 or transmitted via the transmission medium 104.
• FIG. 9 shows a configuration example of the display device 102 of FIG.
• the reading unit 61 reads (reproduces) the image information (corrected pixel value or the pixel value and the exposure time) recorded thereon from the recording medium 103 and supplies it to the I / F 63.
• the communication unit 62 receives the image information transmitted via the transmission medium 104 and supplies the image information to the I / F 63.
• the I / F 63 receives the image information supplied from the reading unit 61 or the communication unit 62 and supplies the image information to the display control unit 64.
• the display control unit 64 includes a buffer 65, a pixel value normalizing unit 66, and a driver 67.
• the buffer 65 receives the image information supplied from the I / F 63 and temporarily stores the image information, for example, in units of one frame.
• the pixel value normalizing unit 66 reads out the image information stored in the buffer 65 and normalizes the image information based on the display accuracy of the display unit 68.
• the pixel value normalizing unit 66 recognizes, via the dryno 67, the display accuracy of the display unit 68, that is, how many bits of the pixel value the display unit 68 can display.
• the display accuracy of the display unit 68 is K bits.
• the pixel value normalizing unit 66 determines that if the image information for one frame stored in the buffer 65 is a corrected pixel value (hereinafter, appropriately referred to as a corrected pixel value), The maximum value of is detected.
• this maximum pixel value is represented by (, (> ⁇ ⁇ ) bits
• the pixel value normalization unit 66 determines the lower ⁇ of each correction pixel value stored in the buffer 65.
• the pixel value normalization unit 66 When the image information stored in the buffer 65 is the pixel value ⁇ and the exposure time 1 / S, the pixel value normalization unit 66 is the same as the pixel value correction unit 22 in FIG. Then, for example, the pixel value ⁇ is corrected by multiplying the pixel value ⁇ by the reciprocal S of the exposure time 1 / S to obtain the corrected pixel value pxS. Then, as in the case described above, the pixel value normalizing unit 66 truncates the lower K ′ one K bits of each correction pixel value and normalizes the corrected pixel values to K bits. The pixel value normalizing unit 66 normalizes the pixel value as described above, and supplies the pixel value after the normalization (hereinafter, appropriately referred to as a normalized pixel value) to the driver 67.
• the driver 67 recognizes the display accuracy by communicating with the display unit 68. Alternatively, the driver 67 recognizes the display accuracy of the display unit 68 in advance. Then, the driver 67 supplies the display accuracy of the display unit 68 to the pixel value normalizing unit 66 according to the request of the pixel value normalizing unit 66. Further, the driver 67 drives the display unit 68 in accordance with the normalized pixel value supplied from the pixel value normalizing unit 66, thereby causing the display unit 68 to display an image.
• the display unit 68 is composed of, for example, a CRT or a liquid crystal display, and displays an image under the control of the driver 67.
• the I / F 63 receives the image information supplied from the reading unit 61 or the communication unit 62 and sequentially supplies and stores the image information to the buffer 65 of the display control unit 64 one frame at a time.
• step S11 the pixel value normalizing section 66 recognizes the display accuracy of the display section 68 via the driver 67.
• the display accuracy indicates how many bits of the pixel value the display unit 68 can display
• the maximum value and the minimum value of the pixel values that can be displayed by the display unit 68 are described. It can be said that the difference is the dynamic range, or the resolution that is the minimum value of the difference between the pixel values that can be identified by the display unit 68.
• step S12 the pixel value normalizing unit 66 determines whether or not the image information is stored in the buffer 65. If it is determined in step S12 that the image information is stored in the buffer 65, the process proceeds to step S13, where the pixel value normalizing unit 66 sends one frame of image information from the buffer 65. And read Proceed to step S14.
• step SI4 if the image information read from the buffer 65 is a corrected pixel value, the pixel value normalizing unit 66 normalizes the corrected pixel value as described above, The normalized pixel value is supplied to the driver 67, and the process returns to step S12.
• the pixel value normalization unit 66 corrects the pixel value with the exposure time to obtain a corrected pixel value. Further, the pixel value normalizing section 66 normalizes the corrected pixel value as described above to provide a normalized pixel value, supplies the normalized pixel value to the dryno 67, and returns to step S12.
• the display unit 68 is driven according to the normalized pixel value from the pixel value normalization unit 66, and the corresponding image, that is, the dynamic range (resolution) of the display unit 68 is enabled.
• the image used is displayed.
• the number of bits K that can be displayed by the display unit 68 as the display accuracy of the display unit 68 is smaller than the number of bits K ′ of the pixel value after correction. If the number of bits, which is the display accuracy of 68, is equal to or greater than the number of bits K 'of the corrected pixel value, the pixel value normalization unit 66 does not need to perform the above-described normalization. Therefore, the pixel value normalizing section 66 supplies the corrected pixel value to the driver 67 as it is.
• step S12 if it is determined in step S12 that the image information is not stored in the buffer 65, the processing is terminated.
• FIG. 11 shows a configuration example of a third embodiment of the digital video camera 101 of FIG.
• the portions corresponding to those in FIG. 2 or FIG. 3 are denoted by the same reference numerals, and the description thereof will be appropriately omitted below.
• the digital video camera 101 shown in FIG. 11 includes a memory controller 31 and memories 3 2 3 2!,...
• the configuration is basically the same as that in the case of FIG. 2 or FIG. 3 except that the controller 33 is provided.
• the shirt 2 is made of a DMD as in the case of FIG. 2, but may be made of a liquid crystal display as in the case of FIG. It is.
• the shutter 2 is the light It is only necessary that the incident light can be turned on / off in the same way for all the pixels constituting the CCD 3.Therefore, a DMD or liquid crystal shutter that controls the incidence of light to the CCD 3 on a pixel basis, etc. No need to configure.
• the memory controller 31 supplies the pixel values supplied from the CCD 3 via the A / D converter 4 to one of the frame memories 32 to 32 according to the control from the controller 33. And memorize it.
• the memories 32 to 32 store pixel values supplied from the memory controller 31.
• the controller 33 sets a plurality of exposure times in the shutter 2 and controls the shutter 2 so that light from the subject enters the CCD 3 at each of the plurality of exposure times. Therefore, in this case, in the CCD 3, the pixel values that constitute one frame are output for each of the plurality of exposure times set by the controller 33. That is, a plurality of exposure times set by the controller 33 and light corresponding to the plurality of exposure times are incident on the CCD 3 within a frame period, whereby the CCD 3 has a plurality of exposure times and corresponding light corresponding to each frame. The pixel values of multiple images are output.
• N n-th shortest exposure time
• the controller 33 transmits the CCD 33 from the CCD 3 through the AZD converter 4.
• the pixel value of the image corresponding to the n-th exposure time is output to the memory 32.
• the memory controller 31 is controlled so as to be stored in the memory controller.
• the controller 33 obtains one pixel for the pixel at that position from the plurality of pixel values of the pixels at the same position composing the image corresponding to the plurality of exposure times stored in the memories 32 to 32 and the plurality of stored exposure times. A value is selected, and an image of one frame is constituted by the selected pixel value. Further, similarly to the controller 5, the controller 33 converts the pixel values constituting the image of one frame configured as described above, based on the exposure time when the pixel value was obtained, as necessary. The image data consisting of the corrected pixel values is output, for example, in units of one frame. In the following, in the controller 33, a plurality of N (N is an integer of 2 or more) (Numerical value) exposure times are set.
• FIG. 12 shows a configuration example of the controller 33 of FIG.
• the reading unit 41 reads the pixel value of the pixel of interest from any of the memories 32 to 32 under the control of the control unit 42, and supplies the pixel value to the buffer 21.
• the control unit 42 refers to the evaluation result of the pixel value stored in the buffer 21 by the evaluation unit 23 and further refers to the N exposure times stored in the memory 44 as necessary, and
• the value correction unit 22, the reading unit 41, and the reference parameter determination unit 43 are controlled.
• the reference parameter determination unit 43 determines a reference parameter that is a reference when determining the N exposure times based on the control from the control unit 42. That is, the reference parameter determining unit 43 calculates, for example, one exposure time serving as a reference, and a parameter setting for determining the remaining N— 1 exposure times based on the exposure time. Determined as the reference parameter.
• the following parameters are used for determining the other N-1 exposure times as the reference exposure time. That is, in a digital video camera, a plurality of usable exposure times are generally set in advance. Therefore, based on a certain exposure time, an exposure time one step shorter or one step longer than that is uniquely determined. Therefore, such a number of steps can be used as a reference parameter.
• the reference parameter determination unit 43 sets N exposure times based on the reference parameter—evening. That is, the reference parameter overnight determining unit 43 sets, for example, the exposure time determined as the reference parameter as the first exposure time, which is the shortest value of the N exposure times, and determines the reference parameter overnight hereinafter.
• the long exposure time is set to the second exposure time, third exposure time,. Therefore, for example, if a plurality of exposure times set in advance in a digital video camera are represented in the shortest order as S, S !
• the reference exposure time is S »(k is an integer value of 1 or more and M or less), and the number of steps is 1 for the reference parameter, N of S K , SM, ⁇ ' ⁇ , St- Exposure time is set. Also, for example, if the reference 'exposure time is S k In the case of the reference parameter having the number of 2, N exposure times of S K , S ", S K ( ,..., S k -u,-" are set. In 43, when the N exposure times are set based on the reference parameters, the number of steps adjacent to the N exposure times can be changed linearly or non-linearly. in ie, the reference parameter Isseki determining unit 4 3, for example S K, as SH, SH, SH, S.. like, it is possible to set the N pieces of exposure time.
• the memory 44 stores (overwrites) the N exposure times set in the reference parameter determination unit 43.
• the N exposure times stored in the memory 44 are supplied to the shirt controller 12, the memory controller 31 (FIG. 11), and the controller 42.
• the shutter control unit 12 controls the shutter 2 so that light from the subject enters the CCD 3 at each of the N exposure times, and the memory controller 31
• the pixel values from the A / D converter 4 obtained for each of the N exposure times are stored in the corresponding one of the memories 32! To 32 »for each exposure time.
• the reference parameter determining unit 43 of the controller 33 sets N exposure times based on the default reference parameters, and sets a memory. 4 Send to 4 for storage.
• the shirt evening control unit 12 controls the shutter 2 according to each of the N exposure times stored in the memory 4, that is, within the frame period, in a time-division manner, the N exposure times and the shirt evening 2 according to the N exposure times.
• the CCD 3 outputs N exposure times and pixel values constituting an image corresponding to the exposure times in a time-division manner.
• the N exposure times and the pixel values constituting the image corresponding to the N exposure times output by the CCD 3 in a time division manner are supplied to the memory controller 31.
• the memory controller 31 recognizes each of the N exposure times by referring to the memory 44, and determines the first exposure time among the N exposure times.
• the pixel value forming the image corresponding to (the shortest exposure time) is supplied to the memory 32, and stored at the address corresponding to the pixel having the pixel value.
• the memory controller 31 stores the pixel values constituting the image corresponding to the second to Nth exposure times. Are also supplied to and stored in the memories 32 to 32, respectively. This allows memory 3
• step S22 the control unit 42 sets the pixels constituting the image as a pixel of interest, for example, in raster scan order, and
• the pixel value of the pixel of interest stored in the default memory is read out.
• the memory used as the default memory is not particularly limited.
• An arbitrary memory such as the memory 32 w or 32 out of 2 t to 32 can be set as the default memory.
• the one from which the reading unit 41 reads the pixel value is hereinafter referred to as a target memory as appropriate.
• the reading unit 41 reads the pixel value of the target pixel from the target memory under the control of the control unit 42, the reading unit 41 supplies the pixel value to the buffer 21 and stores it therein.
• step S23 the evaluation unit 23 evaluates the pixel value of the pixel of interest stored in the buffer 21, outputs the evaluation result to the control unit 42, and proceeds to step S24.
• step S24 the control unit 42 determines whether or not the pixel value of the pixel of interest is in an overexposed state based on the evaluation result from the evaluation unit 23 (and, if necessary, the pixel of interest. Is large or not?).
• step S24 when it is determined that the pixel value of the target pixel is in a white-out condition (or when the motion is determined to be large), that is, when the pixel value read from the target memory is obtained.
• step S25 the control unit 42 stores the pixel value of the image corresponding to the shortest exposure time (first exposure time) in the attention memory.
• shortest memory As appropriate, memory
• step S25 If it is determined in step S25 that the memory of interest is not the shortest memory, the process proceeds to step S26, and the control unit 42 controls the reading unit 41 to store the memory of interest in the next shortest exposure time. Is changed to the one in which the pixel value of the image corresponding to is stored. That is, in the present embodiment, it is assumed that the memory of interest is the memory 32. Then, the control unit 42 changes the attention memory from the memory 3 2 »to the memory 32. Then, the control unit 42 controls the reading unit 41 so as to read the pixel value of the target pixel from the target memory after the change, returns to step S23, and thereafter, the same processing is repeated. returned.
• step S25 If it is determined in step S25 that the memory of interest is the shortest memory, that is, the pixel value obtained by using the shortest exposure time among the N exposure times that are currently set. However, if the exposure time needs to be shorter in order to avoid the overexposure, the process proceeds to step S27, and the controller 4 2 Is all or part of the N exposure times
• the request for shortening (for example, some of the N exposure times shorter) is supplied to the reference parameter determination unit 43, and the process proceeds to step S28.
• step S24 determines whether the pixel value of the pixel of interest is in a whiteout state. If it is determined in step S24 that the pixel value of the pixel of interest is not in a whiteout state, the process proceeds to step S29, and the control unit 42 determines the pixel value based on the evaluation result from the evaluation unit 23. It is determined whether the pixel value of the target pixel is in a blackout state.
• step S29 If it is determined in step S29 that the pixel value of the target pixel is in a blackout state, that is, if the exposure time used to obtain the pixel value read from the target memory is too short, Proceeding to 30, the control unit 42 determines that the memory of interest stores the pixel value of the image corresponding to the longest exposure time (the Nth exposure time in the present embodiment) (hereinafter, the longest (In this embodiment, it is determined whether or not the memory is a memory 32).
• step S30 If it is determined in step S30 that the memory of interest is not the longest memory, the process proceeds to step S31, and the control unit 42 controls the reading unit 41 to store the memory of interest in the next longest exposure time. Is changed to the one in which the pixel value of the image corresponding to is stored. That is, in the present embodiment, assuming that the memory of interest is the memory 32 » the control unit 42 changes the memory of interest from the memory 32» to the memory 32 administrat The unit 42 controls the reading unit 41 so as to read the pixel value of the target pixel from the target memory after the change, returns to step S23, and thereafter repeats the same processing.
• step S30 If it is determined in S30 that the memory of interest is the longest memory, that is, even if the pixel value is obtained using the longest exposure time among the N exposure times currently set, It is in a blackened state, Therefore, if it is necessary to make the exposure time longer in order to avoid the blackout condition, the process proceeds to step S32, and the controller 42 sets the whole or a part of the N exposure times.
• a request to make the longer (for example, some of the N exposure times longer) is supplied to the reference parameter determination unit 43, and the process proceeds to step S28.
• step S28 the control unit 42 recognizes the exposure time when the pixel value stored in the buffer 21 is obtained by referring to the memory 44, and determines the exposure time by the pixel value. Supply to correction unit 22.
• the pixel value correction unit 22 calculates the pixel value of the pixel of interest from the buffer 21 and the exposure time used to obtain the pixel value from the control unit 42.
• the data is supplied to the memory 6 and stored in association therewith. Therefore, in step S 28, the pixel value correction unit 22 in principle, for the pixel of interest, among the plurality of pixel values stored in the memory 32 and the memory 32, loses white and black. Whichever state is not selected is selected and stored in the memory 6. However, for the pixel of interest, if none of the pixel values stored in the memories 32 to 32 is not in the state of underexposure or underexposure, the underexposure or overexposure is performed. The pixel value with the lowest degree of underexposure is selected and stored in the memory 6, and in order to eliminate the underexposure or underexposure state, the exposure time must be changed by the control section 42 from the reference parameter. Required for overnight decision section 43.
• step S33 After storing the pixel value of the target pixel and the exposure time in the memory 6, the process proceeds to step S33, and it is determined whether or not all the pixel values constituting the image of one frame have been written in the memory 6.
• step S33 when it is determined that all the pixel values constituting the image of one frame have not been written to the memory 6, the process proceeds to step S34, and the pixel becomes the target pixel in the last scan order. The next pixel that has been set is newly set as the target pixel, and the reading unit 41 reads the pixel value of the target pixel from the target memory. Then, returning to step S23, the same processing is repeated thereafter.
• step S33 all the pixel values that make up one frame are If it is determined that the data has been written to the memory 6, that is, if the pixel values of all the pixels constituting one frame and the exposure time associated with them are stored in the memory 6, the process proceeds to step S35, The pixel value correction unit 22 reads each pixel value from the memory 6 and corrects each pixel value based on the exposure time associated with the pixel value, as in step S8 in FIG. Then, it outputs one frame of image data composed of the corrected pixel values.
• the reference parameter determining unit 43 determines, in step S27 or S32, that if there is a request to shorten or lengthen the exposure time, the request is made. Redetermine the reference parameters so that the exposure time is set according to. Further, the reference parameter determining section 43 resets the N exposure times based on the determined reference parameter reset, and proceeds to step S37. If there is no request to shorten or lengthen the exposure time, the reference parameter overnight determining unit 43 uses the previously determined reference parameter overnight as it is, and uses the same N parameters as the previous time. Set the exposure time.
• step S37 the reference parameter determination unit 43 supplies the N exposure times set in step S36 to the memory 44 for storage, and returns to step S22. Similar processing is repeated for the next frame.
• each frame is obtained. Since the image of the present invention is configured, it is possible to obtain an image that does not impair the details of a subject having a strong contrast. In this case as well, similar to the case in FIGS. 3 and 3, the same effect as in the case where the dynamic range of the CCD 3 (or the A / D converter 4) is widened can be obtained.
• each pixel value stored in the memory 6 is output as it is together with the exposure time associated with that pixel value, and is recorded on the recording medium 103 or It is possible to transmit via the transmission medium 104.
• the pixel value correction unit 22 corrects the pixel value based on the exposure time on the assumption that the exposure time and the pixel value are in a proportional relationship. If the time and the pixel value are not in a proportional relationship, the corrected pixel value obtained as a result of the pixel value correction based on the proportional relationship includes an error.
• X marks indicate pixel values obtained for each exposure time.
• the pixel value correction unit 22 obtains an approximate curve that approximates the relationship between the exposure time and the pixel value for each brightness, using the pixel value for each exposure time obtained for each brightness. In the embodiment shown in FIG.
• the pixel value correction unit 22 calculates the pixel value p to be corrected. And the exposure time t for that pixel value. Find the approximate curve that is closest to the point (p., T o) (represented by the X mark in Fig. 15). In the embodiment of FIG. 15, the approximate curve L 21 is closest to the point (p., T o). And the exposure time t. Pixel value p for. Is corrected to a pixel value corresponding to the exposure time ti, the pixel value correction unit 22 calculates a point on the approximated curve L 21 corresponding to the exposure time ti (indicated by a triangle in FIG. 15). Is obtained, and the pixel value pi represented by that point is set as a corrected pixel value. In this case, an accurate corrected pixel value can be obtained.
• the pixel value correction unit 22 selects the first found pixel value as the pixel value of the pixel of interest and stores it in the memory 6.
• the pixel value correction unit 22 can, for example, select a certain pixel value as a reference pixel value and select a pixel value close to the reference pixel value as the pixel value of the target pixel. That is, in general, the sensitivity of the CCD 3 is considered to be the highest at an intermediate value in the range of pixel values output by the A / D converter 4. Therefore, the reference pixel value is set to a value approximately in the middle of the range of the pixel value output from the A / D converter 4, and the pixel value correction unit 22 stores the memory 32! It is possible to select the pixel value closest to the reference pixel value among the N pixel values of the pixel of interest stored therein, as the pixel value of the pixel of interest.
• FIG. 16 shows pixel values on a certain horizontal line of an image obtained by using a plurality of exposure times for a certain subject.
• a plurality of exposure times are set as 1/5, 1/10, 1/20, 1/30, 1/60, 1/120, 1/180 sec. Seven exposure times are used.
• curves L 31, L 32, L 33, L 34, L 35, L 36, and L 37 are represented by 1/5, 1/10, 1/20, 1 Exposure times of / 30, 1/60, 1/120, and 1/180 seconds, and the pixel values (the output of the A / D converter 4) obtained thereby are shown.
• FIG. 17 shows corrected pixel values obtained by correcting the pixel values of FIG. 16 based on the exposure time.
• the pixel value and the exposure time are in a proportional relationship, and that the exposure time is 1 / S [second], with 1/10 second being the reference exposure time. Is multiplied by S / 10 to obtain a corrected pixel value.
• the exposure time is set to the correction pixel value for five exposure times of 1/10, 1/20, 1/30, 1/60, and 1/120 seconds.
• Curve 4 1, L 42 L 43, L 44, L 4 5 Force 1/10, 1/20, 1/30, 1/60, 1/1
• the exposure time of 20 seconds and the corrected pixel value of the pixel value obtained by each exposure time are shown.
• the pixel value in Fig. 16 is an 8-bit output from the A / D converter, whereas the pixel value in Fig. 17 is a corrected pixel value. Cleansing is obtained.
• FIG. 18 shows an image formed by selecting the correction pixel value of the pixel value closest to the reference pixel value.
• 100 is used as the reference pixel value. Therefore, assuming that the pixel value obtained by the exposure time T is ⁇ ⁇ and the corrected pixel value obtained by correcting the pixel value ⁇ is f ( ⁇ ), the image in FIG. (PT-PB) is composed of the corrected pixel value P obtained in 2 ).
• min (P T- PB) 2 represents P ⁇ that minimizes ( ⁇ —PB) 2 .
• ⁇ ⁇ represents a reference pixel value, and here is 100 as described above.
• FIG. 19 shows a configuration example of an embodiment of a computer in which a program for executing the series of processes described above is installed.
• the program can be recorded in advance on a hard disk 205 or a ROM 203 as a recording medium built in the computer.
• the program may be a removable recording medium such as a floppy disk, CD-ROM (Compact Disc Read Only Memory), M ⁇ (Magneto optic al) disk, DVD (Digital Versatile Disc), magnetic disk, or semiconductor memory.
• M ⁇ Magnetic Disc Read Only Memory
• DVD Digital Versatile Disc
• semiconductor memory or semiconductor memory. 11 You can store (record) temporarily or permanently.
• Such a removable recording medium 211 can be provided as so-called package software. The program is described above.
• the computer In addition to installing on the computer from the removable recording medium 211 as described above, it can also be transferred from the download site via a satellite for digital satellite broadcasting wirelessly to a computer, Network), via a network such as the Internet, which is transferred to the computer by wire, and the computer receives the transferred program in the communication unit 208, and the internal hard disk Can be installed in 2005.
• a satellite for digital satellite broadcasting wirelessly to a computer, Network via a network such as the Internet, which is transferred to the computer by wire, and the computer receives the transferred program in the communication unit 208, and the internal hard disk Can be installed in 2005.
• the computer has a CPU (Central Processing Unit) 202 built therein.
• the CPU 202 is connected to an input / output interface 210 via a bus 201, and the CPU 202 is connected to a user via an input / output interface 210. Therefore, when a command is input by operating the input unit 207 including a keyboard, a mouse, a microphone, and the like, the ROM (Read Only Memory) 203 is accordingly input. Execute the stored program. Alternatively, the CPU 202 transmits the program stored in the hard disk 205, transmitted from a satellite or a network, received by the communication unit 208, and transferred to the hard disk 205.
• a CPU Central Processing Unit
• a program read from the installed program or the removable recording medium 211 attached to the drive 209 and installed on the hard disk 205 is loaded into a RAM (Random Access Memory). Load to 204 and execute.
• the CPU 202 performs the processing according to the above-described flowchart or the processing performed by the configuration of the above-described block diagram. Then, the CPU 202 outputs the processing result as necessary, for example, via an input / output interface 210, to an output composed of an LCD (Liquid Crystal Display), a speaker, or the like.
• the data is output from the unit 206 or transmitted from the communication unit 208, and further recorded on the hard disk 205.
• processing steps for describing a program for causing a computer to perform various kinds of processing do not necessarily need to be processed in chronological order according to the order described as a flowchart. It also includes processes that are executed individually or individually (for example, parallel processing or object-based processing). Further, the program may be processed by one computer, or may be processed by a plurality of computers in a distributed manner. In addition, the program The system may be transferred to a remote computer and executed.
• a shirt that can control the exposure for each pixel of the CCD 3 is used as the shirt evening 2, but as the shirt evening 2,
• the present invention is applicable to both moving images and still images.
• the aperture is not specifically mentioned, but it is also possible to control the aperture based on the evaluation result of the pixel value. In other words, from the evaluation results of the pixel values, if the image is in a state of underexposure or overexposure, it is possible to control the aperture so that it can be released or reduced.
• the aperture may be manually adjusted by the user.
• INDUSTRIAL APPLICABILITY According to the first imaging device, the imaging method, and the program and the program recording medium of the present invention, the imaging device has a light receiving surface for receiving light from a subject and performing photoelectric conversion, and a result of the photoelectric conversion.
• the pixel value obtained from the imaging unit that outputs the obtained pixel value is evaluated, and the exposure time to the light receiving surface is controlled in pixel units based on the evaluation result. Therefore, it is possible to obtain an image that does not impair the details of a subject having a strong contrast.
• a plurality of pixel values output by an imaging device that captures an image of a subject, and a plurality of pixel values and an exposure for each pixel used in the imaging device to obtain each of the pixel values Time is associated with the time. Therefore, by correcting the pixel value based on the exposure time, it is possible to obtain an image with a wide dynamic range using a constant exposure for the whole.
• the imaging control device of the present invention the pixel value is evaluated, and based on the evaluation result, a control signal for controlling the exposure time with respect to the light receiving surface in predetermined units is output to the imaging unit. Therefore, even for a subject having a strong contrast, it is possible to obtain an image that does not lose its detail.
• a light receiving surface for receiving light from a subject and photoelectrically converting the light, and receiving light in an imaging means for outputting a pixel value obtained as a result of the photoelectric conversion
• a plurality of exposure times for the surface are controlled, and based on the control, one pixel is obtained from the plurality of exposure times at each pixel position and the corresponding pixel value obtained by imaging the object with the plurality of exposure times. The value is selected. Therefore, it is possible to obtain an image that does not impair the details of a highly contrasting subject.
• a light receiving surface for receiving light from a subject and performing photoelectric conversion
• a light receiving surface in an imaging unit for outputting a pixel value obtained as a result of the photoelectric conversion.
• the plurality of exposure times at each pixel position and the corresponding pixel values obtained by controlling the plurality of exposure times are evaluated, and based on the evaluation result, the plurality of exposure times and the corresponding pixel values are used.
• One pixel value is selected. Therefore, it is possible to obtain an image that does not impair the details of a subject having a high contrast.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Studio Devices (AREA)
• Transforming Light Signals Into Electric Signals (AREA)
• Exposure Control For Cameras (AREA)
• Cameras In General (AREA)

Priority Applications (2)

Applications Claiming Priority (4)

Related Child Applications (2)

Publications (1)

Family

ID=26590061

Family Applications (1)

Country Status (4)

Families Citing this family (63)

Citations (4)

Family Cites Families (7)

• 2001
  • 2001-04-04 JP JP2001105852A patent/JP4844780B2/ja not_active Expired - Fee Related
  • 2001-04-13 US US10/009,760 patent/US7477305B2/en not_active Expired - Fee Related
  • 2001-04-13 KR KR1020017015996A patent/KR100860154B1/ko not_active Expired - Fee Related
  • 2001-04-13 WO PCT/JP2001/003203 patent/WO2001080551A1/ja not_active Ceased
• 2007
  • 2007-03-30 US US11/731,548 patent/US7602428B2/en not_active Expired - Fee Related

Patent Citations (4)

Also Published As

Similar Documents

Legal Events