WO2005034504A1 - 撮像装置および撮像方法 - Google Patents
撮像装置および撮像方法 Download PDFInfo
- Publication number
- WO2005034504A1 WO2005034504A1 PCT/JP2003/012553 JP0312553W WO2005034504A1 WO 2005034504 A1 WO2005034504 A1 WO 2005034504A1 JP 0312553 W JP0312553 W JP 0312553W WO 2005034504 A1 WO2005034504 A1 WO 2005034504A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- index value
- image
- compression
- compression coefficient
- imaging device
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/21—Intermediate information storage
- H04N1/2104—Intermediate information storage for one or a few pictures
- H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/21—Intermediate information storage
- H04N1/2104—Intermediate information storage for one or a few pictures
- H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
- H04N1/212—Motion video recording combined with still video recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/21—Intermediate information storage
- H04N1/2104—Intermediate information storage for one or a few pictures
- H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
- H04N1/2137—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/21—Intermediate information storage
- H04N1/2104—Intermediate information storage for one or a few pictures
- H04N1/2158—Intermediate information storage for one or a few pictures using a detachable storage unit
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/149—Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
Definitions
- the present invention relates to an image pickup apparatus that performs image compression processing in a digital color image pickup apparatus and an image pickup method used in the image pickup apparatus.
- FIG. 1 is a diagram showing a schematic configuration of a conventional digital still camera disclosed in, for example, Japanese Patent Application Laid-Open No. 11-331672, which is used for storing image data before compression. This figure shows the configuration of a digital still camera that does not require a frame memory.
- reference numeral 11 denotes an imaging lens
- reference numeral 12 denotes a shirt which also serves as an aperture
- reference numeral 13 denotes a CCD which is a photoelectric conversion element
- reference numeral 14 denotes an analog signal processing unit (CDS / AGC)
- reference numeral 15 denotes an AD comparator.
- 16 is a timing generator (TG)
- 17 is a digital signal processing unit (DSP)
- 18 is an image compression unit (JPEG encoder)
- 20 is flash memory
- 21 is a memory card interface.
- 22 is a control unit.
- the imaging lens 11 forms light from the object to be imaged on the light receiving surface of the CCD 13.
- Aperture / shaft ⁇ Yuichi 12 regulates the beam diameter from the imaging lens 11 to the CCD 13 to adjust the amount of light received by the CCD 13 and after the CCD 13 starts photoelectric conversion. It closes when a predetermined time has elapsed, and limits the exposure time of the CCD 13.
- CCD 13 has a matrix of hundreds of thousands of pixels that alternately respond to red (R), green (G), and blue (B) light. Each pixel converts the received light into electric charge and accumulates it, and outputs the accumulated electric charge as an analog signal.
- the analog signal processor 14 double-correlates samples the output signal of the CCD 13 and performs automatic gain processing.
- the AD converter 15 converts the analog signal input from the analog signal processing unit 14 into a digital signal and outputs the digital signal to the digital signal processing unit 17.
- the timing generator 16 supplies timing signals SH and SV indicating the timing of the horizontal scanning and the vertical scanning to the CCD 13 via the knockers 16a and 16b, respectively.
- the timing generator 16 also supplies a timing signal SS indicating the timing at which the output signal of the CCD 13 is sampled to the analog signal processing unit 14, and the analog signal processing unit 15 processes the analog signal.
- the digital signal processing unit 17 provides a timing signal SC indicating the time to convert the output signal of the unit 14.
- the digital signal processing unit 17 white balances the CCD 13 output signal digitized by the AD converter 15. Processing such as correction, shading, interpolation of three color signals of R, G, and B, and gamma correction are performed to generate image data including a luminance signal and a color signal.
- the set of image data generated by the digital signal processing unit 17 represents a captured one-frame image, and can be displayed as it is.
- the image compression section 18 compresses the image data generated by the digital signal processing section 17.
- the image compression unit 18 is a discrete cosine transformer (DCT) 1 that sequentially performs discrete cosine transform on the image data output from the digital signal processing unit 17 for each pixel block of a predetermined size (8 ⁇ 8 pixels). 8a, a quantizer 18b for quantizing the transformed image data, and a Huffman encoder 18c for Huffman encoding the quantized image data.
- DCT discrete cosine transformer
- the flash memory 20 stores the image data compressed by the image compression unit 18. Remember the evening.
- the card-in face 21 copies the image data stored in the flash memory 20 into a removable memory card in frame units.
- Other devices that comply with the JPEG method can read the captured image by reading the copied image data from the memory card and performing decoding, inverse quantization, and inverse discrete cosine conversion. I can do it.
- the control unit 22 adjusts the opening degree of the aperture and shutter 11 to adjust the brightness of the image formed on the CCD 13. Further, when a release button provided on an operation unit (not shown) is operated and an instruction to start storing an image is given, a control signal S • instructing an operation start is given to the image compression unit 18.
- the image compression section 18 to which the control signal S 0 has been supplied supplies the control signal ST to the timing generator 16.
- the timing generator 16 outputs the timing signals SH, SV, SS, and SC to the CCD 13, the analog signal processing unit 14, and the AD converter 15, and outputs the signals to a predetermined evening. Operate with timing.
- the output cycle of the evening timing signals SH, SS, and SC is set to 1/8 of the time required for the image compression unit 18 to compress the image data for eight lines.
- the image compression section 18 After outputting the control signal ST, the image compression section 18 gives the control signal SP to the digital signal processing section 17 when the time required to compress the image data for 8 lines has elapsed, The next control signal ST is supplied to the timing generator 16.
- the control signal SP applied to the digital signal processing unit 17 is a signal requesting that the generated eight lines of image data be output.
- the image compression unit 18 compresses the image data output from the digital signal processing unit 17 according to the control signal SP, and each unit stops operation until the next instruction is given from the control unit 22.
- the control unit 22 closes the aperture and shirt 1 and 2 until the image is instructed by operating the release button, and then operates the release button. At the same time, open the aperture and shirt 1-12 to the appropriate range. Then, when a predetermined time set to approximately 1/30 second has elapsed, the aperture / shaper 12 is closed again. With this control, the exposure time of the CCD 13 becomes the same as before, and the inconvenience of saturation of the CCD 13 and blurring of the captured image due to movement of the object to be shot or camera shake is prevented. It is.
- Digital still cameras require a frame memory to temporarily store the generated image data, and without this frame memory, image compression cannot be performed properly. There was a problem that. In view of this problem, the above-mentioned conventional digital still camera does not require a frame memory for storing the image data before compression.
- the number of compressed images to be recorded on a recording medium is generally determined in advance to improve usability. For this reason, the recording capacity allocated to one frame of image is constant regardless of the type of image, and any image data is compressed data close to a certain amount within a range not exceeding a certain amount.
- Such a method of compressing data is called constant rate control.
- the size of the compressed image varies greatly depending on the nature of the surface image data, and therefore, in order to perform constant rate control, the parameters of the image compression processing such as the contents of the quantization table used in the quantization processing are dynamically adjusted. It is necessary to change the compression and repeat the compression until a certain amount or less of compressed data is obtained.
- Japanese Patent Application Laid-Open No. H11-123 4 669 There is disclosed a method of extracting a high-frequency component included in a digital signal of an image using the extracted signal, and controlling a compression parameter at the time of image compression processing based on the result.
- the operation state of the CCD differs depending on whether the image display is constantly displayed on the liquid crystal display device to check the image to be captured or when the image is recorded on the recording medium by the shutter operation.
- setting values such as the charge storage time and the setting of the amount of incident light on the aperture are changed. This means that when confirming the image to be captured, the amount of image data transferred is reduced, and the operability is improved by increasing the image update cycle, and when recording images, the amount of image transferred is increased to record more precise images.
- the operation of the CCD can be switched multiple times.
- the present invention has been made to solve the above-described problems, and is intended to constantly display image data on a liquid crystal display device in order to confirm an image to be captured.
- the image is recorded on the recording medium even when the operation state of the CCD, the charge accumulation time, and the setting value such as the incident light amount setting of the aperture are changed between when the image is recorded on the recording medium by the shutter operation and when the image is recorded.
- the purpose is to carry out constant rate control without extending the time required for the operation. Disclosure of the invention
- An image pickup apparatus includes: an index value calculation unit that extracts an index value for predicting a code amount at the time of compression from a video signal obtained from a solid-state imaging device; and an index value calculated by the index value calculation unit.
- Compression coefficient control means for controlling the compression coefficient used in the data compression means based on the index value calculated by the index value calculation means at the time of the photographed image confirmation operation before imaging, and at the time of the imaging operation. The compression coefficient is determined.
- FIG. 1 is a diagram showing a schematic configuration of a conventional digital still camera.
- FIG. 2 is a block diagram showing a configuration of an imaging device according to Embodiment 1 of the present invention.
- FIG. 3 is an explanatory diagram showing a relationship between an index value and a file size.
- FIG. 4 is an explanatory diagram showing an index value correction coefficient table.
- FIG. 5 is an explanatory diagram showing a relationship between a fluctuation range of an index value and an additional correction coefficient.
- FIG. 6 is a block diagram showing a configuration of an imaging device according to a fourth embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION
- FIG. 2 is a block diagram showing a configuration of an imaging device according to Embodiment 1 of the present invention.
- 11 is an imaging lens
- 12 is a CCD which is a photoelectric conversion element
- 13 is an analog signal processing unit (CD S / AGC)
- 14 is an AD converter
- 15 is digital signal processing (DSP)
- 16 is an index value calculation circuit that extracts an index value for predicting the amount of code at the time of compression from the image data
- 17 is an index value calculation circuit that calculates the index value obtained by the index value calculation circuit 16.
- 18 is an image compression section (JPEG encoder)
- 19 is a recording medium for recording an image
- 20 is a CCD drive
- a timing generator (TG) 21 for controlling the operation of each processing unit
- a shutter unit 22 for controlling the operation of each processing unit.
- the imaging lens 11 forms light from a subject to be imaged on the light receiving surface of the CCD 12.
- CCD 12 consists of a matrix of several hundred thousand alternately arranged three types of pixels that respond to red (R), green (G), and blue (B) light, respectively.
- the received light is converted into electric charges and stored, and the stored charges are output as analog signals.
- the CCD 12 has a plurality of drive modes, for example, a drive mode for sequentially outputting all accumulated charges and a drive mode for sequentially outputting only accumulated charges every other line. Control of It has a mechanism that can change the drive mode dynamically.
- the analog signal processing unit 13 performs double correlation sampling of the output signal from the CCD 12 and performs gain control.
- the AD converter 14 converts the analog signal input from the analog signal processor 13 into a digital signal and outputs the digital signal to the digital signal processor 15.
- the timing generator 2 provides a timing signal to the CCD 12 indicating the timing of horizontal scanning and vertical scanning. It also has the function of dynamically switching between multiple drive modes of the CCD 12 by controlling signals output from the timing generator 20.
- the digital signal processor 15 converts the output signal of the CCD 12 digitized by the AD converter 14 into white, lance adjustment, defective pixel correction, R, G, and B color signals. It performs interpolation, gamma correction, color conversion, and other processing to generate image data consisting of luminance and color difference signals.
- the image compression section 18 compresses the image data generated by the digital signal processing section 1 #.
- the image compression unit 18 is a discrete cosine transformer (DCT) 1 that performs a discrete cosine transform of the image data output from the digital signal processing unit 17 for each pixel block of a predetermined size (8 ⁇ 8 pixels). 8a, a quantizer 18b for quantizing the transformed image data, and a Huffman encoder 18c for Huffman encoding the quantized image data.
- DCT discrete cosine transformer
- the image compression section 18 stores the compressed image data in the storage medium 19.
- Other devices that comply with the JPEG system can reproduce the image data by reading the copied image data from the recording medium and performing decoding, inverse quantization, and inverse cosine transform.
- the index value calculation circuit 16 calculates an index value for predicting the code amount at the time of compression from the image data generated by the digital signal processing unit 15.
- an index value for example, the high frequency component of the image signal is extracted and included in the image.
- a numerical value of the amount of the frequency component may be used.
- the shutter button 22 is operated when the user instructs an imaging operation.
- the shutter button 22 informs the controller 21 that an image recording has been instructed by a user operation.
- the control section 21 checks the operation settings of the timing signal generator 20, the analog signal processor 13 and the digital signal processor 15 to confirm the target image. Switch from the setting to the setting for image shooting. In this switching, the operation setting at the time of confirming the image to be photographed and at the time of photographing differs depending on the photographed image size / digital zoom magnification setting specified by the user. Therefore, there are a plurality of switching patterns depending on the combination of the operation settings at the time of confirming the image to be captured and at the time of imaging.
- the control unit 21 also notifies the compression coefficient control circuit 17 that the shirt evening button 22 has been pressed, and at that time the timing generator 20 and the analog signal processing unit 1. 3. Notify the change of the operation setting of the digital signal processor 15 together.
- the compression coefficient control circuit 17 controls the compression coefficient used in the image compression section 18 based on the index value calculated by the index value calculation circuit 16.
- the compression coefficient refers to a parameter (hereinafter, referred to as a Q value) for defining the quantization accuracy in the quantizer 18 b included in the image compression unit 18.
- Q value a parameter for defining the quantization accuracy in the quantizer 18 b included in the image compression unit 18.
- Increasing the Q value increases the quantization accuracy of the data subjected to discrete cosine transform, and improves the image quality of the compressed image.
- the amount of generated code increases, so that the size of the generated compressed image data increases.
- the compression coefficient control circuit 17 controls the Q value to decrease if the index value output from the index value calculation circuit 16 predicts that the data size of the generated compressed image data will increase. To keep the size of the compressed image data low. If the size of the generated compressed image is expected to be small, control is performed to increase the Q value to improve the image quality of the compressed image.
- the compression coefficient control circuit 17 of the first embodiment has a mechanism for receiving a signal from the control unit 21.
- the operation of the compression coefficient control circuit 17 is controlled by the shirt button via the control unit 21. 22 Only when notified that 2 has been pressed. This is because the operation of the image compression unit 18 is necessary only when the shutter button 22 is pressed and the compressed image data is stored in the storage medium 19.
- the compression coefficient control circuit 17 changes how the operations of the control section 22 change the operation of the imaging section 20, the analog signal processing section 13, and the digital signal processing section 15. Then, the method of controlling the Q value from the index value output by the index value calculation circuit 16 is changed based on the information.
- the liquid crystal screen 23 is for displaying an object to be imaged at any time during a captured image checking operation before the user instructs to image.
- the timing generator 20 is set to control the intermittent reading of the accumulated charge from the CCD 12 to reduce the time required to read one frame of the image to increase the frame update rate and use It improves the operability when the user adjusts the angle of view of the captured image.
- the analog signal processing section 13 and digital signal processing section 15 change the output image size and the pixel array order in accordance with the CCD 12 drive mode. Operation settings that match the mode must be made. Since it is not necessary to compress and record the image data at the time of the imaging operation confirmation operation, The image processed by the digital signal processing unit 15 is sent to the liquid crystal screen 23 without passing through the compression processing unit 18 and is displayed as an image for confirming a captured image.
- FIG. 3 is an explanatory diagram showing a relationship between an index value and a file size.
- This figure is a graph showing the relationship between the index value output from the index value calculation circuit 16 and the file size after compression.
- the compression coefficient control circuit 17 the correspondence between the index value corresponding to this graph and the file size is stored as a value. This data needs to be measured in advance from the compression result when an image is actually taken.
- each polygonal line shows the relationship between the index value at a specific Q value setting and the size of the compressed file.
- the compression coefficient control circuit 17 determines the Q value.
- the index value corresponding to the image currently being photographed is calculated by the index value calculation circuit 16
- the intersection between the index value and a predetermined target file size is obtained.
- the uppermost polygonal line that does not exceed the intersection of the target file size and the index value indicates the maximum Q value that can be used within the range that does not exceed the target file size. Therefore, the image compression unit 18 may be controlled with reference to the Q value corresponding to the broken line.
- the above method describes the case where there is no change in the operation setting of the system during the imaging operation. Actually, the operation settings of the system during the imaging operation Because of this change, the compressed file size based on the Q value determined based on the index value may be significantly different from the target file size.
- FIG. 4 is an explanatory diagram showing an index value correction coefficient table. What is illustrated is an example of an index value correction coefficient table used to prevent the above-described file size shift.
- the coefficient obtained by referring to the section in which the thinned-out reading is performed in the captured image checking operation and the all-pixel reading out in the imaging operation is performed. Is multiplied by the calculated index value as a correction coefficient. As a result, it is possible to correct the error of the index value due to the change of the operation setting, and obtain an appropriate Q value for the target file size.
- the coefficients in the index value correction coefficient table need to be calculated in advance based on the measurement results by measuring the change in the index value when an image is captured by actually switching the CCD operation mode.
- the pattern in which the CCD operation mode changes may differ depending on the image size and digital zoom magnification setting specified by the user, but as shown in Fig. 4, all operation modes supported by the CCD 12 If a table of combinations is prepared, an appropriate correction coefficient can be selected regardless of the pattern of change.
- the compression parameter at the time of imaging is appropriately determined using the index value information before entering the imaging operation. As soon as the image is compressed, the image can be compressed and recorded, and the response of the shirt operation can be improved.
- the CCD 1 is used between the imaging operation and the captured image confirmation operation. Even when the two operation modes are different, there is an effect that constant rate control with a small error for the target file size can be realized.
- correction for changes in the operation settings of the imaging device during the imaging operation is performed using a table, so a large number of operations can be switched by combining the operation settings when confirming the image to be captured and when imaging. Even when a pattern exists, there is an effect that constant rate control with little error can be realized for all patterns.
- Embodiment 2 since the operation of the image compression unit 18 is limited to the imaging operation when the button 22 of the shirt is operated, power consumption can be suppressed and a system with a long operating time by a battery can be realized. effective.
- Embodiment 2 since the operation of the image compression unit 18 is limited to the imaging operation when the button 22 of the shirt is operated, power consumption can be suppressed and a system with a long operating time by a battery can be realized. effective.
- the index value is a single value
- the compression coefficient control circuit controls the Q value of the image compression unit based on the value.
- the transfer rate of image data after the image compression unit is limited to a lower value than the transfer rate of image data before the image compression unit. There is. This is expected to reduce the amount of data due to image compression, and aims to reduce the overall cost of the device by securing only the minimum required transfer rate after image compression. It is. In such an image pickup device, even if the amount of compressed data over the entire image is controlled to match the target data amount, if the compressed data size is locally increased, the data is transferred over time. If the amount exceeds the transfer capacity, the phenomenon that the image compression processing cannot be performed normally may occur.
- a description will be given of an imaging device according to a second embodiment that performs an appropriate image compression process using such two types of index values in such an imaging device having no frame buffer.
- the imaging device according to the second embodiment has the same configuration as the imaging device according to the first embodiment shown in FIG. Here, the description of the configuration of the imaging device according to the second embodiment will be omitted.
- the operation of the imaging device according to the second embodiment is substantially the same as that described in the first embodiment, and the description of the same operation as that of the imaging device according to the first embodiment is omitted, and the imaging according to the second embodiment is omitted.
- the characteristic operation of the device will be described.
- the operations of the index value calculation circuit 16 and the compression coefficient control circuit 17 shown in FIG. 2 are different from those described in the first embodiment.
- the index value calculating circuit 16 calculates an index value corresponding to the entire surface of the input image, divides the input image into a plurality of areas, and calculates an index value for each area. The largest index value among the divided areas is output to the compression coefficient control circuit 17 together with the index value of the entire image as the maximum index value at the time of area division.
- the compression coefficient control circuit 17 determines the limit compression size based on the image data transfer rate of the image compression unit 18 and thereafter, in addition to the target file size determined in advance as in the first embodiment.
- the ratio of the limit compression size to the image size before compression is determined to match the ratio of the image data transfer rate of the image compression unit 18 or later and the image compression unit 18 or earlier, the data is Overnight transfer volume exceeds transfer capacity Disappears.
- the compression coefficient control circuit 17 refers to the correlation between the index value and the file size shown in FIG. 3 and the index value correction coefficient table shown in FIG. 18 Find the appropriate Q value for performing the control of 8. At this time, two values are obtained: a Q value based on a combination of the index value of the entire area of the image and the target file size, and a Q value based on a combination of the maximum index value and the limit file size when the area is divided.
- the image compression unit 18 By controlling the image compression unit 18 using the smaller one of these two Q values, the file size does not exceed the target file size and the local data transfer amount It is possible to compress the image so as not to cause overshooting.
- the Q value is controlled in consideration of the local file size increase due to the data transfer rate. Even in an imaging device having a limited data transfer rate, the most appropriate compression file size can be controlled in consideration of the transfer rate limitation.
- Embodiment 2 only the index value calculated in the immediately preceding frame is used as the index value for predicting the code amount at the time of compression.
- the CCD drive mode for confirming the image to be captured is thinning-out reading, and the CCD drive mode is changed from thinning-out reading to all-pixel reading during the imaging operation, the image to be shot is thinned out. Since some information is lost in the image data at the time of image confirmation, there may be cases where a correction error remains even if correction is performed using the index value correction coefficient template in Fig. 4. Can be ' In such a case, an imaging device according to Embodiment 3 that further suppresses a correction error based on a change in index value in a time series will be described.
- the imaging device according to the third embodiment has the same configuration as the imaging device according to the first embodiment shown in FIG. Here, the description of the configuration of the imaging device according to Embodiment 3 is omitted.
- the operation of the imaging device according to the third embodiment is substantially the same as that described in the first embodiment, and the description of the same operation as that of the imaging device according to the first embodiment is omitted, and the imaging according to the third embodiment is omitted.
- the characteristic operation of the device will be described.
- the operation of the index value calculation circuit 16 shown in FIG. 2 is different from that described in the first embodiment.
- the index value calculation circuit 16 is an index for predicting the code amount at the time of compression based on the image data generated by the digital signal processing unit 15 as in the first embodiment. Calculate the value.
- the index value calculation circuit 16 stores the index values calculated for the latest plural frames. For example, consider the case of extracting a high-frequency component of an image as an index value.If the CCD 12 performs thinning-out reading, the index value at the time of medical treatment is corrected by a correction coefficient, and the CCD 12 An error occurs between the index value at the time of pixel readout driving and the index value when the image contains many specific high-frequency components that can be recognized by all-pixel reading but disappears in the thinning mode. Conceivable. In such a case, the image in the decimation mode greatly varies in pixel value due to the phase relationship between the image pickup elements on the imaging surface of the CCD 12 and the high-frequency component of the image. Changes are expected to be severe.
- FIG. 5 is an explanatory diagram showing the relationship between the fluctuation range of the index value and the additional correction coefficient.
- the index value calculation circuit 16 calculates the index value stored over a plurality of frames. From the history, the range of fluctuation between the maximum and minimum index values is determined. The large variation width indicates that the image has many high-frequency components, and the index value in the all-pixel mode is likely to be even larger than the correction by the correction coefficient. Therefore, as shown in Fig. 5, a table showing the relationship between the fluctuation range of the index value and the additional correction coefficient is created in advance, and the additional correction coefficient corresponding to the fluctuation range of the index value and the correction coefficient are applied to the index value. Add and multiply the added value.
- the calculated correction target value is additionally corrected. There is an effect that control can be performed.
- the relation data between the compression code amount prediction index value and the file size used in the compression coefficient control circuit 17 and the data of the correction coefficient table are measured in advance and set as fixed data in the circuit. Must be kept.
- the above various data are greatly affected by the characteristics of the entire imaging device, such as the performance of the optical system and the sensitivity characteristics of the CCD 12, and therefore, from the circuit design stage. It is difficult to determine a fixed value. Further, if these data are set as complete fixed data, it is not possible to flexibly respond to a change in characteristics of the entire apparatus due to a change in an optical system or the like.
- FIG. 6 is a block diagram showing a configuration of an imaging device according to Embodiment 4 of the present invention. Same as or equivalent to that shown in Fig. 2 The reference numerals are used, and the description is omitted.
- Reference numeral 24 denotes a data table for storing relationship data between the compression code amount prediction index value used in the compression coefficient control circuit 17 and the file size, and data of the correction coefficient table.
- the data table 24 has a function of communicating with the outside. For example, by using a serial communication or the like, it is possible to freely rewrite the setting values of each data stored and held in a memory provided therein, which will be described later. You can do it.
- the data table 24 includes a non-volatile memory for storing the set values of each stored data even when the settings of the entire image pickup apparatus are reset or the power is turned off and on again. .
- the imaging device according to the third embodiment is the same as the imaging device according to the first embodiment, except that the data table 24 is provided. Other components are configured in the same manner and operate in the same manner.
- the data template 24 includes communication means for performing serial communication with the outside and a non-volatile memory for storing and storing various data.
- the data on the relationship between the predicted value of the compressed code amount and the file size used in step 17 and the data of the correction coefficient template are stored in the memory.
- the data table 24 sends the stored set value of the data from the outside. Rewrite to what you have. Other operations are the same as those described in the first embodiment, and a description thereof will not be repeated.
- various data used in the compression coefficient control circuit 17 can be freely rewritten by communication with the outside, so that the characteristics of the lens 11 and the CCD 12 Even if the sensitivity characteristic of the device is changed, it is possible to change various data used for controlling the compression coefficient, so that it is possible to flexibly cope with a change in the configuration of the device.
- the image capturing apparatus and the image capturing method according to the present invention perform an image compression and recording operation immediately after the image capturing operation is indicated, and implement an image capturing apparatus with a quick shutter operation response.
- an image compression and recording operation immediately after the image capturing operation is indicated, and implement an image capturing apparatus with a quick shutter operation response.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Algebra (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Studio Devices (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005500455A JP3795516B2 (ja) | 2003-09-30 | 2003-09-30 | 撮像装置および撮像方法 |
CNB038254786A CN100568909C (zh) | 2003-09-30 | 2003-09-30 | 摄像装置和摄像方法 |
PCT/JP2003/012553 WO2005034504A1 (ja) | 2003-09-30 | 2003-09-30 | 撮像装置および撮像方法 |
US10/535,499 US7440010B2 (en) | 2003-09-30 | 2003-09-30 | Image pickup device and image pickup method |
EP03816288A EP1677513A4 (en) | 2003-09-30 | 2003-09-30 | IMAGE FIXING DEVICE AND IMAGE RECORDING PROCESS |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2003/012553 WO2005034504A1 (ja) | 2003-09-30 | 2003-09-30 | 撮像装置および撮像方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005034504A1 true WO2005034504A1 (ja) | 2005-04-14 |
Family
ID=34401443
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2003/012553 WO2005034504A1 (ja) | 2003-09-30 | 2003-09-30 | 撮像装置および撮像方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US7440010B2 (ja) |
EP (1) | EP1677513A4 (ja) |
JP (1) | JP3795516B2 (ja) |
CN (1) | CN100568909C (ja) |
WO (1) | WO2005034504A1 (ja) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003199019A (ja) * | 2001-12-26 | 2003-07-11 | Sony Corp | 撮像装置および方法、記録媒体、並びにプログラム |
KR101409769B1 (ko) * | 2007-08-01 | 2014-06-19 | 삼성전자주식회사 | 영상 데이터 처리 장치 및 그의 영상 데이터 처리 방법 |
US20090066844A1 (en) * | 2007-09-11 | 2009-03-12 | Sony Corporation And Sony Electronics Inc. | Predictive tv adjustment of parameter such as white balance |
JP5641898B2 (ja) * | 2010-11-26 | 2014-12-17 | ルネサスエレクトロニクス株式会社 | 画像圧縮装置及び画像圧縮方法並びにプログラム |
JP6270597B2 (ja) * | 2014-04-04 | 2018-01-31 | キヤノン株式会社 | 画像形成装置 |
TWI577178B (zh) * | 2016-01-06 | 2017-04-01 | 睿緻科技股份有限公司 | 影像處理裝置及其影像壓縮方法 |
JP6792351B2 (ja) * | 2016-06-01 | 2020-11-25 | キヤノン株式会社 | 符号化装置、撮像装置、符号化方法、及びプログラム |
TWI593272B (zh) * | 2016-06-04 | 2017-07-21 | 晨星半導體股份有限公司 | 壓縮影像資料的方法及影像資料壓縮系統 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0548911A (ja) * | 1991-08-19 | 1993-02-26 | Ricoh Co Ltd | 画像読取装置及びデジタル複写装置 |
JPH0654309A (ja) * | 1992-07-30 | 1994-02-25 | Canon Inc | 画像処理装置及び画像記録装置 |
JPH08125902A (ja) * | 1994-10-27 | 1996-05-17 | Fuji Film Micro Device Kk | デジタル静止画像カメラ |
US5661823A (en) * | 1989-09-29 | 1997-08-26 | Kabushiki Kaisha Toshiba | Image data processing apparatus that automatically sets a data compression rate |
JPH10108134A (ja) * | 1996-10-01 | 1998-04-24 | Kawasaki Steel Corp | 電子スチルカメラ |
JP2000115786A (ja) * | 1998-07-22 | 2000-04-21 | Matsushita Electric Ind Co Ltd | 符号化装置、記録装置および符号化方法 |
JP2002247517A (ja) * | 2001-02-14 | 2002-08-30 | Sanyo Electric Co Ltd | ディジタルカメラ |
JP2003179926A (ja) * | 1999-06-14 | 2003-06-27 | Nikon Corp | 圧縮符号化方法,圧縮符号化プログラムを記録した記録媒体,および圧縮符号化方法を実施する電子カメラ |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06165027A (ja) * | 1992-11-25 | 1994-06-10 | Nikon Corp | スチルカメラ |
JP3480615B2 (ja) * | 1994-12-28 | 2003-12-22 | ソニー株式会社 | 映像信号処理装置 |
JPH11234669A (ja) | 1998-02-17 | 1999-08-27 | Hitachi Ltd | 画像圧縮処理装置および方法、ならびにそれを利用したデジタルカメラ |
JPH11331672A (ja) | 1998-05-12 | 1999-11-30 | Rohm Co Ltd | デジタルスチルカメラ |
US7253836B1 (en) * | 1998-06-30 | 2007-08-07 | Nikon Corporation | Digital camera, storage medium for image signal processing, carrier wave and electronic camera |
JP3851027B2 (ja) * | 1999-08-27 | 2006-11-29 | 株式会社リコー | オートフォーカス装置およびカメラ |
GB0004065D0 (en) * | 2000-02-21 | 2000-04-12 | Hewlett Packard Co | Portable information capture devices |
JP2002112086A (ja) | 2000-09-28 | 2002-04-12 | Sony Corp | カメラシステム、画像符号化装置および画像復号化装置 |
JP2003199019A (ja) | 2001-12-26 | 2003-07-11 | Sony Corp | 撮像装置および方法、記録媒体、並びにプログラム |
JP2003304549A (ja) * | 2002-04-11 | 2003-10-24 | Olympus Optical Co Ltd | カメラ及び画像信号処理システム |
-
2003
- 2003-09-30 JP JP2005500455A patent/JP3795516B2/ja not_active Expired - Lifetime
- 2003-09-30 CN CNB038254786A patent/CN100568909C/zh not_active Expired - Fee Related
- 2003-09-30 US US10/535,499 patent/US7440010B2/en not_active Expired - Fee Related
- 2003-09-30 EP EP03816288A patent/EP1677513A4/en not_active Withdrawn
- 2003-09-30 WO PCT/JP2003/012553 patent/WO2005034504A1/ja active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5661823A (en) * | 1989-09-29 | 1997-08-26 | Kabushiki Kaisha Toshiba | Image data processing apparatus that automatically sets a data compression rate |
JPH0548911A (ja) * | 1991-08-19 | 1993-02-26 | Ricoh Co Ltd | 画像読取装置及びデジタル複写装置 |
JPH0654309A (ja) * | 1992-07-30 | 1994-02-25 | Canon Inc | 画像処理装置及び画像記録装置 |
JPH08125902A (ja) * | 1994-10-27 | 1996-05-17 | Fuji Film Micro Device Kk | デジタル静止画像カメラ |
JPH10108134A (ja) * | 1996-10-01 | 1998-04-24 | Kawasaki Steel Corp | 電子スチルカメラ |
JP2000115786A (ja) * | 1998-07-22 | 2000-04-21 | Matsushita Electric Ind Co Ltd | 符号化装置、記録装置および符号化方法 |
JP2003179926A (ja) * | 1999-06-14 | 2003-06-27 | Nikon Corp | 圧縮符号化方法,圧縮符号化プログラムを記録した記録媒体,および圧縮符号化方法を実施する電子カメラ |
JP2002247517A (ja) * | 2001-02-14 | 2002-08-30 | Sanyo Electric Co Ltd | ディジタルカメラ |
Also Published As
Publication number | Publication date |
---|---|
JPWO2005034504A1 (ja) | 2006-12-21 |
US7440010B2 (en) | 2008-10-21 |
JP3795516B2 (ja) | 2006-07-12 |
CN1703899A (zh) | 2005-11-30 |
US20060132618A1 (en) | 2006-06-22 |
CN100568909C (zh) | 2009-12-09 |
EP1677513A1 (en) | 2006-07-05 |
EP1677513A4 (en) | 2006-07-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7136100B1 (en) | Electronic still camera capable of removing noise component in image data and signal processing method thereof | |
US7176962B2 (en) | Digital camera and digital processing system for correcting motion blur using spatial frequency | |
US7420612B2 (en) | Digital camera | |
JP2004328117A (ja) | ディジタルカメラおよび撮像制御方法 | |
JP4769567B2 (ja) | 撮像装置、撮像装置の制御方法、コンピュータプログラム及び記憶媒体 | |
US7187408B2 (en) | Digital camera | |
US7671896B2 (en) | Image sensing apparatus | |
US7193650B2 (en) | Image sensing apparatus | |
JP3795516B2 (ja) | 撮像装置および撮像方法 | |
JP2006345388A (ja) | 撮像装置 | |
EP2202960A1 (en) | Electronic camera | |
JP4123352B2 (ja) | 動画撮像装置及び動画再生装置 | |
JP4118766B2 (ja) | 撮像装置および撮像方法 | |
JP4595231B2 (ja) | 電子カメラ | |
JP2008017198A (ja) | 光源色算出装置、光源色算出方法及び撮影装置 | |
JP4901314B2 (ja) | ディジタル・カメラおよびその制御方法 | |
JP4467232B2 (ja) | 画像記録装置及び方法 | |
JP4233562B2 (ja) | 撮像装置 | |
JP4241725B2 (ja) | 撮像装置 | |
JP5482427B2 (ja) | 撮像装置、手ブレ補正方法、プログラム | |
JP5482428B2 (ja) | 撮像装置、手ブレ補正方法、プログラム | |
JP4529782B2 (ja) | 撮像装置およびその信号処理方法 | |
JPH07131721A (ja) | ディジタルスチルカメラ | |
JP4449692B2 (ja) | 電子カメラ | |
JP2007025129A (ja) | 露出設定方法及び装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 2005500455 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003816288 Country of ref document: EP |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CN JP US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR |
|
ENP | Entry into the national phase |
Ref document number: 2006132618 Country of ref document: US Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10535499 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 20038254786 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWP | Wipo information: published in national office |
Ref document number: 10535499 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2003816288 Country of ref document: EP |