CN1943221A - Image processing device - Google Patents

Image processing device Download PDF

Info

Publication number
CN1943221A
CN1943221A CNA2005800109450A CN200580010945A CN1943221A CN 1943221 A CN1943221 A CN 1943221A CN A2005800109450 A CNA2005800109450 A CN A2005800109450A CN 200580010945 A CN200580010945 A CN 200580010945A CN 1943221 A CN1943221 A CN 1943221A
Authority
CN
China
Prior art keywords
compressing
rule
unit
image data
converting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2005800109450A
Other languages
Chinese (zh)
Other versions
CN100592758C (en
Inventor
滨未希子
原野猛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN1943221A publication Critical patent/CN1943221A/en
Application granted granted Critical
Publication of CN100592758C publication Critical patent/CN100592758C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/41—Bandwidth or redundancy reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Devices (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

It is possible to reduce the necessary capacity of the image memory according to the image characteristics by using a simple compression/decompression method. According to the luminance information extracted by a luminance extraction unit (110), a compression conversion rule setting unit (120) sets a compression conversion rule in a compression conversion table (130). According to the compression conversion rule, an image compression unit (140) compresses/converts the original image data and stores it together with the type of the compression conversion rule in an image memory (150). The type of the compression conversion rule held in the image memory (150) is extracted by a decompression conversion rule setting unit (160). According to the type, the decompression conversion rule is set in a decompression conversion table (170). According to the decompression conversion rule set in the decompression conversion table (170), an image decompression unit (180) decompresses the compressed image data in the image memory (150).

Description

Image processing apparatus
Technical field
The present invention relates to a kind of image processing apparatus, image processing apparatus that relates in particular in camera heads such as digital camera, captured image is handled and the camera head that comprises this image processing apparatus, and the processing method in these devices and make the computing machine carry out the program of this method.
Background technology
In camera heads such as digital camera, the push of response shutter carries out the absorption (seizure) of rest image.After captured original digital image data being implemented internal signals processing such as image pickup signal processing and encoding process, it is stored in for example dismountable recording medium.At this moment, before implementing the internal signal processing, captured original digital image data temporarily is kept in the video memory.Dynamic random access memory) or SDRAM (Synchronous DRAM: formation such as synchronous dram) this video memory is by DRAM (Dynamic Random AccessMemory:, but, be accompanied by high pixelation in recent years, require the more massive capacity of video memory, thereby the high and big problem of power consumption of hardware cost occurred.
Therefore, in existing camera head, be after captured original digital image data is compressed, it is stored in the video memory, then, after the data of reading from this video memory are decompressed again, carry out the processing of back again.For example, thereby proposed a kind of by the difference value of adjacent two pixels being implemented the image processing circuit (for example, with reference to TOHKEMY 2002-111989 communique (Fig. 3)) of binary arithmetic coding and huffman coding constant entropy encoding process compression original digital image data.
In above-mentioned prior art, utilize the relevant compression original digital image data between neighbor, thereby reduced the data that should be stored in video memory.In order to obtain relevant between pixel, then to carry out the processing of hardware or software, still, under the former situation, need to prepare in addition the entropy coding treatment circuit, and in the latter case, then can produce the problem that processing time that high pixelation causes prolongs.
Summary of the invention
The objective of the invention is to reduce the desired volume of video memory with simpler compressing/decompressing method.
In order to address the above problem, the image processing apparatus of first aspect present invention record comprises: transformation rule is preserved the unit, is used to preserve the transformation rule of the original digital image data that is photographed by imaging apparatus; The brightness extraction unit is used to extract the monochrome information about above-mentioned original digital image data; The transformation rule setup unit is used for setting above-mentioned transformation rule based on above-mentioned monochrome information, and above-mentioned transformation rule is kept at above-mentioned transformation rule preservation unit; And image conversion unit, be used for preserving the above-mentioned transformation rule of unit according to being kept at above-mentioned transformation rule, change above-mentioned original digital image data.
Thus, has effect based on the monochrome information adaptive transition original digital image data of relevant original digital image data.
In addition, the image processing apparatus of second aspect present invention record comprises: the compressing and converting rule is preserved unit, the compressing and converting rule that is used to preserve the original digital image data that is photographed by imaging apparatus; The brightness extraction unit is used to extract the monochrome information about above-mentioned original digital image data; Compressing and converting rule setup unit is used for preserving the unit according to above-mentioned monochrome information in above-mentioned compressing and converting rule and sets above-mentioned compressing and converting rule; Image compression unit is used for according to being kept at the above-mentioned compressing and converting rule that above-mentioned compressing and converting rule is preserved the unit above-mentioned original digital image data being compressed into compressing image data; Video memory is together preserved the classification of above-mentioned compressing image data and above-mentioned compressing and converting rule; The decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of above-mentioned compressing image data; Decompression transformation rule setup unit is used for extracting the above-mentioned classification that is kept at above-mentioned video memory, and preserves the above-mentioned decompression transformation rule of setting in the unit based on this classification at above-mentioned decompression transformation rule; The image decompressor unit is used for preserving the above-mentioned decompression transformation rule of unit according to being kept at above-mentioned decompression transformation rule, and above-mentioned compressing image data is de-compressed into decompressed image data; And signal processing unit is used for the signal processing that above-mentioned decompressed image data is stipulated.Thus, have monochrome information based on relevant original digital image data, adaptive transition original digital image data, and after being kept at it in video memory, the view data that is kept at video memory being decompressed, thus implement the effect of signal processing again.
And, the image processing apparatus of third aspect present invention record is in the image processing apparatus of second aspect present invention record, above-mentioned compressing and converting rule is preserved the unit and is comprised fixed area and variable region, wherein, the above-mentioned compressing and converting rule of the fixing preservation of fixed area, variable region are to be set according to above-mentioned monochrome information by above-mentioned compressing and converting rule setup unit.Thus, have in the variable region, suitably change original digital image data based on the monochrome information of relevant original digital image data, and in fixed area, need not to reset the effect of compressing and converting rule.
And, the image processing apparatus of fourth aspect present invention record is in the image processing apparatus of third aspect present invention record, comprise pointer preservation unit and judging unit, above-mentioned pointer is preserved the unit and is used to preserve the regular pointer of preserving the above-mentioned variable region of unit of corresponding above-mentioned compressing and converting, and judging unit is used for setting above-mentioned pointer after the classification of judging above-mentioned compressing and converting rule according to above-mentioned monochrome information.Thus, has the corresponding pointer of classification that can use, the effect of the variable region being carried out access with the compressing and converting rule of judging based on the monochrome information of relevant original digital image data.
In addition, the image processing apparatus of fifth aspect present invention record is in the image processing apparatus of second aspect present invention record, above-mentioned decompression transformation rule is preserved the unit and is comprised fixed area and variable region, wherein, fixed area is used for fixing preserves above-mentioned decompression transformation rule, and the variable region is to be set based on the classification of above-mentioned compressing and converting rule by above-mentioned decompression transformation rule setup unit.Thus, have in the variable region, the view data of adaptive transition decompresses during to compression, and in fixed area, need not to reset the effect of decompression transformation rule.
In addition, the image processing apparatus of sixth aspect present invention record is in the image processing apparatus of fifth aspect present invention record, also comprise pointer preservation unit, and based on the above-mentioned pointer of above-mentioned category setting that is kept at above-mentioned video memory, wherein, pointer is preserved the unit and is used for preserving corresponding above-mentioned decompression transformation rule and preserves the pointer of the above-mentioned variable region of unit.Thus, has the corresponding pointer of classification of the compressing and converting rule that can use and be kept at video memory, the effect of the variable region being carried out access.
And the image processing apparatus of seventh aspect present invention record is in the image processing apparatus of second aspect present invention record, and above-mentioned compressing and converting rule setup unit is set above-mentioned compressing and converting rule in the black-out intervals of above-mentioned imaging apparatus.Thus, have utilize imaging apparatus do not take effective image during, carry out the effect that compressing and converting rule is set.
And the image processing apparatus of eighth aspect present invention record is in the image processing apparatus of second aspect present invention record, and above-mentioned compressing and converting rule setup unit is that unit sets above-mentioned compressing and converting rule with the picture frame.Thus, has each picture frame is realized compressing and converting according to the compressing and converting rule that is fit to this picture frame effect.
In addition, the image processing apparatus of ninth aspect present invention record is in the image processing apparatus of second aspect present invention record, and above-mentioned compressing and converting rule setup unit is that unit sets above-mentioned compressing and converting rule with the image block of regulation.Thus, has each image block is realized compressing and converting according to the compressing and converting rule that is fit to its image block effect.
And, the image processing apparatus of tenth aspect present invention record is in the image processing apparatus of second aspect present invention record, and the interpolation that above-mentioned image compression unit is implemented regulation to the above-mentioned compressing and converting rule that is kept at above-mentioned compressing and converting rule preservation Dan Zhongyuan is compressed above-mentioned original digital image data.Thus, the effect that has the capacity that has reduced the compressing and converting rule that is kept at compressing and converting rule preservation unit.
And, the image processing apparatus of record is in the image processing apparatus of second aspect present invention record on the one hand for the present invention the tenth, and above-mentioned image decompressor unit is preserved above-mentioned decompression transformation rule in the unit and implemented the interpolation of the regulation above-mentioned compressing image data that decompresses being kept at above-mentioned decompression transformation rule.Thus, the effect that has the capacity that has reduced the decompression transformation rule that is kept at decompression transformation rule preservation unit.
In addition, the image pickup device of the present invention the 12 aspect record comprises: image unit is used for photographic images; Front end, the image transitions that is used for being taken becomes original digital image data; The compressing and converting rule is preserved unit, the compressing and converting rule that is used to preserve above-mentioned original digital image data; The brightness extraction unit is used to extract the monochrome information about above-mentioned original digital image data; Compressing and converting rule setup unit is used for preserving the unit according to above-mentioned monochrome information in above-mentioned compressing and converting rule and sets above-mentioned compressing and converting rule; Image compression unit is used for according to being kept at the above-mentioned compressing and converting rule that above-mentioned compressing and converting rule is preserved the unit above-mentioned original digital image data being compressed into compressing image data; Video memory is used for the classification of above-mentioned image compression data and above-mentioned compressing and converting rule is together preserved; The decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of above-mentioned image compression data; Decompression transformation rule setup unit is used for extracting the above-mentioned classification that is kept at above-mentioned video memory, and preserves the above-mentioned decompression transformation rule of setting in the unit based on this classification at above-mentioned decompression transformation rule; The image decompressor unit is used for preserving the above-mentioned decompression transformation rule of unit according to being kept at above-mentioned decompression transformation rule, and above-mentioned compressing image data is de-compressed into decompressed image data; Signal processing unit is used for the signal processing that above-mentioned decompressed image data is stipulated; And, image storage unit, the view data that is used for having carried out above-mentioned signal processing is kept at recording medium.Thus, produced following effect: based on the monochrome information of relevant original digital image data, the adaptive transition original digital image data, and after being kept at it in video memory, the view data that is kept at video memory is decompressed, thereby after having implemented signal processing, it is kept on the recording medium.
In addition, the image processing method of the present invention the 13 aspect record is the image processing method in the image processing apparatus, and this image processing apparatus comprises: the compressing and converting rule that is used to preserve the compressing and converting rule of the original digital image data of being taken by imaging apparatus is preserved the unit; Be used to preserve the video memory of the compressing image data behind the above-mentioned original digital image data of compression; And the decompression transformation rule that is used to preserve the decompression transformation rule of above-mentioned compressing image data is preserved the unit, and this image processing method comprises: extraction step, extract the monochrome information of relevant above-mentioned original digital image data; Set the step of above-mentioned compressing and converting rule, preserve in above-mentioned compressing and converting rule according to above-mentioned monochrome information and set above-mentioned compressing and converting rule in the unit; Compression step, the above-mentioned compressing and converting rule according to being kept in the above-mentioned compressing and converting rule preservation unit is compressed into above-mentioned compressing image data with above-mentioned original digital image data; Preserve step, the classification of above-mentioned compressing image data and above-mentioned compressing and converting rule together is kept in the above-mentioned video memory; Reading step, sense data from above-mentioned video memory; Set the step of above-mentioned decompression transformation rule,, then extract above-mentioned classification, and set above-mentioned decompression transformation rule based on this classification and preserve above-mentioned decompression transformation rule in the unit when above-mentioned data of reading during for the identifier of regulation; Decompression step when above-mentioned data of reading are above-mentioned compressing image data, then according to the above-mentioned decompression transformation rule that is kept in the above-mentioned decompression transformation rule preservation unit, de-compresses into decompressed image data with this compressing image data; And, signal processing step, the signal processing that above-mentioned decompressed image data is stipulated.Thus, have monochrome information based on relevant original digital image data, adaptive transition original digital image data, and after being kept at it in video memory, the view data that is kept at video memory being decompressed, thus implement the effect of signal processing again.
And, the program of the present invention the 14 aspect record is used for making computer to carry out following step at image processing apparatus, wherein, above-mentioned image processing apparatus comprises: the compressing and converting rule that is used to preserve the compressing and converting rule of the original digital image data of being taken by imaging apparatus is preserved the unit; Be used to preserve the video memory of the compressing image data behind the above-mentioned original digital image data of compression; And the decompression transformation rule that is used to preserve the decompression transformation rule of above-mentioned compressing image data is preserved the unit, and described step comprises: extraction step, extract the monochrome information of relevant above-mentioned original digital image data; Set the step of above-mentioned compressing and converting rule, preserve in above-mentioned compressing and converting rule according to above-mentioned monochrome information and set above-mentioned compressing and converting rule in the unit; Compression step according to being kept at the above-mentioned compressing and converting rule that above-mentioned compressing and converting rule is preserved the unit, is compressed into above-mentioned compressing image data with above-mentioned original digital image data; Preserve step, the classification of above-mentioned compressing image data and above-mentioned compressing and converting rule together is kept at above-mentioned video memory; Reading step, sense data from above-mentioned video memory; Set the step of above-mentioned decompression transformation rule,, then extract above-mentioned classification, and set above-mentioned decompression transformation rule based on this classification and preserve above-mentioned decompression transformation rule in the unit when above-mentioned data of reading during for the identifier of regulation; Decompression step when the data of being read are above-mentioned compressing image data, then according to the above-mentioned decompression transformation rule that is kept in the above-mentioned decompression transformation rule preservation unit, de-compresses into decompressed image data with this compressing image data; And, signal processing step, the signal processing that above-mentioned decompressed image data is stipulated.Thus, have monochrome information based on relevant original digital image data, adaptive transition original digital image data, and after being kept at it in video memory, the view data that is kept at video memory being decompressed, thus implement the effect of signal processing again.
Description of drawings
Fig. 1 is the schematic diagram of a configuration example of the camera head 300 in the embodiment of the invention;
Fig. 2 is the schematic diagram of a configuration example of the image processor 200 in the embodiment of the invention;
Fig. 3 is the schematic diagram that a routine function of the image processing apparatus in the embodiment of the invention constitutes;
Fig. 4 is the schematic diagram of a configuration example of the compressing and converting table 130 in the embodiment of the invention;
Fig. 5 is the schematic diagram of the compressing and converting rule of compressing and converting table 130 expression in the embodiment of the invention;
Fig. 6 A and Fig. 6 B are the schematic diagrames of the concrete example of the compressing and converting rule of compressing and converting table 130 expression in the embodiment of the invention;
Fig. 7 is the schematic diagram of a routine choice criteria of the 120 pairs of transformation curves in compressing and converting rule configuration part in the embodiment of the invention;
Fig. 8 is the schematic diagram that is used to set the configuration example of compressing and converting rule in the embodiment of the invention;
Fig. 9 is the schematic diagram that is used to set the configuration example of decompression transformation rule in the embodiment of the invention;
Figure 10 A and Figure 10 B are the schematic diagrames of the example storage data mode in the video memory 360 in the embodiment of the invention;
Figure 11 is the schematic diagram of an illustration picture frame 321 of imaging apparatus 320 in the embodiment of the invention;
Figure 12 is the schematic diagram that a routine interpolation of image compression portion 140 is handled in the embodiment of the invention;
Figure 13 is the schematic diagram of a routine disposed of in its entirety flow process of camera head 300 in the embodiment of the invention;
Figure 14 is the schematic diagram of catching a routine handling process of image Compression in the embodiment of the invention; And
Figure 15 is the schematic diagram of catching a routine handling process of image decompressor processing in the embodiment of the invention.
Embodiment
Below, with reference to accompanying drawing embodiments of the invention are described in detail.
Fig. 1 is the schematic diagram of a configuration example of the camera head 300 in the embodiment of the invention.
This camera head 300 comprises: lens section 310, imaging apparatus 320, timing generator 330, front end 340, image processor 200, video memory 360, picture monitor 370, external recording medium 380 and camera control microcomputer 390.
Lens section 310 is used to assemble the light from reference object, and it comprises lens 311, aperture portion 312 and shutter 313.Aperture portion 312 controls light quantity by changing the area that light passed through.Shutter 313 passes through to control exposure by shielded from light.Aperture portion 312 also can have the function of shutter 313 concurrently.Camera control microcomputer 390 these aperture portions 312 of control and shutters 313.
Imaging apparatus 320 be CCD (Charge Coupled Devices: charge coupled device) or cmos sensor complementary matal-oxide semiconductor transducer) (Complementary Metal Oxide Semiconductorsensor: imageing sensor such as is used for converting the optical information of reference object to the signal of telecommunication.Surface configuration at transducer has a plurality of colour filters with identification colors.Timing generator 330 levels or vertical drive imaging apparatus 320.And timing generator 330 also carries out the exposure control of high speed, low-velocity electron shutter etc.This timing generator 330 is by 390 controls of camera control microcomputer.
Front end 340 will become digital signal from the analog signal conversion of imaging apparatus 320 outputs.Carry out following various processing in the inside of this front end 340: the relevant square sampling of taking out the signal of telecommunication after removing the noise contribution in the imaging apparatus 320; The high lower part of the signal of telecommunication is proofreaied and correct gain controlling to certain level; And be the A/D conversion of digital signal with analog signal conversion.This front end 340 is by 390 controls of camera control microcomputer.
Image processor 200 carries out various Digital Signal Processing based on the view data from imaging apparatus 320 that converts digital signal to, thereby generates luminance signal and color signal etc.JPEG (joint photographic experts group)) and image processor 200 has coded image data is become JPEG (JointPhotographic Experts Group: the function of predetermined file form such as.
Video memory 360 is the memory elements that are used for temporary transient storing image data when carrying out the signal processing of image processor 200, dynamic random access memory) or SDRAM (Synchronous DRAM: synchronous dram) etc. for example, can utilize DRAM (DynamicRandom Access Memory:.
Picture monitor 370 is to be used for the user to confirm for example, can utilize LCD panel (Liquid CrystalDisplay Panel: display panels) etc. by the monitor of the image (finishing image) of imaging apparatus 320 shootings.External recording medium 380 is the recording mediums that are used for storing image data, as rewritable nonvolatile memory, uses flash memories more.
Camera control microcomputer 390 is the microcomputers that carry out the integral body control of camera head 300, and it carries out various patterns controls in the switch control, electronic shutter control in the timing generator 330, the gain controlling in the front end 340, image processor 200 of exposure control, the shutter 313 of aperture portion 312 or parameter control etc.
Fig. 2 is the schematic diagram of a configuration example of the image processor 200 in the embodiment of the invention.This image processor 200 comprises: signal processor 210, the detection unit of picture 220, image compressor 230, image decompressor 240, storage control 250, memory interface 260, interface of monitor 270 and control interface 290.And these parts interconnect by data/address bus 281 and control bus 282.
Signal processor 210 is based on realize digitized original image information (RAW data) in front end 340, carry out digital clamper (digital clamp), white balance, Gamma correction, interpolative operation, filtration operation, matrix operation, brightness generation computing and color and generate Digital Signal Processing such as computing, and after creating rgb value, generate the picture signal that constitutes by brightness and color difference signal.And signal processor 210 also generates the view data that is encoded into predetermined file forms such as JPEG.
220 pairs of camera images as various camera control benchmark of the detection unit of picture carry out detection to be handled.
As the rectified signal that this detection unit of picture 220 detects, the rectified signal of (AE:AutoExposure) etc. is controlled in the rectified signal of for example relevant automatic focusing (AF:Auto Focus) and relevant automatic exposure.As the rectified signal of relevant automatic focusing, the detection unit of picture 220 detects the border composition of the brightness in the automatic focusing detection zone in the precalculated position that is set on the photographic images, and output this border composition of accumulative total and the contrast value that obtains.And as the rectified signal of relevant automatic exposure control, the detection unit of picture 220 detects the brightness in the brightness detection zone in the precalculated position that is set on the photographic images, and exports its intensity level.
Image compressor 230 compresses the seizure image from front end 340 when taking in (seizure) rest image.This compressed view data temporarily is kept in the video memory 360 by storage control 250 and memory interface 260.On the other hand, 240 pairs of view data of reading from video memory 360 in order to carry out the signal processing in the signal processor 210 of image decompressor decompress.
Between each parts in 250 pairs of image processors of storage control 200 or the data/address bus 281 of the transmission of the view data between each parts and the video memory 360 and transmission data control.Carry out the transmission of view data and compressed data between memory interface 260 and the video memory 360 that uses when in image processor 200, carrying out signal processing.For view data being presented on the picture monitor 370, interface of monitor 270 converts view data to various display formats.For example, known have: for being shown in NTSC encoder on the NTSC monitor etc.Control interface 290 is controlled camera control microcomputer 390 and the control data between the image processor 200 and the transmission of view data of image processor 200.
Fig. 3 is the schematic diagram that a routine function formation of the image processing apparatus in the embodiment of the invention is shown.
This image processing apparatus comprises: the various functions of brightness extraction unit 110, compressing and converting rule configuration part 120, compressing and converting table 130, image compression portion 140, video memory 150, decompression transformation rule configuration part 160, decompression conversion table 170, image decompressor portion 180 and signal processing part 190.This image processing apparatus is for example as the image processor 200 of Fig. 2 and realize.Video memory 150 is then for example as the video memory 360 of Fig. 1 and realize.
Brightness extraction unit 110 is extracted the monochrome information of relevant original digital image data from front end 340.Above-mentioned brightness extraction unit 110 for example can be same with the detection unit of picture 220 of Fig. 2, has the function that is used to control automatic exposure.
Compressing and converting rule configuration part 120 is set to the compressing and converting rule in the compressing and converting table 130 based on the monochrome information of being extracted by brightness extraction unit 110.As described later, above-mentioned compressing and converting rule is passed through the data of compressing and converting front and back to expression.Compressing and converting table 130 is preserved above-mentioned compressing and converting rule, and is used for the compressing and converting of image compression portion 140.Image compression portion 140 is according to the compressing and converting rule that is kept in the above-mentioned compressing and converting table 130, original digital image data is changed compression after, it is stored in the video memory 150.At this moment, as described later, the classification that is used for the compressing and converting rule of compressing and converting is stored in video memory 150.Compressing and converting table 130 and image compression portion 140 for example realize by image compressor 230 that compressing and converting rule configuration part 120 then for example can be realized by image compressor 230 or camera control microcomputer 390.
Decompression transformation rule configuration part 160 is extracted and is stored in the classification of the compressing and converting rule in the video memory 150, and based on its classification, the decompression transformation rule is set in the decompression conversion table 170.As described later, the data before and after above-mentioned decompression transformation rule is changed by decompression are to expression.Decompression conversion table 170 is preserved above-mentioned decompression transformation rule, and is used for the decompression conversion of image decompressor portion 180.Image decompressor portion 180 decompresses to the view data that is stored in the video memory 150 according to the decompression transformation rule that is kept in the above-mentioned decompression conversion table 170.Decompression conversion table 170 and image decompressor portion 180 realize that by for example image decompressor 240 decompression transformation rule configuration part 160 then for example can be realized by image decompressor 240 or camera control microcomputer 390.
190 pairs of view data that decompressed by image decompressor portion 180 of signal processing part are implemented various Digital Signal Processing, thereby generate picture signal.The picture signal that generates for example is stored on the external recording medium 380 with predetermined document forms such as JPEG.Above-mentioned signal processing part 190 for example can be realized by signal processor 210.
Fig. 4 is the schematic diagram that a configuration example of the compressing and converting table 130 in the embodiment of the invention is shown.The right set of conversion of data 131 and conversion back data 132 was preserved as the compressing and converting rule before above-mentioned compressing and converting table 130 will be changed.Image compression portion 140 is right with reference to the conversion in the above-mentioned compressing and converting table 130, carries out the compressing and converting from data 131 before changing to conversion back data 132.And, in this Fig. 4, show the example that data 131 before 14 the conversion is converted to data 132 after 8 the conversion, still, be not limited thereto, also can carry out the compressing and converting of desirable bit wide.
Above-mentioned compressing and converting table 130 can be divided into fixed area and variable region.In fixed area, each conversion is to being fixed, and, in image shoot process, can't rewrite.On the other hand, in the variable region, each conversion can suitably be reset by compressing and converting rule configuration part 120 not being fixed.
In addition, after conversion in the data 132, by keeping the sign indicating number of not doing to distribute (being " 11111111 " in the example of Fig. 4) in advance, thereby as described later, this sign indicating number can be used as identifier.
Figure 4 illustrates the configuration example of compressing and converting table 130, and as for decompression conversion table 170, it is that corresponding relation is opposite, can adopt identical formation.That is to say, suppose in image compression portion 140, to carry out the compressing and converting of the data 132 after the less conversion of bit wide of data 131 before the conversion of the bit wide broad from compressing and converting table 130, and in image decompressor portion 180, by carrying out of the conversion of the less data (data 132 after the conversion in the compressing and converting table 130) of bit wide from decompression conversion table 170, thereby realize the conversion that decompresses to the data (data 131 before the conversion in the compressing and converting table 130) of bit wide broad.
Fig. 5 is the schematic diagram that the summary of the compressing and converting rule of being represented by compressing and converting table 130 in the embodiment of the invention is shown.The transverse axis of this compressing and converting rule represents to change preceding data 131, and the longitudinal axis represents to change back data 132.
In above-mentioned compressing and converting rule,, fixed area and variable region have been shown as the explanation of Fig. 4.In fixed area, stipulated that uniquely conversion is right, and in the variable region, regulation there are a plurality of transformation curves.For example, when with A (401), B (402), when (403) three kinds of transformation curves of C are defined as the classification of compressing and converting rule, if the brightness of being extracted by brightness extraction unit 110 is low-light level, then adopt transformation curve A (401), if intermediate light, then adopt transformation curve B (402), if high brightness then adopts transformation curve C (403).That is to say, at the brightness of extracting, suitably select the classification of compressing and converting rule, and selected compressing and converting rule is set in the compressing and converting table 130.
In addition, these transformation curves are the curves that suitably change according to monochrome information, but the gamma curve (gamma curve) of use is similar basically in the signal processor 210 of preferred and after-stage.
Fig. 6 A, Fig. 6 B are by the schematic diagram of the concrete example of the compressing and converting rule of compressing and converting table 130 expression in the embodiment of the invention.At this, for the purpose of simplifying the description, show the example that data 131 before 4 the conversion is converted to data 132 after 3 the conversion.That is to say that this example converts 16 image gray data compressions to 8 image gray data.
Compressing and converting rule when Fig. 6 A shows relatively low brightness.In this compressing and converting rule, to changing the sign bit after part emphasis lower in preceding 16 gray scales distributes conversion.The mankind's eyes were for the highly sensitive character of the low part of gray scale when this had utilized brightness low especially.
Corresponding, the compressing and converting rule when relative higher brightness has been shown among Fig. 6 B.In this compressing and converting rule, to changing the sign bit after part lower in preceding 16 gray scales is distributed more relatively conversion, still, compare with the situation of Fig. 6 A, also distributed the sign bit after the conversion to changing part higher in preceding 16 gray scales.The more blunt character of sensitivity of the human eyes when comparing high brightness when this has utilized with low-light level.
The difference of the distribution method of these sign bits is reflected as classification (401 to the 403) difference of transformation curve as shown in Figure 5.That is to say, as shown in Figure 6A, when to the sign bit after the low gray scale emphasis distribution conversion before changing, then describe the curve that the wide-angle as the transformation curve A (401) of Fig. 5 rises.On the other hand, shown in Fig. 6 B, when the high gray scale before changing is also distributed sign bit after the conversion, then describe the curve that the low-angle as the transformation curve C (403) of Fig. 5 rises.
Fig. 7 illustrates a routine choice criteria of the 120 pairs of transformation curves in compressing and converting rule configuration part in the embodiment of the invention.The transverse axis of this choice criteria represents that the monochrome information extracted by brightness extraction unit 110, the longitudinal axis represent the classification of the transformation curve that select.
If when adopting curve 411 as choice criteria, in this example, as monochrome information, " 90 " and " 180 " become the threshold values that is used to select transformation curve so.Thus, can carry out such judgement: when the monochrome information of being extracted by brightness extraction unit 110 is lower than " 90 ", select transformation curve A (401), when monochrome information is selected transformation curve B (402) more than or equal to " 90 " and when being lower than " 180 ", when monochrome information is selected transformation curve C (403) during more than or equal to " 180 ".
In addition, if when adopting curve 412 as choice criteria, in this example, as monochrome information, " 50 " and " 190 " become the threshold values that is used to select transformation curve so.Thus, can make the following judgment: when the monochrome information of being extracted by brightness extraction unit 110 is lower than " 50 ", select transformation curve A (401), when monochrome information is selected transformation curve B (402) more than or equal to " 50 " and when being lower than " 190 ", when monochrome information is selected transformation curve C (403) during more than or equal to " 190 ".
In addition, in Fig. 5 and Fig. 7 etc., show these 3 kinds of transformation curves of A to C, still, be not limited thereto, can set the transformation curve of desired quantity as an example as conversion curve.At this moment, the quantity of corresponding conversion curve is set the threshold values of monochrome information.
Fig. 8 shows the configuration example that is used to set the compressing and converting rule in the embodiment of the invention.This configuration example comprises compressing and converting table 391, list index 394, threshold registers 395 and comparator 396.
Compressing and converting table 391 is preserved the compressing and converting rule of fixed area and all variable region A to C.Suppose in the A of variable region, to use transformation curve A, in the B of variable region, use transformation curve B, in the C of variable region, use transformation curve C.Each original position of these fixed areas and all variable region A to C is indicated by list index 394.And, for variable region A to C, from list index 394, select one, thereby specify in the original position in the compressing and converting table 391.
Preestablish in the threshold registers 395 and be useful on the threshold values of selecting transformation curve.For example, when the curve 411 of hypothesis Fig. 7 is choice criteria,, " 90 " is reached " 180 " be kept in the threshold registers 395 as monochrome information.Monochrome information of extracting in 396 pairs of brightness extraction units 110 of comparator and the threshold values that is kept in the threshold registers 395 compare, thereby judge select which transformation curve, promptly judge and use the compressing and converting rule of which variable region.This judged result is as the classification (transform class) of compressing and converting rule and be output.
Be used to set such structure example of compressing and converting rule as realizing by the camera control microcomputer 390 of Fig. 1.At this moment, the monochrome information of being extracted by the detection unit of picture 220 of Fig. 2 is sent to control interface 290 by control bus 282, and provides to the input of a side of comparator 396 from this control interface 290.And, to being sent to control interface 290 once more, and be set in the compressing and converting table 130 in the image compressor 230 by control bus 282 from the conversion of compressing and converting table 391 output.Thus, can realize compressing and converting in the image compressor 230.In addition,, both can in advance it be stored among the ROM of image compressor 230 inside, also can be before shooting it be sent to image compressor 230, thereby there is no need corresponding brightness information and provide conversion right for fixed area.
And this structure example that is used to set the compressing and converting rule is as the inside of the image processor 200 that also can be arranged on Fig. 2.That is to say, can consider all conversions are replaced providing conversion right from camera control microcomputer 390 to being kept at image compressor 230 in advance, thereby based on the monochrome information of being extracted by the detection unit of picture 220, what switch compressing and converting table 391 should use the district.
Fig. 9 shows the configuration example that is used to set the decompression transformation rule in the embodiment of the invention.This configuration example comprises decompression conversion table 398 and list index 397.
The compressing and converting rule identical with the compressing and converting table 391 of Fig. 8, that decompression conversion table 398 is preserved fixed area and all variable region A to C.Each original position of these fixed areas and all variable region A to C is indicated by list index 397.And, for variable region A to C, from list index 397, select one, thereby specify in the original position in the decompression conversion table 398.The selection of this list index 397 is carried out based on the classification (transform class) of the compressing and converting rule of extracting from video memory 360.
Be used to set such structure example of decompression transformation rule as realizing by the camera control microcomputer 390 of Fig. 1.At this moment, the transform class of extracting from video memory 360 is sent to storage control 250 by memory interface 260, offers list index 397 by control interface 290 from control bus 282 then.And, to being sent to control interface 290 once more, and be set in the decompression conversion table 170 in the image decompressor 240 by control bus 282 from the conversion of decompression conversion table 398 output.Thus, can realize decompression conversion in the image decompressor 240.
And this structure example that is used to set the decompression transformation rule is as the inside of the image processor 200 that can be arranged on Fig. 2.That is to say, can consider all conversions are replaced providing conversion right from camera control microcomputer 390 to being kept at image decompressor 240 in advance, thereby based on the transform class of extracting from video memory 360, what switch decompression conversion table 398 should use the district.
Figure 10 A, Figure 10 B are the schematic diagrames that the example storage data mode in the video memory 360 in the embodiment of the invention is shown.The view data of storage is the view data after image compression portion 140 compressing and converting in this video memory 360, has for example 8 bit wides respectively.Shown in Figure 10 A, appoint each view data from " 00000000 " to " 11111110 " and get a value.But " 11111111 " are retained as identifier, thereby do not use as view data.In other words, when detecting identifier " 11111111 " from the storage data, what then expression was stored following closely is transform class.
That is, shown in Figure 10 B, when storage be value outside " 11111111 " time, then think compressed view data, when storage be the value of " 11111111 " time, think that then value (being 2 in this example) following closely is a transform class.For example, if transform class is " 01 ", then expression has selected transformation curve A as the compressing and converting rule, if transform class is " 10 ", then expression has selected transformation curve B as the compressing and converting rule, if transform class is " 11 ", then expression has selected transformation curve C as the compressing and converting rule.
And if this transform class is stored, then view data thereafter all is compressed conversion based on its transform class.Therefore, this means, when decompressing conversion by 180 pairs of such view data of image decompressor portion, be necessary to carry out based on its transform class.
Figure 11 shows an illustration picture frame 321 of imaging apparatus 320 in the embodiment of the invention.In picture frame 321, effectively image area 322 is effective image-regions in the picture frame 321, and is the document image zone when taking.Be equivalent to this effective image area 322 exterior lateral area during be called as black-out intervals, it is used in the signal processing in the signal processor 210.This black-out intervals roughly is divided into: the H black-out intervals 325 of horizontal direction and 326 and the V black-out intervals 327 and 328 of vertical direction.
220 pairs of monochrome informations of the detection unit of picture are carried out detection in real time, and based on this monochrome information, carry out compressing and converting table 130 is conciliate the setting of the compressing and converting rule reconciliation compressing and converting rule of compressing and converting table 170 in above-mentioned black-out intervals.When carrying out the shooting of rest image,, be used to catch the regular setting of conciliating the compressing and converting rule of compressing and converting of image based on detected monochrome information in finishing image.
The setting that this compressing and converting rule is conciliate the compressing and converting rule both can be carried out respectively each picture frame 321, also can each the part image piece 323 in the picture frame 321 be carried out respectively.For example, in the view data of 5,000,000 pixels, use the picture size of horizontal 3600 pixels, vertical 1970 row, still, also can carry out the judgement of monochrome information, thereby carry out the setting of compressing and converting rule per 20 row as image block 323.In outdoor shooting, because the high luminance areas such as several behavior skies that begin from above in the width of cloth picture, so it is effective often that each image block 323 is changed transformation curve.
Figure 12 is the schematic diagram that a routine interpolation of image compression portion 140 is handled in the embodiment of the invention.Though compressing and converting table 130 is described transformation curve as shown in Figure 5, still, point that will be not all is kept in the compressing and converting table 130.For example, as shown in figure 12, can be only with the representative point 421 to 424 that disperses as conversion to being kept in the compressing and converting table 130, other point is then handled by interpolation and is tried to achieve.
The example of handling as this interpolation during data x, in order to try to achieve its corresponding conversion data y afterwards, can consider to calculate linear interpolation point 429 from representative point 421 and 422 before providing conversion.At this, the preceding data of conversion of establishing representative point 421 are x1, and conversion back data are y1, and data are x2 before the conversion of representative point 422, and data are y2 after the conversion, and then data y can try to achieve by following arbitrary formula after the conversion of linear interpolation point 429.
y＝(y2-y1)/(x2-x1)×(x-x2)+y2
y＝(y2-y1)/(x2-x1)×(x-x1)+y1
And here an example of handling as interpolation shows the example of linear interpolation, still, is not limited thereto, and also can try to achieve conversion back data by other non-linear interpolations.And in the example of Figure 12, the interpolation that shows when carrying out compressing and converting in the image compression portion 140 is handled, and still, same method can apply in the interpolation processing that decompresses in image decompressor portion 180 when changing.
Below, with reference to accompanying drawing, the action of the camera head in the embodiment of the invention 300 is described.
Figure 13 is the schematic diagram of a routine disposed of in its entirety flow process of camera head 300 in the embodiment of the invention.On the picture monitor 370 of camera head 300, fixedly show captured image and (finish image: through-image) (step S901).And,, after then rest image (seizure image) at this moment being compressed (step S910), be stored in the video memory 360 if the user presses (not shown) shutter (step S902).
Subsequently, read the seizure view data that is stored in the video memory 360, various signal processing (step S903) are implemented in the back (step S920) of decompressing.Then, be encoded into predetermined form type after, record (step S904) on the external recording medium 380.
Figure 14 is the schematic diagram of a routine handling process of the seizure image Compression in the embodiment of the invention.Extracted the monochrome information (step S911) of original digital image data by brightness extraction unit 110 after, compressing and converting rule configuration part 120 is set to (step S912) in the compressing and converting table 130 with the compressing and converting rule.
And image compression portion 140 carries out the compressing and converting (step S913) of original digital image data with reference to the compressing and converting rule that is set in the compressing and converting table 130.Compressed view data like this together is stored in (step S914) in the video memory 360 with the classification of the compressing and converting rule that is used.
When the processing to all effective view data finishes, finish this handling process (step S915).On the other hand, when residual when other effective view data are arranged, then judge whether to be through with to the processing (step S916) of the view data in the image block that extracts unit as monochrome information, processing if be through with in the image block, then repeat monochrome information and extract (step S911) processing afterwards, if do not finish the processing in the image block, then residual view data repeated image compression (step S913) processing afterwards.
Figure 15 is the schematic diagram of a routine handling process of photographic images decompression in the embodiment of the invention.From video memory 360 sense datas (step S921), if these data that are read out are identifier (being " 11111111 " in the example of Figure 10 A, Figure 10 B) (step S922), then extract thereafter compressing and converting classification, and the decompression transformation rule is set in (step S923) in the decompression conversion table 170 by decompression transformation rule configuration part 160.
On the other hand, if the data of reading are the data (step S922) outside the identifier, then image decompressor portion 180 carries out the decompression (step S924) of compressing image data with reference to the decompression transformation rule that is set in the decompression conversion table 170.And, when the processing that finishes all effective view data, finish this handling process (step S925).
Like this, according to embodiments of the invention, based on the monochrome information of extracting by brightness extraction unit 110, by compressing and converting rule configuration part 120 the compressing and converting rule is preestablished in the compressing and converting table 130, and image compression portion 140 is according to its compressing and converting rule, original digital image data is carried out compressing and converting after, the classification of itself and this compressing and converting rule together is kept in the video memory 150, thus, can reduce the desired volume of video memory 150.Extract the decompressed transformation rule of the classification configuration part 160 that is kept at the compressing and converting rule in the video memory 150, and according to this classification, the decompression transformation rule is set in the decompression conversion table 170.Image decompressor portion 180 decompresses to the compressing image data in the video memory 150 according to the decompression transformation rule that is set in this decompression conversion table 170.
Like this, aspect picture quality, when the original digital image data of being taken by 140 pairs of imaging apparatuss of image compression portion 320 compresses, the information adaptive change compressing and converting rule of image is finished in utilization, the compression that can be fit to its original digital image data is thus handled, thereby can be with the degradation inhibiting of the portrait quality that caused by compression to Min..And aspect processing speed, reflection is used to carry out the monochrome information of finishing image of adaptability compression before beginning by the effective image area at next frame, has improved real-time thus.And, be divided into fixed area and variable region by compressing and converting table 130 is conciliate compressing and converting table 170, thereby do not need fixed area is reset compressing and converting rule or decompression transformation rule, bring the high speed of compression and decompression thus.And,, can realize for example shortening the interval when taking pictures continuously by the raising of these real-times and the high speed of compression and decompression.
And, aspect memory capacity and hardware size, owing to after the original digital image data that imaging apparatus 320 is taken compresses, it is stored in the video memory 150, thereby can reduces the ratio that video memory 150 is occupied in chip area.Thus, the capacity of required video memory tails off when taking a rest image, thereby for as the taking pictures continuously of one of basic function of digital camera for example, can increase the number of taking pictures continuously.And, conciliate in the compressing and converting table 170 at compressing and converting table 130, owing to only set the representative point of transformation curve, thereby can compress being used to and the hardware size of decompression is suppressed at Min..And, aspect power consumption, owing to after the original digital image data that imaging apparatus 320 is taken compresses, be stored in the video memory 150, so reduced the access amount of memory, thus the power consumption of storage access can be reduced.And, owing to reduced the power consumption of storage access, thus can make the battery of digital camera keep the longer time.
In addition, the example that embodiments of the invention just make the present invention specialize specifies item to have corresponding relation respectively with the invention in the following claim scope, but, do not limit therewith, in the scope that does not break away from main idea of the present invention, can carry out various distortion.
Promptly, in a first aspect of the present invention, transformation rule is preserved the unit corresponding to for example compressing and converting table 130.The brightness extraction unit is corresponding to for example brightness extraction unit 110.The transformation rule setup unit is corresponding to for example compressing and converting rule configuration part 120.Image conversion unit is corresponding to for example image compression portion 140.
And in a second aspect of the present invention, the compressing and converting rule is preserved the unit corresponding to for example compressing and converting table 130.The brightness extraction unit is corresponding to for example brightness extraction unit 110.Compressing and converting rule setup unit is corresponding to for example compressing and converting rule configuration part 120.Image compression unit is corresponding to for example image compression portion 140.Video memory is corresponding to for example video memory 150.The decompression transformation rule is preserved the unit corresponding to the conversion table 170 that for example decompresses.Decompression transformation rule setup unit is corresponding to the transformation rule configuration part 160 of for example decompressing.The image decompressor unit is corresponding to for example image decompressor portion 180.Signal processing unit is corresponding to for example signal processing part 190.
And in a fourth aspect of the present invention, pointer is preserved the unit corresponding to for example list index 394.Judging unit is corresponding to for example comparator 396.
In addition, in a sixth aspect of the present invention, pointer is preserved the unit for example corresponding to list index 397.
In addition, in a seventh aspect of the present invention, black-out intervals is corresponding to for example H black-out intervals 325 and 326 and V black-out intervals 327 and 328.
And in a twelveth aspect of the present invention, image unit is corresponding to for example imaging apparatus 320.Front end is corresponding to for example front end 340.The compressing and converting rule is preserved the unit corresponding to for example compressing and converting table 130.The brightness extraction unit is corresponding to for example brightness extraction unit 110.Compressing and converting rule setup unit is corresponding to for example compressing and converting rule configuration part 120.Image compression unit is corresponding to for example image compression portion 140.Video memory is corresponding to for example video memory 150.The decompression transformation rule is preserved the unit corresponding to the conversion table 170 that for example decompresses.Decompression transformation rule setup unit is corresponding to the transformation rule configuration part 160 of for example decompressing.The image decompressor unit is corresponding to for example image decompressor portion 180.Signal processing unit is corresponding to for example signal processing part 190.Image recording unit is corresponding to for example external recording medium 380.
And, aspect a thirteenth aspect of the present invention or the 14 in, compressing and converting rule is preserved the unit corresponding to for example compressing and converting table 130.Video memory is corresponding to for example video memory 150.The decompression transformation rule is preserved the unit corresponding to the conversion table 170 that for example decompresses.And the step of monochrome information of extracting relevant original digital image data is corresponding to for example step S911.Set the compressing and converting rule according to monochrome information and preserve the step of the compressing and converting rule in the unit corresponding to for example step S912.According to being kept at the compressing and converting rule that the compressing and converting rule is preserved the unit, the step that original digital image data is compressed into compressing image data is corresponding to for example step S913.The classification of compressing image data and compressing and converting rule together is kept at step in the video memory corresponding to for example step S914.The step of sense data is corresponding to for example step S921 from video memory.If the data of reading are predetermined identifier, then extract the classification of compressing and converting rule, and set the decompression transformation rule based on this classification and preserve the step of the decompression transformation rule in the unit corresponding to for example step S923.If the data of reading are compressing image data, then preserve the decompression transformation rule of unit according to being kept at the decompression transformation rule, the step that this compressing image data is de-compressed into decompressed image data is corresponding to for example step S924.Decompressed image data is carried out the step of prearranged signal processing corresponding to for example step S903.
In addition, Shuo Ming handling process is appreciated that the method that becomes to comprise these series of steps in embodiments of the present invention, in addition, also is appreciated that to become to make computer to carry out the program of these series of steps and record the recording medium of this program.
Utilize possibility on the industry
According to the present invention, with simple compressing/decompressing method, just can obtain the adaptation image Reduce the excellent effect of the desired volume of video memory in the time of character.
As the example of applying flexibly of the present invention, the present invention can be applied to reduction such as digital camera etc. The capacity of the video memory in the camera head.

Claims (14)

1. an image processing apparatus is characterized in that, comprising:
Transformation rule is preserved the unit, is used to preserve the transformation rule of the original digital image data of being taken by imaging apparatus;
The brightness extraction unit is used to extract the monochrome information about described original digital image data;
The transformation rule setup unit is used for setting described transformation rule based on described monochrome information, and described transformation rule is kept in the described transformation rule preservation unit; And
Image conversion unit is used for preserving the described transformation rule of unit according to being kept at described transformation rule, and described original digital image data is changed.
2. an image processing apparatus is characterized in that, comprising:
The compressing and converting rule is preserved the unit, is used to preserve the compressing and converting rule of the original digital image data of being taken by imaging apparatus;
The brightness extraction unit is used to extract the monochrome information about described original digital image data;
Compressing and converting rule setup unit is used for according to described monochrome information, preserves in described compressing and converting rule and sets described compressing and converting rule in the unit;
Image compression unit is used for according to being kept at the described compressing and converting rule that described compressing and converting rule is preserved the unit described original digital image data being compressed into compressing image data;
Video memory is used for the classification of described compressing image data and described compressing and converting rule is together preserved;
The decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of described compressing image data;
Decompression transformation rule setup unit is used for extracting the described classification that is kept at described video memory, and preserves the described decompression transformation rule of setting in the unit based on this classification at described decompression transformation rule;
The image decompressor unit is used for preserving the described decompression transformation rule of unit according to being kept at described decompression transformation rule, and described compressing image data is de-compressed into decompressed image data; And
Signal processing unit is used for the signal processing that described decompressed image data is stipulated.
3. image processing apparatus according to claim 2 is characterized in that,
Described compressing and converting rule is preserved the unit and is comprised:
Fixed area is used for fixing and preserves described compressing and converting rule; And
The variable region is set according to described monochrome information by described compressing and converting rule setup unit.
4. image processing apparatus according to claim 3 is characterized in that, comprising:
Pointer is preserved the unit, is used to preserve corresponding described compressing and converting rule and preserves the pointer of the described variable region of unit; And
Judging unit is used for setting described pointer after the classification of judging described compressing and converting rule according to described monochrome information.
5. image processing apparatus according to claim 2 is characterized in that,
Described decompression transformation rule is preserved the unit and is comprised:
Fixed area is used for fixing and preserves described decompression transformation rule; And
The variable region, by described decompression transformation rule setup unit based on the classification of described compressing and converting rule and set.
6. image processing apparatus according to claim 5 is characterized in that, also comprises:
Pointer is preserved the unit, and be used to preserve corresponding described decompression transformation rule and preserve the pointer of the described variable region of unit,
Wherein, based on the described pointer of described category setting that is kept in the described video memory.
7. image processing apparatus according to claim 2 is characterized in that,
Described compressing and converting rule setup unit is set described compressing and converting rule in the black-out intervals of described imaging apparatus.
8. image processing apparatus according to claim 2 is characterized in that,
Described compressing and converting rule setup unit is that unit sets described compressing and converting rule with the picture frame.
9. image processing apparatus according to claim 2 is characterized in that,
Described compressing and converting rule setup unit is that unit sets described compressing and converting rule with the image block of regulation.
10. image processing apparatus according to claim 2 is characterized in that,
The interpolation that described image compression unit is implemented regulation to the described compressing and converting rule that is kept in the described compressing and converting rule preservation unit comes described original digital image data is compressed.
11. image processing apparatus according to claim 2 is characterized in that,
Described image decompressor unit comes described compressing image data is decompressed to the interpolation that is kept at the described decompression transformation rule execution regulation in the described decompression transformation rule preservation unit.
12. an image pickup device is characterized in that, comprising:
Image unit is used for photographic images;
Front end is used for captured image transitions is become original digital image data;
The compressing and converting rule is preserved unit, the compressing and converting rule that is used to preserve described original digital image data;
The brightness extraction unit is used to extract the monochrome information about described original digital image data;
Compressing and converting rule setup unit is used for preserving the unit according to described monochrome information in described compressing and converting rule and sets described compressing and converting rule;
Image compression unit is used for according to being kept at the described compressing and converting rule that described compressing and converting rule is preserved the unit described original digital image data being compressed into compressing image data;
Video memory is used for the classification of described image compression data and described compressing and converting rule is together preserved;
The decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of described image compression data;
Decompression transformation rule setup unit is used for extracting the described classification that is kept at described video memory, and preserves the described decompression transformation rule of setting in the unit based on this classification at described decompression transformation rule;
The image decompressor unit is used for preserving the described decompression transformation rule of unit according to being kept at described decompression transformation rule, and described compressing image data is de-compressed into decompressed image data;
Signal processing unit is used for the signal processing that described decompressed image data is stipulated; And
Image recording unit, the view data that is used for having implemented described signal processing is kept at recording medium.
13. the image processing method of an image processing apparatus, described image processing apparatus comprises:
The compressing and converting rule is preserved the unit, is used to preserve the compressing and converting rule of the original digital image data of being taken by imaging apparatus; Video memory is used to preserve the compressing image data after described original digital image data compressed; And the decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of described compressing image data, and described image processing method is characterised in that and comprises:
Extraction step extracts the monochrome information about described original digital image data;
Set the step of described compressing and converting rule,, preserve the described compressing and converting rule of setting in the unit in described compressing and converting rule according to described monochrome information;
Compression step, the described compressing and converting rule according to being kept in the described compressing and converting rule preservation unit is compressed into described compressing image data with described original digital image data;
Preserve step, the classification of described compressing image data and described compressing and converting rule together is kept in the described video memory;
Reading step is from described video memory sense data;
Set the step of described decompression transformation rule, when the data of being read are the identifier of regulation, then extract described classification, and preserve the described decompression transformation rule of setting in the unit at described decompression transformation rule based on this classification;
Decompression step when the data of being read are described compressing image data, then according to the described decompression transformation rule that is kept in the described decompression transformation rule preservation unit, de-compresses into decompressed image data with this compressing image data; And
The signal processing step, the signal processing that described decompressed image data is stipulated.
14. a program is characterized in that, makes computer carry out following step in image processing apparatus, wherein, described image processing apparatus comprises: the compressing and converting rule is preserved the unit, is used to preserve the compressing and converting rule of the original digital image data of being taken by imaging apparatus; Video memory is used to preserve the compressing image data after described original digital image data compressed; And the decompression transformation rule is preserved the unit, is used to preserve the decompression transformation rule of described compressing image data, and described step comprises:
Extraction step extracts the monochrome information about described original digital image data;
Set the step of described compressing and converting rule,, preserve the described compressing and converting rule of setting in the unit in described compressing and converting rule according to described monochrome information;
Compression step, the described compressing and converting rule according to being kept in the described compressing and converting rule preservation unit is compressed into described compressing image data with described original digital image data;
Preserve step, the classification of described compressing image data and described compressing and converting rule together is kept in the described video memory;
Reading step is from described video memory sense data;
Set the step of described decompression transformation rule, when the data of being read are the identifier of regulation, then extract described classification, and preserve the described decompression transformation rule of setting in the unit at described decompression transformation rule based on this classification;
Decompression step when the data of being read are described compressing image data, then according to the described decompression transformation rule that is kept in the described decompression transformation rule preservation unit, de-compresses into decompressed image data with this compressing image data; And
The signal processing step, the signal processing that described decompressed image data is stipulated.
CN200580010945A 2004-04-22 2005-04-21 Image processing device Expired - Fee Related CN100592758C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004126382A JP4385841B2 (en) 2004-04-22 2004-04-22 Image processing device
JP126382/2004 2004-04-22

Publications (2)

Publication Number Publication Date
CN1943221A true CN1943221A (en) 2007-04-04
CN100592758C CN100592758C (en) 2010-02-24

Family

ID=35197355

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200580010945A Expired - Fee Related CN100592758C (en) 2004-04-22 2005-04-21 Image processing device

Country Status (7)

Country Link
US (1) US8538174B2 (en)
EP (1) EP1744541A4 (en)
JP (1) JP4385841B2 (en)
KR (1) KR101120206B1 (en)
CN (1) CN100592758C (en)
TW (1) TWI288360B (en)
WO (1) WO2005104526A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101594536A (en) * 2008-05-28 2009-12-02 富士通株式会社 Encoding/decoding apparatus, coding/decoding method and storage medium
CN102577379A (en) * 2009-10-05 2012-07-11 汤姆逊许可证公司 Methods and apparatus for embedded quantization parameter adjustment in video encoding and decoding
CN106256113A (en) * 2014-03-07 2016-12-21 美国莱迪思半导体公司 Compression video transmission on multimedia links

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4321496B2 (en) 2005-06-16 2009-08-26 ソニー株式会社 Image data processing apparatus, image data processing method and program
JP5074820B2 (en) 2007-05-22 2012-11-14 ルネサスエレクトロニクス株式会社 Image processing apparatus and image processing method
US8837598B2 (en) * 2007-12-28 2014-09-16 Cisco Technology, Inc. System and method for securely transmitting video over a network
US20090169001A1 (en) * 2007-12-28 2009-07-02 Cisco Technology, Inc. System and Method for Encryption and Secure Transmission of Compressed Media
JP4656457B2 (en) 2008-11-13 2011-03-23 Ｎｅｃアクセステクニカ株式会社 Image processing system
EP2317769A1 (en) * 2009-11-02 2011-05-04 Panasonic Corporation Luminance dependent quantization
KR101576560B1 (en) 2009-12-21 2015-12-11 삼성전자주식회사 Image processing apparatus for reading compressed data from memory via data bus and image processing method thereof
JP5460405B2 (en) * 2010-03-24 2014-04-02 キヤノン株式会社 Image display device and control method thereof
JP5712609B2 (en) * 2010-12-24 2015-05-07 富士通株式会社 Data processing apparatus and data recording method
US8847516B2 (en) 2011-12-12 2014-09-30 Cree, Inc. Lighting devices including current shunting responsive to LED nodes and related methods
KR102064152B1 (en) * 2013-11-08 2020-02-12 삼성디스플레이 주식회사 Display apparatus and driving method of them
EP2887665A1 (en) * 2013-12-19 2015-06-24 Thomson Licensing Method and device for encoding a high-dynamic range image
US10283091B2 (en) * 2014-10-13 2019-05-07 Microsoft Technology Licensing, Llc Buffer optimization
JP6628400B2 (en) * 2015-09-25 2020-01-08 シャープ株式会社 Video processing apparatus, video processing method and program
JP6624889B2 (en) 2015-10-30 2019-12-25 キヤノン株式会社 Video processing apparatus, video processing method, and video processing program
KR20210132420A (en) * 2020-04-27 2021-11-04 엘지전자 주식회사 Air-conditioner system and method for operating the same

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6030392A (en) * 1983-07-28 1985-02-15 Mitsubishi Chem Ind Ltd Thiadiazole coloring matter for thermal transfer recording
JPH0630392A (en) 1992-07-08 1994-02-04 Toshiba Corp Picture coding device
JPH06217274A (en) * 1993-01-18 1994-08-05 Matsushita Electric Ind Co Ltd Image signal compressing device
JP3444449B2 (en) * 1994-12-26 2003-09-08 ソニー株式会社 Video signal processing device
US6118820A (en) * 1998-01-16 2000-09-12 Sarnoff Corporation Region-based information compaction as for digital images
JPH11252372A (en) * 1998-03-04 1999-09-17 Minolta Co Ltd Data converting circuit and image reader
US6560285B1 (en) * 1998-03-30 2003-05-06 Sarnoff Corporation Region-based information compaction as for digital images
JP2001094788A (en) * 1999-09-27 2001-04-06 Ricoh Co Ltd Image forming device
JP2002111989A (en) 2000-10-02 2002-04-12 Mega Chips Corp Image processing circuit
JP2003274178A (en) * 2002-03-18 2003-09-26 Seiko Epson Corp Image processing method and image processor

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101594536A (en) * 2008-05-28 2009-12-02 富士通株式会社 Encoding/decoding apparatus, coding/decoding method and storage medium
US8761246B2 (en) 2008-05-28 2014-06-24 Fujitsu Limited Encoding/decoding device, encoding/decoding method and storage medium
CN102577379A (en) * 2009-10-05 2012-07-11 汤姆逊许可证公司 Methods and apparatus for embedded quantization parameter adjustment in video encoding and decoding
CN102577379B (en) * 2009-10-05 2017-12-19 汤姆逊许可证公司 Method and apparatus for the embedded quantization parameter regulation in Video coding and decoding
CN106256113A (en) * 2014-03-07 2016-12-21 美国莱迪思半导体公司 Compression video transmission on multimedia links

Also Published As

Publication number Publication date
JP2005311743A (en) 2005-11-04
TW200606752A (en) 2006-02-16
WO2005104526A1 (en) 2005-11-03
EP1744541A4 (en) 2010-09-22
US8538174B2 (en) 2013-09-17
EP1744541A1 (en) 2007-01-17
KR101120206B1 (en) 2012-03-16
US20070196023A1 (en) 2007-08-23
KR20070012668A (en) 2007-01-26
TWI288360B (en) 2007-10-11
JP4385841B2 (en) 2009-12-16
CN100592758C (en) 2010-02-24

Similar Documents

Publication Publication Date Title
CN1943221A (en) Image processing device
CN101325659B (en) Imaging device, imaging method
KR100917088B1 (en) Image capturing apparatus and electronic zoom method
JP4466261B2 (en) Imaging apparatus, brightness correction method, and program
CN101031021A (en) Image capturing apparatus, imaging circuit, and image capturing method
CN1967566A (en) Image processing apparatus and method
CN1496110A (en) ROI set-up method and equipment, electronic camera equipment, program and recording medium
JP2003224769A (en) Digital camera
KR101579736B1 (en) A device a method and a computer-readable storage medium for reducing noise
CN1992816A (en) Image display apparatus, method, and program
CN107454322A (en) Photographic method, device, computer can storage medium and mobile terminals
CN1925559A (en) Device and method for processing images
US20060215915A1 (en) Device and method for generating thumbnail JPEG image and medium for storing thumbnail JPEG image
CN1739116A (en) Apparatus and method for producing thumbnail images and for improving image quality of re-sized images
CN1674683A (en) Digital picture signal processing apparatus, method thereof. digital picture recording apparatus and method
Chan et al. Video CCD based portable digital still camera
JP2008109305A (en) Image processing device, and control method of image processing device
CN1179558C (en) Image recording apparatus and method, image reproducing apparatus and method, and recorded medium on which image processing program is recorded
JP6793511B2 (en) Image processing device
JP2012222453A (en) Data processing device, data processing method, program, and camera system
US8837866B2 (en) Image processing apparatus and method for controlling image processing apparatus
CN1934585A (en) Electronic device and a method in an electronic device for processing image data
CN101076080A (en) Image-data noise reduction apparatus and method of controlling same
JP2005260467A (en) Image processor
KR100686358B1 (en) Image improving system and method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100224

Termination date: 20150421

EXPY Termination of patent right or utility model