WO2007055389A2 - Dispositif de traitement de signal image - Google Patents
Dispositif de traitement de signal image Download PDFInfo
- Publication number
- WO2007055389A2 WO2007055389A2 PCT/JP2006/322690 JP2006322690W WO2007055389A2 WO 2007055389 A2 WO2007055389 A2 WO 2007055389A2 JP 2006322690 W JP2006322690 W JP 2006322690W WO 2007055389 A2 WO2007055389 A2 WO 2007055389A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image signal
- picture
- code amount
- unit
- smoothing
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 107
- 238000009499 grossing Methods 0.000 claims abstract description 154
- 230000008859 change Effects 0.000 claims abstract description 41
- 238000007906 compression Methods 0.000 claims abstract description 25
- 230000006835 compression Effects 0.000 claims abstract description 25
- 238000013139 quantization Methods 0.000 claims description 116
- 230000002123 temporal effect Effects 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 9
- 230000007423 decrease Effects 0.000 abstract description 35
- 230000000694 effects Effects 0.000 abstract description 23
- 206010047571 Visual impairment Diseases 0.000 abstract description 10
- 230000002411 adverse Effects 0.000 abstract description 7
- 230000015654 memory Effects 0.000 description 20
- 238000006243 chemical reaction Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 14
- 230000001629 suppression Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 9
- 230000002457 bidirectional effect Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 239000004065 semiconductor Substances 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000002829 reductive effect Effects 0.000 description 3
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/115—Selection of the code volume for a coding unit prior to coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Definitions
- the present invention relates to an image signal processing apparatus for processing a photographed image signal and, more particularly, to suppression processing of a flicker that occurs upon increasing the camera gain in a compression scheme using intra-picture and inter-picture prediction.
- Efficient moving image encoding as represented by MPEG2 generally executes compression encoding by using a plurality of different picture types including intra-frame and inter-frame prediction. More specifically, only frames at a predetermined interval use a picture type for intra-frame encoding. Frames between them use a picture type for inter-frame prediction due to the fact that successive frames have high image data correlation, thereby increasing the moving image data compression efficiency.
- Fig. 17 is a block diagram showing a conventional image signal processing apparatus.
- Reference numeral 1702 denotes a camera unit; and 1701, a camera including a optical lens system and a photoelectric conversion unit such as a CCD (Charge Coupled Device) .
- An analog moving image signal photographed by the camera 1701 undergoes processing such as A/D- conversion, pixel interpolation, color conversion, and ⁇ -conversion by a photographed image signal processing circuit 1703.
- a camera control circuit 1725 executes processing such as exposure control of the camera 1701 on the basis of, for example, the brightness of the photographed image.
- the photographed image signal processing circuit 1703 supplies its output to a frame rearranging circuit 1709 as image data to be encoded.
- the frame rearranging circuit 1709 rearranges frames in encoding order.
- the frames are rearranged in an order suitable for encoding. For example, a B-picture serving as a bidirectional prediction frame should be encoded after the encoding of the preceding and succeeding frames and therefore it is moved backward.
- a difference circuit 1710 outputs the image data itself to a DCT circuit 1711.
- the difference circuit 1710 calculates the difference value between the image data and a predicted image and outputs the difference value to the DCT circuit 1711 according to a selection by a switch 1723.
- the DCT circuit 1711 converts the image data into a DCT coefficient.
- a quantization circuit 1712 quantizes the DCT coefficient using a predetermined quantization scale Q. When the Q value changes, the coefficient value after quantization changes greatly. Hence, the generated code amount changes .
- a variable-length coding circuit 1713 for example, entropy-encodes the quantization coefficient output from the quantization circuit 1712 and outputs it as encoded data.
- a buffer 1714 temporarily saves the generated encoded data to control the encoding rate.
- the encoded data stored in the buffer 1714 is read out at a predetermined rate and output from a terminal 1715 as compression-encoded data.
- the coefficient data quantized by the quantization circuit 1712 undergoes inverse quantization by an inverse quantization circuit 1717 and inverse DCT by an inverse DCT circuit 1718 to obtain predicted image data.
- an adding circuit 1719 saves data after inverse DCT directly in a video memory 1720.
- the adding circuit 1719 adds the predicted image to the P- and B- pictures and saves it in the video memory 1720 as locally decoded image data.
- a motion compensation predicting circuit 1721 compares the locally decoded image data saved in the video memory 1720 with the input image data.
- predicted image data with motion compensation in the forward direction is generated and supplied to the above-described difference circuit 1710.
- predicted image data with bidirectional motion compensation is generated and supplied to the above-described difference circuit 1710.
- the motion compensation predicting circuit 1721 also supplies the generated image data to the adding circuit 1719 as a predicted image for next local decoding.
- a rate control circuit 1727 executes code amount assignment control of a picture to be encoded for a target encoding rate using information such as a past generated code amount and buffer fill factor obtained from the buffer 1714. At this time, the rate control circuit 1727 controls the quantization circuit 1712 by deciding the quantization scale Q based on a code amount assigned to each picture type. The generated code amount after quantization changes between the I-, P-, and B-pictures. The quantization scale Q is therefore generally changed in accordance with the picture type. For example, an encoding scheme known as MPEG2-TM (Test Model) sets the quantization scale corresponding to each picture type.
- MPEG2-TM Transmission Model
- Fig. 16 shows graphs a through c for explaining the cause of a luminance flicker in the reproduction mode which is generated when increasing the gain of the camera used in the conventional arrangement described above.
- the graph a_ of Fig. 16 shows a reproduction signal from I-pictures.
- the luminance peak of the noise component superimposed on a flat image signal is maintained to some extent by intra-frame encoding. This is also because the assigned code amount of I-pictures is generally larger than that of the other picture types.
- the graph b of Fig. 16 shows a reproduction signal from P- and B-pictures.
- the correlation between frames is low because of the random noise component.
- the encoded image signal degrades because of the increase in inter- frame difference information of P- and B-pictures.
- the noise peak decreases so that a luminance peak difference is generated, unlike the I-pictures in the graph a_ of Fig. 16.
- a luminance flicker derived from noise is generated in reproducing a moving image, as shown in the graph c of Fig. 16.
- the conventional technique to remove random noise derived when increasing the gain i.e., the method of changing the filter characteristic as in WO97/05745 is one of general encoding distortion reducing methods in the case of a low S/N ratio and can expect a partial effect.
- the filter intensity must be sufficiently high.
- a TV program image can sometimes contain intentionally added noise intended to produce a film-like effect based on the granularity of noise. In this situation, it is impossible to uniformly remove noise using a filter. Removal of the noise component itself must be suppressed as much as possible. That is, to effectively reduce the above-described luminance flicker while maintaining image quality, the invention of WO97/05745 does not suffice.
- the present invention has been made to solve the above-described unsolved problems of the prior art, and has as its object to effectively reduce a luminance flicker caused by noise while suppressing adverse effects such as afterimages and decreases in resolution due to smoothing as much as possible even when the S/N ratio of an image photographed at an increased gain is low. It has, as another object, the reduction of a luminance flicker while making the most of the effect of noise even when photographing an image containing noise that is intentionally added to obtain an effect in the image.
- One aspect of the present invention relates to an image signal processing apparatus for classifying pictures contained in an image signal into a plurality of picture types and compression-encoding the image signal, characterized by comprising, acquisition unit adapted to acquire a gain setting value for the image signal; compression encoding adapted to execute compression-encoding the image signal, adjustment unit capable of adjusting a code amount to be assigned to each picture type in the compression encoding unit; and ' control adapted to control to change, in accordance with the gain setting value acquired by the acquisition unit, an assignment ratio of code amount for each picture type which is adjusted by the adjustment unit.
- Another aspect of the present invention relates to an image signal processing apparatus for classifying pictures contained in an image signal into a plurality of picture types and compression-encoding the image signal, comprising, acquisition unit adapted to acquire a gain setting value for the image signal, smoothing unit adapted to execute smoothing processing of the image signal, compression encoding unit, provided on a subsequent stage of the smoothing unit, adapted to execute compression-encoding the image signal, adjustment unit capable of adjusting a code amount to be assigned to each picture type in the compression encoding unit, and control unit adapted to control to change, in accordance with the gain setting value acquired by the acquisition unit, an intensity of smoothing processing by the smoothing unit and an assignment ratio of code amount for each picture type which is adjusted by the adjustment unit.
- an image signal processing apparatus for classifying pictures contained in an image signal into a plurality of picture types and compression-encoding the image signal, comprising, acquisition adapted to acquire a gain setting value of gain adjustment for the image signal and a sharpness setting value of sharpness adjustment, smoothing unit adapted to execute smoothing processing of the image signal, compression encoding unit, provided on a subsequent stage of the smoothing unit, adapted to execute compression-encoding the image signal, adjustment unit capable of adjusting a code amount to be assigned to each picture type in the compression encoding unit, and control unit adapted to control to change, in accordance with the gain setting value and the sharpness setting value acquired by the acquisition unit, an intensity of smoothing processing by the smoothing unit and an assignment ratio of code amount for each picture type which is adjusted by the adjustment unit.
- an image signal processing apparatus for classifying pictures contained in an image signal into a plurality of picture types and compression-encoding the image signal, comprising, acquisition unit adapted to acquire a gain setting value for the image signal, smoothing unit adapted to execute smoothing processing of the image signal, compression encoding unit, provided on a subsequent stage of the smoothing unit, adapted to execute compression-encoding the image signal, adjustment unit capable of adjusting a code amount to be assigned to each picture type in the compression encoding unit, and designation unit adapted to designate a target bit rate of compression encoding of the compression encoding unit, and control unit adapted to control to change, in accordance with the gain setting value acquired by the acquisition unit and the target bit rate designated by the designation unit, an intensity of smoothing processing by the smoothing unit and an assignment ratio of code amount for each picture type which is adjusted by the adjustment unit.
- FIG. 10 Further aspect of the present invention according to one of embodiments relates to a control method of an image signal processing apparatus for classifying pictures contained in an image signal into a plurality of picture types and compression-encoding the image signal, comprising steps of, acquiring a gain setting value for the image signal, setting an assignment ratio of code amount for each picture type, compression-encoding the image signal in accordance with the set ratio, changing, in accordance with the acquired gain setting value, an assignment ratio of code amount for each picture type.
- Fig. 1 is a block diagram of a digital video camera according to the first embodiment;
- Fig. 2 shows graphs showing an example of assigned code amount control according to the first embodiment;
- Fig. 3 shows graphs showing another example of assigned code amount control according to the first embodiment;
- Fig. 4 shows graphs showing an example of smoothing intensity control according to the first embodiment
- Fig. 5 shows graphs showing another example of smoothing intensity control according to the first embodiment
- Fig. 6 shows block diagrams showing structural examples of a smoothing circuit
- FIG. 7 is a block diagram of a digital video camera according to the second embodiment
- FIG. 8 shows graphs showing an example of assigned code amount control according to the second embodiment
- FIG. 9 shows graphs showing another example of assigned code amount control according to the second embodiment
- Fig. 10 shows graphs showing an example of smoothing intensity control according to the second embodiment
- Fig. 11 shows graphs showing another example of smoothing intensity control according to the second embodiment
- Fig. 12 is a block diagram of a digital video camera according to the third embodiment
- Fig. 13 shows graphs showing an example of assigned code amount control according to the third embodiment
- FIG. 14 shows graphs showing another example of assigned code amount control according to the third embodiment
- Fig. 15 shows graphs for explaining a luminance flicker reduction effect according to the present invention.
- Fig. 16 shows graphs for explaining a cause of a luminance flicker
- Fig. 17 is a block diagram showing the arrangement of a conventional image signal processing apparatus.
- An embodiment of an image signal processing apparatus of the present invention will be described by exemplifying a digital video camera capable of encoding an image signal photographed with a camera by a compression scheme using intra-picture prediction and inter-picture prediction and outputting the encoded data.
- Pictures include a field image and a frame image. In the following description, a picture indicates a frame image.
- Fig. 1 is a block diagram showing, as the first embodiment, a digital video camera according to an embodiment of an image signal processing apparatus of the present invention.
- Reference numeral 102 denotes a camera unit; and 101, a camera including a lens optical system and a photo-electric conversion unit such as a CCD.
- An analog moving image signal photographed by the camera 101 undergoes processing such as A/D-conversion, pixel interpolation, color conversion, and ⁇ -conversion by a photographed image signal processing circuit 103.
- a camera control circuit 125 executes processing such as exposure control of the camera 101 on the basis of, for example, the brightness of the photographed image.
- the camera control circuit 125 controls to raise the amplifier gain of the photographed image signal processing circuit 103 not to reduce the shutter speed, thereby preventing any afterimage.
- a camera apparatus for business use generally has a function of causing a user to arbitrarily switch the camera gain.
- the camera control circuit 125 controls to make the photographed image signal processing circuit 103 have a fixed amplifier gain corresponding to a user setting value input from an operation unit (not shown) .
- the photographed image signal processing circuit 103 supplies its output to a smoothing circuit 124 as an image signal from the camera unit 102.
- the smoothing circuit 124 includes a variable-band special filter that limits the spatial band of an image signal, a variable temporal filter that executes temporal smoothing of each pixel, or a combination thereof. The smoothing circuit 124 will be described later in detail .
- the output from the smoothing circuit 124 is supplied to a frame rearranging circuit 109 as image data to be encoded.
- the frame rearranging circuit 109 rearranges frames in an encoding order.
- the frames are rearranged in an order suitable for encoding.
- a B- picture serving as a bidirectional prediction frame should be encoded after encoding of the preceding and succeeding frames and therefore is moved backward.
- a difference circuit 110 outputs the image data itself to a DCT circuit 111.
- the difference circuit 110 calculates the difference value between the image data and a predicted image and outputs the difference value to the DCT circuit 111 by selecting a switch 123.
- the DCT circuit 111 converts the image data into a DCT coefficient.
- a quantization circuit 112 quantizes the DCT coefficient by using a predetermined quantization scale Q. When the Q value changes, the coefficient value after quantization largely changes. Hence, the generated code amount changes.
- a variable-length coding circuit 113 for example, entropy-encodes the quantization coefficient output from the quantization circuit 112 and outputs it as encoded data.
- a buffer 114 temporarily saves the generated encoded data to control the encoding rate.
- the encoded data stored in the buffer 114 is read out at a predetermined rate and output from a terminal 115 as compression-encoded data. It is possible to efficiently record the output compression-encoded data on a recording medium such as a tape, disc, or semiconductor memory or efficiently transmit the compression-encoded data by using a network or commutation channel.
- the coefficient data quantized by the quantization circuit 112 undergoes inverse quantization by an inverse quantization circuit 111 and inverse DCT by an inverse DCT circuit 118 to obtain predicted image data.
- an adding circuit 119 saves data after inverse DCT directly in a video memory 120.
- the adding circuit 119 adds the predicted image to the P- and B- pictures and saves it in the video memory 120 as locally decoded image data.
- a motion compensation predicting circuit 121 compares the locally decoded image data saved in the video memory 120 with the input image data. For P-pictures, predicted image data with motion compensation in the forward direction is generated and supplied to the above-described difference circuit 110.
- a rate control circuit 127 executes code amount assignment control of a picture to be encoded for a target encoding rate in accordance with information such as a past generated code amount and buffer fill factor obtained from the buffer 114 and the setting value of a code amount ratio setting circuit 126 (to be described later) . At this time, the rate control circuit 127 controls the quantization circuit 112 by deciding the quantization scale Q based on a code amount assigned to each picture type.
- the generated code amount after quantization changes between the I-, P-, and B-pictures.
- the quantization scale Q is therefore changed in accordance with the picture type. For example, in calculating of code amount assignment, the ratio of the quantization scale Q of P- and B-pictures to the quantization scale Q of I-pictures is set, thereby setting the quantization scale Q corresponding to each picture type.
- a flicker suppression control circuit 116 controls smoothing processing of the smoothing circuit 124 and the code amount ratio setting circuit 126 in accordance with a camera gain setting value supplied from the camera control circuit 125.
- the flicker suppression control circuit 116 controls the code amount ratio setting circuit 126 to change the code amount ratio to be assigned to each picture type, thereby suppressing a luminance flicker upon increasing the gain.
- Fig. 2 shows graphs a and b showing control of assignment ratio of code amount by the camera gain.
- a graph ⁇ a of Fig. 2 shows quantization scale ratio control for control of assignment ratio of code amount.
- the ratio of the quantization scale of P- and B-pictures to the quantization scale Q of I- pictures is set by code amount assignment control by the rate control circuit 127, thereby controlling the code amount ratio to be assigned to each picture type.
- L201 indicates a change in the quantization scale ratio of B-pictures according to the camera gain. When the camera gain exceeds +6 dB, the quantization scale ratio of B-pictures decreases. As a result, the generated code amount ratio of B-pictures increases.
- L202 indicates a change in the quantization scale ratio of P-pictures according to the camera gain.
- the quantization scale ratio of P-pictures decreases.
- the generated code amount ratio of P-pictures increases.
- a graph b of Fig. 2 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control according to the camera gain in the graph a of Fig. 2.
- L203 indicates an assigned code amount ratio of B-pictures.
- the assigned code amount ratio increases in accordance with the change L201 in the quantization scale ratio in the graph a. of Fig. 2.
- L204 indicates an assigned code amount ratio of P-pictures.
- the assigned code amount ratio increases in accordance with the change L202 in the quantization scale ratio in the graph a. of Fig. 2.
- a smaller code amount may be assigned to I-pictures when the code amount to be assigned to the P- and B- pictures increases.
- the camera gain has a predetermined threshold value so that the quantization scale ratio is controlled in two steps. It is also possible to change the quantization scale ratio in proportion to the camera gain.
- Fig. 3 shows examples of control of assignment ratio of code amount proportional to the camera gain.
- a graph a_ of Fig. 3 shows quantization scale ratio control for control of assignment ratio of code amount.
- L301 indicates a change in the quantization scale ratio of B-pictures according to the camera gain.
- the quantization scale ratio of B- pictures decreases in accordance with the camera gain. As a result, the generated code amount ratio of B- pictures increases.
- L302 indicates a change in the quantization scale ratio of P-pictures according to the camera gain.
- the quantization scale ratio of P-pictures decreases in accordance with the camera gain.
- the generated code amount ratio of P-pictures increases.
- a graph b of Fig. 3 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control according to the camera gain in the graph a. of Fig. 3.
- L303 indicates an assigned code amount ratio of B-pictures.
- the assigned code amount ratio increases in accordance with the change L301 in the quantization scale ratio in the graph a_ of Fig. 3.
- L304 indicates an assigned code amount ratio of P-pictures.
- the assigned code amount ratio of P- and B-pictures increases as the camera gain increases. This allows to suppress loss of the peak of the noise component upon increasing the gain when P- and B-pictures are encoded. This arrangement can reduce a luminance flicker in reproducing encoded image data.
- the flicker suppression control circuit 116 controls spatial or temporal smoothing or spatial and temporal smoothing of the above-described smoothing circuit 124.
- the smoothing circuit 124 executes smoothing at an intensity corresponding to the camera gain to suppress the peak of the noise component itself and decrease the luminance peak due to the noise component of I-pictures. This allows to reduce the difference from the decrease in the luminance peak of noise upon encoding P- and B-pictures. As a result, a luminance flicker between the pictures can be suppressed. Additionally, this smoothing processing also suppresses the noise component input to the P- and B-pictures.
- a circuit a of Fig. 6 shows a detailed example of the smoothing circuit 124, which implements a smoothing circuit by a variable-band spatial filter that limits the spatial band.
- a one- or two- dimensional spatial filter (SPF) circuit 602 spatially smoothes an image signal supplied to a terminal 601. The smoothing intensity of a spatial filter indicates the passband characteristic of the spatial filter.
- a coefficient setting circuit 604 causes a coefficient setting circuit 604 to set the weighting coefficient of the filter to a reference pixel to obtain a predetermined passband characteristic, thereby changing the passband characteristic, i.e., the smoothing intensity.
- a terminal 603 is a smoothing intensity control input terminal.
- a terminal 605 outputs the image signal that has undergone the smoothing processing.
- a graph a of Fig. 4 shows an example of smoothing intensity control according to the camera gain. When the camera gain exceeds +6 dB, smoothing processing is executed.
- a graph b of Fig. 4 shows the band characteristic of the spatial filter corresponding to the change in the smoothing intensity in the graph a. of Fig. 4.
- L4.01 indicates a band characteristic obtained when no smoothing processing is executed.
- L402 indicates a band characteristic obtained when smoothing processing is executed. This characteristic corresponds to the region equal to or more than +6 dB in the graph a. of Fig. 4.
- smoothing is executed by limiting the high frequency side of the passband. The band narrows, and the smoothing intensity increases.
- the camera gain has a predetermined threshold value so that the smoothing characteristic is changed in two steps (whole band is passed in one mode) . It is also possible to change the smoothing intensity in proportion to the camera gain.
- a graph a. of Fig. 5 shows an example of smoothing intensity control proportional to the camera gain. When the camera gain exceeds +6 dB, the smoothing intensity increases up to a predetermined upper limit in accordance with the camera gain.
- a graph b of Fig. 5 shows the band characteristic of the spatial filter corresponding to the change in the smoothing intensity in the graph a_ of Fig. 5. When the camera gain is +6 dB to +12 dB, the passband of the spatial filter narrows stepwise in accordance with the camera gain.
- variable temporal filter that executes temporal smoothing of each pixel is independently applicable to the smoothing processing of this embodiment. It is possible to use the above-described spatial filter together.
- a circuit b of Fig. 6 shows a detailed example of the smoothing circuit 124, which implements a smoothing circuit by a variable temporal filter that executes temporal smoothing of each pixel.
- This circuit is known as a recursive filter.
- a subtracting circuit 607 calculates the difference between each pixel of an image signal supplied to a terminal 606 and a corresponding pixel of the preceding frame.
- a coefficient multiplying circuit 610 multiplies the difference value by a predetermined coefficient.
- An adding circuit 611 adds the result to the pixel of the preceding frame. If the coefficient is 1, an output terminal 623 outputs the same value as the input, and the smoothing intensity is 0.
- a terminal 608 is a smoothing intensity control input terminal.
- a coefficient setting circuit 609 sets a coefficient corresponding to the input smoothing intensity.
- a frame memory 612 holds the processed image signal to be used to process the succeeding frame.
- Fig. 15 shows graphs a. through c showing the luminance flicker reduction effect upon increasing the camera gain when encoded data generated in this embodiment is reproduced.
- the graph a_ of Fig. 15 shows the reproduction signal from I-pictures.
- the smoothing circuit suppresses the luminance peak of the noise component superimposed on a flat image signal so that the peak is lower than in the graph a of Fig. 16. It is also possible to suppress the luminance peak of the noise component in I-pictures by assigning a smaller code amount to I-pictures when a larger code amount is assigned to the P- and B-pictures.
- the graph b of Fig. 15 shows the reproduction signal from P- and B- pictures. Smoothing suppresses the noise peak.
- the assigned code amount ratio of each picture type and the image signal smoothing intensity are controlled collectively in accordance with the camera gain. This allows to effectively reduce the noise flicker while minimizing an adverse effect such as a decrease in the resolution or an afterimage due to smoothing. Even when a camera apparatus for business use is used for photographing containing noise as a photographic effect, the flicker can be reduced while making the most of the effect of noise.
- Fig. 7 is a block diagram showing, as the second embodiment, a digital video camera according to another embodiment of an image signal processing apparatus of the present invention.
- Reference numeral 702 denotes a camera unit; and 701, a camera including a lens optical system and a photo-electric conversion unit such as a CCD.
- An analog moving image signal photographed by the camera 701 undergoes processing such as A/D-conversion, pixel interpolation, color conversion, and ⁇ -conversion by a photographed image signal processing circuit 703.
- the photographed image signal processing circuit 703 also executes sharpness control processing of controlling the resolution by adding, to the original image signal, an aperture correction signal generated from the high frequency component of the image signal.
- a camera control circuit 725 executes processing such as exposure control of the camera 701 on the basis of, for example, the brightness of the photographed image.
- the camera control circuit 725 controls the amplifier gain of the photographed image signal processing circuit 703 as needed, as in the first embodiment.
- the camera control circuit 725 also controls the sharpness control processing of the photographed image signal processing circuit 703 to adjust the resolution of the image signal. The sharpness can be either set within a predetermined range by the user or automatically controlled by the camera control circuit 725 in accordance with the photographing situation.
- the photographed image signal processing circuit 703 supplies its output to a smoothing circuit 724 as an image signal from the camera unit 702.
- the smoothing circuit 724 includes a variable-band special filter that limits the spatial band of an image signal, a variable temporal filter that executes temporal smoothing of each pixel, or a combination thereof.
- the smoothing circuit 724 has already been described in detail in the first embodiment, and a repetitive description will be omitted here.
- the output from the smoothing circuit 724 is supplied to a frame rearranging circuit 709 as image data to be encoded.
- the frame rearranging circuit 709 rearranges frames in an encoding order.
- a difference circuit 710 outputs the image data itself to a DCT circuit 711.
- the difference circuit 710 calculates the difference value between the image data and a predicted image and outputs the difference value to the DCT circuit 711 by selecting a switch 723.
- the DCT circuit 711 converts the image data into a DCT coefficient.
- a quantization circuit 712 quantizes the DCT coefficient by using a predetermined quantization scale Q.
- a variable-length coding circuit 713 for example, entropy-encodes the quantization coefficient output from the quantization circuit 712 and outputs it as encoded data.
- a buffer 714 temporarily saves the generated encoded data to control the encoding rate.
- the encoded data stored in the buffer 714 is read out at a predetermined rate and output from a terminal 715 as compression-encoded data. It is possible to efficiently record the output compression-encoded data on a recording medium such as a tape, disc, or semiconductor memory or efficiently transmit the compression-encoded data by using a network or commutation channel.
- the coefficient data quantized by the quantization circuit 712 undergoes inverse quantization by an inverse quantization circuit 711 and inverse DCT by an inverse DCT circuit 718 to obtain predicted image data.
- an adding circuit 719 saves data after inverse DCT directly in a video memory 720.
- the adding circuit 719 adds the predicted image to the P- and B- pictures and saves it in the video memory 720 as locally decoded image data.
- a motion compensation predicting circuit 721 compares the locally decoded image data saved in the video memory 720 with the input image data. For P-pictures, predicted image data with motion compensation in the forward direction is generated and supplied to the above-described difference circuit 710.
- a rate control circuit 727 executes code amount assignment control of a picture to be encoded for a target encoding rate in accordance with information such as a past generated code amount and buffer fill factor obtained from the buffer 714 and the setting value of a code amount ratio setting circuit 726 (to be described later) .
- the rate control circuit 727 controls the quantization circuit 712 by deciding the quantization scale Q based on a code amount assigned to each picture type. The generated code amount after quantization changes between the I-, P-, and B-pictures. The quantization scale Q is therefore changed in accordance with the picture type.
- a flicker suppression control circuit 716 controls smoothing processing of the smoothing circuit 724 and the code amount ratio setting circuit 726 in accordance with a camera gain setting value and sharpness setting value supplied from the camera control circuit 725.
- the flicker suppression control circuit 716 controls the code amount ratio setting circuit 726 to change the code amount ratio to be assigned to each picture type, thereby suppressing a luminance flicker upon increasing the gain.
- Fig. 8 shows graphs a_ and b showing control of assignment ratio of code amount by the camera gain and sharpness setting.
- the graph a of Fig. 8 shows quantization scale ratio control for control of assignment ratio of code amount.
- the graph a of Fig. 8 shows only the control characteristic of B-pictures.
- Symbols a, b, and c indicate changes in the quantization scale ratio of B-pictures according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the threshold value of the change in the quantization scale changes between a, b, and c. When the camera gain exceeds +3, +6, and +9 dB, the quantization scale ratio of B-pictures decreases.
- the graph b of Fig. 8 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control according to the camera gain and sharpness setting in the graph a_ of Fig. 8.
- a., b, and c indicate changes in the assigned code amount ratio of B-pictures according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the camera gain has a predetermined threshold value so that the quantization scale ratio is controlled in two steps. It is also possible to change the quantization scale ratio in proportion to the camera gain.
- Fig. 9 shows examples of control of assignment ratio of code amount proportional to the camera gain in accordance with sharpness setting.
- a graph a of Fig. 9 shows quantization scale ratio control for control of assignment ratio of code amount.
- the graph a_ of Fig. 9 shows only the control characteristic of B-pictures.
- Symbols a_, b, and c indicate changes in the quantization scale ratio of B-pictures according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the threshold value of the change in the quantization scale changes between a_, b, and c.
- the quantization scale ratio of B-pictures decreases in accordance with the camera gain.
- the generated code amount ratio of B-pictures increases.
- the tilt of the change in the quantization scale changes between a., b, and c.
- the threshold value of quantization scale ratio change corresponding to the camera gain is changed in accordance with the sharpness intensity.
- the quantization scale ratio decrease rate is also changed in accordance with the sharpness intensity. If the sharpness is high, the quantization scale ratio decreases from a low camera gain.
- a graph b of Fig. 9 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control proportional to the camera gain in accordance with the sharpness setting in the graph a_ of Fig. 9.
- symbols a_, b, and c indicate changes in the assigned code amount ratio of B-pictures according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the assigned code amount ratio of P- and B-pictures increases in accordance with the camera gain and sharpness setting. This allows to suppress loss of the peak of the noise component upon increasing the gain when P- and B-pictures are encoded. This arrangement can reduce a luminance flicker in reproducing encoded image data.
- the flicker suppression control circuit 716 controls spatial or temporal smoothing or spatial and temporal smoothing of the above-described smoothing circuit 724.
- the smoothing circuit 724 executes smoothing at an intensity corresponding to the camera gain and sharpness setting to suppress the peak of the noise component itself and decrease the luminance peak due to the noise component of I-pictures. This allows to reduce the difference from the decrease in the luminance peak of noise upon encoding P- and B- pictures. As a result, a luminance flicker between the pictures can be suppressed. Additionally, this smoothing processing also suppresses the noise component input to the P- and B-pictures. This further suppresses the decrease in the luminance peak of noise dependent on encoding by an increase in the code amount assignment ratio.
- a graph a. of Fig. 10 shows an example of smoothing intensity control according to the camera gain and sharpness setting.
- Symbols a, b, and c indicate smoothing intensities according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the threshold value of the change in the smoothing intensity changes between a, b, and c.
- the smoothing processing is executed.
- a graph b of Fig. 10 shows the band characteristic of the spatial filter corresponding to the change in the smoothing intensity in the graph a_ of Fig. 10.
- LlOOl indicates a band characteristic obtained when no smoothing processing is executed.
- This characteristic corresponds to the region without smoothing processing (smoothing intensity: 0) in the graph a of Fig. 10.
- L1002 indicates a band characteristic obtained when smoothing processing is executed. This characteristic corresponds to the region where the smoothing processing is effective in the graph a. of Fig. 10.
- the camera gain has a predetermined threshold value so that the smoothing characteristic is changed in two steps (whole band is passed in one mode) . It is also possible to change the smoothing intensity in proportion to the camera gain.
- a graph a of Fig. 11 shows smoothing intensity control proportional to the camera gain in accordance with sharpness setting.
- Symbols a, b, and c indicate smoothing intensities according to the camera gain in correspondence with the sharpness setting intensities (high, medium, and low) .
- the threshold value of the change in the smoothing intensity changes between a., b, and c.
- the smoothing intensity increases up to a predetermined upper limit in accordance with the camera gain.
- the tilt of the increases changes depending on the sharpness setting. If the sharpness setting is high, the smoothing intensity is high even at a low camera gain.
- a graph b of Fig. 11 shows the band characteristic of the spatial filter corresponding to the change in the smoothing intensity in the graph a of Fig. 11.
- the passband of the spatial filter narrows stepwise in accordance with the camera gain.
- the assigned code amount ratio of each picture type and the image signal smoothing intensity are controlled collectively in accordance with the camera gain and sharpness setting. This allows to effectively reduce the noise flicker while minimizing an adverse effect such as a decrease in the resolution or an afterimage due to smoothing. Even when a camera apparatus for business use is used for photographing containing noise as a photographic effect, the flicker can be reduced while making the most of the effect of noise. [0086] [Third Embodiment]
- Fig. 12 is a block diagram showing, as the third embodiment, a digital video camera according to still another embodiment of an image signal processing apparatus of the present invention.
- Reference numeral 1202 denotes a camera unit; and 1201, a camera including a lens optical system and a photo-electric conversion unit such as a CCD.
- An analog moving image signal photographed by the camera 1201 undergoes processing such as A/D-conversion, pixel interpolation, color conversion, and ⁇ -conversion by a photographed image signal processing circuit 1203.
- a camera control circuit 1225 executes processing such as exposure control of the camera 1201 on the basis of, for example, the brightness of the photographed image.
- the camera control circuit 1225 controls the amplifier gain of the photographed image signal processing circuit 1203 as needed, as in the first embodiment.
- the photographed image signal processing circuit 1203 supplies its output to a smoothing circuit 1224 as an image signal from the camera unit 1202.
- the smoothing circuit 1224 includes a variable-band special filter that limits the spatial band of an image signal, a variable temporal filter that executes temporal smoothing of each pixel, or a combination thereof.
- the smoothing circuit 1224 has already been described in detail in the first embodiment, and a repetitive description will be omitted here.
- the output from the smoothing circuit 1224 is supplied to a frame rearranging circuit 1209 as image data to be encoded.
- the frame rearranging circuit 1209 rearranges frames in an encoding order.
- a difference circuit 1210 outputs the image data itself to a DCT circuit 1211.
- the difference circuit 1210 calculates the difference value between the image data and a predicted image and outputs the difference value to the DCT circuit 1211 by selecting a switch 1223.
- the DCT circuit 1211 converts the image data into a DCT coefficient.
- a quantization circuit 1212 quantizes the DCT coefficient by using a predetermined quantization scale Q.
- a variable-length coding circuit 1213 for example, entropy-encodes the quantization coefficient output from the quantization circuit 1212 and outputs it as encoded data.
- a buffer 1214 temporarily saves the generated encoded data to control the encoding rate.
- the encoded data stored in the buffer 1214 is read out at a predetermined rate and output from a terminal 1215 as compression-encoded data. It is possible to efficiently record the output compression- encoded data on a recording medium such as a tape, disc, or semiconductor memory or efficiently transmit the compression-encoded data by using a network or commutation channel.
- the coefficient data quantized by the quantization circuit 1212 undergoes inverse quantization by an inverse quantization circuit 1211 and inverse DCT by an inverse DCT circuit 1218 to obtain predicted image data.
- an adding circuit 1219 saves data after inverse DCT directly in a video memory 1220.
- the adding circuit 1219 adds the predicted image to the P- and B- pictures and saves it in the video memory 1220 as locally decoded image data.
- a motion compensation predicting circuit 1221 compares the locally decoded image data saved in the video memory 1220 with the input image data. For P-pictures, predicted image data with motion compensation in the forward direction is generated and supplied to the above-described difference circuit 1210.
- a target bit rate setting circuit 1228 calculates a target bit rate in accordance with, for example, a user's encoding mode selection instruction and supplies the information to a rate control circuit 1227 and flicker suppression control circuit 1216.
- the rate control circuit 1227 executes code amount assignment control of a picture to be encoded for a target encoding rate in accordance with information such as a past generated code amount and buffer fill factor obtained from the buffer 1214, the information from the above-described target bit rate setting circuit 1228, and the setting value of a code amount ratio setting circuit 1226 (to be described later) .
- the rate control circuit 1227 controls the quantization circuit 1212 by deciding the quantization scale Q based on a code amount assigned to each picture type.
- the generated code amount after quantization changes between the I-, P-, and B- pictures.
- the quantization scale Q is therefore changed in accordance with the picture type.
- the flicker suppression control circuit 1216 controls smoothing processing of the smoothing circuit 1224 and the code amount ratio setting circuit 1226 in accordance with a camera gain setting value supplied from the camera control circuit 1225 and the target bit rate value supplied from the above-described target bit rate setting circuit 1228.
- the flicker suppression control circuit 1216 controls the code amount ratio setting circuit 1226 to change the code amount ratio to be assigned to each picture type, thereby suppressing a luminance flicker upon increasing the gain.
- Fig. 13 shows graphs a. and b showing control of assignment ratio of code amount by the camera gain and target bit rate value.
- the graph a of Fig. 13 shows quantization scale ratio control for control of assignment ratio of code amount.
- the graph a_ of Fig. 13 shows only the control characteristic of B-pictures.
- Symbols a, b, and c indicate changes in the quantization scale ratio of B-pictures according to the camera gain in correspondence with the target bit rates (low, medium, and high) .
- the threshold value of the change in the quantization scale changes between a, b, and c.
- the quantization scale ratio of B-pictures decreases.
- the generated code amount ratio of B-pictures increases.
- the lower the target bit rate is the larger the decrease in the luminance peak caused by the noise component upon encoding of P- and B-pictures is.
- the threshold value of quantization scale ratio change corresponding to the camera gain is changed in accordance with the target bit rate. If the target bit rate is low, the quantization scale ratio decreases from a low camera gain.
- the graph b of Fig. 13 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control according to the camera gain and target bit rate value in the graph a of Fig. 13.
- symbols a., b, and c indicate changes in the assigned code amount ratio of B-pictures according to the camera gain in correspondence with the target bit rates (low, medium, and high) .
- the camera gain has a predetermined threshold value so that the quantization scale ratio is controlled in two steps. It is also possible to change the quantization scale ratio in proportion to the camera gain.
- a graph a of Fig. 14 shows quantization scale ratio control for control of assignment ratio of code amount.
- the graph a_ of Fig. 14 shows only the control characteristic of B- pictures.
- Symbols a, b, and c indicate changes in the quantization scale ratio of B-pictures according to the camera gain in correspondence with the target bit rates (low, medium, and high).
- the threshold value of the change in the quantization scale changes between a_, b, and c.
- the generated code amount ratio of B-pictures increases.
- the tilt of the change in the quantization scale changes between a, b, and c.
- the threshold value of quantization scale ratio change corresponding to the camera gain is changed in accordance with the target bit rate.
- the quantization scale ratio decrease rate is also changed in accordance with the target bit rate. If the target bit rate is low, the quantization scale ratio decreases from a low camera gain.
- a graph b of Fig. 14 shows a state wherein the assigned code amount ratio changes upon quantization scale ratio control proportional to the camera gain in accordance with the target bit rate value in the graph a. of Fig. 14.
- symbols a, b, and c indicate changes in the assigned code amount ratio of B-pictures according to the camera gain in correspondence with the target bit rates (low, medium, and high) .
- the assigned code amount ratio of P- and B-pictures increases as the camera gain increases. This allows to suppress loss of the peak of the noise component upon increasing the gain when P- and B-pictures are encoded. This arrangement can reduce a luminance flicker in reproducing encoded image data.
- the flicker suppression control circuit 1216 controls spatial or temporal smoothing or spatial and temporal smoothing of the above-described smoothing circuit 1224.
- the arrangement to control the smoothing processing combines with the above-described arrangement to control code amount assignment, a synergy effect can be expected.
- the smoothing circuit 1224 executes smoothing at an intensity corresponding to the camera gain and target bit rate value to suppress the peak of the noise component itself and decrease the luminance peak due to the noise component of I-pictures. This allows to reduce the difference from the decrease in the luminance peak of noise upon encoding P- and B- pictures. As a result, a luminance flicker between the pictures can be suppressed. Additionally, this smoothing processing also suppresses the noise component input to the P- and B-pictures. This further suppresses the decrease in the luminance peak of noise dependent on encoding by an increase in the code amount assignment ratio.
- the assigned code amount ratio of each picture type and the image signal smoothing intensity are controlled collectively in accordance with the camera gain and target bit rate value. This allows to effectively reduce the noise flicker while minimizing an adverse effect such as a decrease in the resolution or an afterimage due to smoothing. Even when a camera apparatus for business use is used for photographing containing noise as a photographic effect, the flicker can be reduced while making the most of the effect of noise .
- the assigned code amount ratio of each picture type and the image signal smoothing intensity are controlled collectively in accordance with the camera gain.
- the CPU accesses are nonvolatile memories such as an HDD, optical disc, and flash memory, read-only recording media such as a CD- ROM, volatile memories except a RAM, and computer- readable/writable recording media by combinations thereof.
- the program to implement the functions of the processes of the camera control circuit, flicker suppression control circuit, code amount ratio setting circuit, and rate control circuit of the above- described embodiments may be recorded on a computer- readable recording medium such that a computer system can load and execute the program recorded on the recording medium to do the processes.
- the "computer system” includes an OS and hardware such as peripheral devices.
- the functions of the above-described embodiments may be implemented when the program read out from a storage medium is written in the memory of a function expansion board inserted into a computer or a function expansion unit connected to a computer, and the CPU of the function expansion board or function expansion unit partially or wholly performs actual processing on the basis of the instructions of the program.
- the "computer-readable recording medium” indicates a portable medium including an optical disc such as a CD-ROM or DVD and a semiconductor memory card, or a storage device such as a hard disc incorporated in a computer system.
- the "computer- readable recording medium” also includes a device that holds a program for a predetermined time, like a volatile memory (RAM) in a compute system serving as a server or client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line.
- RAM volatile memory
- the program may be transmitted from a computer system that stores it in a storage device to another computer system through a transmission medium or transmission wave in a transmission medium.
- transmission medium to transmit the program indicates a medium having a function of transmitting information, like a network (communication network) such as the Internet or a communication line such as a telephone line.
- the program may implement some of the above- described functions.
- the program may be a so-called differential file (differential program) implemented by combining the above-described functions with an already recorded program.
- a program product such as a computer-readable recording medium that records the program is also applicable as an embodiment of the present invention.
- the present invention incorporates the program, recording medium, transmission medium, and program product .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Studio Devices (AREA)
Abstract
L'invention a pour objet de réduire de manière efficace le papillotement lumineux provoqué par un bruit, tout en supprimant dans la mesure du possible les effets indésirables tels que la rémanence à l'extinction et la diminution de la résolution après le lissage, même lorsque le rapport signal/bruit d'une image saisie avec un gain accru est faible. L'invention porte sur un dispositif de traitement du signal image qui comprend un circuit (124) de lissage permettant d'exécuter le lissage d'un signal image, un circuit (112, 113) de codage de compression permettant de coder le signal image pour le compresser, un circuit de réglage (126) permettant de régler la quantité de code pour chaque type d'image dans le circuit de codage de compression, et un circuit (116) de commande qui modifie, conformément à la valeur de réglage de gain obtenue à partir d'une caméra (102), l'intensité du traitement de lissage et le coefficient d'attribution de quantité de code pour chaque type d'image.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20060823392 EP1949705B1 (fr) | 2005-11-09 | 2006-11-08 | Dispositif de traitement de signal image |
US12/093,126 US8229004B2 (en) | 2005-11-09 | 2006-11-08 | Image signal processing apparatus with code amount control for inter-frame and intra-frame encoding |
CN2006800419714A CN101305617B (zh) | 2005-11-09 | 2006-11-08 | 图像信号处理设备 |
US13/531,234 US20120262598A1 (en) | 2005-11-09 | 2012-06-22 | Image signal processing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005324784A JP4794987B2 (ja) | 2005-11-09 | 2005-11-09 | 映像信号処理装置 |
JP2005-324784 | 2005-11-09 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/531,324 Continuation US8787195B2 (en) | 2011-06-29 | 2012-06-22 | Beacon selection in communication networks |
US13/531,234 Continuation US20120262598A1 (en) | 2005-11-09 | 2012-06-22 | Image signal processing apparatus |
Publications (3)
Publication Number | Publication Date |
---|---|
WO2007055389A2 true WO2007055389A2 (fr) | 2007-05-18 |
WO2007055389A3 WO2007055389A3 (fr) | 2007-12-06 |
WO2007055389B1 WO2007055389B1 (fr) | 2008-02-07 |
Family
ID=37906920
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2006/322690 WO2007055389A2 (fr) | 2005-11-09 | 2006-11-08 | Dispositif de traitement de signal image |
Country Status (5)
Country | Link |
---|---|
US (2) | US8229004B2 (fr) |
EP (1) | EP1949705B1 (fr) |
JP (1) | JP4794987B2 (fr) |
CN (1) | CN101305617B (fr) |
WO (1) | WO2007055389A2 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8229004B2 (en) | 2005-11-09 | 2012-07-24 | Canon Kabushiki Kaisha | Image signal processing apparatus with code amount control for inter-frame and intra-frame encoding |
EP3557872A1 (fr) * | 2018-04-16 | 2019-10-23 | InterDigital VC Holdings, Inc. | Procédé et dispositif pour coder une image ou une vidéo avec une efficacité de compression optimisée préservant la fidélité de l'image ou de la vidéo |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4936557B2 (ja) * | 2008-01-24 | 2012-05-23 | キヤノン株式会社 | 符号化装置 |
JP5081729B2 (ja) * | 2008-06-03 | 2012-11-28 | 株式会社日立国際電気 | 画像符号化装置 |
JP5136470B2 (ja) * | 2009-03-06 | 2013-02-06 | 富士通株式会社 | 動画像符号化装置及び動画像符号化方法 |
JP2011029954A (ja) * | 2009-07-27 | 2011-02-10 | Sony Corp | 画像符号化装置と画像符号化方法 |
JP5762026B2 (ja) * | 2011-02-01 | 2015-08-12 | キヤノン株式会社 | 画像処理装置 |
JP2012227955A (ja) * | 2012-07-12 | 2012-11-15 | Hitachi Kokusai Electric Inc | 画像符号化装置 |
US9215411B2 (en) * | 2014-02-03 | 2015-12-15 | Google Inc. | Enhancing video conferences |
US9635212B2 (en) * | 2014-05-30 | 2017-04-25 | Apple Inc. | Dynamic compression ratio selection |
JP6381380B2 (ja) * | 2014-09-08 | 2018-08-29 | キヤノン株式会社 | 撮像装置、制御方法及びそのプログラム |
EP3182704B1 (fr) * | 2015-12-15 | 2018-01-31 | Axis AB | Contrôleur de débit binaire et procédé de limitation de débit binaire de sortie |
EP3379830B1 (fr) * | 2017-03-24 | 2020-05-13 | Axis AB | Procédé, codeur vidéo et caméra vidéo pour le codage d'un flux vidéo |
CN111200734B (zh) * | 2018-11-19 | 2022-03-11 | 浙江宇视科技有限公司 | 视频编码方法及装置 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997005745A1 (fr) * | 1995-07-31 | 1997-02-13 | Sony Corporation | Systeme de prise de vues, processeur d'images, codeur, procede de codage et procede d'elimination du bruit aleatoire |
US20040008772A1 (en) * | 2001-06-07 | 2004-01-15 | Masaaki Kojima | Camera-integrated video recording and reproducing apparatus, and record control method thereof |
WO2006090755A1 (fr) * | 2005-02-23 | 2006-08-31 | Canon Kabushiki Kaisha | Dispositif de traitement d'image |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0402058B1 (fr) | 1989-06-07 | 1996-03-27 | Canon Kabushiki Kaisha | Dispositif de décodage prévisionnel corrigeant des erreurs de code |
EP0408343B1 (fr) | 1989-07-13 | 1998-11-04 | Canon Kabushiki Kaisha | Dispositif de codage et de décodage adapté à la copie d'information |
US6718122B1 (en) | 1991-01-18 | 2004-04-06 | Canon Kabushiki Kaisha | Image processing apparatus |
US6219157B1 (en) | 1992-06-18 | 2001-04-17 | Canon Kabushiki Kaisha | Image coding apparatus |
DE69323855T2 (de) | 1992-12-24 | 1999-09-16 | Canon K.K., Tokio/Tokyo | Vorrichtung für die Wiedergabe eines Bildsignals |
JPH08181987A (ja) | 1994-12-22 | 1996-07-12 | Canon Inc | 符号化装置 |
KR100188934B1 (ko) * | 1995-08-28 | 1999-06-01 | 윤종용 | 영상 신호 부호화 장치 및 방법 |
JP3767007B2 (ja) * | 1996-03-27 | 2006-04-19 | ソニー株式会社 | 符号化装置および符号化方法 |
KR100756596B1 (ko) * | 1997-07-08 | 2007-09-10 | 소니 가부시끼 가이샤 | 비디오 데이터 부호화 장치 및 비디오 데이터 부호화 방법 |
US6690410B1 (en) * | 1999-06-09 | 2004-02-10 | Olympus Optical Co., Ltd. | Image processing unit with expandable image signal processing capability and endoscopic imaging system |
JP4208342B2 (ja) * | 1999-05-14 | 2009-01-14 | キヤノン株式会社 | 画像記録装置、方法及びコンピュータ読み取り可能な記憶媒体 |
JP4362795B2 (ja) * | 1999-07-13 | 2009-11-11 | 日本ビクター株式会社 | 動画像符号化装置及びその方法 |
JP2001313906A (ja) * | 2000-04-27 | 2001-11-09 | Hitachi Ltd | デジタルカメラ |
JP3641214B2 (ja) * | 2001-02-28 | 2005-04-20 | 株式会社東芝 | 動画像符号化装置および動画像符号化方法 |
US6895050B2 (en) * | 2001-04-19 | 2005-05-17 | Jungwoo Lee | Apparatus and method for allocating bits temporaly between frames in a coding system |
JP2003023637A (ja) * | 2001-07-06 | 2003-01-24 | Sony Corp | 画像符号化方法および画像符号化装置 |
JP4072347B2 (ja) * | 2002-01-18 | 2008-04-09 | キヤノン株式会社 | 画像処理装置 |
KR101051604B1 (ko) * | 2003-01-09 | 2011-07-22 | 소니 주식회사 | 화상 처리 장치 및 방법 |
JP4759360B2 (ja) * | 2005-10-07 | 2011-08-31 | キヤノン株式会社 | 画像処理装置 |
JP4423214B2 (ja) * | 2005-02-23 | 2010-03-03 | キヤノン株式会社 | 画像処理装置 |
JP4794987B2 (ja) | 2005-11-09 | 2011-10-19 | キヤノン株式会社 | 映像信号処理装置 |
-
2005
- 2005-11-09 JP JP2005324784A patent/JP4794987B2/ja not_active Expired - Fee Related
-
2006
- 2006-11-08 CN CN2006800419714A patent/CN101305617B/zh not_active Expired - Fee Related
- 2006-11-08 WO PCT/JP2006/322690 patent/WO2007055389A2/fr active Application Filing
- 2006-11-08 US US12/093,126 patent/US8229004B2/en not_active Expired - Fee Related
- 2006-11-08 EP EP20060823392 patent/EP1949705B1/fr not_active Not-in-force
-
2012
- 2012-06-22 US US13/531,234 patent/US20120262598A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997005745A1 (fr) * | 1995-07-31 | 1997-02-13 | Sony Corporation | Systeme de prise de vues, processeur d'images, codeur, procede de codage et procede d'elimination du bruit aleatoire |
US20040008772A1 (en) * | 2001-06-07 | 2004-01-15 | Masaaki Kojima | Camera-integrated video recording and reproducing apparatus, and record control method thereof |
WO2006090755A1 (fr) * | 2005-02-23 | 2006-08-31 | Canon Kabushiki Kaisha | Dispositif de traitement d'image |
Non-Patent Citations (1)
Title |
---|
INTERNATIONAL ORGANIZATION FOR STANDARDIZATION = ORGANISATION INTERNATIONALE DE NORMALISATION: "TEST MODEL 5" MPEG TEST MODEL 5. ISO-IEC/JTCI/SC29/WG11/N0400. CODED REPRESENTATION OF PICTURE AND AUDIO INFORMATION. DOCUMENT AVC-491B, VERSION 2: APRIL 1993, GENEVA, ISO, CH, 1993, pages 1-119, XP001150695 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8229004B2 (en) | 2005-11-09 | 2012-07-24 | Canon Kabushiki Kaisha | Image signal processing apparatus with code amount control for inter-frame and intra-frame encoding |
EP3557872A1 (fr) * | 2018-04-16 | 2019-10-23 | InterDigital VC Holdings, Inc. | Procédé et dispositif pour coder une image ou une vidéo avec une efficacité de compression optimisée préservant la fidélité de l'image ou de la vidéo |
WO2019203973A1 (fr) * | 2018-04-16 | 2019-10-24 | Interdigital Vc Holdings, Inc. | Procédé et dispositif de codage d'une image ou d'une vidéo avec une efficacité de compression optimisée préservant la fidélité de l'image ou de la vidéo |
Also Published As
Publication number | Publication date |
---|---|
JP4794987B2 (ja) | 2011-10-19 |
WO2007055389B1 (fr) | 2008-02-07 |
US8229004B2 (en) | 2012-07-24 |
WO2007055389A3 (fr) | 2007-12-06 |
EP1949705B1 (fr) | 2014-06-04 |
US20090096883A1 (en) | 2009-04-16 |
EP1949705A2 (fr) | 2008-07-30 |
CN101305617A (zh) | 2008-11-12 |
JP2007134880A (ja) | 2007-05-31 |
CN101305617B (zh) | 2013-02-20 |
US20120262598A1 (en) | 2012-10-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1949705B1 (fr) | Dispositif de traitement de signal image | |
US20210037252A1 (en) | Rate Control in Video Coding | |
US8634458B2 (en) | Image processing apparatus | |
US7903733B2 (en) | Adaptive filtering to enhance video encoder performance | |
US8009963B2 (en) | Adaptive filtering to enhance video bit-rate control performance | |
US8611426B2 (en) | Image-sensing apparatus | |
US8102436B2 (en) | Image-capturing apparatus and method, recording apparatus and method, and reproducing apparatus and method | |
US8903222B2 (en) | Image reproducing apparatus, image reproducing method, image capturing apparatus, and control method therefor | |
US20080317377A1 (en) | Image coding apparatus and image coding method | |
US8488681B2 (en) | Image capturing apparatus, control method therefor, program, and storage medium | |
JP3783238B2 (ja) | 撮像システム、画像処理装置、符号化装置、符号化方法及びランダムノイズを除去する方法 | |
US7606433B2 (en) | Encoding apparatus, encoding method, and storage medium | |
JP2007028598A (ja) | 圧縮符号化装置及び圧縮符号化方法 | |
JP2008141354A (ja) | 画像符号化装置および撮像装置 | |
JP2005295215A (ja) | 動画像符号化装置 | |
JP2005175974A (ja) | 撮像装置 | |
JP3202270B2 (ja) | 動画像符号化装置 | |
JP4185413B2 (ja) | フリッカ低減量子化器、フリッカ低減量子化方法、及びそのプログラム | |
JP2001313906A (ja) | デジタルカメラ | |
US8340174B2 (en) | Image processing device and image processing method | |
KR0157467B1 (ko) | 버퍼상태에 따른 동영상부호화방법 및 장치 | |
JP4612897B2 (ja) | 画像処理装置 | |
KR100335435B1 (ko) | 영상 신호의 압축 부호화기 및/또는 복호화기와 그 방법 | |
JPH0865565A (ja) | 撮像記録装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200680041971.4 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2006823392 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12093126 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |