EP0716549A1 - Digitale videokamera und bildformatkonverter - Google Patents

Digitale videokamera und bildformatkonverter Download PDF

Info

Publication number
EP0716549A1
EP0716549A1 EP95923535A EP95923535A EP0716549A1 EP 0716549 A1 EP0716549 A1 EP 0716549A1 EP 95923535 A EP95923535 A EP 95923535A EP 95923535 A EP95923535 A EP 95923535A EP 0716549 A1 EP0716549 A1 EP 0716549A1
Authority
EP
European Patent Office
Prior art keywords
aspect ratio
digital picture
picture signal
data rate
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP95923535A
Other languages
English (en)
French (fr)
Other versions
EP0716549A4 (de
EP0716549B1 (de
Inventor
Takashi Sony Corporation Asaida
Takashi Sony Corporation KAMEYAMA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of EP0716549A1 publication Critical patent/EP0716549A1/de
Publication of EP0716549A4 publication Critical patent/EP0716549A4/de
Application granted granted Critical
Publication of EP0716549B1 publication Critical patent/EP0716549B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0102—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving the resampling of the incoming video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0105—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level using a storage device with different write and read speed

Definitions

  • This invention relates to a digital video camera apparatus having an aspect ratio converting function, and an aspect ratio converting apparatus adapted for converting an aspect ratio of a digital picture signal from a first aspect ratio to a second aspect ratio.
  • an aspect ratio converting circuit for converting a digital picture signal of the wide aspect ratio of 16:9 into a digital picture signal of the aspect ratio of 4:3 is provided, thereby making it possible to cope with both the standard television system and the television system of the wide aspect ratio.
  • a digital picture signal of the wide aspect ratio of 16:9 is converted into a digital picture signal of the aspect ratio of 4:3 by the time axis expansion of 4/3 times at the H period.
  • the aspect ratio conversion is carried out by the composite signal
  • the frequency of sub-carrier would be changed.
  • the time or labor for decoding in advance and/or post encoding which are to be to be required not only becomes wasteful, but also injures the picture quality.
  • an object of this invention is to provide a digital video camera apparatus capable of generating, from an analog image pick-up signal having a first aspect ratio obtained by imaging means, an output digital picture signal of a first sampling rate having a second aspect ratio different from the first aspect ratio to output it.
  • Another object of this invention is to provide a digital video camera apparatus having a function to carry out aspect ratio conversion of color image.
  • a further object of this invention is to provide a digital video camera apparatus having a function to carry out aspect ratio conversion with respect to three prime color signals obtained by imaging means employing the Spatial Offset Method.
  • a further object of this invention is to provide an aspect ratio converting apparatus capable of generating, from an input digital picture signal of a first sampling rate indicating an image of a first aspect ratio, an output digital picture signal of a first sampling rate indicating an image of a second aspect ratio.
  • a further object of this invention is to provide an aspect ratio converting apparatus capable of carrying out aspect ratio conversion of color image.
  • a further object of this invention is to provide an aspect ratio converting apparatus capable of carrying out aspect ratio conversion with respect to three prime color digital picture signals obtained by respectively digitizing, by a first sampling rate, three prime color signals obtained by imaging means employing the Spatial Offset Method.
  • a further object of this invention is to provide an aspect ratio converting apparatus capable of carrying out aspect ratio conversion by a single clock.
  • a digital video camera apparatus is characterized in that it includes imaging means for outputting an analog image pick-up signal, analog/digital converting means for converting the analog image pick-up signal into an input digital picture signal of a first data rate having a first aspect ratio, and aspect ratio converting means for converting the input digital picture signal into an output digital picture signal of the first data rate having a second aspect ratio different from the first aspect ratio.
  • the imaging means outputs, by the Spatial Offset Method, a first analog image pick-up signal of a first sampling rate equal to the first data rate and a second analog image pick-up signal of the first sampling rate different from the first analog image pick-up signal in terms of the spatial sampling position.
  • the analog/digital converting means converts the first analog image pick-up signal into a first input digital picture signal of the first data rate having a first spatial sampling phase, and converts the second analog image pick-up signal into a second input digital picture signal of the first data rate having a second spatial sampling phase in which phase difference with respect to the first spatial sampling phase corresponds to difference of the spatial sampling position with respect to the second analog image pick-up signal of the first analog image pick-up signal.
  • the aspect ratio converting means converts the first input digital picture signal into a first output digital picture signal having the second aspect ratio at the first data rate having a third spatial sampling phase, and converts the second input digital picture signal into a second output digital picture signal having the second aspect ratio at the first data rate having a fourth spatial sampling phase in which phase difference with respect to the third spatial sampling phase corresponds to difference of the spatial sampling position with respect to the second analog image pick-up signal of the first analog image pick-up signal.
  • the digital video camera apparatus is characterized in that spatial sampling phase difference between the first analog image pick-up signal and the second analog image pick-up signal is ⁇ .
  • the digital video camera apparatus is characterized in that spatial sampling phase difference between the first output digital picture signal and the second output digital picture signal is ⁇ .
  • the digital video camera apparatus is characterized in that it further comprises selector means for selectively outputting the input digital picture signal and the output digital picture signal.
  • the digital video camera apparatus is characterized in that it further comprises signal processing means for carrying out signal processing at a clock rate related to the first data rate with respect to a digital picture signal selected by the selector means.
  • the digital video camera apparatus is characterized in that the signal processing means carries out signal processing at a clock rate of multiple of integer of the first data rate.
  • the digital video camera apparatus is characterized in that the first aspect ratio is 16:9 and the second aspect ratio is 4:3, and that the aspect ratio converting means comprises time axis converting means for implementing time axis conversion to the input digital picture signal to thereby form a digital picture signal of the second data rate different from the first data rate having the second aspect ratio, and data rate converting means for substantially carrying out over-sampling of 4n times (n is positive integer) and down-sampling of 1/3n times with respect to the digital picture signal delivered from the time axis converting means.
  • the aspect ratio converting means comprises time axis converting means for implementing time axis conversion to the input digital picture signal to thereby form a digital picture signal of the second data rate different from the first data rate having the second aspect ratio, and data rate converting means for substantially carrying out over-sampling of 4n times (n is positive integer) and down-sampling of 1/3n times with respect to the digital picture signal delivered from the time axis converting means.
  • the digital video camera apparatus comprises, every color signals of red, blue and green, three systems of the imaging means, the analog/digital converting means and the aspect ratio converting means to carry out converting operations of aspect ratios every spective color signals.
  • the digital video camera apparatus is characterized in that the aspect ratio converting means is composed of memory means for writing the input digital picture signal at a first clock rate equal to the first data rate to carry out read-out operation by a signal of the first clock rate thinned so that its clock rate substantiality becomes equal to a second clock rate different from the first clock rate to output a digital picture signal of the second data rate substantially equal to the second clock rate, and data rate converting means for converting the digital picture signal of the second data rate outputted from the memory means into the output digital picture signal of the first data rate.
  • An aspect ratio converting apparatus is characterized in that it comprises aspect ratio converting means for converting an input digital picture signal of a first data rate having a first aspect ratio into a digital picture signal of a second data rate different from the first data rate having a second aspect ratio different from the first aspect ratio, and data rate converting means for implementing data rate conversion to the digital picture signal delivered from the aspect ratio converting means to thereby generate an output digital picture signal of the first data rate having the second aspect ratio.
  • the aspect ratio converting apparatus is characterized in that the input digital picture signal consists of a first input digital picture signal of the first data rate having a first spatial sampling phase and a second input digital picture signal of the first data rate having a second spatial sampling phase different from the first input digital picture signal in terms of the spatial sampling position, and that the aspect ratio converting means converts the first input digital picture signal into a first output digital picture signal having the second aspect ratio at the first data rate having a third spatial sampling phase, and converts the second input digital picture signal into a second output digital picture signal having the second aspect ratio at the first data rate having a fourth spatial sampling phase in which phase difference with respect to the third spatial sampling phase corresponds to difference of the spatial sampling position with respect to the second input digital picture signal of the first input digital picture signal.
  • the aspect ratio converting apparatus is characterized in that spatial sampling phase difference between the first input digital picture signal and the second input digital picture signal is ⁇ .
  • the aspect ratio converting apparatus is characterized in that spatial sampling phase difference between the first output digital picture signal and the second output digital picture signal is ⁇ .
  • the aspect ratio converting apparatus is characterized in that the first aspect ratio is 16:9 and the second aspect ratio is 4:3, and that the aspect ratio converting means comprises time axis converting means for implementing time axis conversion to the input digital picture signal to thereby form a digital picture signal of the second data rate having the second aspect ratio, and data rate converting means for substantially carrying out over-sampling of 4n times (n is positive integer) and down sampling of 1/3n times with respect to the digital picture signal delivered from the time axis converting means.
  • the aspect ratio converting apparatus comprises, every color signals of red, blue and green, three systems of the aspect ratio converting means to carry out converting operations of aspect ratios every respective color signals.
  • FIG. 1 is a block circuit diagram showing the configuration of a digital video camera apparatus to which an aspect ratio converting unit (apparatus) according to this invention is applied.
  • FIG. 2 is a view showing, in a model form, by signal spectrum, the operation in the frequency region of the aspect ratio converting unit in the digital video camera apparatus.
  • FIG. 3 is a view showing, in a model form, by data train, the operation in the time region of the aspect ratio converting unit in the digital video camera apparatus.
  • FIG. 4 is a block circuit diagram showing the fundamental configuration of an aspect ratio converting apparatus according to this invention.
  • FIG. 5 is a view showing, in a model form, the state of extraction of picture frame in the aspect ratio converting apparatus.
  • FIG. 6 is a view showing, in a model form, timings of extraction of picture frame in the aspect ratio converting apparatus.
  • FIG. 7 is a block circuit diagram showing more practical configuration of the aspect ratio converting apparatus according to this invention.
  • FIG. 8 is a view showing, in a model form, the operation timings of the aspect ratio converting apparatus shown in FIG. 7.
  • FIG. 9 is a view showing, in a model form, output contents at respective timings of registers of sampling rate converting section in the aspect ratio converting apparatus operative at the operation timings shown in FIG. 8.
  • FIG. 10 is a block circuit diagram showing another configuration of the aspect ratio converting apparatus according to this invention.
  • FIG. 11 is a block circuit diagram showing another more practical configuration of the aspect ratio converting apparatus according to this invention.
  • FIG. 12 is a view showing, in a model form, other operation timings of the aspect ratio converting apparatus shown in FIG. 11.
  • FIG. 13 is a view showing, in a model form, output contents at respective timings of registers of sampling rate converting section in the aspect ratio converting apparatus operative at the operation timings shown in FIG. 12.
  • FIG. 14 is a view showing an example of filter coefficients of the aspect ratio converting unit in the digital video camera apparatus.
  • FIG. 15 is a view showing another example of filter coefficients of the aspect ratio converting unit in the digital video camera apparatus.
  • FIG. 16 is a view showing, in a model form, other operation timings of the aspect ratio converting apparatus according to this invention.
  • a digital video camera apparatus is constituted as shown in FIG. 1, for example.
  • the imaging section 1 employs the Spatial Offset Method, wherein respective CCD image sensors 1R, 1B for imaging red picture (pictorial image) and blue picture (pictorial image) are disposed in the state where they are shifted in a horizontal direction by 1/2 of the spatial sampling period ⁇ s of pixel with respect to the CCD image sensor 1G for imaging green picture (pictorial image).
  • Green image pick-up signal G(f s1 ) obtained by spatially sampling an object image by means of the CCD image sensor 1G is shown in (A) of FIG. 2, and respective signal spectrum components of red image pick-up signal R(f s1 ) and blue image pick-up signal B(f s1 ) obtained by spatially sampling the object image by means of the CCD image sensors 1R, 1B are shown in (B) of FIG. 2.
  • the green image pick-up signal G(f s1 ) and the red and blue image pick-up signals R(f s1 ) and B(f s1 ) are shifted by ⁇ in terms of the spatial sampling phase.
  • phases of clocks for signal processing with respect to the green image pick-up signal G(f s1 ), and the red image pick-up signal R(f s1 ) and blue image pick-up signal B(f s1 ) are in correspondence with each other.
  • analog signal processing including various level adjustments such as noise elimination by the CDS (Correlated Double Sampling), gain adjustment, black balance or white balance, shading correction or the like is carried out.
  • CDS Correlated Double Sampling
  • the respective A/D converters 3R, 3G, 3B serve to carry out A/D conversion processing synchronous with drive clock having a predetermined phase at f s1 rate equal to the sampling rates of the respective analog color image pick-up signals R(f s1 ), G(f s1 ), B(f s1 ), i.e., digitize, at the f s1 rate, respective color image pick-up signals R(f s1 ), G(f s1 ), B(f s1 ) of the f s1 rate.
  • the digital video camera apparatus includes a defect correction processing section 4 supplied with respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) digitized by the A/D converters 3R, 3G, 3B. Respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) to which the defect correction processing with respect to defect pixel or pixels of the CCD image sensors 1R, 1G, 1B has been implemented by the defect correction processing section 4 are delivered to an aspect ratio converting apparatus (unit) 100 according to this invention.
  • the aspect ratio converting unit 100 comprises aspect ratio converting sections 100R, 100G, 100B of three systems respectively composed of a time axis converting section 10R, a data rate converting section 20R and an output select switch 30R; a time axis converting section 10G, a data rate converting section 20G and an output select switch 30G; and a time axis converting section 10B, a data rate converting section 20B, and an output select switch 30B.
  • the time axis converting sections 10R, 10G, 10B are respectively composed of FIFO memories.
  • An approach is employed to write respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) to which the defect correction processing has been implemented by the defect correction processing section 4 into the respective FIFO memories at a sampling clock of the first sampling rate f s1 to implement thinning to the write clocks of the first clock frequency f s1 at a rate of one to four clock pulses so that the clock is caused to substantially have a second sampling rate, i.e., (3/4) f s1 rate to read out respective color digital picture signals from the FIFO memories by using the above-mentioned clock to thereby generate respective color digital picture signals R(f s2 ), G(f s2 ), B(f s2 ) of a second aspect ratio having signal spectrum components as shown in (C), (D) of FIG. 2.
  • the data rate converting sections 20R, 20G, 20B are respectively comprised of rate converters each constituted by a pre-register type-FIR filter which sequentially carries out switching between filter coefficients at the output rate f s1 to conduct filtering processing, and serve to carry out octuple (eight times) over-sampling by means of interpolation filter of the MTF characteristic having zero point at f s1 /2 as shown in (E) of FIG. 2 with respect to the color digital picture signals R(f s2 ), G(f s2 ), B(f s2 ) of the second aspect ratio to thereby substantially carry out processing as shown in (E) to (I) of FIG. 2.
  • the data rate converting sections generate respective color image pick-up data R(6f s1 ), G(6f s1 ), B(6f s1 ) of the second aspect ratio having respective signal spectrum components as shown in (F), (G) of FIG. 2 thereafter to carry out down-sampling into 1/6 to thereby generate respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the second aspect ratio.
  • octuple (eight times) over-sampling is carried out with respect to respective input sample trains of (3/4) f s1 rate indicated by the mark ⁇ to thereby generate octuple over-sample train of the 6f s1 rate indicated by the mark X to take out data from the octuple (eight times) over-sample train every other seventh sample (at intervals of six samples) to thereby carry out down-sampling into 1/6 to thereby generate an output sample train of f s1 rate as indicated by the mark ⁇ .
  • the aspect ratio converting apparatus 100 of such a configuration at the three systems of the data rate converting sections 20R, 20G, 20B, 1/6 down-sampling is substantially carried out by the phase corresponding to the Spatial Offset to thereby carry out the aspect ratio conversion with respect to three prime color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) obtained by respectively digitizing, at the first data rate f s1 , three prime color signals obtained by the imaging section 1 employing the Spatial Offset Method.
  • this aspect ratio converting unit 100 is adapted so that respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the first aspect ratio or respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the second aspect ratio are outputted, at the first data rate selected by the output select switches 30R, 30G, 30B switched by designation of user, from the aspect ratio converting sections 100R, 100G, 100B of the three systems.
  • switching between the output select switches 30R, 30G, 30B is carried out by designation of user, thereby making it possible to output respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the first aspect ratio at the first data rate f s1 or respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the second aspect ratio at the first data rate f s1 from the aspect ratio converting sections 100R, 100G, 100B of three systems.
  • the respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the first aspect ratio or the second aspect ratio outputted from the three systems of the aspect ratio converting sections 100R, 100G, 100B are all color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the first data rate f s1 , it is possible to implement digital signal processing without switching the clock rate at the succeeding stage.
  • the digital video camera apparatus of this embodiment includes a digital signal processing section 5 supplied with respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) of the first aspect ratio or the second aspect ratio from the aspect ratio converting unit 100.
  • the digital signal processing section 5 is composed of a delay memory 51, a pre-processor 52, and an encoder 53, etc.
  • the delay memory 51 is comprised of delay memories of 2 channels and serves to deliver, to the pre-processor 52, respective green digital picture signals G 0H , G 1H , G 2H and respective red digital picture signals R 0H , R 1H , R 2H obtained by respectively delaying the green digital picture signal G(f s1 ) and the red digital picture signal R(f s1 ) by delay quantities of 0H (horizontal period), 1H, 2H.
  • the pre-processor 52 is operative with the clock of the f s1 rate being as a master clock to carry out image emphasis processing, addition of pedestal, non-linear processing such as gamma or knee, etc. or linear matrix processing with respect to respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ) to further carry out of well known implementation (realization) of high resolution corresponding to the Spatial Offset Method in the imaging section 1 to generate respective digital picture signals VF-Y(f s1 ), DTL-O(f s1 ), DTL-E(f s1 ) for high resolution monitor from the respective color digital picture signals R(f s1 ), G(f s1 ), B(f s1 ), and to generate luminance data Y(f s1 ) and two color difference data R-Y(f s1 ), B-YC B (f s1 ) to deliver them to the encoder 53.
  • the encoder 53 generates digital picture signal VBS(2f s1 ) for high resolution monitor from respective digital picture signals VF-Y(f s1 ), DTL-O(f s1 ), DTL-E(f s1 ), and generates a color signal C(f s1 /2, f s1 /2) from the color difference data R-Y (f s1 ), B-YC B (f s1 ).
  • luminance data Y(f s1 ) and two color difference data R-Y(f s1 ), B-Y(f s1 ) generated by the pre-processor 52 are changed into data in an analog form by a D/A converting section 6. They are outputted as analog component signals Y, R-Y/U, B-Y/V through a low-pass filter 7.
  • the luminance data Y(f s1 ) generated by the pre-processor 52 and the color signal C(f s1 /2, f s1 /2) generated by the encoder 53 are converted into a digital picture signal Y(f s2 ) + C(f s2 /2, f s2 /2) of the f s2 rate by a rate converter 8, and is then delivered to digital VTR (not shown). Further, the digital picture signal VBS (2f s1 ) generated by the encoder 53 is delivered to high resolution monitor (not shown) through a low-pass filter 9.
  • the aspect ratio converting apparatus is composed of a time axis converting section 10 and a data rate converting section 20 which are cascade-connected as the fundamental configuration is as shown in FIG. 4.
  • This aspect ratio converting unit is provided in correspondence with respective color picture signals of the time axis converting sections 10R, 10G, 10B and data rate converting sections 20R, 20G, 20B shown in FIG. 1.
  • the aspect ratio converting unit shown in FIG. 4 serves to convert a digital picture signal Video in of the picture frame of the first aspect ratio (e.g., 16:9) into a digital picture signal Video out of the picture frame of the second aspect ratio (e.g., 4:3).
  • the digital picture signal Video in of the first data rate is inputted to the time axis converting section 10.
  • the time axis converting section 10 implements time axis conversion processing to the digital picture signal Video in of the first data rate of the picture frame of the first aspect ratio to thereby generate a digital picture signal of the second data rate of the picture frame of the second aspect ratio.
  • This time axis converting section 10 writes the digital picture signal Video in of the first aspect ratio (16:9) into the FIFO memory by the write clock of the first clock rate and reads out the digital picture signal Video in from the FIFO memory by the read(-out) clock of the second clock rate to thereby extract picture frame of the second aspect ratio (4:3) from the picture frame of the first aspect ratio (16:9) as shown in FIGS. 5 and 6 to carry out time axis expansion processing of 4/3 times which outputs a digital picture signal of the second aspect ratio (4:3) at the second data rate.
  • the position at which the picture frame of the second aspect ratio (4:3) is extracted from the picture frame of the first aspect ratio (16:9) is designated by setting FIFO length.
  • L1 is the number of FIFO stages corresponding to the number of valid data of 1H of the digital picture signal of the second aspect ratio (4:3)
  • L2 is the number of FIFO stages corresponding to the number of valid data of 1H of the digital picture signal of the first aspect ratio (16:9).
  • the FIFO length is caused to be L1+ ⁇ to designate the picture frame extracting position.
  • the data rate converting section 20 carries out data rate conversion processing of conversion ratio of 3:4 with respect to the digital picture signal of the second data rate of the picture frame of the second aspect ratio (4:3) generated by implementing time axis conversion processing to the digital picture signal Video in of the first data rate of the picture frame of the first aspect ratio (16:9) in the time axis converting section 1 to thereby carry out data rate conversion processing of the conversion ratio of 3:4 to generate a digital picture signal of the first data rate of the picture frame of the second aspect ratio (4:3).
  • the rate convert filter for sequentially carrying out switching between filter coefficients at the output rate to carry out filtering processing is comprised of pre-register type FIR filter or post-register type FIR filter.
  • the aspect ratio converting apparatus there is employed, in the time axis converting section 10, an approach to implement time axis conversion processing of 4/3 times to a digital picture signal of the first data rate indicating an image (pictorial image) of the first aspect ratio (16:9) to generate a digital picture signal of the second data rate indicating an image (pictorial image) of the second aspect ratio (4:3), and there is employed, in the data rate converting section 20, an approach to implement data rate conversion processing of conversion ratio of 3:4 to the digital picture signal of the second data rate, thereby making it possible to generate a digital picture signal of the first data rate indicating the image of the second aspect ratio (4:3) from the digital picture signal of the first data rate indicating the image of the first aspect ratio (16:9).
  • the data rate converting section 20 substantially carries out 4n times over-sampling and 1/3n down-sampling with respect to the digital picture signal of the second data rate generated by the time axis converting section 10, thereby making it possible to carry out data rate conversion of conversion ratio of 3:4.
  • the aspect ratio converting apparatus is composed of time axis converting section 10 using FIFO memory and data rate converting section 20 using pre-register type FIR filter as shown in more practical embodiment in FIG. 7, for example.
  • This aspect ratio converting apparatus serves to convert a digital picture signal Video in of the picture frame of the first aspect ratio (16:9) into a digital picture signal Video out of the picture frame of the second aspect ratio (4:3), and is adapted so that the digital picture signal Video in of the first data rate is inputted to a memory cell 11 constituting the FIFO memory of the time axis converting section 10.
  • the write address generating section 12 sequentially generates write addresses synchronous with the write clock of the first clock frequency f s1 to deliver these write addresses to the memory cell 11.
  • the input digital picture signals Video in are sequentially written into the memory cell 11 by the first clock frequency f s1 .
  • the write address generating section 12 is adapted to be reset at 1H period by the reset pulse Reset 1.
  • the read address generating section 13 sequentially generates read addresses synchronous with the read clock of the second clock frequency f s2 to deliver these read addresses to the memory cell 11.
  • digital picture signals are sequentially read out at the second clock frequency f s2 , as shown in FIG. 8, from the memory cell 11. Namely, the digital picture signals of the second data rate are obtained.
  • the read address generating section 13 is adapted to be reset at one horizontal period by the reset pulse Reset 2.
  • the data rate converting section 20 is comprised of a pre-register type FIR filter composed of four stages of registers 21 ⁇ 24 cascade connected, four multipliers 25 ⁇ 28 for respectively multiplying respective delay outputs by the registers 21 ⁇ 24 by filter coefficients, and an adder 29 for adding respective delay outputs by the multipliers 25 ⁇ 28, wherein the digital picture signal of the second data rate of the picture frame of the second aspect ratio (4:3) generated by the time axis converting section 10 is delivered to respective multipliers 25 ⁇ 28 through the four stages of registers 21 ⁇ 24.
  • This data rate converting section 20 becomes operative by the clock of the first clock frequency f s1 to sequentially carry out switching between filter coefficients delivered to the multipliers 25 ⁇ 28 at the output rate to substantially carry out octuple over-sampling and 1/6 down-sampling to thereby carry out data rate conversion processing of conversion ratio of 3:4 to generate a digital picture signal Video out of the picture frame of the second aspect ratio (4:3) at the first data rate.
  • the digital picture signal of the second data rate i.e., (3/4) f s1 rate is sampled by the clock of the first clock frequency f s1 at the four stages of registers 21 ⁇ 24 of the data rate converting section 20
  • the contents of the four stages of registers 21 ⁇ 24 are as shown in FIG. 9. Namely, when the clock timings are respectively assumed to be t0, t1, t2, t3, t4, ⁇ , one four contents is repeated with respect to the other content. Accordingly, filter coefficients delivered to the multipliers 25 ⁇ 28 are caused to be [0] with respect to the repeated digital picture signals, and operation results of the remaining three multipliers are assumed to be valid. In this state, filter operation is carried out.
  • the aspect ratio converting apparatus is constituted in FIG. 10, for example.
  • the aspect ratio converting apparatus shown in FIG. 10 serves to convert a digital picture signal Video in of the picture frame of the first aspect ratio (e.g., 16:9) into a digital picture signal Video out of the picture frame of the second aspect ratio (e.g., 4:3), wherein the digital picture signal Video in of the first data rate is inputted to the time axis converting section 10.
  • a digital picture signal Video in of the picture frame of the first aspect ratio e.g., 16:9
  • a digital picture signal Video out of the picture frame of the second aspect ratio e.g., 4:3
  • the time axis converting section 10 implements time axis conversion processing to the digital picture signal Video in of the first data rate of the picture frame of the first aspect ratio to thereby generate a digital picture signal of the second data rate of the picture frame of the second aspect ratio.
  • This time axis converting section 10 is comprised of, e.g., FIFO memory in which write and read operations of the memory cell are independently carried out by write clock and read clock having first clock frequency f s1 equal to the data rate of the digital picture signal Video in.
  • an enable signal for controlling read-out operation of data is delivered along with the write clock and the read clock of the first clock frequency f s1 to stop, by the enable signal, read-out operation of data from the memory cell of the FIFO memory by the read-out clock once every four read-out operations to write the digital picture signal Video in of the first aspect ratio (16:9) into the FIFO memory by the write clock of the first clock rate, and to stop, by the enable signal, read-out operation of data from the memory cell of the FIFO memory by the read-out clock once every four operations to read out the digital picture signal Video in from the FIFO memory substantially by the second clock rate to thereby extract the picture frame of the second aspect ratio (4:3) from the picture frame of the first aspect ratio (16:9) to carry out time axis expansion processing of 4/3 times which outputs the digital picture signal of the second aspect ratio (4:3) at the second data rate.
  • the aspect ratio converting apparatus is composed of time axis converting section 10 using FIFO memory and data rate converting section 20 using pre-register type FIR filter as shown in the more practical configuration in FIG. 11, for example.
  • This aspect ratio converting apparatus serves to convert the digital picture signal Video in of the picture frame of the first aspect ratio (16:9) into a digital picture signal Video out of the picture frame of the second aspect ratio (4:3), wherein the digital picture signal Video in of the first data rate is inputted to the memory cell 11 constituting the FIFO memory of the time axis converting section 10.
  • the time axis converting section 10 is comprised of a FIFO memory constituted by the memory cell 11, write address generating section 12, and read address generating section 13, wherein write clock having first clock frequency f s1 equal to the data rate of the input digital picture signal Video in is delivered to the memory cell 11 and the write address generating section 12, and read clock having the first clock frequency f s1 is delivered to the memory cell 11 and the read address generating section 13. Further, an enable signal to control read-out operation of data from the memory cell 11 by the read clock is delivered to the memory cell 11.
  • the write address generating section 12 sequentially generates write addresses synchronous with the write clock of the first clock frequency f s1 to deliver these write addresses to the memory cell 11.
  • the input digital picture signals Video in are sequentially written into the memory cell 11 by the first clock frequency f s1 .
  • the write address generating section 12 is adapted to be reset at one horizontal period by the reset pulse Reset 1.
  • the read address generating section 13 sequentially generates read-out addresses synchronous with the read clock of the first clock frequency f s1 to deliver these read-out addresses to the memory cell 11. Further, as shown in FIG. 12, read-out operation of data from the memory cell 11 of the FIFO memory by the read(-out) clock of the first clock frequency f s1 is stopped by the enable signal once every four operations to allow the data rate to be substantially equal to (3/4)f s1 rate to thereby sequentially read out digital picture signals substantially at the second data rate from the memory cell 11.
  • the read address generating section 13 is adapted to be reset at one horizontal period by the reset pulse Reset 2.
  • the data rate converting section 20 is comprised, as shown in FIG. 11, of a pre-register type FIR filter constituted by four stages of registers 21 ⁇ 24 cascade-connected, four multipliers 25 ⁇ 28 for respectively multiplying respective delay outputs by the registers 21 ⁇ 24 by filter coefficients, and adder 29 for adding respective delay outputs by the multipliers 25 ⁇ 28, wherein the digital picture signal of the second data rate of the picture frame of the second aspect ratio (4:3) generated by the time axis converting section 10 is delivered to respective multipliers 25 ⁇ 28 through the four stages of registers 21 ⁇ 24.
  • This data rate converting section 20 becomes operative by the clock of the first clock frequency f s1 to sequentially carry out switching between filter coefficients delivered to the multipliers 25 ⁇ 28 at the output rate to substantially carry out octuple over-sampling and 1/6 down-sampling to thereby carry out data rate conversion processing of conversion ratio of 3:4 to generate a digital picture signal Video out of the picture frame of the second aspect ratio (4:3).
  • values shown in FIG. 14 or 15 are delivered as coefficients COE1 ⁇ COE4 to data rate converting sections 20R, 20G, 20B constituted by the pre-register type FIR filter in the state where they are sequentially switched in accordance with the clock.
  • sum totals of values of coefficients COE1 ⁇ COE4 at respective timings are all equal to 64.
  • the imaging section 1 is constituted by employing the Spatial Offset Method, and respective CCD image sensors 1R, 1B for imaging red picture image and blue picture image are disposed in such a manner that they are shifted in a horizontal direction by 1/2 of the spatial sampling period ⁇ s of pixel with respect to the CCD image sensor 1G for imaging green picture image.
  • coefficients COE1 ⁇ COE4 shown in one of the FIGS. 14 and 15 mentioned above are applied to the data rate converting section 20G
  • coefficients COE1 ⁇ COE4 shown in one of the FIGS. 14 and 15 mentioned above are applied to the data rate converting sections 20R, 20B.
  • Sum totals of values of coefficients COE1 ⁇ COE4 at respective timings of the data rate converting sections 20R, 20G, 20B are caused to be all equal to each other as described above.
  • the spatial sampling phase of the digital picture signal obtained from the data rate converting section 20G and the spatial sampling phases of the digital picture signals obtained from the data rate converting sections 20R, 20B are caused to be different by ⁇ .
  • an approach is employed to stop read-out operation of data by the enable signal once every four operations to allow the data rate to be substantially (3/4)f s1 rate to thereby sequentially read out digital picture signals substantially at the second data rate from the memory cell 11, even if read-out clocks caused to substantially have second frequency, i.e., (3/4)f s1 rate by thinning write clocks of the first clock frequency f s1 at a rate of one to four clock pulses are delivered to the FIFO memory constituting the time axis converting section 10 in place of the read-out control by the enable signal, it is possible to sequentially read out digital picture signals substantially at the second data rate from the memory cell 11.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Television Systems (AREA)
  • Color Television Image Signal Generators (AREA)
  • Color Television Systems (AREA)
EP95923535A 1994-06-29 1995-06-28 Digitale videokamera Expired - Lifetime EP0716549B1 (de)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP14830594 1994-06-29
JP14830594 1994-06-29
JP148305/94 1994-06-29
PCT/JP1995/001287 WO1996001026A1 (fr) 1994-06-29 1995-06-28 Camera video numerique et etage de conversion de format de cadre

Publications (3)

Publication Number Publication Date
EP0716549A1 true EP0716549A1 (de) 1996-06-12
EP0716549A4 EP0716549A4 (de) 1997-03-19
EP0716549B1 EP0716549B1 (de) 2000-11-02

Family

ID=15449821

Family Applications (1)

Application Number Title Priority Date Filing Date
EP95923535A Expired - Lifetime EP0716549B1 (de) 1994-06-29 1995-06-28 Digitale videokamera

Country Status (4)

Country Link
US (2) US5659356A (de)
EP (1) EP0716549B1 (de)
DE (1) DE69519276T2 (de)
WO (1) WO1996001026A1 (de)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0963113A2 (de) * 1998-06-02 1999-12-08 Peter Denz Normwandler für Videobilder und Verfahren zum Umwandeln der Norm eines Videosignals

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5659356A (en) * 1994-06-29 1997-08-19 Sony Corporation Digital video camera apparatus and aspect ratio converting apparatus
KR100194802B1 (ko) * 1995-12-19 1999-06-15 이계철 디지탈 티비 및 고선명 티비의 분할 화면 영상 처리를위한엠펙2인코더전처리장치
KR0165512B1 (ko) * 1996-01-29 1999-03-20 김광호 면적영향 상관방법 및 이를 이용한 디지탈 영상신호에 대한 클럭레이트 변환방법 및 장치
US6330081B1 (en) * 1998-11-20 2001-12-11 Agfa Corporation Crosstalk cancellation in a multi-color CCD signal processor
US20040152058A1 (en) * 2002-06-11 2004-08-05 Browne H. Lee Video instructional system and method for teaching motor skills
JP3630591B2 (ja) * 1999-08-30 2005-03-16 沖電気工業株式会社 クロック乗せ換え方法及び回路
US7106380B2 (en) * 2001-03-12 2006-09-12 Thomson Licensing Frame rate multiplier for liquid crystal display
KR100429874B1 (ko) * 2001-07-20 2004-05-04 삼성전자주식회사 파노라마/워터글라스 기능 구현을 위한 영상 처리 장치 및그 방법
US7023478B2 (en) * 2001-10-12 2006-04-04 Eastman Kodak Company Hybrid cameras having electronic image conversion to selected geometric formats and methods
JP4114569B2 (ja) * 2003-07-22 2008-07-09 ソニー株式会社 画像処理装置及び画像処理方法、並びにコンピュータ・プログラム
US8149285B2 (en) * 2007-09-12 2012-04-03 Sanyo Electric Co., Ltd. Video camera which executes a first process and a second process on image data

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0421433A2 (de) * 1989-10-04 1991-04-10 Sony Corporation Signalverarbeitungsschaltung für Festkörper-Bildaufnahmevorrichtung
EP0559478A1 (de) * 1992-03-06 1993-09-08 Sony Corporation Videokamera für 16:9 und 4:3 Bildseitenverhältnisse

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH03198486A (ja) * 1989-12-26 1991-08-29 Sony Corp 撮像装置
JP3094429B2 (ja) * 1990-07-31 2000-10-03 ソニー株式会社 画像撮影記録装置
JP3047440B2 (ja) * 1990-09-18 2000-05-29 ソニー株式会社 画像撮影装置
JP3351804B2 (ja) * 1991-04-16 2002-12-03 ソニー株式会社 ビデオカメラ装置
JP2904975B2 (ja) * 1991-10-30 1999-06-14 三菱電機株式会社 ワイドアスペクト比のテレビジョン受信機
JP3340458B2 (ja) * 1992-01-18 2002-11-05 松下電器産業株式会社 デジタルカメラ
JP3396891B2 (ja) * 1992-03-06 2003-04-14 ソニー株式会社 ビデオカメラ
JP3544998B2 (ja) * 1992-06-22 2004-07-21 ソニー株式会社 レートコンバータ
DE69331347T2 (de) * 1992-10-09 2002-06-13 Sony Corp Festkörperbildaufnahmevorrichtung
US5659356A (en) * 1994-06-29 1997-08-19 Sony Corporation Digital video camera apparatus and aspect ratio converting apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0421433A2 (de) * 1989-10-04 1991-04-10 Sony Corporation Signalverarbeitungsschaltung für Festkörper-Bildaufnahmevorrichtung
EP0559478A1 (de) * 1992-03-06 1993-09-08 Sony Corporation Videokamera für 16:9 und 4:3 Bildseitenverhältnisse

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PROCEEDINGS OF THE IEEE, vol. 69, no. 3, 1981, pages 300-331, XP002022466 CROCHIERE: "interpolation and decimation of digital signals" *
See also references of WO9601026A1 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0963113A2 (de) * 1998-06-02 1999-12-08 Peter Denz Normwandler für Videobilder und Verfahren zum Umwandeln der Norm eines Videosignals
EP0963113A3 (de) * 1998-06-02 2001-07-18 Peter Denz Normwandler für Videobilder und Verfahren zum Umwandeln der Norm eines Videosignals

Also Published As

Publication number Publication date
EP0716549A4 (de) 1997-03-19
US5801772A (en) 1998-09-01
EP0716549B1 (de) 2000-11-02
DE69519276D1 (de) 2000-12-07
WO1996001026A1 (fr) 1996-01-11
DE69519276T2 (de) 2001-04-12
US5659356A (en) 1997-08-19

Similar Documents

Publication Publication Date Title
EP0501718B1 (de) Farbfernsehkameragerät und Verfahren zur Erzeugung von Farbfernsehsignalen
EP0469836B1 (de) Bildsignalverarbeitungsvorrichtung
US5262849A (en) Digital camera processing device having variably settable interpolation
EP0716549B1 (de) Digitale videokamera
EP0520759B1 (de) Festkörperkamera
US5181100A (en) Digital video processing system with mixing prefilter
US4506294A (en) Solid state camera
JP4085431B2 (ja) デジタルビデオカメラ装置及びアスペクト比変換装置
EP0415756A2 (de) Elektronische Standbildkamera
US6266101B1 (en) Y/C separator
CN100385933C (zh) 摄像装置
JP2861055B2 (ja) 画像信号処理装置
JP3581457B2 (ja) 撮像装置
JP2670719B2 (ja) 映像信号処理装置
JP3374404B2 (ja) ビデオカメラ及びビデオカメラの信号処理方法
JPH08279947A (ja) 撮像装置
JP3263848B2 (ja) カラーテレビジョンカメラ装置
JP3232576B2 (ja) カラーテレビジョンカメラ装置
JPH0488785A (ja) カラー撮像素子及び信号処理装置
JP2728135B2 (ja) 撮像装置
JP2000261817A (ja) 撮像装置
JP3355975B2 (ja) 色信号処理回路
JP2554080Y2 (ja) テレビジョン方式変換装置
JPS63198486A (ja) 撮像素子の信号処理方式
EP0420588A2 (de) Bildaufnahmegerät

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 19960304

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB

A4 Supplementary search report drawn up and despatched
AK Designated contracting states

Kind code of ref document: A4

Designated state(s): DE FR GB

17Q First examination report despatched

Effective date: 19981208

RTI1 Title (correction)

Free format text: DIGITAL VIDEO CAMERA DEVICE

RTI1 Title (correction)

Free format text: DIGITAL VIDEO CAMERA DEVICE

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

17Q First examination report despatched

Effective date: 19981208

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REF Corresponds to:

Ref document number: 69519276

Country of ref document: DE

Date of ref document: 20001207

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

REG Reference to a national code

Ref country code: GB

Ref legal event code: 746

Effective date: 20120702

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20120622

Year of fee payment: 18

Ref country code: FR

Payment date: 20120705

Year of fee payment: 18

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 69519276

Country of ref document: DE

Effective date: 20120614

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20120822

Year of fee payment: 18

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20130628

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20140228

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69519276

Country of ref document: DE

Effective date: 20140101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130628

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130701