JP3658430B2 - Image signal processing device - Google Patents

Description

【００２４】
フィールド間引き回路１０は、このようにＢフィールド（あるいはＡフィールド）に生成された色差信号Ｃのみを出力し、Ａフィールド（あるいはＢフィールド）の色差信号Ｃを間引く。
【００２５】
以上説明したように、この実施の形態によれば、Ａフィ−ルドとＢフィ−ルドの２フィ−ルドから色差信号を加算平均するので、フィ−ルド毎に位相が１８０°反転するフリッカ状の色モアレを打ち消し合い、従来方式に比べて画素混合撮像素子に起因する色モアレを低減することができる。
【００２６】
図３は、本発明に係る画像信号処理装置１０１の第２の実施の形態の構成を示すブロック図である。この実施の形態では、画像信号処理装置１０１は、Ａ／Ｄ変換器２と、Ｙ／Ｃ分離回路４６と、メモリコントロール回路２１と、輝度信号処理手段９１と、色差信号処理手段８１と、フィールド間引き回路２８，２９とを有している。
輝度信号処理手段９１は、フィ−ルドメモリ２２と、加算器２４と、除算器２６とを有している。同様に色差信号処理手段８１は、フィ−ルドメモリ２３と、加算器２５と、除算器２７とを有している。メモリコントロ−ル回路２１は、フィ−ルドメモリ２２，２３へのライン信号の書込みおよび読出しを制御する。
輝度信号処理回路９１の加算器２４は、Ｙ／Ｃ分離回路４６の出力する原輝度信号とフィ−ルドメモリ２２の出力する１フィールド遅延した輝度信号とを加算する。除算器２６は、加算器２４の出力する輝度信号信号レベルを１／２に除算し平均化する。フィールド間引き回路２８は、Ａフィ−ルドあるいはＢフィ−ルドのいずれか一方のみを出力して輝度信号をフィ−ルド間引する。
色差信号処理回路８１の加算器２５は、それぞれＹ／Ｃ分離回路４６の出力する原色差信号とフィ−ルドメモリ２３の出力する１フィールド遅延した色差信号とを加算する。除算器２７は、加算器２５の出力する信号レベルを１／２に除算し平均化する。フィールド間引き回路２９は、Ａフィ−ルドあるいはＢフィ−ルドのいずれか一方のみを出力して色差信号をフィ−ルド間引きする。
【００２７】
以上の構成を有する画像信号処理装置１０１は、Ｙ／Ｃ分離回路４６の出力する輝度信号Ｙおよび色差信号Ｃを図４に示すように処理する。すなわち、Ｙ／Ｃ分離回路４６から出力された輝度信号Ｙは、まず、例えばＡフィールドの期間にＹ／Ｃ分離回路４６から出力されるＹ11，Ｙ12，Ｙ13，…，Ｙ1n，Ｙ31，Ｙ32，Ｙ33，…，Ｙmnから成るＡフィールドライン信号がフィールドメモリ２２に記憶され、次いで、Ｂフィールドの期間にＹ／Ｃ分離回路４６から出力されるＹ（m＋1）1，Ｙ（m＋1）2，Ｙ（m＋1）3，…，Ｙ（m＋1）nから成るＢフィールドライン信号（原信号）が加算器２４に入力される。このＢフィールドライン信号が加算器２４に入力されるのと同時に、フィールドメモリ２２に記憶されたＡフィールドライン信号が１フィールド分遅延して読み出され加算器２４に入力される。加算器２４で加算されたライン信号は、除算器２６において下記（４）〜（６）式を用いてＡフィ−ルドの水平画素とＢフィ−ルドの水平画素からＡフィールドとＢフィールドの各水平画素毎に加算平均化されたＳy11、Ｓy12、Ｓy13、…，Ｓymnラインの水平列輝度信号Ｓyを生成する。フィールド間引き回路２８は、このようにＢフィールド（あるいはＡフィールド）に生成された水平列輝度信号のみを出力し、Ａフィールド（あるいはＢフィールド）の水平列輝度信号を間引いて出力する。
【００２８】
【数２】

【００２９】
一方、Ｙ／Ｃ分離回路４６から出力された色差信号Ｃは、第１の実施の形態と同様に、例えばＡフィールドにＹ／Ｃ分離回路４６から出力されるＣ11，Ｃ12，Ｃ13，…，Ｃmnから成るＡフィールドライン信号がフィールドメモリ２３に記憶され、次いで、ＢフィールドにＹ／Ｃ分離回路４６から出力されるＣ（m＋1）1，Ｃ（m＋1）2，Ｃ（m＋3）3，…，Ｃ（m＋1）nから成るＢフィールドライン信号（原信号）が加算器２５に入力される。このＢフィールドライン信号が加算器２５に入力されるのと同時に、フィールドメモリ２３に記憶されたＡフィールドライン信号が１フィールド分遅延して読み出され加算器２５に入力される。加算器２５で加算されたライン信号は、除算器２７において前記（１）〜（３）式を用いてＡフィ−ルドの水平画素とＢフィ−ルドの水平画素からＡフィールドとＢフィールドの各水平画素毎に加算平均化されたＳc1、Ｓc2、Ｓc3、…Ｓcnラインの水平列色差信号Ｓcを生成する。フィールド間引き回路２９は、このようにＢフィールド（あるいはＡフィールド）に生成された水平列色差信号のみを出力し、Ａフィールド（あるいはＢフィールド）の水平列色差信号を間引くことができる。
【００３０】
以上説明したように、この実施の形態によれば、Ａフィ−ルドとＢフィ−ルドの２フィ−ルドから色差信号を加算平均しているので、フィ−ルド毎に位相が１８０°反転するフリッカ状の色モアレを打ち消し合い、従来方式に比べて画素混合撮像素子に起因する色モアレを低減することができ、さらに、輝度信号についても加算平均しているので時間方向に滑らかな画像を実現することができる。
【００３１】
【実施例】
図５は、本発明の第１の実施の形態に係る画像信号処理回路１００を撮像装置に用いた第１の実施例の構成を示すブロック図である。この実施例は、第１の実施の態様に示した画像信号処理回路１００の前に撮像装置１を具備したものであり、上記第１の実施の形態で述べたように動作して、撮像装置１の出力する１秒間に２ｎフィールドの標準カラー映像信号を、１秒間にｎフレームの輝度信号および色差信号に処理生成する。
【００３２】
この実施例に使用される撮像装置１は、単板式で画像面に分光感度の異なる複数種の色フィルタを備え、標準カラ−映像信号などのカラー映像信号を出力するように構成された撮像装置である。
【００３３】
本実施例によれば、Ａフィ−ルドとＢフィ−ルドの２フィ−ルドから色差信号を加算平均するので、フィ−ルド毎に位相が１８０°反転するフリッカ状の色モアレを打ち消し合い、従来方式に比べて画素混合撮像素子に起因する色モアレを低減することができる。
【００３４】
図６は、本発明の第２の実施の形態に係る画像信号処理回路１０１を撮像装置に用いた第２の実施例を示すブロック図で、第２の実施の形態に示した画像信号処理回路１０１の前に撮像装置１を具備したものであり、上記第２の実施の形態で述べたように動作し、撮像装置１の出力する１秒間に２ｎフィールドの標準カラー映像信号を１秒間にｎフレームの輝度信号および色差信号に処理生成する。本実施例によれば、Ａフィ−ルドとＢフィ−ルドの２フィ−ルドから色差信号を加算平均するので、フィ−ルド毎に位相が１８０°反転するフリッカ状の色モアレを打ち消し合い、従来方式に比べて画素混合撮像素子に起因する色モアレを低減させることができ、さらに、輝度信号を加算平均しているので時間方向に滑らかな画像を実現することができる。
【００３５】
図７は、本発明の第３の実施例を示すブロック図で、第１の実施例に示した画像信号処理回路１００の後に、入力信号を画像圧縮に用いる中間フォーマットに変換するデータ変換器４５を具備した例である。この画像信号処理回路１００は、撮像装置１からの標準カラー映像信号を上記第１の実施例で述べたように動作してフィールド間引きし、データ変換器４５へ出力する。データ変換器４５は、フィールド間引きされた輝度信号および色差信号を、圧縮符号化に用いられる中間フォーマットの輝度信号および色差信号に変換して出力する。本実施例によれば、光信号から圧縮符号化に用いる輝度信号および色差信号を生成することができる。
【００３６】
図８は、本発明の第４の実施例を示すブロック図で、第２の実施例に示した画像信号処理回路１０１の後に入力信号を画像圧縮に用いる中間フォーマットに変換するデータ変換器４５を具備した例である。この画像信号処理回路１０１は、撮像装置１からの標準カラー映像信号を上記第２の実施例で述べたように動作してフィールド間引きし、データ変換器４５へ出力する。データ変換器４５は、フィールド間引きされた輝度信号および色差信号を、圧縮符号化に用いられる中間フォーマットの輝度信号および色差信号に変換して出力する。本実施例によれば、光信号から時間方向に滑らかな圧縮符号化に用いる輝度信号および色差信号を生成することができる。
【００３７】
図９は、本発明の第５の実施例に係る撮像装置の構成を示すブロック図である。この撮像装置は、レンズ３１とシャッタ３２と撮像素子を用いた撮像部４７からなる撮像装置１と、Ａ／Ｄ変換器２と、フィールドメモリ３３と１Ｈ遅延回路３４，３５，３６とメモリコントロール回路３７とからなる画像信号処理回路１０２と、信号処理回路３９と、撮像素子駆動パルス発生回路３８と、アイリス制御回路４０とから構成される。
【００３８】
この撮像部４７は、画像面に分光感度の異なる複数種の色フィルタが配列され、第１の色に対する色フィルタと第２の色に対する色フィルタとが水平方向に交互に配列されてなる第１の水平色フィルタ列と、第３の色に対する色フィルタと第４の色に対する色フィルタとが水平方向に交互に配列されてなる第２の水平色フィルタ列と、第１の水平色フィルタ列信号の第１の色に対する色フィルタと第２の色に対する色フィルタとが空間的に位相が１８０°異なって配列されてなる第３の水平色フィルタ列と、第２の水平色フィルタ列と同一の第４の水平色フィルタ列が順次垂直方向に繰り返し配列され、第１のフィ−ルド（あるいは第２フィールド）では第１と第３の水平色フィルタ列に対応した色信号を１水平走査期間（１Ｈ）毎に水平方向に連続して出力して、第２のフィ−ルド（あるいは第１のフィールド）では第２と第４の水平色フィルタ列に対応した色信号を、１水平走査期間毎に水平方向に連続して出力する撮像部である。
【００３９】
シャッタ３２は、アイリス制御回路４０で発生するシャッタ開閉制御パルス４４によって開閉を制御される。シャッタ３２によって露光を制御された光信号は、撮像素子４７で電気信号に変換される。撮像素子４７は、撮像素子駆動パルス発生回路３８から発生されるＡフィールド読み出し制御パルス４１、Ｂフィールド読み出し制御パルス４２、電荷転送パルス４３によって制御され、変換された電気信号を読み出す。このとき、撮像素子１からの読み出しは、画素混合読み出しを行なわず、各画素信号をそのまま読み出すようにして、Ａ／Ｄ変換器２に出力する。Ａ／Ｄ変換器２に入力されたアナログ信号は、ディジタル信号に変換され出力される。メモリコントロ−ル回路３７は、Ａ／Ｄ変換器２の出力する信号Ｇ，Ｍgを、Ａフィ−ルド（あるいはＢフィールド）ではフィ−ルドメモリ３３へ記憶し、Ｂフィ−ルド（あるいはＡフィールド）ではフィ−ルドメモリ３３から信号Ｇ，Ｍgを出力するように制御する。Ａ／Ｄ変換器２から出力された信号Ｙeと信号Ｃyは、信号処理回路３９へ直接入力される第１のライン信号と、入力を１水平走査期間遅延させる１Ｈ遅延回路３４に入力され１水平走査期間（１Ｈ）分遅延して出力される第２のライン信号の２ライン信号とされる。他方、フィールドメモリ３３から１フィールド分遅延して読み出された信号Ｇ，Ｍgは、信号処理回路３９へ直接入力される第３のライン信号と、１Ｈ遅延回路３５に入力され１水平走査期間分遅延して信号処理回路３９へ出力される第４のライン信号と、この第４のライン信号をさらに１Ｈ遅延回路３６に入力してさらに１水平走査期間分遅延して信号処理回路３９へ出力される第５のライン信号との３ライン信号とされる。信号処理回路３９は、入力されたライン信号を輝度信号および色差信号に変換する。
【００４０】
以上の構成を有する本実施例では、アイリス制御回路４０は、Ａフィールド（あるいはＢフィールド）ではシャッタ３２を開き、Ｂフィールド（あるいはＡフィールド）ではシャッタ３２を閉じ、１フィールド毎にシャッタ３２が開閉を繰り返すシャッタ開閉信号を出力してシャッタの開閉を制御する。撮像素子駆動パルス発生回路３８は、Ａフィールド（あるいはＢフィールド）で蓄えた電荷をレジスタにシフトするシフトパルス４１〜４３を２フィールド毎に出力する。
【００４１】
このように制御された撮像装置１は、図６に示すようにＡフィールドおよびＢフィールドとも画素混合しないで各画素信号を出力する。Ａフィールド（あるいはＢフィールド）で撮像装置１の出力する信号Ｙe，Ｃyはフィールドメモリ３３に記憶され、Ｂフィールド（あるいはＡフィールド）で出力される。そして、Ｂフィールド（あるいはＡフィールド）で、撮像装置１の出力する第１のライン信号Ｙe，Ｃyと、撮像装置１の出力する信号を１Ｈ遅延回路３４で１Ｈ遅延した第２のライン信号Ｃy，Ｙeと、フィールドメモリ３３の出力する第３のライン信号Ｇ，Ｍｇと、フィールドメモリ３３の出力する信号を１Ｈ遅延した第４のライン信号Ｍｇ，Ｇと、フィールドメモリ３３の出力する信号を２Ｈ遅延した第５のライン信号Ｇ，Ｍｇとを同時化して、信号処理回路３９に出力する。
【００４２】
信号処理回路３９は、入力される５ラインの信号からフィールドメモリ３３の出力する信号を１Ｈ遅延した信号を補間して、輝度信号および色差信号を生成する。信号処理回路３９における補間方法について図１１を用いて説明する。同図において、各枠は例えばそれぞれ１つの画素を表している。まず、Ｓ₁ラインは、Ａ₁，Ｂ₁，Ａ₂，Ｂ₂，Ａ₃ラインを用いて補間する。Ａ₂ラインには、Ｙe，Ｃyの画素がないのでＢ₁ラインおよびＢ₂ラインを用いて補間する。また、Ｇ、Ｍｇについては、Ａ₂ラインの信号を中心に重みを付けてＡ₁、Ａ₃ラインから補間する。したがって、この補間式は、下記（７）式〜（１０）式で示される。
【００４３】
【数３】

【００４４】
次に、Ｓ₂ラインはＡ₂，Ｂ₂，Ａ₃，Ｂ₃，Ａ₄ラインを用いて補間する。Ｓ₂ラインではＳ₁ラインに較べてＧ、Ｍgの画素配置がライン毎に入れ替わっていることを考慮して、下記（１１）〜（１４）式を用いて補間生成される。
【００４５】
【数４】

【００４６】
このように、２ライン毎に補間係数を切り換えることによって、ライン信号を順次補間生成することができる。本実施例では、水平列信号５ラインを同時化して生成した１例であり、特に水平列信号５ラインにこだわるものではない。また、上式の補間係数は、水平列信号５ラインから補間生成する係数の１例であり、特に本係数にこだわるものではない。そして、上記説明により補間生成された撮像信号は輝度マトリックス処理、エンハンサ処理、ガンマ補正、ＲＧＢマトリックス処理、ホワイトバランス補正等の公知の処理を施して、輝度信号および色差信号を出力する。
【００４７】
以上述べたように、本実施例によれば、水平列信号５ラインから撮像装置１の出力する信号に重みを付けて補間生成するので、垂直方向でのフィルタ特性も水平方向と同様２タップ、３タップ特性となり、水平方向、垂直方向での補間特性の揃った信号処理回路を実現できる。したがって、従来方法に比べて色モアレを低減することができる。
【００４８】
図１２は、本発明の第６の実施例を示すブロック図である。この実施例は、第５の実施例で用いた信号処理回路３９の後に圧縮符号化に用いられるフォーマットへデータを変換するデータ変換回路４５を具備したものであり、上記第５の実施例で述べたように動作し、圧縮符号化に用いられるフォーマットに用いる輝度信号および色差信号を出力する。本実施例では、データ変換回路４５を輝度信号および色差信号を生成した後に設けた例であるが、データ変換回路４５を配置する位置は特にこの位置にこだわるものではない。例えば、撮像部４７の出力の後に設けても効果は同じである。本実施例によれば、光信号から圧縮符号化に用いられる中間フォーマットの輝度信号および色差信号を生成することができる。
【００４９】
【発明の効果】
以上のように、本発明によれば、１秒間に２ｎフレ−ムの標準カラー映像信号から１秒間にｎフレ−ムの輝度信号および色差信号を生成する画像信号処理装置において、色モアレを低減することができる。
【図面の簡単な説明】
【図１】本発明の第１の実施形態のブロック図。
【図２】輝度信号フィ−ルド間引き、色差信号２フィ−ルド加算平均を示す図。
【図３】本発明の第２の実施形態のブロック図。
【図４】輝度信号、色差信号２フィ−ルド加算平均を示す図。
【図５】本発明の第１の実施例のブロック図。
【図６】本発明の第２の実施例のブロック図。
【図７】本発明の第３の実施例のブロック図。
【図８】本発明の第４の実施例のブロック図。
【図９】本発明の第５の実施例のブロック図。
【図１０】撮像装置の色フィルタ配置を示す図。
【図１１】水平列信号５ラインから各補色を生成する補間方法の説明図。
【図１２】本発明の第６の実施例のブロック図。
【符号の説明】
１ 撮像装置
２ Ａ／Ｄコンバ−タ
４，３７ メモリコントロ−ル回路
５，２２，２３，３３ フィ−ルドメモリ
６；２４，２５ 加算器
７，２６，２７ 除算器
９，１０，２８，２９ フィ−ルド間引き回路
２１ メモリコントロ−ル回路
３１ レンズ
３２ シャッタ
３４，３５，３６ １Ｈ遅延回路
３８ 駆動パルス発生回路
３９ 信号処理回路
４０ アイリス制御回路
４１ Ａフィ−ルド読み出し制御パルス
４２ Ｂフィ−ルド読み出し制御パルス
４３ 電荷転送パルス
４４ シャッタ開閉パルス
４５ データ変換回路
４６ Ｙ／Ｃ分離回路
４７ 撮像部
８０，８１ 色差信号処理回路
９０，９１ 輝度信号処理回路
１００，１０１，１０２ 画像信号処理回路[0001]
[Industrial application fields]
The present invention relates to an image signal processing apparatus that halves and outputs a picture rate of an input signal, and more particularly to an image signal processing apparatus including an imaging device and an image compression device.
[0002]
[Prior art]
In recent years, video signal digitization technology has advanced, and high-efficiency encoding of moving images has been performed. For example, MPEG (Moving Picture Experts Group), which is an encoding standard for storage media, and CCITT H.264, which is an encoding standard for communication, such as videophones, as high-efficiency encoding methods for moving images. 261 etc. are mentioned. The luminance signal and color difference signal of the intermediate format used in these standards are an odd field or an even field as described in, for example, ISO / IEC, 11172-2, P57 to P60. ) Only one of the fields was used.
[0003]
[Problems to be solved by the invention]
However, color moiré occurs when the above method is performed in an image pickup apparatus including a pixel mixture type image pickup device. This is, for example, the TV Science Technical Report VOL. 13, NO. As described in P49 to P54 of No. 11, the color difference signal is generated by the calculation between two horizontal lines. That is, when a color difference signal is generated by calculation between two horizontal lines, a flicker-like color moire in which the phase is inverted by 180 ° for each field is generated. Normally, the flicker-like color moire is canceled out by the integration effect by interlacing, and is not so noticeable visually. However, if one field is thinned out as in the above-described method in order to process the encoding with high efficiency, the canceling effect between the fields is lost, and color moire occurs.
[0004]
It is an object of the present invention to provide an image signal processing apparatus that solves the above problems and reduces color moire.
[0005]
[Means for Solving the Problems]
In order to solve the above-described problems, the invention of this application is directed to an image signal processing apparatus that performs field thinning, wherein a color video signal is input from the outside and the first field (or the second field) is input from the outside. The color difference signal of the color video signal is stored for one field, and the stored contents are output to the second field (or the first field) and the second field (or the first field). The color difference signal of the color video signal input from the outside, and the color difference input to the field memory one field before the color difference signal and output from the field memory in the second field (or first field) An averaging means for adding and averaging signals, and a second field (or first field) output from the averaging means. A first field thinning means for thinning out the color difference signal of the first field (or second field) other than the difference signal, and a first field (or second field) of the color video signal inputted from the outside. A second field thinning means for thinning out the luminance signal is provided, and a color video signal such as a 2n field standard color video signal is input per second to generate a luminance signal and a color difference signal of n frames per second; Configure.
[0006]
According to the second aspect of the present invention, in the image processing apparatus that performs field thinning, a luminance signal and a color difference signal of a color video signal input from the outside are input to the first field (or the second field). Is stored for one field, and a field memory for outputting the stored contents to the second field (or the first field) and a color input from the outside to the second field (or the first field) First addition averaging means for averaging the luminance signal of the video signal and the luminance signal input to the field memory one field before the luminance signal and output from the field memory to the second field; A color difference signal of a color video signal input from the outside to the second field (or the first field), and one field from the color difference signal Second averaging means for averaging the color difference signals input to the field memory and output from the field memory to the second field (or first field); and the second field (or first field). First field thinning means for thinning out the color difference signals of the first field (or second field) other than the color difference signals output from the second addition averaging means, and the second field (or second field). 1 field) is provided with second field thinning means for thinning out the luminance signal of the first field (or second field) other than the luminance signal output from the first averaging means, 2n per second. A standard color video signal of a field is input, and a luminance signal and a color difference signal of n frames are generated per second.
[0007]
According to a third aspect of the present invention, there is provided an image processing apparatus that performs field thinning, an image pickup apparatus that is provided with a plurality of types of color filters having different spectral sensitivities on the image plane, and outputs a standard color video signal. And generating a luminance signal and a color difference signal of n frames per second from a standard color video signal of 2n fields per second output from the imaging device.
[0008]
According to a fourth aspect of the present invention, there is provided an image processing apparatus that performs field thinning, an image pickup apparatus that is provided with a plurality of types of color filters having different spectral sensitivities on an image plane, and outputs a standard color video signal. And generating a luminance signal and a color difference signal of n frames per second from a standard color video signal of 2n fields per second output from the imaging device.
[0009]
In the fifth invention, in the image processing apparatus that performs field thinning, the input signal is output from the image pickup apparatus using the same means as that of the third invention, and data conversion means for converting the input signal into a format used for compression coding. A luminance signal and a color difference signal in a format used for compression encoding of n frames per second are generated from a standard color video signal of 2n fields per second.
[0010]
According to a sixth aspect of the present invention, in an image processing apparatus that performs field thinning, the data conversion means for converting an input signal into a format used for compression coding and the same means as in the fourth aspect of the invention are output from the imaging apparatus. A luminance signal and a color difference signal in a format used for compression encoding of n frames per second are generated from a standard color video signal of 2n fields per second.
[0011]
In the seventh invention, in the image processing apparatus for field thinning, a plurality of types of color filters having different spectral sensitivities are arranged on the image plane, and the color filter for the first color and the color filter for the second color are arranged in the horizontal direction. A first horizontal color filter row that is alternately arranged; a second horizontal color filter row that is alternately arranged in the horizontal direction with a color filter for the third color and a color filter for the fourth color; A third horizontal color filter array in which the color filters for the first color and the color filters for the second color of the first horizontal color filter array signal are arranged with a phase difference of 180 ° spatially; The fourth horizontal color filter row that is the same as the horizontal color filter row is sequentially and repeatedly arranged in the vertical direction, and the first field (or second field) corresponds to the first and third horizontal color filter rows. A signal is continuously output in the horizontal direction every 1H (1H: 1 horizontal scanning period), and the second field (or the first field) corresponds to the second and fourth horizontal color filter columns. An image pickup apparatus including an image pickup unit that continuously outputs color signals every 1H in the horizontal direction, an exposure control unit that controls exposure of the image pickup unit, and a first field (or a second field). A field memory for storing one field of a signal output from the image pickup unit in the -field) and outputting the stored contents in a second field (or first field); and output from the image pickup unit First delay means for generating 1H delay signal, 2H delay signal,... IH delay signal and i delay signals using i 1H delay circuits (i is an integer equal to or greater than 1). The signal output from the field memory is converted to a 1H delay circuit. 2 (j is an integer equal to or greater than 1), 1H delay signal, 2H delay signal,... JH delay signal and second delay means for generating j delay signals are provided, and the signal output from the imaging unit And a signal output from the field memory, i delay signals output from the first delay means, and j delay signals output from the second delay means, Brightness of n frames per second is obtained by performing known processing such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix, and white balance correction from 2n field signals output from the imaging unit per second. A signal and a color difference signal are generated.
[0012]
In the eighth invention, the data conversion means for converting the input signal into a format used for compression coding and the same means as in the seventh invention are used to output from the 2n field signal per second output from the imaging unit. A luminance signal and a color difference signal in a format used for compression encoding of n frames per second are generated.
[0013]
In the first invention, of the 2n field standard color video signals to be input, the color difference signal input to the first field (or the second field) is stored in the field memory, and the second field (or the first field) is stored. The color difference signal input to the (field) is output so as to be synchronized. The color difference signal output from the field memory and the color difference signal output from the imaging device to the second field (or the first field) are averaged to output an n frame color difference signal. As a result, the flicker-like color moire whose phase is inverted by 180 ° for each field cancels each other, and the color moire is reduced as compared with the conventional method.
[0014]
In the second invention, of the 2n field standard color video signals to be input, the luminance signal and the color difference signal input to the first field (or second field) are stored in the field memory, and the second field (or The luminance signal and the color difference signal input to the first field) are output so as to be synchronized. The luminance signal and chrominance signal output from the field memory and the luminance signal and chrominance signal input to the second field (or the first field) are added and averaged to output an n-frame luminance signal and chrominance signal. As a result, by adding and averaging the color difference signals, the flicker-like color moire whose phase is inverted by 180 ° for each field is canceled out, and the color moire is reduced compared to the conventional method, and the luminance signals are added and averaged. Realize smooth images in the time direction.
[0015]
In the third invention, among the 2n field standard color video signals output from the imaging device, the color difference signal output to the first field (or the second field) is stored in the field memory, and the second field ( Alternatively, it is output so as to be synchronized with the color difference signal output to the first field). The color difference signal output from the field memory and the color difference signal output from the imaging device to the second field (or the first field) are averaged to output an n frame color difference signal. As a result, the flicker-like color moire whose phase is inverted by 180 ° for each field cancels each other, and the color moire is reduced as compared with the conventional method.
[0016]
In the fourth invention, of the 2n field standard color video signals output from the imaging device, the luminance signal and the color difference signal output to the first field (or the second field) are stored in the field memory, and the second Are output so as to be synchronized with the luminance signal and the color difference signal output to the field (or the first field). The luminance signal and color difference signal output from the field memory and the luminance signal and color difference signal output from the imaging device are added and averaged to the second field (or first field) to obtain the luminance signal and color difference signal of n frames. Output. As a result, by adding and averaging the color difference signals, the flicker-like color moire whose phase is inverted by 180 ° for each field is canceled out, and the color moire is reduced compared to the conventional method, and the luminance signals are added and averaged. Realize smooth images in the time direction.
[0017]
In the fifth invention, among the 2n field standard color video signals output from the imaging device, the color difference signal output to the first field (or the second field) is stored in the field memory, and the second field ( Alternatively, it is output so as to be synchronized with the color difference signal output to the first field). The color difference signal output from the field memory and the color difference signal output from the imaging device to the second field (or the first field) are averaged to output an n frame color difference signal. The luminance signal that has been thinned out in the field and the color-difference signal that has been averaged are converted into an intermediate format used for compression coding by a data conversion circuit and output. As a result, flicker-like color moiré whose phase is inverted by 180 ° for each field is canceled out, and an intermediate format used for compression coding with reduced color moiré compared to the conventional method can be generated.
[0018]
In the sixth invention, of the 2n field standard color video signals output from the image pickup apparatus, the luminance signal and the color difference signal output to the first field (or the second field) are stored in the field memory, and the second Are output so as to be synchronized with the luminance signal and the color difference signal output to the field (or the first field). The luminance signal and color difference signal output from the field memory and the luminance signal and color difference signal output from the imaging device are added and averaged to the second field (or first field) to obtain the luminance signal and color difference signal of n frames. Output. The generated luminance signal and color difference signal are converted into an intermediate format used for compression coding by a data conversion circuit and output. As a result, by adding and averaging the color difference signals, the flicker-like color moire whose phase is inverted by 180 ° for each field is canceled out, and the color moire is reduced compared to the conventional method, and the luminance signals are added and averaged. An intermediate format used for smooth compression coding in the time direction can be generated.
[0019]
In the seventh invention, a first horizontal color filter in which a plurality of color filters having different spectral sensitivities are arranged, and a color filter for the first color and a color filter for the second color are alternately arranged in the horizontal direction. A second horizontal color filter column in which columns, a color filter for the third color, and a color filter for the fourth color are alternately arranged in the horizontal direction, and the first horizontal color filter column signal A third horizontal color filter array in which color filters for colors and color filters for the second color are spatially arranged with a phase difference of 180 °, and a fourth horizontal color that is the same as the second horizontal color filter array An image pickup apparatus in which color filter arrays are sequentially and repeatedly arranged in the vertical direction is provided. The first field (or the second field) exposes the image surface to store charges, and the second field (or the first field). Feel ) In to prevent exposure by closing the shutter. In the second field (or the first field), the charge stored in the first field (or the second field) is shifted to the register, and the second and fourth of the charges shifted to the register are shifted to the register. The color signal corresponding to the horizontal color filter row is continuously output in the horizontal row direction every 1H without pixel mixing. In the first field (second field), the color signals corresponding to the first and third horizontal color filter columns out of the charges shifted to the register one field before are not mixed in pixels, and the horizontal columns are set every 1H. Output continuously in the direction. The signal output from the imaging device in the first field (second field) is stored in the frame memory and synchronized with the signal output from the imaging device in the second field (first field). Read as you do. There are provided 1st delay means for outputting 1H delay signal, 2H delay signal,..., IH delay signal using i 1H delay circuits (i is an integer equal to or greater than 1), i i signals. Similarly, j 1H delay circuits (j is an integer equal to or greater than 1) are output from the field memory, and 1H delay signal, 2H delay signal,... JH delay signal are output. 2 delay means are provided to generate j delay signals. As described above, a plurality of horizontal scanning lines are simultaneously input to the signal processing circuit, and subjected to known processing such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix processing, white balance correction, etc., and luminance signals and color difference signals Is generated. As a result, since color signals are generated by a plurality of horizontal scanning lines, color moire is reduced as compared with the conventional method.
[0020]
In the eighth invention, the first horizontal color filter in which a plurality of color filters having different spectral sensitivities are arranged, and the color filter for the first color and the color filter for the second color are alternately arranged in the horizontal direction. A second horizontal color filter column in which columns, a color filter for the third color, and a color filter for the fourth color are alternately arranged in the horizontal direction, and the first horizontal color filter column signal A third horizontal color filter array in which color filters for colors and color filters for the second color are spatially arranged with a phase difference of 180 °, and a fourth horizontal color that is the same as the second horizontal color filter array An image pickup apparatus in which color filter arrays are sequentially and repeatedly arranged in the vertical direction is provided. The first field (or the second field) exposes the image surface to store charges, and the second field (or the first field). Feel ) In to prevent exposure by closing the shutter. In the second field (or the first field), the charge stored in the first field (or the second field) is shifted to the register, and the second and fourth of the charges shifted to the register are shifted to the register. The color signal corresponding to the horizontal color filter row is continuously output in the horizontal row direction every 1H without pixel mixing. In the first field (second field), the color signals corresponding to the first and third horizontal color filter columns out of the charges shifted to the register one field before are not mixed in pixels, and the horizontal columns are set every 1H. Output continuously in the direction. The signal output from the imaging device in the first field (second field) is stored in the frame memory and synchronized with the signal output from the imaging device in the second field (first field). Read as you do. There are provided 1st delay means for outputting 1H delay signal, 2H delay signal,..., IH delay signal using i 1H delay circuits (i is an integer equal to or greater than 1), i i signals. Similarly, j 1H delay circuits (j is an integer equal to or greater than 1) are output from the field memory, and 1H delay signal, 2H delay signal,... JH delay signal are output. 2 delay means are provided to generate j delay signals. As described above, a plurality of horizontal scanning lines are simultaneously input to the signal processing circuit, and subjected to known processing such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix processing, white balance correction, etc., and luminance signals and color difference signals Is generated. The generated luminance signal and color difference signal are converted into an intermediate format used for compression coding by a data conversion circuit and output. As a result, since color signals are generated by a plurality of horizontal scanning lines, color moire is reduced as compared with the conventional method.
[0021]
[ BEST MODE FOR CARRYING OUT THE INVENTION ]
A first embodiment of an image signal processing apparatus according to the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a first embodiment of an image signal processing apparatus according to the present invention. The image signal processing apparatus 100 includes an A / D converter 2, a Y / C separation circuit 46, a color difference signal processing unit 80, a luminance signal processing unit 90, and a field thinning circuit 10. The A / D converter 2 converts an input analog signal into a digital signal. The Y / C separation circuit 46 separates the input standard color video signal into a luminance signal and a color difference signal. The color difference signal processing means 80 includes a memory control circuit 4, a field memory 5, an adder 6, and a divider 7. The memory control circuit 4 controls writing to and reading from the field memory 5. The adder 6 adds the original signal output from the Y / C separation circuit 46 and the signal delayed by one field output from the field memory 5. The divider 7 halves the signal level output from the adder 6. The luminance signal processing means 90 includes a field thinning circuit 9 that outputs a luminance signal of only one of the A field and the B field. Similarly, the field thinning circuit 10 outputs a color difference signal for only one of the A field and the B field.
[0022]
The image signal processing means 100 having the above configuration processes the luminance signal Y and the color difference signal C output from the Y / C separation circuit 46 as shown in FIG. That is, the luminance signal Y consisting of the A field and the B field is converted into a luminance signal of one of the fields by the field thinning circuit 9, for example, Y11, Y12 of the A field (or B field). , Y13,..., Ymn (m = 1, 3, 5,... N = 1, 2, 3,...) Are used to generate luminance signals of Sy1, Sy2,. On the other hand, the color difference signal C output from the Y / C separation circuit 46 is first supplied from C11, C12, C13,..., Cmn output from the Y / C separation circuit 46, for example, in the A field (or B field). The A field line signal is stored in the field memory 5. Next, C (m + 1) 1, C (m + 1) 2, C (m + 3) 3 output from the Y / C separation circuit 46 to the B field, which is a field different from the field (A field) stored in the field memory 5. ,..., C (m + 1) n, a B field line signal (original signal) is input to the adder 6. At the same time when the B field line signal is input to the adder 6, the A field line signal stored in the field memory 5 is read out with a delay of one field and input to the adder 6. The line signal added by the adder 6 is divided into the A field and B field from the horizontal pixels of the A field and the horizontal pixels of the B field using the following equations (1) to (3) in the divider 7. A color difference signal Sc of Sc1, Sc2, Sc3,... Scn line is generated by averaging for each horizontal pixel.
[0023]
[Expression 1]

[0024]
The field thinning circuit 10 outputs only the color difference signal C generated in the B field (or A field) in this way, and thins out the color difference signal C in the A field (or B field).
[0025]
As described above, according to this embodiment, since the color difference signals are added and averaged from the two fields of the A field and the B field, the flicker pattern in which the phase is inverted by 180 ° for each field. Thus, the color moire caused by the pixel mixed image sensor can be reduced as compared with the conventional method.
[0026]
FIG. 3 is a block diagram showing the configuration of the second embodiment of the image signal processing apparatus 101 according to the present invention. In this embodiment, the image signal processing apparatus 101 includes an A / D converter 2, a Y / C separation circuit 46, a memory control circuit 21, a luminance signal processing unit 91, a color difference signal processing unit 81, a field Thinning circuits 28 and 29 are included.
The luminance signal processing means 91 includes a field memory 22, an adder 24, and a divider 26. Similarly, the color difference signal processing means 81 has a field memory 23, an adder 25, and a divider 27. The memory control circuit 21 controls writing and reading of line signals to the field memories 22 and 23.
The adder 24 of the luminance signal processing circuit 91 adds the original luminance signal output from the Y / C separation circuit 46 and the luminance signal delayed by one field output from the field memory 22. The divider 26 divides the luminance signal signal level output from the adder 24 by ½ and averages it. The field thinning circuit 28 outputs only one of the A field and the B field to thin out the luminance signal.
The adder 25 of the color difference signal processing circuit 81 adds the primary color difference signal output from the Y / C separation circuit 46 and the color difference signal delayed by one field output from the field memory 23. The divider 27 divides the signal level output from the adder 25 by ½ and averages it. The field thinning circuit 29 outputs only one of the A field and the B field to thin out the color difference signal.
[0027]
The image signal processing apparatus 101 having the above configuration processes the luminance signal Y and the color difference signal C output from the Y / C separation circuit 46 as shown in FIG. That is, the luminance signal Y output from the Y / C separation circuit 46 is first outputted from the Y / C separation circuit 46 during the A field period, for example, Y11, Y12, Y13,..., Y1n, Y31, Y32, Y33. ,..., Ymn are stored in the field memory 22, and then Y (m + 1) 1, Y (m + 1) 2, Y (m + 1) output from the Y / C separation circuit 46 during the B field period. ) 3,..., Y (m + 1) n B field line signal (original signal) is input to the adder 24. At the same time as the B field line signal is input to the adder 24, the A field line signal stored in the field memory 22 is read out with a delay of one field and input to the adder 24. The line signal added by the adder 24 is converted into the A field and B field from the horizontal pixels of the A field and the horizontal pixels of the B field by using the following equations (4) to (6) in the divider 26. A horizontal column luminance signal Sy of the Sy11, Sy12, Sy13,..., Symn line, which is averaged for each horizontal pixel, is generated. The field thinning circuit 28 outputs only the horizontal column luminance signal generated in the B field (or A field) in this way, and thins and outputs the horizontal column luminance signal of the A field (or B field).
[0028]
[Expression 2]

[0029]
On the other hand, the color difference signal C output from the Y / C separation circuit 46 is output from the Y / C separation circuit 46 in the A field, for example, C11, C12, C13,..., Cmn, as in the first embodiment. Are stored in the field memory 23 and then output from the Y / C separation circuit 46 in the B field C (m + 1) 1, C (m + 1) 2, C (m + 3) 3,. A B field line signal (original signal) composed of (m + 1) n is input to the adder 25. At the same time as the B field line signal is input to the adder 25, the A field line signal stored in the field memory 23 is read by being delayed by one field and input to the adder 25. The line signal added by the adder 25 is converted from the horizontal pixels of the A field and the horizontal pixels of the B field in the divider 27 using the equations (1) to (3). A horizontal column color difference signal Sc of Sc1, Sc2, Sc3,. The field thinning circuit 29 outputs only the horizontal column color difference signals generated in the B field (or A field) in this way, and can thin out the horizontal column color difference signals of the A field (or B field).
[0030]
As described above, according to this embodiment, since the color difference signals are added and averaged from the two fields of the A field and the B field, the phase is inverted by 180 ° for each field. Flicker-like color moire can be canceled out, color moire caused by pixel-mixed image sensors can be reduced compared to conventional methods, and luminance signals are added and averaged, resulting in a smooth image in the time direction. can do.
[0031]
【Example】
FIG. 5 is a block diagram showing a configuration of a first example in which the image signal processing circuit 100 according to the first embodiment of the present invention is used in an imaging apparatus. In this example, the image pickup apparatus 1 is provided in front of the image signal processing circuit 100 shown in the first embodiment. The image pickup apparatus operates as described in the first embodiment and operates as described above. A standard color video signal of 2n fields per second that is output by 1 is processed into a luminance signal and a color difference signal of n frames per second.
[0032]
An image pickup apparatus 1 used in this embodiment is a single plate type, includes a plurality of types of color filters having different spectral sensitivities on an image plane, and is configured to output a color video signal such as a standard color video signal. It is.
[0033]
According to this embodiment, the color difference signals are added and averaged from the two fields of the A field and the B field, so that the flicker-like color moire whose phase is inverted by 180 ° is canceled for each field. Compared with the conventional method, it is possible to reduce the color moire caused by the pixel mixed image sensor.
[0034]
FIG. 6 is a block diagram showing a second example in which the image signal processing circuit 101 according to the second embodiment of the present invention is used in an imaging apparatus, and the image signal processing circuit shown in the second embodiment. 101 is provided with the imaging device 1, operates as described in the second embodiment, and outputs a standard color video signal of 2n fields per second output by the imaging device 1 per second. Processed to generate luminance signal and color difference signal of frame. According to this embodiment, the color difference signals are added and averaged from the two fields of the A field and the B field, so that the flicker-like color moire whose phase is inverted by 180 ° is canceled for each field. Compared with the conventional method, the color moire caused by the pixel mixed image sensor can be reduced, and furthermore, since the luminance signals are added and averaged, a smooth image in the time direction can be realized.
[0035]
FIG. 7 is a block diagram showing a third embodiment of the present invention. After the image signal processing circuit 100 shown in the first embodiment, a data converter 45 for converting an input signal into an intermediate format used for image compression. Is an example. The image signal processing circuit 100 operates as described in the first embodiment to thin out the field of the standard color video signal from the image pickup apparatus 1 and outputs it to the data converter 45. The data converter 45 converts the luminance signal and color difference signal that have been thinned out into fields into a luminance signal and color difference signal of an intermediate format used for compression coding and outputs the result. According to the present embodiment, a luminance signal and a color difference signal used for compression encoding can be generated from an optical signal.
[0036]
FIG. 8 is a block diagram showing a fourth embodiment of the present invention. A data converter 45 for converting an input signal into an intermediate format used for image compression is provided after the image signal processing circuit 101 shown in the second embodiment. This is an example. The image signal processing circuit 101 operates as described in the second embodiment to thin out the field of the standard color video signal from the imaging device 1 and outputs it to the data converter 45. The data converter 45 converts the luminance signal and color difference signal that have been thinned out into fields into a luminance signal and color difference signal of an intermediate format used for compression coding and outputs the result. According to the present embodiment, it is possible to generate a luminance signal and a color difference signal used for smooth compression coding in the time direction from an optical signal.
[0037]
FIG. 9 is a block diagram showing the configuration of the image pickup apparatus according to the fifth embodiment of the present invention. This imaging device includes an imaging device 1 including an imaging unit 47 using a lens 31, a shutter 32, and an imaging device, an A / D converter 2, a field memory 33, 1H delay circuits 34, 35, and 36, and a memory control circuit. 37, an image signal processing circuit 102, a signal processing circuit 39, an image sensor driving pulse generation circuit 38, and an iris control circuit 40.
[0038]
The imaging unit 47 includes a first type in which a plurality of types of color filters having different spectral sensitivities are arranged on the image plane, and a color filter for the first color and a color filter for the second color are alternately arranged in the horizontal direction. Horizontal color filter row, a second horizontal color filter row in which color filters for the third color and color filters for the fourth color are alternately arranged in the horizontal direction, and a first horizontal color filter row signal A third horizontal color filter array in which the color filters for the first color and the color filter for the second color are arranged so that their phases are spatially different from each other by 180 °, and the same as the second horizontal color filter array The fourth horizontal color filter column is sequentially and repeatedly arranged in the vertical direction. In the first field (or the second field), the color signals corresponding to the first and third horizontal color filter columns are transmitted in one horizontal scanning period ( 1H) Horizontally every time In the second field (or first field), the color signals corresponding to the second and fourth horizontal color filter rows are continuously output in the horizontal direction every horizontal scanning period. And an imaging unit for outputting.
[0039]
The opening and closing of the shutter 32 is controlled by a shutter opening / closing control pulse 44 generated by the iris control circuit 40. The optical signal whose exposure is controlled by the shutter 32 is converted into an electric signal by the image sensor 47. The image sensor 47 is controlled by the A field read control pulse 41, the B field read control pulse 42, and the charge transfer pulse 43 generated from the image sensor drive pulse generation circuit 38, and reads the converted electric signal. At this time, the readout from the image sensor 1 is output to the A / D converter 2 so that each pixel signal is read as it is without performing the pixel mixture readout. The analog signal input to the A / D converter 2 is converted into a digital signal and output. The memory control circuit 37 stores the signals G and Mg output from the A / D converter 2 in the field memory 33 in the A field (or B field), and the B field (or A field). Then, control is performed so that the signals G and Mg are output from the field memory 33. The signal Ye and the signal Cy output from the A / D converter 2 are input to the first line signal directly input to the signal processing circuit 39 and the 1H delay circuit 34 that delays the input by one horizontal scanning period and 1 horizontal. The second line signal is output as a two-line signal delayed by the scanning period (1H). On the other hand, the signals G and Mg read from the field memory 33 with a delay of one field are input to the third line signal directly input to the signal processing circuit 39 and to the 1H delay circuit 35 and to one horizontal scanning period. The fourth line signal delayed and output to the signal processing circuit 39, and the fourth line signal are further input to the 1H delay circuit 36 and further delayed by one horizontal scanning period and output to the signal processing circuit 39. The third line signal and the fifth line signal. The signal processing circuit 39 converts the input line signal into a luminance signal and a color difference signal.
[0040]
In the present embodiment having the above configuration, the iris control circuit 40 opens the shutter 32 in the A field (or B field), closes the shutter 32 in the B field (or A field), and opens and closes the shutter 32 for each field. The shutter opening / closing signal is repeatedly output to control the opening / closing of the shutter. The imaging element drive pulse generation circuit 38 outputs shift pulses 41 to 43 for shifting the charge stored in the A field (or B field) to the register every two fields.
[0041]
The imaging device 1 controlled in this way outputs each pixel signal without pixel mixing in both the A field and the B field as shown in FIG. Signals Ye and Cy output from the imaging apparatus 1 in the A field (or B field) are stored in the field memory 33 and output in the B field (or A field). Then, in the B field (or A field), the first line signals Ye and Cy output from the imaging device 1 and the second line signal Cy and 1H delayed from the signal output from the imaging device 1 by the 1H delay circuit 34, respectively. Ye, the third line signals G and Mg output from the field memory 33, the fourth line signals Mg and G obtained by delaying the signal output from the field memory 33 by 1H, and the signal output from the field memory 33 by 2H The fifth line signals G and Mg thus synchronized are output to the signal processing circuit 39.
[0042]
The signal processing circuit 39 interpolates a signal obtained by delaying the signal output from the field memory 33 by 1H from the input 5-line signal, and generates a luminance signal and a color difference signal. An interpolation method in the signal processing circuit 39 will be described with reference to FIG. In the figure, each frame represents, for example, one pixel. First, S ₁ Line is A ₁ , B ₁ , A ₂ , B ₂ , A _Three Interpolate using lines. A ₂ Since there are no Ye and Cy pixels in the line, B ₁ Line and B ₂ Interpolate using lines. For G and Mg, A ₂ A with weights centered on the line signal ₁ , A _Three Interpolate from line. Therefore, this interpolation formula is expressed by the following formulas (7) to (10).
[0043]
[Equation 3]

[0044]
Next, S ₂ Line is A ₂ , B ₂ , A _Three , B _Three , A _Four Interpolate using lines. S ₂ S in line ₁ Considering that the pixel arrangement of G and Mg is changed for each line as compared with the line, interpolation is generated using the following equations (11) to (14).
[0045]
[Expression 4]

[0046]
As described above, the line signals can be sequentially generated by switching the interpolation coefficient every two lines. The present embodiment is an example in which 5 horizontal signal lines are generated simultaneously, and is not particularly concerned with the 5 horizontal signal lines. The interpolation coefficient in the above equation is an example of a coefficient generated by interpolation from five horizontal column signals, and is not particularly limited to this coefficient. Then, the imaging signals generated by interpolation according to the above description are subjected to known processing such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix processing, and white balance correction, and output luminance signals and color difference signals.
[0047]
As described above, according to the present embodiment, since the signal output from the imaging device 1 is weighted and interpolated from the five horizontal column signals, the filter characteristic in the vertical direction is 2 taps as in the horizontal direction. A signal processing circuit having three tap characteristics and uniform interpolation characteristics in the horizontal and vertical directions can be realized. Therefore, color moire can be reduced as compared with the conventional method.
[0048]
FIG. 12 is a block diagram showing a sixth embodiment of the present invention. This embodiment is provided with a data conversion circuit 45 for converting data into a format used for compression encoding after the signal processing circuit 39 used in the fifth embodiment, and is described in the fifth embodiment. The luminance signal and the color difference signal used for the format used for compression encoding are output. In this embodiment, the data conversion circuit 45 is provided after the luminance signal and the color difference signal are generated. However, the position where the data conversion circuit 45 is arranged is not particularly limited to this position. For example, the effect is the same even if it is provided after the output of the imaging unit 47. According to the present embodiment, it is possible to generate an intermediate format luminance signal and color difference signal used for compression encoding from an optical signal.
[0049]
【The invention's effect】
As described above, according to the present invention, color moiré is reduced in an image signal processing apparatus that generates n-frame luminance and color difference signals per second from 2n-frame standard color video signals per second. can do.
[Brief description of the drawings]
FIG. 1 is a block diagram of a first embodiment of the present invention.
FIG. 2 is a diagram showing luminance signal field decimation and color difference signal 2-field addition averaging.
FIG. 3 is a block diagram of a second embodiment of the present invention.
FIG. 4 is a diagram illustrating a luminance signal and color difference signal 2-field addition average.
FIG. 5 is a block diagram of a first embodiment of the present invention.
FIG. 6 is a block diagram of a second embodiment of the present invention.
FIG. 7 is a block diagram of a third embodiment of the present invention.
FIG. 8 is a block diagram of a fourth embodiment of the present invention.
FIG. 9 is a block diagram of a fifth embodiment of the present invention.
FIG. 10 is a diagram illustrating a color filter arrangement of the imaging apparatus.
FIG. 11 is an explanatory diagram of an interpolation method for generating each complementary color from five horizontal column signal lines.
FIG. 12 is a block diagram of a sixth exemplary embodiment of the present invention.
[Explanation of symbols]
1 Imaging device
2 A / D converter
4,37 Memory control circuit
5, 22, 23, 33 Field memory
6; 24, 25 Adder
7, 26, 27 Divider
9, 10, 28, 29 Field decimation circuit
21 Memory control circuit
31 lenses
32 Shutter
34, 35, 36 1H delay circuit
38 Drive pulse generation circuit
39 Signal processing circuit
40 Iris control circuit
41 A Field read control pulse
42 B field readout control pulse
43 Charge transfer pulse
44 Shutter open / close pulse
45 Data conversion circuit
46 Y / C separation circuit
47 Imaging unit
80, 81 color difference signal processing circuit
90, 91 Luminance signal processing circuit
100, 101, 102 Image signal processing circuit

Claims (8)

In the image signal processing apparatus for field thinned color video signal of the standard color video signal input from the outside,
A field memory in which the first field of the color difference signal of the input from the external color video signal stored one field, and outputs the content stored in the second field,
A color difference signal of the color video signal externally input to the second field, the color difference signal output from the pre-Symbol field memory in the second field are inputted to the field memory in one field before the color difference signal and An averaging means for adding and averaging,
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signal outputted from said averaging means to a second field,
A second field thinning means for thinning the luminance signal of the first field of the color video signal input from the outside is provided,
An image signal processing apparatus, wherein a color video signal such as a 2n field standard color video signal is input per second, and an n-frame luminance signal and color difference signal are generated and output per second. In the image signal processing means for field thinned color video signal of the standard color video signal input from the outside,
A field memory for the luminance signal and color difference signals of the color video signal inputted from the outside to the first field storing one field, and outputs the content stored in the second field, respectively,
And the luminance signal of the color video signal externally input to the second field, the luminance signal outputted from said field memory to a second field are inputted to the field memory before one field from the luminance signal First averaging means for calculating and averaging,
A color difference signal of the color video signal externally input to the second field, the color difference signal outputted from said field memory to a second field are inputted to the field memory in one field before the color difference signal and A second averaging means for averaging
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signals outputted from the second averaging means to the second field,
A second field thinning means for thinning the second first field luminance signals other than luminance signal output from said first averaging means in the field provided,
An image signal processing apparatus, wherein a standard color video signal of 2n fields is input per second, and a luminance signal and a color difference signal of n frames are generated and output per second. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
An imaging device for outputting a color video signal of the video signal, - with a plurality of different kinds of color filters spectral sensitivity in the image plane, a standard color of a single plate type
A field memory for a color difference signal input from the imaging device to a first field storing one field, and outputs the content stored in the second field,
Averaging the color difference signal input from the imaging device in the second field, and a color difference signal outputted from said field memory to a second field are inputted to the field memory in one field before the color difference signal An averaging means to perform,
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signal outputted from said averaging means to a second field,
A second field thinning means for thinning the luminance signal of the first field of the color video signal output from the imaging device is provided,
An image signal processing apparatus that generates and outputs a luminance signal and a color difference signal of n frames per second from a standard color video signal of 2n fields per second output by an imaging apparatus. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
An image pickup apparatus that is a single plate type and includes a plurality of types of color filters having different spectral sensitivities on the image surface, and outputs a standard color video signal;
A field memory in which the first luminance signal and color difference signal input from the imaging device stores one field in the field, to output the content stored in the second field, respectively,
A luminance signal input from the imaging device in the second field, averaging the luminance signal is output to the second field is input from the image pickup device before one field from the luminance signal from the field memory First averaging means for
Averaging the color difference signal input from the imaging device in the second field, and a color difference signal outputted from said field memory to the second field is input from the imaging device in one field before the color difference signal Second averaging means for performing,
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signals outputted from the second averaging means to the second field,
A second field thinning means for thinning the second first field luminance signals other than luminance signal output from said first averaging means in the field provided,
An image signal processing apparatus that generates and outputs a luminance signal and a color difference signal of n frames per second from a standard color video signal of 2n fields per second output from an imaging apparatus. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
An image pickup apparatus that is a single plate type and includes a plurality of types of color filters having different spectral sensitivities on the image surface, and outputs a standard color video signal;
A field memory for a color difference signal input from the imaging device to a first field storing one field, and outputs the content stored in the second field,
Averaging the color difference signal input from the imaging device in the second field, and a color difference signal outputted from said field memory to the second field is input from the imaging device in one field before the color difference signal An averaging means to perform,
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signal outputted from said averaging means to a second field,
A second field thinning means for thinning the luminance signal of the first field of the color video signal input from the imaging device,
Data conversion means for converting the signal output from the first field thinning means and the signal output from the second field thinning means into an image format used for compression encoding;
An image signal characterized by generating and outputting a luminance signal and a color difference signal in a format used for compression encoding of n frames per second from a standard color video signal of 2n fields per second output from the imaging device Processing equipment. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
An image pickup apparatus that is a single plate type and includes a plurality of types of color filters having different spectral sensitivities on the image surface, and outputs a standard color video signal;
A field memory in which the first luminance signal and color difference signal input from the imaging device stores one field in the field, to output the content stored in the second field, respectively,
A luminance signal input from the imaging device in the second field, averaging the luminance signal outputted from said field memory to the second field is input from the imaging device before one field from the luminance signal First averaging means for
Averaging the color difference signal input from the imaging device in the second field, and a color difference signal outputted from said field memory to the second field is input from the imaging device in one field before the color difference signal Second averaging means for performing,
A first field thinning means for thinning the color difference signal of the first field other than the color-difference signals outputted from the second averaging means to the second field,
A second field thinning means for thinning the luminance signal of the first field other than the luminance signal output from said first averaging means to a second field,
Data conversion means for converting the signal output from the first field thinning means and the signal output from the second field thinning means into an image format used for compression encoding;
An image signal characterized by generating and outputting a luminance signal and a color difference signal in a format used for compression encoding of n frames per second from a standard color video signal of 2n fields per second output from the imaging device Processing equipment. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
A first horizontal color filter array in which a plurality of types of color filters having different spectral sensitivities are arranged on the image plane, and color filters for the first color and color filters for the second color are alternately arranged in the horizontal direction; , A second horizontal color filter array in which color filters for the third color and color filters for the fourth color are alternately arranged in the horizontal direction, and the first color of the first horizontal color filter array signal A third horizontal color filter array in which the color filters and the color filters for the second color are spatially arranged with a phase difference of 180 °, and a fourth horizontal color filter identical to the second horizontal color filter array column is repeatedly arranged sequentially vertically in the first field continuously outputs the first and third horizontal color signals corresponding to the horizontal color filter row every horizontal scanning period (1H) Te, in the second field first When an imaging device having an imaging unit for a color signal corresponding to the fourth horizontal color filter rows, continuously outputting horizontally every horizontal scanning period,
Exposure control means for controlling exposure of the imaging unit;
A field memory for a signal input from the imaging unit to the first field storing one field, and outputs the contents the stored second field,
Using i 1H delay circuits (i is an integer of 1 or more) for delaying the signal output from the imaging unit by one horizontal period, i delay signals of 1H delay signal, 2H delay signal,. First delay means to generate;
Using 1H delay circuits for delaying the signal output from the field memory by one horizontal period (j is an integer equal to or greater than 1), j delay signals of 1H delay signal, 2H delay signal,. A second delay means for generating,
The signal input from the imaging unit, the signal output from the field memory, the i delay signals output from the first delay means, and the j delay signals output from the second delay means The delay signal is synchronized with the 2n-field signal output from the imaging unit, and known processes such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix, and white balance correction are performed for 1 second. An image signal processing device for generating and outputting n-frame luminance signals and color difference signals. In the image signal processing apparatus for field thinned color video signal of the standard color video signal inputted from the imaging device,
A first horizontal color filter array in which a plurality of types of color filters having different spectral sensitivities are arranged on the image plane, and color filters for the first color and color filters for the second color are alternately arranged in the horizontal direction; , A second horizontal color filter array in which color filters for the third color and color filters for the fourth color are alternately arranged in the horizontal direction, and the first color of the first horizontal color filter array signal A third horizontal color filter array in which the color filters and the color filters for the second color are spatially arranged with a phase difference of 180 °, and a fourth horizontal color filter identical to the second horizontal color filter array column is repeatedly arranged sequentially vertically in the first field continuously outputs the first and third horizontal color signals corresponding to the horizontal color filter row every horizontal scanning period (1H) Te, in the second field first When an imaging device having an imaging unit for a color signal corresponding to the fourth horizontal color filter rows are continuously output to the horizontal direction every horizontal scanning period (1H),
Exposure control means for controlling exposure of the imaging unit;
A field memory in which the first to field a signal input from the imaging unit stores one field, and outputs the contents of the stored in the second field,
Using i 1H delay circuits (i is an integer of 1 or more) for delaying a signal input from the imaging unit by 1 horizontal scanning period, i delay signals of 1H delay signal, 2H delay signal,... IH delay signal are used. First delay means for generating
Using 1H delay circuits for delaying a signal input from the field memory for one horizontal scanning period (j is an integer of 1 or more), 1H delay signal, 2H delay signal,... JH delay signal j delay signals Second delay means for generating
Signals output from the imaging unit (or luminance signals and color difference signals generated by performing known processing such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix, white balance correction on the signal output from the imaging unit) A data conversion means for converting to a format used for compression encoding;
The signal input from the imaging unit, the signal output from the field memory, the i delay signals output from the first delay means, and the j delay signals output from the second delay means The delay signal is synchronized with the 2n-field signal output from the imaging unit, and known processes such as luminance matrix processing, enhancer processing, gamma correction, RGB matrix, and white balance correction are performed for 1 second. An image signal processing apparatus for generating and outputting a luminance signal and a color difference signal in a format used for n-frame compression encoding.

Images