JP4292873B2 - Image processing method, image processing apparatus, and image recording apparatus - Google Patents

Description

【数３】

【数４】

【数５】

【数６】

【０１５７】
式（２）〜式（５）は、８ｂｉｔの画像データ（Ｒ_sRGB(8)、Ｇ_sRGB(8)、Ｂ_sRGB(8)）から等色関数の三刺激値（Ｘ、Ｙ、Ｚ）に変換することを示している。ここで、等色関数とは、人間の目の分光感度分布を示す関数である。ここで、式（２）〜式（５）におけるｓＲＧＢは、画像データのＲＧＢ値が、ｓＲＧＢ規格に準拠することを示し、式（２）中の（８）は、８ｂｉｔ（０〜２５５）の画像データであることを示している。
【０１５８】
また、式（６）において、Ｌ＊は輝度を示す。階調変換曲線では、輝度のみの入力値と出力値の関係を規定しているため、ａ＊ｂ＊は不要となり、Ｌ＊のみが算出される。また、式（６）のＹ_nは、標準白色板のＹを示し、Ｄ₆₅は、色温度が６５００Ｋの光を標準白色版に照明したときの刺激値を示す。式（６）では、Ｙ_n＝１である。
【０１５９】
式（６）によりＬ＊が求められると、硬さ、明るさの初期値、特定領域内の所定の位置を設定することにより、初期階調変換曲線が作成される。例えば、Ｌ＊＝２０〜５０の硬さを１．４２、Ｌ＊＝２０〜７５の硬さを１．３５、特定領域（不動領域）内の所定の位置としての入力Ｌ＊を４４．４に設定することができる。硬さ、明るさの初期値、所定の位置は、硬さ・明るさ設定部１０９又は操作部１１により、ユーザ別に設定し、階調変換曲線データメモリ１１６に記憶することが可能である。
【０１６０】
次に、初期階調変換曲線上の特定領域（不動領域）を用いて「硬さ」、「明るさ」を調整し、新たな階調変換曲線を作成する条件式の例を以下に示す。
【０１６１】
階調変換曲線の調整係数として、下記の２係数(F_C, F_L)を定義する。
▲１▼F_C：硬さの調整係数 （-2<F_C <2、F_C= 0で初期階調変換曲線）
▲２▼F_L：明るさの調整係数 （-2<F_L <2、F_L= 0で初期階調変換曲線）
これらの調整係数によって階調変換曲線を変更するために必要な変数は、式（７）のようになる。
【数７】

【０１６２】
式（７）において、Ｌは、出力Ｌ＊＝５０となる入力Ｌ＊を示し、Ｌｓは、出力Ｌ＊＝２０となる入力Ｌ＊を示し、Ｌｈは、出力Ｌ＊＝７５となる入力Ｌ＊を示し、Ｇｓは、入力Ｌ＊＝２０〜５０での硬さを示し、Ｇは、入力Ｌ＊＝２０〜７５での硬さを示す。
【０１６３】
式（７）により算出されたＬｓ、Ｌ、Ｌｈにより、(0, 0)、(Ls, 20)、(L, 50)、(Lh, 75)、(100, 100)の５点を通る滑らかな曲線は、スプライン補間の両端条件を２階微分値＝０とする３次スプライン補間により算出される。以下、スプライン補間について説明する。
【０１６４】
与えられた点をx₀、x₁、x₂、…、x_nとし、その関数値を式（８）のように定義する。
【数８】

また、これらの分点により閉区間［ａ、ｂ］を分割した小区間を次のように定義する。[x_j, x_j+1] (0≦j≦n-1)、但し、ａ＝x₀<x₁<x₂、…<x_n＝ｂ。
【０１６５】
区間［ａ、ｂ］で２階連続微分可能な３次の区分多項式は、３次スプライン関数と呼ばれ、これをs(x)と表す。この３次スプライン関数は、分割された小区間[x_j, x_j+1]毎に、式（１０）で定義される多項式s_j(x)で表せる。
【数９】

式（９）より、u₀、u₁、u₂、…、u_nを求め、下記の式（１０）に代入する。
【数１０】

【０１６６】
スプライン補間の他の具体的な例として、Math Soft 社MathCAD2000 のlspline関数、渡辺力・名取亮・小国力 監修「Fortran77による数値計算ソフトウエア」丸善株式会社２４８ページの SPLC 関数（ DF(1)=DF(2)=0, IOPT(1)=IOPT(2)=1 として使用）、黒瀬能筆・松島勇雄・松雄俊彦 共著「Ｃ言語による科学技術計算サブルーチンライブラリ」啓学出版１６２ページの SPLINT関数、三上直樹著「アルゴリズム教科書」ＣＱ出版社１１０ページのspline 関数、W.H.Press, S.A.Teukolsky, W.T.Vetterling, B.P.Flannery著「Numerical Recipes in C 日本語版」技術評論社１０６ページの spline 関数などを用いることができる。
【０１６７】
図１２に、硬さの調整係数F_Cが−２、−１、０、＋１、＋２、明るさの調整係数F_Lが０の場合の階調変換曲線を示す。図１２において、曲線ＧＰ２は、F_C＝＋２の場合を示し、曲線ＧＰ１は、F_C＝＋１の場合を示し、曲線ＧＰ０は、F_C＝０の場合を示し、曲線ＧＭ１は、F_C＝−１の場合を示し、曲線ＧＭ２は、F_C＝−２の場合を示す。
【０１６８】
図１３に、明るさの調整係数F_Lが−２、−１、０、＋１、＋２、硬さの調整係数F_Cが０の場合の階調変換曲線を示す。図１３において、曲線ＧＰ２は、F_L＝＋２の場合を示し、曲線ＧＰ１は、F_L＝＋１の場合を示し、曲線ＧＰ０は、F_L＝０の場合を示し、曲線ＧＭ１は、F_L＝−１の場合を示し、曲線ＧＭ２は、F_L＝−２の場合を示す。
【０１６９】
図１４に、明るさの調整係数F_Lが−２、−１、０、＋１、＋２、硬さの調整係数F_Cが０のときの特定領域（不動領域）の移動軌跡を示す。なお、上述の階調変換曲線の作成方法は、下記の各実施例においても適用される。また、階調変換曲線の作成方法は、上述の方法に限定されるものではない。
【０１７０】
次に、実施例１における動作を説明する。
図１５のフローチャートを参照して、実施例１における画像処理について説明する。
【０１７１】
まず、シーン参照画像データの入力が指示された後（ステップＳ１０１）、設定入力部（図示略）により、出力媒体が指定されると（ステップＳ１０２）、階調変換曲線データメモリ１１６から、ステップＳ１０２において指定された出力媒体に対応する階調変換曲線データが読み出され（ステップＳ１０３）、その読み出された階調変換曲線データに基づいて、シーン参照画像データから鑑賞画像参照データが生成される（ステップＳ１０４）。
【０１７２】
次いで、画像処理対象のシーン参照画像データが視差画像であるか否かが判定される（ステップＳ１０５）。ステップＳ１０５において、シーン参照画像データが視差画像でないと判定された場合（ステップＳ１０５；ＮＯ）、後述のステップＳ１０８に移行する。
【０１７３】
ステップＳ１０５において、シーン参照画像データが視差画像であると判定された場合（ステップＳ１０５；ＹＥＳ）、その視差画像から視差量が算出される（ステップＳ１０６）。次いで、図８のグラフに基づいて、ステップＳ１０６において算出された視差量に応じた硬さ補正値及び明るさ補正値が算出される（ステップＳ１０７）。
【０１７４】
シーン参照画像データが視差画像でない場合、硬さ・明るさ設定入力部１０９により、硬さ補正値が入力されると、その入力された硬さ補正値が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ１０８）。シーン参照画像データが視差画像である場合、硬さ・明るさ設定入力部１０９により、硬さ補正値が入力されると、その入力された硬さ補正値と、ステップＳ１０７において視差量に応じて算出された硬さ補正値の和が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ１０８）。
【０１７５】
硬さ補正値が決定されると、階調変換曲線データメモリ１１６から特定領域データが読み出され（ステップＳ１０９）、ステップＳ１０８において決定された硬さ補正値に従って階調変換曲線の修正処理が施される（ステップＳ１１０）。
【０１７６】
シーン参照画像データが視差画像でない場合、硬さ・明るさ設定入力部１０９により、明るさ補正値が入力されると、その入力された明るさ補正値が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ１１１）。シーン参照画像データが視差画像である場合、硬さ・明るさ設定入力部１０９により明るさ補正値が入力されると、その入力された明るさ補正値と、ステップＳ１０７において算出された視差量に応じて算出された明るさ補正値の和が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ１１１）。
【０１７７】
明るさ補正値が決定されると、階調変換曲線データメモリ１１６から移動軌跡データが読み出され（ステップＳ１１２）、ステップＳ１１１において決定された明るさ補正値に従って階調変換曲線の修正処理が施される（ステップＳ１１３）。次いで、修正された階調変換曲線に基づいて鑑賞画像参照データが再生成され（ステップＳ１１４）、本画像処理が終了する。
【０１７８】
以上のように、実施例１によれば、鑑賞画像参照データの硬さ補正値に基づいて階調変換曲線を調整し、明るさ補正値に基づいて階調変換曲線を調整し、それぞれの調整効果の干渉を抑制した画像処理を行うことにより、理想的な階調変換曲線の設定が可能になる。また、設定作業に係る負荷を軽減することができ、階調変換曲線の設定作業の効率化を図ることができる。更に、シーン参照画像データが視差画像である場合、その視差画像の視差量に基づいて硬さ補正値及び明るさ補正値を算出し、その硬さ補正値及び明るさ補正値に基づいて階調変換曲線を調整するようにしたことにより、立体視表示の画像の画質を向上させることができる。
【０１７９】
［実施例２］
まず、実施例２における構成を説明する。
【０１８０】
〈画像処理部の構成〉
図１６は、請求項３０に記載の発明に係る画像処理部７０の機能的構成を示すブロック図である。画像処理部７０は、図１６に示すように、画像調整処理部７０１、フィルムスキャンデータ処理部７０２、反射原稿スキャンデータ処理部７０３、画像データ書式解読処理部７０４、テンプレート処理部７０５、ＣＲＴ固有処理部７０６、プリンタ固有処理部▲１▼７０７、プリンタ固有処理部▲２▼７０８、画像データ作成処理部７０９、ヘッダ情報解析部１０２、装置特性補正処理部１０３ａ、処理条件テーブル１０３ｂ、シーン参照画像データ生成部１０４、鑑賞画像参照データ生成部１０７、階調変換曲線データメモリ１１６、撮影情報データ処理部１０６、視差量・補正値算出部１１９により構成される。以下、実施例２の画像処理部７０を構成する各部のうち、実施例１の画像処理部７０（図６参照）と異なる点のみ説明する。
【０１８１】
ヘッダ情報解析部１０２は、画像データ書式解読処理部７０４によって、画像データが、画像転送手段３０又は通信手段（入力）３２から入力されたことが判別された場合、撮像装置特性補正データと撮影情報データを解読する。
【０１８２】
撮影情報データ処理部１０６は、ヘッダ情報解析部１０２から撮影情報データに含まれる、被写体の種類と撮影情報に関する情報から、鑑賞画像参照データの硬さ補正値及び明るさ補正値を算出し（表１及び表２参照）、算出結果を鑑賞画像参照データ生成部１０７に出力する。視差量・補正値算出部１１９は、視差画像から視差量を算出し、視差量及び被写体の種類に応じた硬さ補正値及び明るさ補正値（図１８参照）を算出する。
【０１８３】
鑑賞画像参照データ生成部１０７は、階調変換曲線データとシーン参照画像データから鑑賞画像参照データを生成する。また、鑑賞画像参照データ生成部１０７は、撮影情報データ処理部１０６で算出された硬さ補正値及び明るさ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値及び明るさ補正値から、実際に階調変換曲線を修正するための硬さ補正値及び明るさ補正値を決定し、決定された硬さ補正値及び明るさ補正値に基づいて、階調変換曲線に修正（変更）処理を施して、再度、鑑賞画像参照データを生成する。
【０１８４】
〈画像処理装置の構成〉
次に、図１７のブロック図を参照して、請求項１６に記載の発明に係る画像処理装置１１５について説明する。画像処理装置１１５は、図１６の画像処理部７０の一部分を構成するもので、図１７に示すように、入力部１０１、ヘッダ情報解析部１０２、第１処理部１１３及び第２処理部１１４により構成される。第１処理部１１３には、ヘッダ情報解析部１０２が接続され、第２処理部１１４には、記憶デバイス１１０、出力デバイス１１１、表示デバイス１１２が接続される。以下、実施例２の画像処理装置１１５を構成する各部のうち、実施例１の画像処理装置１１５（図７参照）と異なる点のみ説明する。
【０１８５】
ヘッダ情報解析部１０２は、入力部１０１から読み出された画像データのヘッダ情報を解析し、被写体情報と、当該画像データに添付された撮像装置特性補正データと、撮影情報データに分ける。
【０１８６】
第１処理部１１３は、装置特性補正処理部１０３ａ、処理条件テーブル１０３ｂ、シーン参照画像データ生成部１０４、一時記憶メモリ１０５、視差量・補正値算出部１１９により構成される。第１処理部１１３において、視差量・補正値算出部１１９以外の構成説明は、実施例１での説明と同一ゆえ、ここでは省略する。
【０１８７】
視差量・補正値算出部１１９は、視差画像から視差量を算出し、図１８（ａ）に示す視差量と硬さ補正値の関係から、被写体の種類及び算出された視差量に応じた硬さ補正値を算出する。また、視差量・補正値算出部１１９は、図１８（ｂ）に示す視差量と明るさ補正値の関係から、被写体の種類及び算出された視差量に応じた明るさ補正値を算出する。図１８（ａ）では、被写体が人物である場合、視差量が大きくなるほど階調を軟調化し、被写体が風景や静物である場合、視差量が大きくなるほど階調を硬調化するように硬さ補正値が設定されている。図１８（ｂ）では、被写体が人物である場合、視差量が大きくなるほど明るくし、被写体が静物である場合、視差量に関係なく明るさを不変にするように明るさ補正値が設定されている。
【０１８８】
第２処理部１１４は、鑑賞画像参照データ生成部１０７、一時記憶メモリ１０８、階調変換曲線データメモリ１１６、撮影情報データ処理部１０６により構成される。一時記憶メモリ１０８及び階調変換曲線データメモリ１１６の構成説明は、実施例１での説明と同一ゆえ、ここでは省略する。
【０１８９】
撮影情報データ処理部１０６は、ヘッダ情報解析部１０２から入力された撮影情報データに含まれる被写体の種類に関する情報から、鑑賞画像参照データの硬さ補正値を算出し、撮影情報データに含まれる撮影条件に関する情報から、鑑賞画像参照データの明るさ補正値を算出し、算出結果を鑑賞画像参照データ生成部１０７に出力する。
【０１９０】
以下、被写体の種類に応じて階調変換曲線の硬さを調整する条件を例示する。表１に、各被写体毎の初期階調変換曲線からの硬さ（Ｌ＊２０〜７５）の差（Δ硬さ）及びFc値（硬さの調整係数）の参考値を示す。
【表１】

【０１９１】
次に、撮影条件に応じて該階調変換曲線の明るさ（明度）を調整する条件を例示する。表２に、各撮影条件毎の初期階調変換曲線からの明るさ（Ｌ＊５０）の差（Δ明るさ）及びF_L値（明るさの調整係数）の参考値を示す。
【表２】

【０１９２】
鑑賞画像参照データ生成部１０７は、一時記憶メモリ１０５に記憶されたシーン参照画像データが読み出され、設定入力部（図示略）により出力媒体が指定されると、階調変換曲線データメモリ１１６から、指定された出力媒体に対応する階調変換曲線データを読み出し、読み出した階調変換曲線データに基づいて、鑑賞画像参照データを生成する。
【０１９３】
また、鑑賞画像参照データ生成部１０７は、撮影情報データ処理部１０６により算出された硬さ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値の和を、実際の階調変換曲線を修正するための硬さ補正値として決定し、階調変換曲線データメモリ１１６から、特定領域データを読み出し、決定された硬さ補正値に基づいて階調変換曲線の修正（変更）処理を行う。更に、鑑賞画像参照データ生成部１０７は、撮影情報データ処理部１０６により算出された明るさ補正値と、視差量・補正値算出部１１９により算出された明るさ補正値の和を、実際の階調変換曲線を修正するための明るさ補正値として決定し、階調変換曲線データメモリ１１６から、移動軌跡データを読み出し、決定された明るさ補正値に基づいて階調変換曲線の修正（変更）処理を行う。また、鑑賞画像参照データ生成部１０７は、修正された階調変換曲線に基づいて、鑑賞画像参照データを再生成する。
【０１９４】
なお、上述では、撮影情報データ処理部１０６により算出された硬さ補正値（Ｃ）と、視差量・補正値算出部１１９により算出された硬さ補正値（Ｄ）の和（Ｃ＋Ｄ）を、実際に階調変換曲線を修正するための硬さ補正値として決定するようにしたが、これに限定されない。明るさ補正値の決定についても同様である。
【０１９５】
次に、実施例２における動作を説明する。
図１９のフローチャートを参照して、実施例２における画像処理について説明する。
【０１９６】
まず、シーン参照画像データの入力が指示された後（ステップＳ２０１）、設定入力部（図示略）により、出力媒体が指定されると（ステップＳ２０２）、階調変換曲線データメモリ１１６から、ステップＳ２０２において指定された出力媒体に対応する階調変換曲線データが読み出され（ステップＳ２０３）、その読み出された階調変換曲線データに基づいて、シーン参照画像データから鑑賞画像参照データが生成される（ステップＳ２０４）。
【０１９７】
次いで、画像処理対象のシーン参照画像データが視差画像であるか否かが判定される（ステップＳ２０５）。ステップＳ２０５において、シーン参照画像データが視差画像であると判定された場合（ステップＳ２０５；ＹＥＳ）、その視差画像から視差量が算出される（ステップＳ２０６）。次いで、ヘッダ情報解析部１０２から、シーン参照画像データのヘッダに記録されている撮影情報データが読み出され、被写体の種類が特定される。そして、図１８のグラフに基づいて、特定された被写体の種類と、ステップＳ２０６において算出された視差量に対応する硬さ補正値及び明るさ補正値が算出される（ステップＳ２０７）。
【０１９８】
ステップＳ２０５において、シーン参照画像データが視差画像でないと判定された場合（ステップＳ２０５；ＮＯ）、ヘッダ情報解析部１０２から、シーン参照画像データのヘッダに記録されている撮影情報データが読み出され、被写体の種類が特定される。そして、特定された被写体の種類から、例えば、表１に基づいて、硬さ補正値が算出され、この算出された硬さ補正値が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ２０８）。
【０１９９】
シーン参照画像データが視差画像である場合は、ステップＳ２０７において特定された被写体の種類から、表１に基づいて、硬さ補正値が算出され、この算出された硬さ補正値と、ステップＳ２０７において算出された硬さ補正値の和が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ２０８）。硬さ補正値が決定されると、階調変換曲線データメモリ１１６から特定領域データが読み出され（ステップＳ２０９）、ステップＳ２０８において決定された硬さ補正値に従って階調変換曲線の修正処理が施される（ステップＳ２１０）。
【０２００】
次いで、ヘッダ情報解析部１０２から、シーン参照画像データのヘッダに記録されている撮影情報データが読み出され、撮影条件が特定される。そして、特定された撮影条件から、例えば、表２に基づいて、明るさ補正値が算出され、この算出された明るさ補正値と、ステップＳ２０７において算出された明るさ補正値の和が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ２１１）。
【０２０１】
明るさ補正値が決定されると、階調変換曲線データメモリ１１６から移動軌跡データが読み出され（ステップＳ２１２）、ステップＳ２１１において決定された明るさ補正値に従って階調変換曲線の修正処理が施される（ステップＳ２１３）。次いで、修正された階調変換曲線に基づいて鑑賞画像参照データが再生成され（ステップＳ２１４）、本画像処理が終了する。
【０２０２】
以上のように、実施例２によれば、被写体の種類に応じて鑑賞画像参照データの硬さ補正値を決定して、硬さ補正値に基づいて階調変換曲線を調整し、撮影条件に応じて鑑賞画像参照データの明るさ補正値を決定して、明るさ補正値に基づいて階調変換曲線を調整することにより、理想的な階調変換曲線の設定が可能になる。また、階調変換曲線の設定作業に係る負荷を軽減することができ、階調変換曲線の設定作業が更に効率化される。更に、シーン参照画像データが視差画像である場合、その視差画像の視差量及び被写体の種類に基づいて硬さ補正値及び明るさ補正値を算出し、その硬さ補正値及び明るさ補正値に基づいて階調変換曲線を調整するようにしたことにより、立体視表示の画像の画質を一層向上させることができる。
【０２０３】
［実施例３］
まず、実施例３における構成を説明する。
【０２０４】
〈画像処理部の構成〉
図２０は、請求項３１に記載の発明に係る画像処理部７０の機能的構成を示すブロック図である。画像処理部７０は、図２０に示すように、画像調整処理部７０１、フィルムスキャンデータ処理部７０２、反射原稿スキャンデータ処理部７０３、画像データ書式解読処理部７０４、テンプレート処理部７０５、ＣＲＴ固有処理部７０６、プリンタ固有処理部▲１▼７０７、プリンタ固有処理部▲２▼７０８、画像データ作成処理部７０９、ヘッダ情報解析部１０２、装置特性補正処理部１０３ａ、処理条件テーブル１０３ｂ、シーン参照画像データ生成部１０４、鑑賞画像参照データ生成部１０７、階調変換曲線データメモリ１１６、撮影情報データ処理部１０６、条件算出部３０３、視差量・補正値算出部１１９により構成される。以下、実施例３の画像処理部７０を構成する各部のうち、実施例２の画像処理部７０（図１６参照）と異なる点のみ説明する。
【０２０５】
撮影情報データ処理部１０６は、ヘッダ情報解析部１０２から撮影情報データに含まれる、被写体の種類と撮影情報に関する情報から、被写体の種類と撮影条件の特定の組み合わせがあるか否かを判別し、特定の組み合わせがあれば、その組み合わせのデータを条件算出部３０３に出力する。
【０２０６】
条件算出部３０３は、被写体の種類と撮影情報の組み合わせ毎に、適合する硬さ補正値及び明るさ補正値のデータを予め格納しており（後述の表３参照）、撮影情報データ処理部１０６から入力された組み合わせのデータに従って、鑑賞画像参照データの硬さ補正値及び明るさ補正値を算出する。
【０２０７】
鑑賞画像参照データ生成部１０７は、階調変換曲線データとシーン参照画像データから鑑賞画像参照データを生成する。また、鑑賞画像参照データ生成部１０７は、条件処理部３０３で算出された硬さ補正値及び明るさ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値及び明るさ補正値から、実際に階調変換曲線を修正するための硬さ補正値及び明るさ補正値を決定し、決定された硬さ補正値及び明るさ補正値に基づいて、階調変換曲線に修正（変更）処理を施して、再度、鑑賞画像参照データを生成する。
【０２０８】
〈画像処理装置の構成〉
次に、図２１のブロック図を参照して、請求項１７に記載の発明に係る画像処理装置１１５について説明する。画像処理装置１１５は、図２０の画像処理部７０の一部分を構成するもので、図２１に示すように、入力部１０１、ヘッダ情報解析部１０２、第１処理部１１３及び第２処理部１１４により構成される。第１処理部１１３には、ヘッダ情報解析部１０２が接続され、第２処理部１１４には、記憶デバイス１１０、出力デバイス１１１、表示デバイス１１２が接続される。以下、実施例３の画像処理装置１１５を構成する各部のうち、実施例２の画像処理装置１１５（図１７参照）と異なる点のみ説明する。
【０２０９】
ヘッダ情報解析部１０２及び第１処理部１１３の構成説明は、実施例２での説明と同一ゆえ、ここでは省略する。
【０２１０】
第２処理部１１４は、鑑賞画像参照データ生成部１０７、一時記憶メモリ１０８、階調変換曲線データメモリ１１６、撮影情報データ処理部１０６、条件算出部３０３により構成される。一時記憶メモリ１０８及び階調変換曲線データメモリ１１６の構成説明は、実施例１での説明と同一ゆえ、ここでは省略する。
【０２１１】
撮影情報データ処理部１０６は、ヘッダ情報解析部１０２から撮影情報データに含まれる、被写体の種類と撮影情報に関する情報から、被写体の種類と撮影条件の特定の組み合わせがあるか否かを判別し、特定の組み合わせがあれば、その組み合わせのデータを条件算出部３０３に出力する。
【０２１２】
条件算出部３０３は、被写体の種類と撮影情報の組み合わせ毎に、適合する硬さ補正値及び明るさ補正値のデータを予め格納（後述の表３参照）しており、撮影情報データ処理部１０６から入力された組み合わせのデータに従って、鑑賞画像参照データの硬さ補正値及び明るさ補正値を算出する。
【０２１３】
以下、特定の被写体の種類と撮影条件の組み合わせによる、硬さ補正値と明るさ（明度）補正値の設定例を示す。表３に、被写体の種類がポートレート、撮影条件がストロボ及び逆光である場合の、初期階調変換曲線からの硬さ（Ｌ＊２０〜７５）の差（Δ硬さ）及び対応するFc値（硬さの調整係数）と、初期階調変換曲線からの明るさ（Ｌ＊５０）の差（Δ明るさ）及び対応するF_L値（明るさの調整係数）の参考値を示す。
【表３】

【０２１４】
鑑賞画像参照データ生成部１０７は、一時記憶メモリ１０５に記憶されたシーン参照画像データが読み出され、設定入力部（図示略）により出力媒体が指定されると、階調変換曲線データメモリ１１６から、指定された出力媒体に対応する階調変換曲線データを読み出し、読み出した階調変換曲線データに基づいて、鑑賞画像参照データを生成する。
【０２１５】
また、鑑賞画像参照データ生成部１０７は、条件処理部３０３により算出された硬さ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値の和を、実際の階調変換曲線を修正するための硬さ補正値として決定し、階調変換曲線データメモリ１１６から、特定領域データを読み出し、決定された硬さ補正値に基づいて階調変換曲線の修正（変更）処理を行う。更に、鑑賞画像参照データ生成部１０７は、条件処理部３０３により算出された明るさ補正値と、視差量・補正値算出部１１９により算出された明るさ補正値の和を、実際の階調変換曲線を修正するための明るさ補正値として決定し、階調変換曲線データメモリ１１６から、移動軌跡データを読み出し、決定された明るさ補正値に基づいて階調変換曲線の修正（変更）処理を行う。また、鑑賞画像参照データ生成部１０７は、修正された階調変換曲線に基づいて、鑑賞画像参照データを再生成する。
【０２１６】
なお、上述では、条件処理部３０３により算出された硬さ補正値（Ｅ）と、視差量・補正値算出部１１９により算出された硬さ補正値（Ｆ）の和（Ｅ＋Ｆ）を、実際に階調変換曲線を修正するための硬さ補正値として決定するようにしたが、これに限定されない。明るさ補正値の決定についても同様である。
【０２１７】
次に、実施例３における動作を説明する。
図２２のフローチャートを参照して、実施例３における画像処理について説明する。
【０２１８】
まず、シーン参照画像データの入力が指示された後（ステップＳ３０１）、設定入力部（図示略）により、出力媒体が指定されると（ステップＳ３０２）、階調変換曲線データメモリ１１６から、ステップＳ３０２において指定された出力媒体に対応する階調変換曲線データが読み出され（ステップＳ３０３）、その読み出された階調変換曲線データに基づいて、シーン参照画像データから鑑賞画像参照データが生成される（ステップＳ３０４）。
【０２１９】
次いで、画像処理対象のシーン参照画像データが視差画像であるか否かが判定される（ステップＳ３０５）。ステップＳ３０５において、シーン参照画像データが視差画像であると判定された場合（ステップＳ３０５；ＹＥＳ）、その視差画像から視差量が算出される（ステップＳ３０６）。次いで、ヘッダ情報解析部１０２から、シーン参照画像データのヘッダに記録されている撮影情報データが読み出され、被写体の種類が特定される。そして、図１８のグラフに基づいて、特定された被写体の種類と、ステップＳ３０６において算出された視差量に対応する硬さ補正値及び明るさ補正値が算出される（ステップＳ３０７）。
【０２２０】
ステップＳ３０５において、シーン参照画像データが視差画像でないと判定された場合（ステップＳ３０５；ＮＯ）、ヘッダ情報解析部１０２から、シーン参照画像データのヘッダに記録されている撮影情報データが読み出され、被写体の種類及び撮影条件が特定される。そして、特定された被写体の種類及び撮影条件の組み合わせから、例えば、表３に基づいて、硬さ補正値及び明るさ補正値が算出され、これら算出された硬さ補正値及び明るさ補正値が、実際に階調変換曲線を修正するための硬さ補正値及び明るさ補正値として決定される（ステップＳ３０８）。
【０２２１】
シーン参照画像データが視差画像である場合は、被写体の種類及び撮影条件の組み合わせに基づいて算出された硬さ補正値と、ステップＳ３０７において視差量に応じて算出された硬さ補正値の和が、実際に階調変換曲線を修正するための硬さ補正値として決定される。また、被写体の種類及び撮影条件の組み合わせに基づいて算出された明るさ補正値と、ステップＳ３０７において視差量に応じて算出された明るさ補正値の和が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ３０８）。
【０２２２】
硬さ補正値及び明るさ補正値が決定されると、階調変換曲線データメモリ１１６から特定領域データが読み出され（ステップＳ３０９）、ステップＳ３０８において決定された硬さ補正値に従って階調変換曲線の修正処理が施される（ステップＳ３１０）。
【０２２３】
次いで、階調変換曲線データメモリ１１６から移動軌跡データが読み出され（ステップＳ３１１）、ステップＳ３０８において決定された明るさ補正値に従って階調変換曲線の修正処理が施される（ステップＳ３１２）。次いで、修正された階調変換曲線に基づいて鑑賞画像参照データが再生成され（ステップＳ３１３）、本画像処理が終了する。
【０２２４】
以上のように、実施例３によれば、被写体の種類及び撮影条件の組み合わせに応じて、鑑賞画像参照データの硬さ補正値及び明るさ補正値を決定して、その決定された硬さ補正値及び明るさ補正値に基づいて階調変換曲線の調整を行うようにしたことにより、階調変換曲線の設定作業に係る負荷を軽減することができ、階調変換曲線の設定作業が更に効率化される。更に、シーン参照画像データが視差画像である場合、その視差画像の視差量及び被写体の種類に基づいて硬さ補正値及び明るさ補正値を算出し、その硬さ補正値及び明るさ補正値に基づいて階調変換曲線を調整するようにしたことにより、立体視表示の画像の画質を一層向上させることができる。
【０２２５】
［実施例４］
まず、実施例４における構成を説明する。
【０２２６】
〈画像処理部の構成〉
図２３は、請求項３２に記載の発明に係る画像処理部７０の機能的構成を示すブロック図である。画像処理部７０は、図２３に示すように、画像調整処理部７０１、フィルムスキャンデータ処理部７０２、反射原稿スキャンデータ処理部７０３、画像データ書式解読処理部７０４、テンプレート処理部７０５、ＣＲＴ固有処理部７０６、プリンタ固有処理部▲１▼７０７、プリンタ固有処理部▲２▼７０８、画像データ作成処理部７０９、ヘッダ情報解析部１０２、装置特性補正処理部１０３ａ、処理条件テーブル１０３ｂ、シーン参照画像データ生成部１０４、鑑賞画像参照データ生成部１０７、階調変換曲線データメモリ１１６、硬さ・明るさ設定入力部１０９、彩度補正データ算出部３０４、視差量・補正値算出部１１９により構成される。以下、実施例４の画像処理部７０を構成する各部のうち、実施例１の画像処理部７０（図６参照）と異なる点のみ説明する。
【０２２７】
彩度補正データ算出部３０４は、硬さ・明るさ設定入力部１０９により指定された硬さ補正値（及び視差量に応じて算出された硬さ補正値）に基づいて、鑑賞画像参照データの彩度調整量を算出する。
【０２２８】
鑑賞画像参照データ生成部１０７は、階調変換曲線データとシーン参照画像データから鑑賞画像参照データを生成する。また、鑑賞画像参照データ生成部１０７は、硬さ・明るさ設定入力部１０７により指定された硬さ補正値及び明るさ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値及び明るさ補正値から、実際に階調変換曲線を修正するための硬さ補正値及び明るさ補正値を決定し、決定された硬さ補正値及び明るさ補正値に基づいて、階調変換曲線に修正（変更）処理を施す。更に、鑑賞画像参照データ生成部１０７は、修正された階調変換曲線と、彩度補正データ算出部３０４により算出された彩度調整量に基づいて、再度、鑑賞画像参照データを生成する。
【０２２９】
〈画像処理装置の構成〉
次に、図２４のブロック図を参照して、請求項１８に記載の発明に係る画像処理装置１１５について説明する。画像処理装置１１５は、図２３の画像処理部７０の一部分を構成するもので、図２４に示すように、入力部１０１、ヘッダ情報解析部１０２、第１処理部１１３及び第２処理部１１４により構成される。第１処理部１１３には、ヘッダ情報解析部１０２が接続され、第２処理部１１４には、記憶デバイス１１０、出力デバイス１１１、表示デバイス１１２が接続される。以下、実施例４の画像処理装置１１５を構成する各部のうち、実施例１の画像処理装置１１５（図７参照）と異なる点のみ説明する。
【０２３０】
ヘッダ情報解析部１０２及び第１処理部１１３の構成説明は、実施例１での説明と同一ゆえ、ここでは省略する。
【０２３１】
第２処理部１１４は、鑑賞画像参照データ生成部１０７、一時記憶メモリ１０８、階調変換曲線データメモリ１１６、硬さ・明るさ設定入力部１０９、彩度補正データ算出部３０４により構成される。一時記憶メモリ１０８、階調変換曲線データメモリ１１６及び硬さ・明るさ設定入力部１０９の構成説明は、実施例１での説明と同一ゆえ、ここでは省略する。
【０２３２】
彩度補正データ算出部３０４は、硬さ・明るさ設定入力部１０９により指定された硬さ補正値（及び視差量に応じて算出された硬さ補正値）に基づいて、鑑賞画像参照データの彩度調整量を算出する。以下、硬さ補正値によって階調変換曲線を調整した程度に応じて、彩度調整量を算出する定義式の一例を示す。指定された硬さ補正値に対応する硬さの調整係数をＦｃ、硬さ（Ｌ＊２５〜７５）の初期階調変換曲線からの差（Δ硬さ）をＤＧ、彩度調整量（％）をＰＳとすると、彩度調整量ＰＳは、下記の式（１１）のように表される。
【数１１】

式（１１）では、硬さの調整量が０、即ち、硬さの調整係数が０であるときの彩度調整量（強調量）が＋１０％（強調）に設定される場合を示している。図２５に、式（１１）が示すＤＧ（＝Δγ）とＰＳの関係を示す。
【０２３３】
鑑賞画像参照データ生成部１０７は、一時記憶メモリ１０５に記憶されたシーン参照画像データが読み出され、設定入力部（図示略）により出力媒体が指定されると、階調変換曲線データメモリ１１６から、指定された出力媒体に対応する階調変換曲線データを読み出し、読み出した階調変換曲線データに基づいて、鑑賞画像参照データを生成する。
【０２３４】
また、鑑賞画像参照データ生成部１０７は、硬さ・明るさ設定入力部１０９から入力された硬さ補正値と、視差量・補正値算出部１１９により算出された硬さ補正値の和を、実際に階調変換曲線を修正するための硬さ補正値として決定し、階調変換曲線データメモリ１１６から、特定領域データを読み出し、決定された硬さ補正値に基づいて階調変換曲線の修正（変更）処理を行う。更に、鑑賞画像参照データ生成部１０７は、硬さ・明るさ設定入力部１０９から入力された明るさ補正値と、視差量・補正値算出部１１９により算出された明るさ補正値の和を、実際に階調変換曲線を修正するための明るさ補正値として決定し、階調変換曲線データメモリ１１６から、移動軌跡データを読み出し、決定された明るさ補正値に基づいて階調変換曲線の修正（変更）処理を行う。また、鑑賞画像参照データ生成部１０７は、修正された階調変換曲線と、彩度補正データ算出部３０４により算出された彩度調整量に基づいて、再度、鑑賞画像参照データを生成する。
【０２３５】
なお、上述では、硬さ・明るさ設定入力部１０９から入力された硬さ補正値（Ａ）と、視差量・補正値算出部１１９により算出された硬さ補正値（Ｂ）の和（Ａ＋Ｂ）を、実際に階調変換曲線を修正するための硬さ補正値として決定するようにしたが、これに限定されない。明るさ補正値の決定についても同様である。
【０２３６】
次に、次に、実施例４における動作を説明する。
図２６のフローチャートを参照して、実施例４における画像処理について説明する。
【０２３７】
まず、シーン参照画像データの入力が指示された後（ステップＳ４０１）、設定入力部（図示略）により、出力媒体が指定されると（ステップＳ４０２）、階調変換曲線データメモリ１１６から、ステップＳ４０２において指定された出力媒体に対応する階調変換曲線データが読み出され（ステップＳ４０３）、その読み出された階調変換曲線データに基づいて、シーン参照画像データから鑑賞画像参照データが生成される（ステップＳ４０４）。
【０２３８】
次いで、画像処理対象のシーン参照画像データが視差画像であるか否かが判定される（ステップＳ４０５）。ステップＳ４０５において、シーン参照画像データが視差画像でないと判定された場合（ステップＳ４０５；ＮＯ）、後述のステップＳ４０８に移行する。
【０２３９】
ステップＳ４０５において、シーン参照画像データが視差画像であると判定された場合（ステップＳ４０５；ＹＥＳ）、その視差画像から視差量が算出される（ステップＳ４０６）。次いで、図８のグラフに基づいて、ステップＳ４０６において算出された視差量に応じた硬さ補正値及び明るさ補正値が算出される（ステップＳ４０７）。
【０２４０】
シーン参照画像データが視差画像でない場合、硬さ・明るさ設定入力部１０９により、硬さ補正値が入力されると、その入力された硬さ補正値が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ４０８）。シーン参照画像データが視差画像である場合、硬さ・明るさ設定入力部１０９により、硬さ補正値が入力されると、その入力された硬さ補正値と、ステップＳ４０７において視差量に応じて算出された硬さ補正値の和が、実際に階調変換曲線を修正するための硬さ補正値として決定される（ステップＳ４０８）。
【０２４１】
硬さ補正値が決定されると、階調変換曲線データメモリ１１６から特定領域データが読み出され（ステップＳ４０９）、ステップＳ４０８において決定された硬さ補正値に従って階調変換曲線の修正処理が施される（ステップＳ４１０）。
【０２４２】
シーン参照画像データが視差画像でない場合、硬さ・明るさ設定入力部１０９により、明るさ補正値が入力されると、その入力された明るさ補正値が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ４１１）。シーン参照画像データが視差画像である場合、硬さ・明るさ設定入力部１０９により、明るさ補正値が入力されると、その入力された明るさ補正値と、ステップＳ４０７において視差量に応じて算出された明るさ補正値の和が、実際に階調変換曲線を修正するための明るさ補正値として決定される（ステップＳ４１１）。
【０２４３】
明るさ補正値が決定されると、階調変換曲線データメモリ１１６から移動軌跡データが読み出され（ステップＳ４１２）、ステップＳ４１１において決定された明るさ補正値に従って階調変換曲線の修正処理が施される（ステップＳ４１３）。
【０２４４】
次いで、ステップＳ４０８において決定された硬さ補正値に基づいて彩度調整量が算出される（ステップＳ４１４）。次いで、修正処理が施された階調変換曲線と、彩度調整量に基づいて、鑑賞画像参照データが再生成され（ステップＳ４１５）、本画像処理が終了する。
【０２４５】
以上のように、実施例４によれば、鑑賞画像参照データの硬さ補正値に基づいて階調変換曲線を調整し、明るさ補正値に基づいて階調変換曲線を調整し、硬さ補正値に基づいて彩度調整量を決定し、調整（修正）された階調変換曲線及び彩度調整量に基づいて鑑賞画像参照データを生成するようにしたことにより、階調変換曲線の設定作業に係る負荷を軽減することができ、理想的な階調変換曲線の設定作業が更に効率化される。更に、シーン参照画像データが視差画像である場合、その視差画像の視差量に基づいて硬さ補正値及び明るさ補正値を算出し、その硬さ補正値及び明るさ補正値に基づいて階調変換曲線を調整するようにしたことにより、立体視表示の画像の画質を向上させることができる。
【０２４６】
なお、上記各実施の形態における記述内容は、本発明の趣旨を逸脱しない範囲で適宜変更可能である。
【０２４７】
例えば、実施例２と実施例３を組み合わせることにより、被写体の種類に応じて鑑賞画像参照データの硬さを設定し、撮影条件に応じて鑑賞画像参照データの明るさを設定し、被写体の種類と撮影条件の組み合わせによって、鑑賞画像参照データの硬さと明るさを設定するようにしてもよい。
【０２４８】
また、実施例２と実施例４を組み合わせることにより、被写体の種類に応じて鑑賞画像参照データの硬さを設定し、撮影条件に応じて鑑賞画像参照データの明るさを設定し、鑑賞画像参照データの硬さを調整した程度に応じて、鑑賞画像参照データの彩度を調整するようにしてもよい。
【０２４９】
更に、実施例３と実施例４を組み合わせることにより、被写体の種類と撮影条件の組み合わせによって、鑑賞画像参照データの硬さと明るさを設定し、鑑賞画像参照データの硬さを調整した程度に応じて、鑑賞画像参照データの彩度を調整するようにしてもよい。
【０２５０】
また、実施例２と実施例３と実施例４を組み合わせることにより、被写体の種類に応じて鑑賞画像参照データの硬さを設定し、撮影条件に応じて鑑賞画像参照データの明るさを設定するとともに、被写体の種類と撮影条件の組み合わせによって、鑑賞画像参照データの硬さと明るさを設定し、鑑賞画像参照データの硬さを調整した程度に応じて、鑑賞画像参照データの彩度を調整するようにしてもよい。
【０２５１】
【発明の効果】
本発明によれば、シーン参照画像データが視差画像である場合、その視差画像の視差量に基づいて硬さ補正値及び明るさ補正値を決定し、その硬さ補正値及び明るさ補正値に基づいて、シーン参照画像データから鑑賞画像参照データへの変換を示す階調変換曲線を調整するようにしたことにより、立体視表示の画像の画質を向上させることができる。また、階調変換曲線上の所定の位置を含む特定領域を不動領域として、階調変換曲線の形状を変更することによって鑑賞画像参照データの硬さを調整し、特定領域が予め定義された曲線状を移動するように、階調変換曲線の形状を変更することによって鑑賞画像参照データの明るさを調整することにより、階調変換曲線の設定作業の効率化を図ることができる。また、明るさ変動が抑制された、鑑賞画像参照データの硬さ調整が可能になる。更に、硬さ変動が抑制された、鑑賞画像参照データの明るさ調整が可能になる。
【０２５２】
また、被写体の種類に応じて鑑賞画像参照データの硬さを調整し、撮影条件に応じて鑑賞画像参照データの明るさを調整することにより、階調変換曲線の設定作業を効率化することができる。また、特定の被写体の種類及び撮影条件の組み合わせに応じて鑑賞画像参照データの硬さ及び明るさを調整することにより、階調変換曲線の設定作業を更に効率化することができる。
【０２５３】
更に、鑑賞画像参照データの硬さの補正値に応じて、当該鑑賞画像参照データの彩度を調整可能にしたことにより、階調変換曲線の設定作業が効率化されるとともに、好ましい鑑賞画像参照データを得ることができる。
【図面の簡単な説明】
【図１】シーン参照画像データを鑑賞画像参照データに変換するための階調変換曲線を示す図。
【図２】図１の階調変換曲線上の所定の位置１と、その所定の位置１を含む特定領域２を示す図。
【図３】図２の特定領域２の移動軌跡を説明するための図。
【図４】本実施の形態における画像記録装置１の外観構成を示す斜視図である。
【図５】画像記録装置１の内部構成を示すブロック図である。
【図６】本発明の実施例１における画像処理部７０の機能的構成を示すブロック図。
【図７】本発明の実施例１における画像処理装置１１５の機能的構成を示すブロック図。
【図８】視差量と硬さ補正値の関係（同図（ａ））と、視差量と明るさ補正値の関係（同図（ｂ））を示す図。
【図９】視差量の算出方法を説明するための図。
【図１０】被写体の検出方法を説明するための図。
【図１１】被写体の検出方法を説明するための図。
【図１２】階調変換曲線の一例を示す図。
【図１３】階調変換曲線の一例を示す図。
【図１４】階調変換曲線における特定領域（不動領域）の移動軌跡の一例を示す図。
【図１５】実施例１における画像処理を示すフローチャート。
【図１６】本発明の実施例２における画像処理部７０の機能的構成を示すブロック図。
【図１７】本発明の実施例２における画像処理装置１１５の機能的構成を示すブロック図。
【図１８】被写体の種類別の視差量と硬さ補正値の関係（同図（ａ））と、被写体の種類別の視差量と明るさ補正値の関係（同図（ｂ））を示す図。
【図１９】実施例２における画像処理を示すフローチャート。
【図２０】本発明の実施例３における画像処理部７０の機能的構成を示すブロック図。
【図２１】本発明の実施例３における画像処理装置１１５の機能的構成を示すブロック図。
【図２２】実施例３における画像処理を示すフローチャート。
【図２３】本発明の実施例４における画像処理部７０の機能的構成を示すブロック図。
【図２４】本発明の実施例４における画像処理装置１１５の機能的構成を示すブロック図。
【図２５】硬さ（Ｌ＊２５〜７５）の初期階調変換曲線からの差ＤＧ（Δγ）と、彩度調整量ＰＳ（％）の関係を示す図。
【図２６】実施例４における画像処理を示すフローチャート。
【符号の説明】
１ 画像記録装置
４ 露光処理部
５ プリント作成部
７ 制御部
８ ＣＲＴ
９ フィルムスキャナ部
１０ 反射原稿入力装置
１１ 操作部
１２ 情報入力手段
１４ 画像読込部
１５ 画像書込部
３０ 画像転送手段
３１ 画像搬送部
３２ 通信手段（入力）
３３ 通信手段（出力）
５１ 外部プリンタ
７０ 画像処理部
７０１ 画像調整処理部
７０２ フィルムスキャンデータ処理部
７０３ 反射原稿スキャンデータ処理部
７０４ 画像データ書式解読処理部
７０５ テンプレート処理部
７０６ ＣＲＴ固有処理部
７０７ プリント固有処理部▲１▼
７０８ プリント固有処理部▲２▼
７０９ 画像データ作成処理部
７１ データ蓄積手段
７２ テンプレート記憶手段
１０１ 入力部
１０２ ヘッダ情報解析部
１０３ａ 処理条件テーブル
１０３ｂ 装置特性補正処理部
１０４ シーン参照画像データ生成部
１０５、１０８ 一時記憶メモリ
１０６ 撮影情報データ処理部
１０７ 鑑賞画像参照データ生成部
１０９ 硬さ・明るさ設定入力部
１１６ 階調変換曲線データメモリ
１１９ 視差量・補正値算出部
３０３ 条件算出部
３０４ 彩度補正データ算出部[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing method, an image processing apparatus, and an image recording apparatus for forming an appreciation image on an output medium, which performs an optimization process for forming an appreciation image on an output medium from scene reference image data.
[0002]
[Prior art]
In recent years, digital image data captured by an imaging device such as a digital camera is distributed via a storage device such as a CD-R, a floppy (registered trademark) disk, a memory card, or the Internet, and a CRT (Cathode Ray Tube) or liquid crystal display. Displayed on a display device such as a plasma display or a small liquid crystal monitor of a mobile phone, or printed as a hard copy image using an output device such as a digital printer, an inkjet printer, or a thermal printer. It has been diversified.
[0003]
Also, when digital image data is displayed for viewing or printed out, gradation adjustment is performed on the digital image data so that the desired image quality can be obtained on the display or hard copy used for viewing. In general, various image processes represented by brightness adjustment, color balance adjustment, and sharpness enhancement are performed.
[0004]
In response to these various display methods and printing methods, efforts have been made to increase the versatility of digital image data. As part of this effort, there is an attempt to standardize the color space represented by the digital RGB signal to a color space that does not depend on the characteristics of the imaging device. Currently, “sRGB” is adopted as a standardized color space for many digital image data. (See "Multimedia Systems and Equipment-Colour Measurment and Management-Part2-1: Color Management-Default RGB Color Space-sRGB" IEC "61966-2-1.) This sRGB color space is a standard CRT display. It is set corresponding to the color reproduction area of the monitor.
[0005]
In general, a digital camera is an imaging device having a photoelectric conversion function (CCD-type imaging) to which color sensitivity is imparted by combining a charge coupled device (CCD), a charge transfer mechanism, and a checkered color filter. Element, hereinafter simply referred to as CCD). Digital image data output from the digital camera is converted into an electrical original signal converted via the CCD, with correction of the photoelectric conversion function of the image sensor (for example, gradation correction, spectral sensitivity crosstalk correction, dark current noise). File conversion / compression processing into a predetermined data format that has been standardized so that it can be read / displayed by image editing software (image processing such as suppression, sharpening, white balance adjustment, saturation adjustment, etc.) Etc.
[0006]
As such a data format, for example, “Baseline Tiff Rev. 6.0 RGB Full Color Image” adopted as an uncompressed file of an Exif file and a compressed data file format conforming to the JPEG format are known. The Exif file conforms to sRGB, and the correction of the photoelectric conversion function of the image sensor is set so as to obtain the most suitable image quality on a display monitor conforming to sRGB.
[0007]
For example, tag information indicating that any digital camera is displayed in a standard color space of a display monitor (hereinafter referred to as “monitor profile”) compliant with the sRGB signal, the number of pixels, the pixel array, The digital image data has a function of writing additional information indicating model-dependent information such as the number of bits per pixel as metadata in the file header of the digital image data. The tag information is analyzed by image editing software (for example, Photoshop manufactured by Adobe), and the monitor profile is prompted to change to sRGB, or the change processing is automatically performed. Therefore, it is possible to reduce the difference between different displays and to view digital image data taken with a digital camera in a suitable state on a display monitor.
[0008]
Further, as additional information written in the file header of digital image data, in addition to the above-mentioned model-dependent information, for example, information directly related to the camera type (model) such as camera name and code number, exposure time, shutter Speed, aperture value (F number), ISO sensitivity, brightness value, subject distance range, light source, presence / absence of strobe emission, subject area, white balance, zoom magnification, subject composition, shooting scene type, amount of reflected light from strobe light source, A tag (code) indicating shooting conditions such as shooting saturation, information on the type of subject, and the like is used. The image editing software and the output device have a function of reading the additional information and making the image quality of the hard copy image more suitable.
[0009]
By the way, an image displayed on a display device such as a CRT display monitor and a hard copy image printed by various printing devices have different color gamuts depending on the configuration of the phosphor or color material used. For example, the color reproduction area of a CRT display monitor corresponding to the sRGB standard color space has a wide bright green and blue area, and there are areas that cannot be reproduced by hard copy such as silver halide photographic prints, inkjet printers, and printing. On the other hand, there are areas that cannot be reproduced with a CRT display monitor that supports the sRGB standard color space in the cyan area of printing / inkjet and the yellow area of silver halide photography. For example, Corona “Fine Imaging and Digital Photography” Japan (See page 444 of the Photographic Society Publishing Committee). On the other hand, there is a possibility that some subject scenes to be photographed exhibit area colors that cannot be reproduced in any of these color reproduction areas.
[0010]
As described above, since the color space (including sRGB) optimized on the premise of display or printing by a specific device is limited in the recordable color gamut, the information acquired by the imaging device is recorded. Needs to be compressed and mapped to a recordable color gamut. As the mapping method, clipping that maps chromaticity points outside the recordable color gamut onto the nearest color gamut boundary is the simplest, but this will collapse the gradation outside the color gamut, It becomes an image that feels strange when watching. For this reason, at present, non-linear compression is generally employed in which chromaticity points in a region where the chroma is higher than an appropriate threshold value are smoothly compressed according to the size of the chroma. As a result, the chroma is also compressed and recorded at chromaticity points within the recordable color gamut. (Details of the color gamut mapping method are described in, for example, Corona, “Fine Imaging and Digital Photography”, page 447 of the Japan Photographic Society Publishing Committee.)
[0011]
Further, an image displayed on a display device such as a CRT display monitor, a hard copy image printed by various printing devices, and a color space (including sRGB) optimized on the premise of display / printing by these devices The recordable / reproducible luminance range is limited to about 100: 1 order. On the other hand, the subject scene to be photographed has a wide luminance range and often reaches the order of several thousand: 1 outdoors (for example, “New Color Science Handbook 2nd Edition” published by the University of Tokyo Press) Pp. 926). Therefore, when recording the information acquired by the imaging device, the luminance needs to be similarly compressed. In this process, it is necessary to set appropriate conditions for each image in accordance with the dynamic range of the shooting scene and the luminance range of the main subject in the shooting scene.
[0012]
However, when the color gamut / luminance gamut compression operation described above is performed, the compressed gradation information and clipped information are lost at that time due to the principle of digital images recorded as discrete values. It is broken and cannot be restored to the original state. This is a major limitation on the versatility of high-quality digital images.
[0013]
For example, when printing an image recorded in the sRGB standard color space, mapping is required again based on the difference in the color reproduction range between the sRGB standard color space and the print device. However, since the gradation information of the area once compressed at the time of recording is lost, the smoothness of gradation is deteriorated as compared with the case where the information acquired by the imaging device is directly mapped to the color reproduction area of the printing device. Also, if the gradation compression conditions at the time of recording are inadequate, and the picture is whitish, the face is dark, the shadows are crushed, or the highlight area is overly conspicuous, change the gradation settings and change the image. Even if you try to improve it, the compressed gradation information and the information on the crushed and overexposed parts are already lost, so there is only a significant improvement compared to recreating a new image from the information acquired by the imaging device. I can't do it.
[0014]
A technique for storing the image editing process as a backup and returning it to the state before editing as necessary has long been known. For example, Patent Document 1 describes a backup device that stores, as backup data, differential image data from digital image data before and after image processing when digital image data is locally changed by image processing. Yes. Japanese Patent Application Laid-Open No. 2005-228561 describes a method for restoring digital image data before editing by saving and saving differential image data of digital image data before and after image processing. Although such a technique is effective from the viewpoint of preventing information loss, there is a problem in that the number of images that can be captured by the camera decreases as the amount of data to be recorded on the media increases.
[0015]
The problem described above is caused by compressing and recording information on a wide color gamut and luminance range acquired by the imaging device into appreciation image reference data in an optimized state assuming an appreciation image. In contrast, if information on a wide color gamut / luminance gamut acquired by the imaging device is recorded as uncompressed scene reference image data, inadvertent loss of information can be prevented. As standard color spaces suitable for recording such scene reference image data, for example, “RIMM RGB” and “ERIMM RGB” have been proposed (Journal of Imaging Science and Technology 45, pp. 418-426 ( 2001)).
[0016]
Patent Document 3 discloses an image processing apparatus having a mode for recording in the form of an image signal displayed on the display means and a mode for recording in the form of a captured image signal. The latter image signal form is generally referred to as RAW data, and such digital image data is used for display / printing of Exif files, etc., using dedicated application software (referred to as “electronic development software”). Can be converted into appreciation image reference data (referred to as “electronic development” or simply “development”). Since RAW data stores all information at the time of shooting, it is possible to recreate appreciation image reference data. If another color system file such as CMYK is created directly, the color gamut with the display monitor (sRGB) The color is not inadvertently changed due to the difference.
[0017]
By the way, in recent years, autostereoscopic viewing (hereinafter referred to as “stereoscopic display”) in which stereoscopic (three-dimensional) image display is performed using a plurality of images arranged on a plane has been known. There are various types of stereoscopic display, but in common with any display method, two images (hereinafter simply referred to as “parallax images”) for generating parallax are required. A parallax image is obtained by photographing the same subject from different viewpoints.
[0018]
In a digital camera capable of shooting such a parallax image, the distance between viewpoints, that is, the distance between lenses (referred to as “shooting baseline length”) is the distance between human eyes in order to give a natural perspective. It is set to about 6-7 cm which is equal. With a general digital camera with one photographic optical system, it is possible to shoot a parallax image by shifting the shooting position in the horizontal direction at the time of the second shooting, and shooting the same subject twice continuously. There are some that have an auxiliary function.
[0019]
In the stereoscopic display called a stereo pair, the size of each image is adjusted so that the two parallax images are kept at about 6-7 cm, which is the same as the distance between the human eyes, on the plane. Are arranged side by side. As a method for observing the parallax image arranged on the plane, there are a parallel method in which the parallax image arranged on the right side is viewed with the right eye and an intersection method in which the parallax image arranged on the right side is viewed with the left eye. In the parallel method, a parallax image can be viewed without requiring extra power on the eyes, but a large image cannot be viewed. On the other hand, since the intersection method looks at the parallax image as a close eye, the eyes are easily tired, but a large image can be seen.
[0020]
[Patent Document 1]
JP 7-57074 A
[Patent Document 2]
JP 2001-94778 A
[Patent Document 3]
JP 11-261933 A
[0021]
[Problems to be solved by the invention]
When converting scene reference image data to optimal viewing image reference data on a display monitor using the above-described technique, a gradation conversion curve is set using dedicated application software as with RAW data. Or adjust saturation. In general, the gradation conversion curve is set by a mouse operation using a user interface function for visually adjusting the curve shape. However, the setting operation of the gradation conversion curve is to adjust the hardness and lightness of the shadow side, intermediate area, and highlight side of the image at the same time, and requires considerable skill. Also, the setting of the gradation conversion curve varies depending on the type of subject or shooting conditions (for example, flash photography, backlight). Furthermore, if it conforms to a standard such as sRGB as in a CRT display, the versatility of setting the gradation conversion curve is high, and the manufacturer can easily make some recommended settings. When an appreciation image is formed on an ink jet printer or the like, there are very few cases where the recommended setting is sufficient due to various fluctuation factors. In addition to this, since the user's preference is also different, after all, it is necessary to rely on the adjustment by the user himself. Therefore, the conventional technique has a problem that the gradation conversion curve cannot be easily set due to a heavy load on the user for setting the gradation conversion curve when converting the scene reference image data to the viewing image reference data. It was. In particular, when the scene reference image data is a parallax image, the load related to the setting operation of the gradation conversion curve is further increased.
[0022]
An object of the present invention is to realize image processing that reduces a load related to a setting operation of a gradation conversion curve when converting scene reference image data to appreciation image reference data.
[0023]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1 is directed to image processing for generating appreciation image reference data by performing image processing optimized for appreciation image formation on an output medium on scene reference image data. In the method, a determination step of determining whether the scene reference image data is a parallax image, and a parallax amount of the parallax image when the scene reference image data is determined to be a parallax image in the determination step A correction value determining step for determining the hardness correction value and the brightness correction value of the viewing image reference data based on the above, and from the scene reference image data defined in advance for each output medium to the viewing image reference data A first changing step of changing a gradation conversion curve indicating conversion based on the determined hardness correction value; and changing the gradation conversion curve based on the determined brightness correction value. And a generation step of generating appreciation image reference data based on the gradation conversion curve changed in the first change step and the second change step. In the changing step, a specific area including a predetermined position on the gradation conversion curve is set as a non-moving area, and the shape of the gradation conversion curve is changed based on the determined hardness correction value. In the changing step, the shape of the gradation conversion curve is changed based on the determined brightness correction value so that the specific area moves on a predefined curve.
[0024]
According to a second aspect of the present invention, in the image processing method according to the first aspect, a hardness calculation step of calculating a correction value of the hardness of the appreciation image reference data according to the type of the subject, and a photographing condition. Accordingly, a brightness calculation step of calculating a correction value of the brightness of the viewing image reference data, and in the correction value determination step, the hardness correction value calculated in the hardness calculation step, and Based on the parallax amount of the parallax image, a correction value for the hardness of the viewing image reference data is determined, and based on the brightness correction value calculated in the brightness calculation step and the parallax amount of the parallax image, A correction value for brightness of the viewing image reference data is determined.
[0025]
According to a third aspect of the present invention, in the image processing method according to the first aspect, the correction value of the hardness and the correction of the brightness of the appreciation image reference data according to the combination of the type of the specific subject and the photographing condition. A hardness / brightness calculation step of calculating a value, and in the correction value determination step, a parallax amount of the parallax image, a correction value of the hardness calculated in the hardness / brightness calculation step, and a brightness Based on the correction value, a hardness correction value and a brightness correction value of the viewing image reference data are determined.
[0026]
According to a fourth aspect of the present invention, in the image processing method according to the first aspect, the saturation adjustment amount of the appreciation image reference data is determined based on the hardness correction value determined in the correction value determination step. A saturation determination step, and in the generation step, the gradation conversion curve changed in the first change step and the second change step, and the appreciation based on the determined saturation adjustment amount It is characterized in that image reference data is generated.
[0027]
According to a fifth aspect of the present invention, in the image processing method according to the second aspect, the correction value for the hardness and the correction of the brightness of the viewing image reference data according to the combination of the type of the specific subject and the photographing condition. A hardness / brightness calculation step of calculating a value, and in the correction value determination step, a parallax amount of the parallax image, a correction value of the hardness calculated in the hardness calculation step, and the hardness / brightness calculation Based on the hardness correction value calculated in the step, the hardness correction value of the viewing image reference data is determined, and the parallax amount of the parallax image, the brightness correction value calculated in the brightness calculation step The brightness correction value of the viewing image data is determined based on the brightness correction value calculated in the hardness / brightness calculation step.
[0028]
According to a sixth aspect of the present invention, in the image processing method according to the second aspect, the amount of adjustment of the saturation of the viewing image reference data is determined based on the hardness correction value determined in the correction value determination step. Viewing image reference data based on the gradation conversion curves changed in the first changing step and the second changing step and the saturation adjustment amount in the generating step Is generated.
[0029]
According to a seventh aspect of the present invention, in the image processing method according to the third aspect, the amount of saturation adjustment of the viewing image reference data is determined based on the hardness correction value determined in the correction value determination step. Viewing image reference data based on the gradation conversion curves changed in the first changing step and the second changing step and the saturation adjustment amount in the generating step Is generated.
[0030]
According to an eighth aspect of the present invention, in the image processing method according to the fifth aspect, the saturation adjustment amount of the appreciation image reference data is determined based on the hardness correction value determined in the correction value determination step. Viewing image reference data based on the gradation conversion curves changed in the first changing step and the second changing step and the saturation adjustment amount in the generating step Is generated.
[0031]
According to a ninth aspect of the present invention, in the image processing method according to any one of the third, fifth, seventh, and eighth aspects, in the combination of the specific subject type and the photographing condition, the subject type is a portrait. It is characterized in that the photographing condition is backlight.
[0032]
According to a tenth aspect of the present invention, in the image processing method according to any one of the fourth, sixth to eighth aspects, the saturation adjustment amount when the hardness correction value is 0 is an appreciation image. It is a value that emphasizes the saturation of the reference data.
[0033]
According to an eleventh aspect of the present invention, in the image processing method according to any one of the second, third, and fifth to tenth aspects, the type of the subject includes at least a portrait, a landscape, and a still life. It is a feature.
[0034]
According to a twelfth aspect of the present invention, in the image processing method according to any one of the second, third, and fifth to eleventh aspects, the photographing condition includes at least backlighting and strobe photographing. .
[0035]
A thirteenth aspect of the present invention is the image processing method according to any one of the first to twelfth aspects, wherein when the input / output value of the gradation conversion curve is L *, the predetermined region in the specific region is The position is characterized in that the input L * is a position of 40 or more and less than 50.
[0036]
The invention according to claim 14 is the image processing method according to any one of claims 1 to 13, wherein initial values of hardness and brightness of a gradation conversion curve defined in advance for each output medium are as follows: It is characterized by being stored for each user.
[0037]
According to a fifteenth aspect of the present invention, in the image processing apparatus for generating appreciation image reference data by performing image processing optimized for appreciation image formation on an output medium on the scene reference image data, the scene reference image is generated. When the determination unit determines whether the data is a parallax image, and the determination unit determines that the scene reference image data is a parallax image, the appreciation image is based on the parallax amount of the parallax image. A correction value determination unit for determining a correction value for hardness and a correction value for brightness of reference data, and a gradation conversion curve that is defined in advance for each output medium and indicates conversion from scene reference image data to appreciation image reference data A first changing unit that changes the gradation conversion curve based on the determined brightness correction value, and a first changing unit that changes the gradation conversion curve based on the determined brightness correction value. The first A generation unit that generates appreciation image reference data based on the gradation conversion curve changed by the further change unit and the second change unit, and the first change unit has a predetermined value on the gradation conversion curve. The specific area including the position is defined as a non-moving area, and the shape of the gradation conversion curve is changed based on the determined hardness correction value. The second changing unit is configured to predefine the specific area. It is characterized in that the shape of the gradation conversion curve is changed based on the determined brightness correction value so as to move on the curve.
[0038]
According to a sixteenth aspect of the present invention, in the image processing device according to the fifteenth aspect, a hardness calculation unit that calculates a correction value of the hardness of the appreciation image reference data according to the type of the subject, and a photographing condition. Accordingly, a brightness calculation unit that calculates a correction value of the brightness of the viewing image reference data, and the correction value determination unit includes the hardness correction value calculated by the hardness calculation unit, Based on the parallax amount of the parallax image, the correction value of the hardness of the viewing image reference data is determined, and based on the brightness correction value calculated by the brightness calculation unit and the parallax amount of the parallax image, A correction value for brightness of the appreciation image reference data is determined.
[0039]
According to a seventeenth aspect of the present invention, in the image processing device according to the fifteenth aspect, the correction value of the hardness and the correction of the brightness of the appreciation image reference data according to the combination of the type of the specific subject and the photographing condition. A hardness / brightness calculation unit that calculates a value, and the correction value determination unit calculates a parallax amount of the parallax image, a hardness correction value and a brightness calculated by the hardness / brightness calculation unit. Based on the correction value, the hardness correction value and the brightness correction value of the viewing image reference data are determined.
[0040]
According to an eighteenth aspect of the present invention, in the image processing apparatus according to the fifteenth aspect, an amount of adjustment of the saturation of the appreciation image reference data is determined based on the correction value of hardness determined by the correction value determination unit. A saturation determining unit that performs the appreciation based on the gradation conversion curve changed by the first changing unit and the second changing unit and the determined amount of saturation adjustment. It is characterized by generating image reference data.
[0041]
According to a nineteenth aspect of the present invention, in the image processing apparatus according to the sixteenth aspect, a correction value of hardness and a correction of brightness of the appreciation image reference data according to a combination of a specific subject type and a photographing condition. A hardness / brightness calculation unit that calculates a value, and the correction value determination unit calculates a parallax amount of the parallax image, a correction value of the hardness calculated by the hardness calculation unit, and the hardness / brightness calculation. Based on the hardness correction value calculated by the unit, the hardness correction value of the viewing image reference data is determined, the parallax amount of the parallax image, the brightness correction value calculated by the brightness calculation unit The brightness correction value of the viewing image data is determined based on the brightness correction value calculated by the hardness / brightness calculation unit.
[0042]
According to a twentieth aspect of the present invention, in the image processing apparatus according to the sixteenth aspect, the amount of saturation adjustment of the appreciation image reference data is determined based on the hardness correction value determined by the correction value determination unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0043]
According to a twenty-first aspect of the present invention, in the image processing device according to the seventeenth aspect, the amount of adjustment of the saturation of the viewing image reference data is determined based on the hardness correction value determined by the correction value determining unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0044]
According to a twenty-second aspect of the present invention, in the image processing apparatus according to the nineteenth aspect, an amount of saturation adjustment of the viewing image reference data is determined based on the hardness correction value determined by the correction value determination unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0045]
According to a twenty-third aspect of the present invention, in the image processing apparatus according to any one of the seventeenth, nineteenth, twenty-first, and twenty-second aspect, in the combination of the specific subject type and the photographing condition, the subject type is a portrait. It is characterized in that the photographing condition is backlight.
[0046]
According to a twenty-fourth aspect of the present invention, in the image processing apparatus according to any one of the eighteenth and twenty-second aspects, the saturation adjustment amount when the hardness correction value is 0 is an appreciation image. It is a value that emphasizes the saturation of the reference data.
[0047]
According to a twenty-fifth aspect of the present invention, in the image processing device according to any one of the sixteenth, seventeenth, and nineteenth to twenty-fourth aspects, the types of the subject include at least a portrait, a landscape, and a still life. It is a feature.
[0048]
According to a twenty-sixth aspect of the present invention, in the image processing apparatus according to any one of the sixteenth, seventeenth, and nineteenth to twenty-fifth aspects, the photographing conditions include at least backlighting and strobe photographing. .
[0049]
According to a twenty-seventh aspect of the present invention, in the image processing apparatus according to any one of the fifteenth to twenty-sixth aspects, when an input / output value of the gradation conversion curve is L *, a predetermined value in the specific region is set. The position is characterized in that the input L * is a position of 40 or more and less than 50.
[0050]
According to a twenty-eighth aspect of the present invention, in the image processing apparatus according to any one of the fifteenth to twenty-seventh aspects, initial values of hardness and brightness of a gradation conversion curve defined in advance for each output medium are: It is characterized by being stored for each user.
[0051]
According to the twenty-ninth aspect of the present invention, the scene reference image data is subjected to image processing that is optimized for appreciation image formation on the output medium to generate appreciation image reference data, and the generated appreciation image data is output. In the image recording apparatus formed on the medium, a determination unit that determines whether or not the scene reference image data is a parallax image, and the determination unit determines that the scene reference image data is a parallax image A correction value determining unit that determines a correction value of hardness and a correction value of brightness of the viewing image reference data based on a parallax amount of the parallax image, and scene reference image data defined in advance for each output medium A first changing unit that changes a gradation conversion curve indicating conversion from image to viewing image reference data based on the determined correction value of hardness, and the gradation conversion curve includes the determined brightness. Correction A second change unit that changes based on the first change unit, and a generation unit that generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit, The first changing unit changes a shape of the gradation conversion curve based on the determined hardness correction value, with a specific region including a predetermined position on the gradation conversion curve as a non-moving region, The second changing unit changes the shape of the gradation conversion curve based on the determined brightness correction value so that the specific region moves on a predefined curve. Yes.
[0052]
According to a thirty-third aspect of the present invention, in the image recording device according to the twenty-ninth aspect, a hardness calculation unit that calculates a correction value of the hardness of the appreciation image reference data according to the type of the subject, and a photographing condition Accordingly, a brightness calculation unit that calculates a correction value of the brightness of the viewing image reference data, and the correction value determination unit includes the hardness correction value calculated by the hardness calculation unit, Based on the parallax amount of the parallax image, the correction value of the hardness of the viewing image reference data is determined, and based on the brightness correction value calculated by the brightness calculation unit and the parallax amount of the parallax image, A correction value for brightness of the appreciation image reference data is determined.
[0053]
According to a thirty-first aspect of the present invention, in the image recording device according to the twenty-ninth aspect, the correction value of the hardness of the appreciation image reference data and the correction of the brightness according to the combination of the type of the specific subject and the photographing condition. A hardness / brightness calculation unit that calculates a value, and the correction value determination unit calculates a parallax amount of the parallax image, a hardness correction value and a brightness calculated by the hardness / brightness calculation unit. Based on the correction value, the hardness correction value and the brightness correction value of the viewing image reference data are determined.
[0054]
According to a thirty-second aspect of the present invention, in the image recording apparatus according to the twenty-ninth aspect, the amount of adjustment of the saturation of the viewing image reference data is determined based on the hardness correction value determined by the correction value determination unit. A saturation determining unit that performs the appreciation based on the gradation conversion curve changed by the first changing unit and the second changing unit and the determined amount of saturation adjustment. It is characterized by generating image reference data.
[0055]
According to a thirty-third aspect of the present invention, in the image recording apparatus according to the thirty-third aspect, a correction value of hardness and a correction of brightness of the appreciation image reference data according to a combination of a specific subject type and photographing conditions A hardness / brightness calculation unit that calculates a value, and the correction value determination unit calculates a parallax amount of the parallax image, a correction value of the hardness calculated by the hardness calculation unit, and the hardness / brightness calculation. Based on the hardness correction value calculated by the unit, the hardness correction value of the viewing image reference data is determined, the parallax amount of the parallax image, the brightness correction value calculated by the brightness calculation unit The brightness correction value of the viewing image data is determined based on the brightness correction value calculated by the hardness / brightness calculation unit.
[0056]
According to a thirty-fourth aspect of the present invention, in the image recording apparatus according to the thirty-third aspect, an amount of saturation adjustment of the appreciation image reference data is determined based on the hardness correction value determined by the correction value determination unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0057]
According to a thirty-fifth aspect of the present invention, in the image recording apparatus according to the thirty-first aspect, an amount of saturation adjustment of the appreciation image reference data is determined based on the hardness correction value determined by the correction value determination unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0058]
According to a thirty-sixth aspect of the present invention, in the image recording apparatus according to the thirty-third aspect, an amount of saturation adjustment of the appreciation image reference data is determined based on the hardness correction value determined by the correction value determination unit. And the generation unit is configured to apply the viewing image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. It is characterized by generating.
[0059]
According to a thirty-seventh aspect of the present invention, in the image recording apparatus according to any one of the thirty-first, thirty-third, thirty-five, and thirty-sixth aspects, in the combination of the specific subject type and the photographing condition, the subject type is a portrait. It is characterized in that the photographing condition is backlight.
[0060]
According to a thirty-eighth aspect of the present invention, in the image recording apparatus according to any one of the thirty-second and thirty-fourth to thirty-sixth aspects, the saturation adjustment amount when the hardness correction value is zero is an appreciation image. It is a value that emphasizes the saturation of the reference data.
[0061]
According to a thirty-ninth aspect of the present invention, in the image recording apparatus according to any one of the thirty-third, thirty-one, and thirty-third to thirty-eight aspects, the types of the subject include at least a portrait, a landscape, and a still life. It is a feature.
[0062]
The invention according to claim 40 is the image recording apparatus according to any one of claims 30, 31, 33 to 39, wherein the photographing conditions include at least backlighting and flash photography. .
[0063]
In the image recording apparatus according to any one of claims 29 to 40, when the input / output value of the gradation conversion curve is L *, the image recording apparatus according to any one of claims 29 to 40 has a predetermined value in the specific area. The position is characterized in that the input L * is a position of 40 or more and less than 50.
[0064]
The invention according to claim 42 is the image recording apparatus according to any one of claims 29 to 41, wherein initial values of hardness and brightness of a gradation conversion curve defined in advance for each output medium are: It is characterized by being stored for each user.
[0065]
According to the present invention, when the scene reference image data is a parallax image, the hardness correction value and the brightness correction value are determined based on the parallax amount of the parallax image, and the hardness correction value and the brightness correction value are determined. Based on this, the tone conversion curve indicating the conversion from the scene reference image data to the appreciation image reference data is adjusted, so that the image quality of the stereoscopic display image can be improved. In addition, the hardness of the viewing image reference data is adjusted by changing the shape of the gradation conversion curve using a specific area including a predetermined position on the gradation conversion curve as a non-moving area, and the specific area is a curve in which the specific area is defined in advance. By adjusting the brightness of the viewing image reference data by changing the shape of the gradation conversion curve so as to move, the efficiency of the gradation conversion curve setting work can be improved. Further, it is possible to adjust the hardness of the viewing image reference data in which the brightness fluctuation is suppressed. Furthermore, it is possible to adjust the brightness of the viewing image reference data in which the variation in hardness is suppressed.
[0066]
In addition, by adjusting the hardness of the viewing image reference data according to the type of the subject and adjusting the brightness of the viewing image reference data according to the shooting conditions, it is possible to improve the efficiency of setting the gradation conversion curve. it can. In addition, by adjusting the hardness and brightness of the viewing image reference data according to the combination of the specific subject type and the shooting conditions, it is possible to further improve the efficiency of setting the gradation conversion curve.
[0067]
In addition, since the saturation of the viewing image reference data can be adjusted according to the correction value of the hardness of the viewing image reference data, the setting operation of the gradation conversion curve is made efficient, and preferable viewing of the viewing image is performed. Data can be obtained.
[0068]
Next, terms used in the present invention will be described in detail.
[0069]
In the description of the present invention, “generation” means that a program and a processing circuit that operate in the image processing method, image processing apparatus, and image recording apparatus of the present invention newly generate an image signal. “Create” may be used as a synonym.
[0070]
“Scene reference image data” means that the signal intensity of each color channel based on at least the spectral sensitivity of the image sensor itself has been mapped to the standard color space such as RIM RGB, ERIMM RGB, etc. It means image data in a state in which image processing for modifying data contents in order to improve the effect at the time of image viewing such as enhancement and saturation enhancement is omitted. In addition, the scene reference image data corrects the photoelectric conversion characteristics (opto-electronic conversion function, for example, “Fine Imaging and Digital Photography” of Corona Co., Ltd., page 449 of the Japan Photographic Society Publishing Committee). It is preferable that The information amount (for example, the number of gradations) of the standardized scene reference image data is equal to or greater than the information amount (for example, the number of gradations) required for the viewing image reference data in accordance with the performance of the A / D converter. It is preferable. For example, when the number of gradations of the viewing image reference data is 8 bits per channel, the number of gradations of the scene reference image data is preferably 12 bits or more, more preferably 14 bits or more, and even more preferably 16 bits or more.
[0071]
“Appreciation image reference data” means digital image data used for generating a hard copy image on an “output medium” such as a CRT, liquid crystal display, plasma display, silver halide photographic paper, inkjet paper, thermal printer paper or the like. . An “optimization process” is performed so that an optimal image can be obtained on a display device such as a CRT, a liquid crystal display, a plasma display, and an output medium such as a silver salt photographic paper, an inkjet paper, and a thermal printer paper.
[0072]
In addition, “optimized image processing” is to obtain an optimal image on a display device such as a CRT, a liquid crystal display, a plasma display, or an output medium such as a silver salt photographic paper, an inkjet paper, or a thermal printer paper. For example, when it is assumed that the image is displayed on a CRT display monitor compliant with the sRGB standard, the process is performed so that an optimum color reproduction is obtained within the color gamut of the sRGB standard. Also, assuming output to silver salt photographic paper, processing is performed so that optimum color reproduction is obtained within the color gamut of the silver salt photographic paper. In addition to color gamut compression, gradation compression from 16 bits to 8 bits, reduction of the number of output pixels, and processing for handling output characteristics (LUT) of the output device are also included. Furthermore, it goes without saying that image processing such as noise suppression, sharpening, color balance adjustment, saturation adjustment, and dodging processing is performed.
[0073]
The “output medium” is a display device such as a CRT, a liquid crystal display, or a plasma display, silver salt photographic paper, inkjet paper, thermal printer paper, or the like.
[0074]
The “parallax image” is digital image data taken from at least two different viewpoints necessary for stereoscopic display by a stereo pair, taken by an imaging device. There are the following two methods for obtaining the parallax image. (1) A method in which the position of one imaging device is changed and acquired by at least two shootings. (2) A method in which two image pickup devices are arranged at a predetermined interval and acquired by one shooting of each image pickup device. {Circle around (3)} A method of obtaining by photographing with one imaging device having two imaging optical systems arranged at a predetermined interval.
[0075]
The parallax images may be stored individually for each digital image data photographed from different viewpoints, but are preferably stored so that difference data of other parallax images is attached to one parallax image. . When parallax images are stored individually, it is preferable that information for specifying the parallax image for one subject is attached. When difference data of another parallax image is attached to one parallax image, it is preferable to attach information indicating that the difference data is attached to the one parallax image.
[0076]
The “tone conversion curve” is an input / output conversion curve (“Look Up Table”, hereinafter simply referred to as “LUT”) for converting “scene reference image data” to “viewing image reference data”. FIG. 1 shows a curve on the graph represented by the input L * on the horizontal axis and the output L * on the vertical axis. In FIG. 1, the input L * and the brightness (luminance) value of the subject are directly proportional to the linear portion of the CCD output. The output L * is a value obtained by gradation conversion using a value obtained by a predetermined brightness (luminance) calculation formula when the input L * is mapped to the sRGB color space.
[0077]
In addition, “a gradation conversion curve that is pre-defined for each output medium and indicates conversion from scene reference image data to appreciation image reference data” refers to a display device such as a CRT, a liquid crystal display, or a plasma display, silver salt photographic paper This means that a “tone conversion curve” is prepared for each type of inkjet paper, thermal printer paper, and the like.
[0078]
Further, the “specific region including a predetermined position on the gradation conversion curve” means a certain area including a point on the gradation conversion curve for converting scene reference image data to appreciation image reference data as shown in FIG. Indicates the area. Here, the “predetermined position” is preferably a position where the input L * is 40 or more and less than 50, as described in claims 13, 27, and 41.
[0079]
The range of “specific region” and the relationship between “specific region” and “predetermined position” depend on a relational expression that changes the shape of the gradation conversion curve. When defining the relational expression for changing the shape of the gradation conversion curve using the “hardness correction value” (hardness adjustment parameter) input by the user, the “predetermined position” is the “specific region”. It is preferable to consider that the range of the specific region becomes as small as possible. In particular, the range of the specific region is preferably Δ10 or less, and more preferably 5 or less, at the input / output L *. Note that the hardness adjustment parameter is preferably one.
[0080]
“The shape of the gradation conversion curve is changed (the shape is changed) based on the correction value of the hardness with the specific region as a non-moving region” as shown in FIG. An input / output value is fixed for at least one point on the conversion curve, and the curve shape on the S-shape is reproduced by adjusting the hardness. When the hardness is set to be hard, the slope at a point on the gradation conversion curve that passes through the specific region increases. Note that 1 in FIG. 2 represents a “predetermined position” and 2 represents a “specific area”. In the present invention, the output value of input L * = 0 in FIG. 2 is preferably fixed at L * = 0, and the output value of input L * = 100 is preferably fixed at L * = 100. By setting the immovable region in this way, it is possible to adjust the hardness of the viewing image reference data in which the variation in brightness is suppressed.
[0081]
Further, “the shape of the gradation conversion curve is changed (the shape is changed) based on the brightness correction value so that the specific region moves on a predefined curve” is shown in FIG. As shown, even if the brightness is changed, the shape of the gradation conversion curve is intended to be set so that the specific region is always on a predetermined parabolic movement locus. 3 in FIG. 3 indicates a “predetermined position” in the initial state before the brightness adjustment, 3 indicates a “predetermined position” when the brightness is adjusted brightly, and 5 indicates a brightness adjusted darkly. "Predetermined position" is shown.
[0082]
When defining a relational expression that changes the shape of the gradation conversion curve using the “brightness correction value” (brightness adjustment parameter) input by the user, the amount of deviation from the movement locus is as small as possible. It is preferable to do so. In the present invention, it is preferable that the output value of the input L * = 0 in FIG. 3 is fixed to L * = 0, and the output value of the input L * = 100 is fixed to L * = 100. Note that the brightness adjustment parameter is preferably one. By setting the movement trajectory in this way, it is possible to adjust the brightness of the viewing image reference data in which the variation in hardness is suppressed.
[0083]
Further, “calculating the correction value of the hardness of the viewing image reference data according to the type of the subject” is to adjust the hardness different for each type of the subject. Is set with a different numerical value for each type, and the hardness is corrected (adjusted) automatically according to the type information of the subject (main subject) input automatically or manually by the operator. This is based on the knowledge obtained from the investigation on the hardness adjustment factor that the hardness is often adjusted depending on the type of the subject such as portrait and outdoor. In the present invention, as described in claims 11, 25, and 39, it is preferable that at least portrait, landscape, and still life are included in the types of subjects.
[0084]
In the description of the present invention, “subject type” indicates a category for what the photographer intends to photograph. In the description of the present invention, “portrait” refers to a subject whose area occupied by the face is 20% or more of the entire screen. Further, in the description of the present invention, “landscape” refers to a case where an outdoor shooting scene and nature such as the sky, green trees, and mountains are subjects. In the description of the present invention, “still life” refers to a subject whose area occupied by objects other than living things is 50% or more of the entire screen.
[0085]
The “subject type” can be used as an index for optimizing the image quality to be subjectively preferable. For example, it is known that optimum values differ in sharpness, smoothness, saturation value, and gradation in a person and a landscape (still life). Further, the effect of improving the image quality can be further enhanced by combining the parallax amount, the subject distance, and the subject type information. For example, when the subject is a person, the degree of gradation softening, smoothing processing, and saturation enhancement is adjusted according to the value of the parallax amount, that is, the size of the person. In the case where the subject is a building, the degree of gradation gradation enhancement, sharpening processing, and saturation reduction is adjusted according to the value of the amount of parallax, that is, the size of the building.
[0086]
Further, “determining the correction value of the brightness of the viewing image reference data according to the shooting conditions” means adjusting the brightness to be different for each shooting condition, specifically, for each shooting condition in advance. Are set with different numerical values, and the brightness is automatically adjusted in accordance with the information of the photographing conditions automatically determined or manually input by the operator. This is based on the knowledge obtained from the investigation on the brightness adjustment factor that the brightness is often adjusted due to differences in photographing conditions such as strobe light and backlight. In the present invention, as described in claims 12, 26, and 40, it is preferable that the photographing conditions include at least backlight and strobe light. In this way, the hardness of the viewing image reference data is adjusted according to the type of subject, and the brightness of the viewing image reference data is adjusted according to the shooting conditions, so that the gradation conversion curve can be changed efficiently. Can be
[0087]
In the description of the present invention, “imaging condition” mainly indicates a condition relating to a light source state at the time of imaging. In the description of the present invention, “backlight” indicates a shooting condition in fine weather where the position of the sun is within 45 degrees from the front of the photographer. In the description of the present invention, “strobe” refers to a shooting condition for shooting using a strobe.
[0088]
Further, “determining the hardness correction value and the brightness correction value of the appreciation image reference data according to the combination of the type of the specific subject and the shooting condition” refers to the combination of the specific subject and the shooting condition in advance. Is set, and the captured image data corresponding to this combination corresponds to the adjustment of hardness and brightness under special conditions. This is because, in a visual experiment in which the factors governing the adjustment of the hardness and brightness described above were investigated, there were extremely large hardness correction values and brightness correction values for a combination of a specific subject and shooting conditions. It is based on the knowledge of doing.
[0089]
Also, “determining the saturation adjustment amount of the viewing image reference data based on the hardness correction value” means that the saturation adjustment amount (%) is determined according to the hardness correction value. It is to define a relational expression in advance. This is based on the knowledge that the hardness correction value and the saturation adjustment amount correlate with each other obtained in the visual experiment in which the investigation is performed on the factors governing the adjustment of the above-described hardness and brightness. Further, it is also obtained that the saturation adjustment amount when the hardness correction value from the appreciation image reference data is 0 is the largest + 10%. Therefore, as described in claims 10, 24, and 38, it is preferable that the saturation adjustment amount when the hardness correction value is 0 is a setting for performing saturation enhancement.
[0090]
The “image recording apparatus” of the present invention includes a color negative film, a color reversal film, a black and white negative film, and a black and white reversal film in addition to the mechanism for performing the image processing of the present invention on digital image data acquired by an imaging apparatus. For example, a film scanner for inputting frame image information of a photographic photosensitive material recorded by an analog camera, and a flatbed scanner for inputting image information reproduced on color paper which is silver salt photographic paper may be provided. In addition, compact flash (registered trademark), memory stick (registered trademark), smart media (registered trademark), multimedia card (registered trademark), floppy (registered trademark) disk, magneto-optical storage medium (MO), CD-R, etc. Display device such as CRT, liquid crystal display, plasma display, etc., which acquires digital image data from a remote location via means for reading digital image data stored in any known portable “media” or communication means such as a network And a processing means for forming an appreciation image on any known “output medium” such as silver salt photographic paper, ink jet paper, thermal printer paper and the like.
[0091]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
First, the configuration will be described.
[0092]
<Appearance Configuration of Image Recording Apparatus 1>
First, the configuration of the image recording apparatus 1 will be described.
[0093]
FIG. 4 is a perspective view showing an external configuration of the image recording apparatus 1 according to the embodiment of the present invention. As shown in FIG. 4, the image recording apparatus 1 includes a magazine loading unit 3 for loading a photosensitive material on one side surface of the housing 2. Inside the housing 2 are provided an exposure processing unit 4 for exposing the photosensitive material, and a print creating unit 5 for developing and drying the exposed photosensitive material to create a print. On the other side surface of the housing 2, a tray 6 for discharging the print created by the print creation unit 5 is provided.
[0094]
In addition, a CRT (Cathode Ray Tube) 8 serving as a display device, a film scanner unit 9 serving as a device for reading a transparent document, a reflective document input device 10, and an operation unit 11 are provided on the upper portion of the housing 2. The CRT 8 constitutes display means for displaying an image of image information to be printed on the screen. Further, the housing 2 includes an image reading unit 14 that can read image information recorded on various digital recording media, and an image writing unit 15 that can write (output) image signals to various digital recording media. Yes. In addition, a control unit 7 that centrally controls these units is provided inside the housing 2.
[0095]
The image reading unit 14 includes a PC card adapter 14a and a floppy (registered trademark) disk adapter 14b, and a PC card 13a and a floppy (registered trademark) disk 13b can be inserted therein. The PC card 13a has, for example, a memory in which a plurality of frame image data captured by a digital camera is recorded. For example, a plurality of frame image data captured by a digital camera is recorded on the floppy (registered trademark) disk 13b. Examples of the recording medium on which frame image data is recorded other than the PC card 13a and the floppy (registered trademark) disk 13b include a multimedia card (registered trademark), a memory stick (registered trademark), MD data, and a CD-ROM. .
[0096]
The image writing unit 15 is provided with a floppy (registered trademark) disk adapter 15a, an MO adapter 15b, and an optical disk adapter 15c, into which an FD 16a, an MO 16b, and an optical disk 16c can be respectively inserted. Examples of the optical disc 16c include a CD-R and a DVD-R.
[0097]
In FIG. 4, the operation unit 11, the CRT 8, the film scanner unit 9, the reflection original input device 10, and the image reading unit 14 are integrally provided in the housing 2. One or more may be provided separately.
[0098]
Further, in the image recording apparatus 1 shown in FIG. 4, there is exemplified an apparatus that creates a print by exposing to a photosensitive material and developing it. However, the print production method is not limited to this. A method such as a photographic method, a thermal method, or a sublimation method may be used.
[0099]
<Internal Configuration of Image Recording Apparatus 1>
FIG. 5 is a block diagram showing the internal configuration of the image recording apparatus 1. As shown in FIG. 5, the image recording apparatus 1 includes a control unit 7, an exposure processing unit 4, a print generation unit 5, a film scanner unit 9, a reflection original input device 10, an image reading unit 14, a communication unit (input) 32, The image writing unit 15, data storage unit 71, template storage unit 72, operation unit 11, CRT 8, and communication unit (output) 33 are configured.
[0100]
The control unit 7 includes a microcomputer, and various control programs such as an image processing program stored in a storage unit (not shown) such as a ROM (Read Only Memory), and a CPU (Central Processing Unit) (not shown). The operation of each part constituting the image recording apparatus 1 is controlled in cooperation with the.
[0101]
The control unit 7 includes an image processing unit 70 according to the image processing apparatus of the present invention, and is read from the film scanner unit 9 or the reflective original input device 10 based on an input signal (command information) from the operation unit 12. The image processing of the present invention is performed on the image signal, the image signal read from the image reading unit 14 and the image signal input from the external device via the communication means 32 to form image information for exposure, and exposure processing Output to part 4. Further, the image processing unit 70 performs a conversion process corresponding to the output form on the image signal subjected to the image processing, and outputs the image signal. Output destinations of the image processing unit 70 include the CRT 8, the image writing unit 15, the communication means (output) 33, and the like.
[0102]
The exposure processing unit 4 exposes an image to the photosensitive material and outputs the photosensitive material to the print creating unit 5. The print creating unit 5 develops and exposes the exposed photosensitive material to create prints P1, P2, and P3. The print P1 is a service size, high-definition size, panoramic size print, the print P2 is an A4 size print, and the print P3 is a business card size print.
[0103]
The film scanner unit 9 reads a frame image recorded on a transparent original such as a developed negative film N or a reversal film imaged by an analog camera, and acquires a digital image signal of the frame image. The reflective original input device 10 reads an image on a print P (photo print, document, various printed materials) by a flat bed scanner, and acquires a digital image signal.
[0104]
The image reading unit 14 reads frame image information recorded on the PC card 13 a or the floppy (registered trademark) disk 13 b and transfers the frame image information to the control unit 7. The image reading unit 14 includes, as the image transfer means 30, a PC card adapter 14a, a floppy (registered trademark) disk adapter 14b, and the like. The image reading unit 14 reads frame image information recorded on the PC card 13a inserted into the PC card adapter 14a or the floppy (registered trademark) disk 13b inserted into the floppy (registered trademark) disk adapter 14b. Transfer to the control unit 7. For example, a PC card reader or a PC card slot is used as the PC card adapter 14a.
[0105]
The communication means (input) 32 receives an image signal representing a captured image and a print command signal from another computer in the facility where the image recording apparatus 1 is installed, or a distant computer via the Internet or the like.
[0106]
The image writing unit 15 includes, as the image conveying unit 31, a floppy (registered trademark) disk adapter 15a, an MO adapter 15b, and an optical disk adapter 15c. In accordance with a write signal input from the control unit 7, the image writing unit 15 includes a floppy (registered trademark) disk 16a inserted into the floppy (registered trademark) disk adapter 15a, an MO 16b inserted into the MO adapter 15b, The image signal generated by the image processing method according to the present invention is written to the optical disk 16c inserted into the optical disk adapter 15c.
[0107]
The data storage unit 71 stores and sequentially stores image information and order information corresponding to the image information (information on how many prints are to be created from images of which frames, print size information, and the like).
[0108]
The template storage means 72 stores at least one template data for setting a synthesis area and a background image, an illustration image, and the like, which are sample image data corresponding to the sample identification information D1, D2, and D3. A predetermined template is selected from a plurality of templates that are set by the operation of the operator and stored in advance in the template storage means 72, and the frame image information is synthesized by the selected template and designated sample identification information D1, D2, D3 The sample image data selected on the basis of the image data and the image data and / or character data based on the order are combined to create a print based on the specified sample. The synthesis using this template is performed by a well-known chroma key method.
[0109]
Note that sample identification information D1, D2, and D3 for specifying a print sample is configured to be input from the operation unit 211. These sample identification information is recorded on a print sample or an order sheet. Therefore, it can be read by reading means such as OCR. Or it can also input by an operator's keyboard operation.
[0110]
In this way, sample image data is recorded corresponding to the sample identification information D1 for designating the print sample, the sample identification information D1 for designating the print sample is input, and based on the input sample identification information D1. Select the sample image data, synthesize the selected sample image data with the image data and / or text data based on the order, and create a print based on the specified sample. Can actually place a print order and meet the diverse requirements of a wide range of users.
[0111]
Also, the first sample identification information D2 designating the first sample and the image data of the first sample are stored, and the second sample identification information D3 designating the second sample and the second sample The image data is stored, the sample image data selected based on the designated first and second sample identification information D2 and D3, and the image data and / or character data based on the order are synthesized, and according to the designation In order to create a print based on a sample, it is possible to synthesize a wider variety of images, and it is possible to create a print that meets a wider variety of user requirements.
[0112]
The operation unit 11 includes information input means 12. The information input unit 12 is configured by a touch panel, for example, and outputs a pressing signal from the information input unit 12 to the control unit 7 as an input signal. Note that the operation unit 11 may be configured to include a keyboard, a mouse, and the like. The CRT 8 displays image information and the like according to the display control signal input from the control unit 7.
[0113]
The communication means (output) 33 sends an image signal representing a photographed image after image processing of the present invention and order information attached thereto to other computers in the facility where the image recording apparatus 1 is installed, the Internet Etc. to a distant computer via
[0114]
As shown in FIG. 5, the image recording apparatus 1 displays an image input unit that captures image information obtained by dividing and metering images of various digital media and an image original, an image processing unit, and a processed image. Print output, image output means for writing to an image recording medium, and means for transmitting image data and accompanying order information to another computer in the facility or a distant computer via the Internet via a communication line, Prepare.
[0115]
Next, processing executed by the image processing unit 70 in FIG. 5 will be described with reference to the first to fourth embodiments.
[0116]
[Example 1]
First, the configuration in the first embodiment will be described.
[0117]
<Configuration of image processing unit>
FIG. 6 is a block diagram showing a functional configuration of the image processing unit 70 according to the twenty-ninth aspect of the present invention. As shown in FIG. 6, the image processing unit 70 includes an image adjustment processing unit 701, a film scan data processing unit 702, a reflection original scan data processing unit 703, an image data format decoding processing unit 704, a template processing unit 705, and CRT specific processing. Section 706, printer specific processing section (1) 707, printer specific processing section (2) 708, image data creation processing section 709, header information analysis section 102, apparatus characteristic correction processing section 103a, processing condition table 103b, scene reference image data A generation unit 104, an appreciation image reference data generation unit 107, a gradation conversion curve data memory 116, a hardness / brightness setting input unit 109, and a parallax amount / correction value calculation unit 119 are configured.
[0118]
The film scan data processing unit 702 performs a calibration operation specific to the film scanner unit 9, negative / positive reversal (in the case of a negative document), dust flaw removal, gray balance adjustment, contrast adjustment, granularity for the image data input from the film scanner unit 9. Processing such as noise removal and sharpening enhancement is performed, and processed image data is output to the image adjustment processing unit 701. Also, the film size, negative / positive type, information relating to the main subject optically or magnetically recorded on the film, information relating to the photographing conditions (for example, information content described in APS) and the like are also output to the image adjustment processing unit 701. .
[0119]
The reflection original scan data processing unit 703 performs a calibration operation unique to the reflection original input device 10, negative / positive reversal (in the case of a negative original), dust flaw removal, gray balance adjustment, and contrast for the image data input from the reflection original input device 10. Processing such as adjustment, noise removal, and sharpening enhancement is performed, and processed image data is output to the image adjustment processing unit 701.
[0120]
The image data format decoding processing unit 704 restores the compression code as necessary according to the data format of the image data input from the image transfer means 30 and / or the communication means (input) 32, and the color data. Are converted into a data format suitable for calculation in the image processing unit 70 and output to the image adjustment processing unit 701. In addition, when the size of the output image is specified from any of the operation unit 11, the communication unit (input) 32, and the image transfer unit 30, the image data format decoding processing unit 704 detects the specified information, The image is output to the image adjustment processing unit 701. Information about the size of the output image designated by the image transfer means 30 is embedded in the header information and tag information of the image data acquired by the image transfer means 30.
[0121]
The image adjustment processing unit 701 receives from the film scanner unit 9, the reflection original input device 10, the image transfer unit 30, the communication unit (input) 32, and the template processing unit 705 based on the command from the operation unit 11 or the control unit 7. The image data is subjected to image processing that gives a favorable impression when observing the image on the output medium by the method described later to generate digital image data for output, and a CRT specific processing unit 706, a printer specific processing unit (1) 707, printer specific processing unit (2) 708, image data creation processing unit 709, and data storage means 71. In this image processing, the image adjustment processing unit 701 creates appreciation image reference data suitable for the output device and output medium from the gradation conversion curve data memory 116 based on commands from the operation unit 11 and the control unit 7. The gradation conversion curve data for reading is read out and output to the appreciation image reference data generation unit 107.
[0122]
The template processing unit 705 reads out predetermined image data (template) from the template storage unit 72 based on a command from the image adjustment processing unit 701, and performs template processing for combining the image data to be processed with the template. The image data after the template processing is output to the image adjustment processing unit 701.
[0123]
The header information analysis unit 102 decodes the imaging device characteristic correction data when the image data format decoding processing unit 704 determines that the image data is input from the image transfer unit 30 or the communication unit (input) 32. .
[0124]
The device characteristic correction processing unit 103a refers to the processing condition table 103b and determines an image processing condition from the imaging device characteristic correction data. The scene reference image data generation unit 104 generates scene reference image data in accordance with the image processing conditions determined by the device characteristic correction processing unit 103a. The scene reference image data generation unit 104 determines whether the generated scene reference image data is a parallax image, and outputs the determination result to the parallax amount / correction value calculation unit 119.
[0125]
When the determination result that the scene reference image data is a parallax image is input from the scene reference image data generation unit 104, the parallax amount / correction value calculation unit 119 calculates the parallax amount from the parallax image, and the parallax amount The hardness correction value and the brightness correction value (see FIG. 8) according to the above are calculated.
[0126]
The appreciation image reference data generation unit 107 generates appreciation image reference data from the gradation conversion curve data and the scene reference image data. Also, the viewing image reference data generation unit 107 includes the hardness correction value and the brightness correction value specified by the hardness / brightness setting input unit 109, and the hardness correction calculated by the parallax amount / correction value calculation unit 119. The hardness correction value and the brightness correction value for actually correcting the tone conversion curve are determined from the value and the brightness correction value, and the tone conversion is performed based on the determined hardness correction value and the brightness correction value. The gradation conversion curve read from the curve data memory 116 is corrected (changed), and the viewing image reference data is generated again.
[0127]
The CRT specific processing unit 706 performs a process such as changing the number of pixels and color matching on the image data input from the image adjustment processing unit 701 as necessary, and combines the information with information that needs to be displayed, such as control information. Image data is output to the CRT 8.
[0128]
The printer-specific processing unit {circle around (1)} 707 performs printer-specific calibration processing, color matching, pixel number change processing and the like as necessary, and outputs processed image data to the exposure processing unit 4.
[0129]
When an external printer 51 such as a large-format ink jet printer can be connected to the image recording apparatus 1 of the present invention, a printer specific processing unit {circle around (2)} 708 is provided for each connected printer device. This printer-specific processing unit {circle around (2)} 708 performs printer-specific calibration processing, color matching, pixel number change, and the like, and outputs processed image data to the external printer 51.
[0130]
The image data format creation processing unit 709 converts the image data input from the image adjustment processing unit 701 into various general-purpose image formats typified by JPEG, TIFF, Exif, and the like as necessary. The completed image data is output to the image transport unit 31 and the communication means (output) 33.
[0131]
The image data created in the appreciation image reference data generation unit 107 is processed by the CRT unique processing unit 706, the printer unique processing unit (1) 707, the printer unique processing unit (2) 708, and the image data creation processing unit 709. Based on the format of the appreciation image reference data, the image data creation processing unit 709 optimizes image data for CRT, exposure output unit, external printer, communication means (output), etc. Can be individually output to the image transport unit 31.
[0132]
The film scan data processing unit 702, the reflection original scan data processing unit 703, the image data format decoding processing unit 704, the image adjustment processing unit 701, the CRT specific processing unit 706, the printer specific processing unit (1) 707 shown in FIG. The printer-specific processing unit {circle around (2)} 708 and the image data creation processing unit 709 are provided to help understand the functions of the image processing unit 70 and need to be realized as physically independent devices. For example, it may be realized as a type of software processing in a single CPU.
[0133]
The header information analysis unit 102, device characteristic correction processing unit 103a, shooting information data processing unit 106, scene reference image data generation unit 104, and appreciation image reference data generation unit 107 are also classified into the image processing unit 70 according to the present invention. This is a division provided to assist in understanding the function, and is not necessarily realized as a physically independent device. For example, it may be realized as a division of the type of software processing in a single CPU.
[0134]
<Configuration of image processing device>
Next, an image processing apparatus 115 according to the present invention will be described with reference to the block diagram of FIG. The image processing apparatus 115 constitutes a part of the image processing unit 70 in FIG. 6 and includes an input unit 101, a header information analysis unit 102, a first processing unit 113, and a second processing unit 114 as shown in FIG. Composed. The header information analysis unit 102 is connected to the first processing unit 113, and the storage device 110, the output device 111, and the display device 112 are connected to the second processing unit 114.
[0135]
The input unit 101 reads image data recorded by the imaging device from a storage medium. The header information analysis unit 102 analyzes the header information of the image data read from the input unit 101, and divides it into imaging device characteristic correction data and subject information attached to the image data.
[0136]
The first processing unit 113 includes an apparatus characteristic correction processing unit 103a, a processing condition table 103b, a scene reference image data generation unit 104, a temporary storage memory 105, and a parallax amount / correction value calculation unit 119.
[0137]
The device characteristic correction processing unit 103a refers to the processing condition table 103b, determines the generation conditions for scene reference image data from the image pickup device characteristic correction data, and generates the determined scene reference image data generation conditions as scene reference image data generation. Output to the unit 103.
[0138]
The scene reference image data generation unit 104 generates scene reference image data subjected to the imaging device characteristic correction processing from the image data to be processed according to the scene reference image data generation conditions determined by the device characteristic correction processing unit 103a. To do. Further, the scene reference image data generation unit 104 determines whether the generated scene reference image data is a parallax image from the tag information of the image data to be processed, and calculates the determination result as a parallax amount / correction value. Output to the unit 119. The temporary storage memory 105 temporarily stores the scene reference image data generated by the scene reference image data generation unit 104.
[0139]
When the determination result that the scene reference image data is a parallax image is input from the scene reference image data generation unit 104, the parallax amount / correction value calculation unit 119 calculates the parallax amount from the parallax image, and FIG. Based on the relationship between the parallax amount and the hardness correction value shown in a), a hardness correction value corresponding to the calculated parallax amount is calculated. Also, the parallax amount / correction value calculation unit 119 calculates a brightness correction value according to the calculated parallax amount from the relationship between the parallax amount and the brightness correction value illustrated in FIG. In FIG. 8A, the hardness correction value is set so that the gradation is increased as the amount of parallax increases (that is, as the subject is closer). In FIG. 8B, the brightness correction value is set so that the larger the amount of parallax (that is, the closer the subject is), the brighter the image. Details of the method of calculating the amount of parallax will be described later with reference to FIGS. Note that the parallax amount of the parallax image may be written in the tag information of the scene reference image data.
[0140]
The setting input unit (not shown) outputs operation information regarding the types of the storage device 110, the output device 111, and the display device 112 that output digital image data to the appreciation image reference data generation unit 107 of the second processing unit 114.
[0141]
The second processing unit 114 includes a gradation conversion curve data memory 116, a hardness / brightness setting input unit 109, an appreciation image reference data generation unit 107, and a temporary storage memory 108.
[0142]
The gradation conversion curve data memory 116 stores gradation conversion curve data, specific area data, and movement trajectory data for each output medium.
[0143]
The hardness / brightness setting input unit 109 includes an input device for inputting the hardness correction value and the brightness correction value of the viewing image reference data.
[0144]
The appreciation image reference data generation unit 107 reads the scene reference image data stored in the temporary storage memory 105, and when the output medium is designated by the setting input unit (not shown), the gradation conversion curve data memory 116 Then, gradation conversion curve data corresponding to the designated output medium is read, and appreciation image reference data is generated based on the read gradation conversion curve data.
[0145]
The appreciation image reference data generation unit 107 calculates the sum of the hardness correction value input from the hardness / brightness setting input unit 109 and the hardness correction value calculated by the parallax amount / correction value calculation unit 119. It is determined as a hardness correction value for actually correcting the gradation conversion curve, the specific area data is read from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected based on the determined hardness correction value. (Change) process. Furthermore, the viewing image reference data generation unit 107 calculates the sum of the brightness correction value input from the hardness / brightness setting input unit 109 and the brightness correction value calculated by the parallax amount / correction value calculation unit 119. It is determined as a brightness correction value for actually correcting the gradation conversion curve, the movement trajectory data is read from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected based on the determined brightness correction value. (Change) process. The appreciation image reference data generation unit 107 regenerates the appreciation image reference data based on the corrected gradation conversion curve. Details of the method of creating a new gradation conversion curve by correcting the gradation conversion curve will be described later.
[0146]
In the above description, the sum of the hardness correction value (A) input from the hardness / brightness setting input unit 109 and the hardness correction value (B) calculated by the parallax amount / correction value calculation unit 119 (A + B) ) Is determined as a hardness correction value for actually correcting the gradation conversion curve, but is not limited to this. The same applies to the determination of the brightness correction value.
[0147]
The temporary storage memory 108 temporarily stores the appreciation image reference data generated by the appreciation image reference data generation unit 107. The viewing image reference data stored in the temporary storage memory 108 is output to any of the storage device 110, the output device 111, and the display device 112 in accordance with operation information from a setting input unit (not shown).
[0148]
<Calculation method of parallax amount>
Next, a method for calculating the amount of parallax will be described with reference to FIGS.
[0149]
FIG. 9 shows the relationship between the two imaging optical systems (CCD1, CCD2) of the imaging apparatus used for acquiring images for stereoscopic display and subjects (P1, P2) having different distances. The distance W between the CCD 1 and the CCD 2 is called the photographing base line length, and is usually set to about 6 to 7 cm, which is equal to the distance between the human eyes. f is the focal length of the lens, and is set to the same value for the CCD 1 and the CCD 2. P1 represents a specific position on the building subject located at the shooting distance of H1 from the lens, and P2 represents a specific position on the person subject located at the shooting distance of H2 from the lens.
[0150]
In FIG. 9, among the subjects P1 and P2, the subject P2 located near the lens differs greatly in CC1 and CCD2, but the subject P1 located far from the lens differs greatly in the image formation position. It can be seen that the CCD 1 and the CCD 2 have a small shift in image forming position.
[0151]
The imaging distance S1 of the subject P1 is calculated from the imaging position of the subject P1 in the CCD1 and CCD2, and the imaging distance S2 of the subject P2 is calculated from the imaging position of the subject P2 in the CCD1 and CCD2. Subtracting the imaging baseline length W from the imaging distance S1 yields the parallax amount V = S1-W of the subject P1, and subtracting the imaging baseline length W from the imaging distance S2 results in the parallax amount V = S2-W of the subject P2. Is obtained.
[0152]
In addition, it is preferable to use the shooting distance information as a supplement for calculating the amount of parallax. The photographing distance can be measured by arranging the infrared light emitting part and the light receiving part at the same base line length as that of the CCD 1 and the CCD 2. This is generally used as a distance measuring method for automatic focusing (autofocus) of a photographing lens. In this case, the parallax amount V can be calculated from the shooting distance H and the shooting baseline length W by the following equation (1).
[Expression 1]
V = f × (W / H) (1)
In Formula (1), W / H represents a baseline ratio.
[0153]
Any known method such as feature extraction processing or similarity determination for scene reference image data can be used as a method for detecting the subjects P1 and P2. As an example of a method for detecting a specific subject, extraction of the contour of the subject, detection of the pupil position, and the like as shown in FIG.
[0154]
Also, as shown in FIG. 11, the subject area can be detected by extracting a predetermined color such as a skin color area or a high saturation area. Thus, in order to extract a specific color region, the RGB values of the image data are converted into the HSV color system (H: hue, S: saturation, V: lightness), and two-dimensional hue and saturation are obtained. This can be realized by creating a histogram and determining hue and saturation extraction conditions from the created two-dimensional histogram. For example, if the hue is 10 to 30 degrees and the saturation (0 to 255) is limited to 50 to 100, the skin color region can be extracted.
[0155]
<Creation of gradation conversion curve>
First, a method for creating an initial gradation conversion curve will be described. The gradation conversion curve is created by applying the following formulas (2) to (5) defined by IEC61966-2-1 and the following formula (6) defined by JISZ8729 to the scene reference image data. This is done by using the lightness (luminance) value obtained.
[0156]
[Expression 2]

[Equation 3]

[Expression 4]

[Equation 5]

[Formula 6]

[0157]
Expressions (2) to (5) are expressed as 8-bit image data (R_{sRGB (8)}, G_{sRGB (8)}, B_{sRGB (8)}) To the tristimulus values (X, Y, Z) of the color matching function. Here, the color matching function is a function indicating the spectral sensitivity distribution of the human eye. Here, sRGB in the expressions (2) to (5) indicates that the RGB value of the image data conforms to the sRGB standard, and (8) in the expression (2) is 8 bits (0 to 255). It shows that it is image data.
[0158]
Moreover, in Formula (6), L * shows a brightness | luminance. Since the gradation conversion curve defines the relationship between the input value and the output value only for luminance, a * b * is not necessary, and only L * is calculated. Also, Y in equation (6)_nIndicates Y of a standard white plate, D₆₅Indicates a stimulation value when a standard white plate is illuminated with light having a color temperature of 6500K. In equation (6), Y_n= 1.
[0159]
When L * is obtained by Expression (6), an initial gradation conversion curve is created by setting the initial values of hardness and brightness and a predetermined position in the specific area. For example, the hardness of L * = 20 to 50 is 1.42, the hardness of L * = 20 to 75 is 1.35, and the input L * as a predetermined position in a specific region (non-moving region) is 44.4. Can be set to The initial values of hardness and brightness and the predetermined position can be set for each user by the hardness / brightness setting unit 109 or the operation unit 11 and stored in the gradation conversion curve data memory 116.
[0160]
Next, an example of a conditional expression for adjusting a “hardness” and “brightness” using a specific area (non-moving area) on the initial gradation conversion curve and creating a new gradation conversion curve is shown below.
[0161]
The following two coefficients (F_C, F_L) Is defined.
▲ 1 ▼ F_C: Hardness adjustment factor (-2 <F_C<2, F_C= 0 Initial gradation conversion curve)
▲ 2 ▼ F_L: Brightness adjustment factor (-2 <F_L<2, F_L= 0 Initial gradation conversion curve)
A variable necessary for changing the gradation conversion curve by these adjustment coefficients is expressed by Equation (7).
[Expression 7]

[0162]
In Expression (7), L represents an input L * at which the output L * = 50, Ls represents an input L * at which the output L * = 20, and Lh represents an input L at which the output L * = 75. *, Gs indicates the hardness at the input L * = 20 to 50, and G indicates the hardness at the input L * = 20 to 75.
[0163]
Smooth through 5 points (0, 0), (Ls, 20), (L, 50), (Lh, 75), (100, 100) by Ls, L, and Lh calculated by equation (7) A simple curve is calculated by cubic spline interpolation with the second-order differential value = 0 as both-end conditions of spline interpolation. Hereinafter, the spline interpolation will be described.
[0164]
The given point x₀, X₁, X₂, ..., x_nAnd the function value is defined as in equation (8).
[Equation 8]

Further, a small section obtained by dividing the closed section [a, b] by these dividing points is defined as follows. [x_j, x_{j + 1}] (0≤j≤n-1) where a = x₀<x₁<x₂,… <X_n= B.
[0165]
A cubic polynomial that can be second-order differentiated in the interval [a, b] is called a cubic spline function, which is represented as s (x). This cubic spline function is divided into subsections [x_j, x_{j + 1}], The polynomial s defined by equation (10)_jIt can be expressed as (x).
[Equation 9]

From equation (9), u₀, U₁, U₂, ..., u_nIs substituted into the following equation (10).
[Expression 10]

[0166]
Other specific examples of spline interpolation include MathSoft's MathCAD2000 lspline function, Watanabe Tsutomu, Natori Ryo, Oguni Tsuji supervised "Numerical calculation software by Fortran77" Maruzen Co., Ltd. page 248 SPLC function (DF (1) = DF (2) = 0, IOPT (1) = IOPT (2) = 1), Noriyoshi Kurose, Isao Matsushima, Toshihiko Matsuo "SPLINT function" page 162 , Using the spline function on page 110 of CQ Publishing, "Algorithm Textbook" written by Naoki Mikami, and the spline function on page 106 of Technical Review, "Numerical Recipes in C Japanese Version" written by WHPress, SATeukolsky, WTVetterling, BPFlannery be able to.
[0167]
Figure 12 shows the hardness adjustment factor F_CIs -2, -1, 0, +1, +2, brightness adjustment factor F_LThe gradation conversion curve when is 0 is shown. In FIG. 12, the curve GP2 is F_C= + 2 indicates the curve GP1 is F_C= + 1, the curve GP0 is F_C= 0, the curve GM1 is F_C= -1 indicates the curve GM2 is F_C==-2.
[0168]
FIG. 13 shows the brightness adjustment factor F._LIs -2, -1, 0, +1, +2, hardness adjustment factor F_CThe gradation conversion curve when is 0 is shown. In FIG. 13, the curve GP2 is F_L= + 2 indicates the curve GP1 is F_L= + 1, the curve GP0 is F_L= 0, the curve GM1 is F_L= -1 indicates the curve GM2 is F_L==-2.
[0169]
FIG. 14 shows the brightness adjustment factor F._LIs -2, -1, 0, +1, +2, hardness adjustment factor F_CThe movement trajectory of the specific area (non-moving area) when is 0 is shown. Note that the above-described method for creating a gradation conversion curve is also applied to the following embodiments. Further, the method of creating the gradation conversion curve is not limited to the method described above.
[0170]
Next, the operation in the first embodiment will be described.
Image processing in the first embodiment will be described with reference to the flowchart of FIG.
[0171]
First, after input of scene reference image data is instructed (step S101), an output medium is designated by a setting input unit (not shown) (step S102). From the gradation conversion curve data memory 116, step S102 is performed. In step S103, gradation conversion curve data corresponding to the output medium specified in step S103 is read, and appreciation image reference data is generated from the scene reference image data based on the read gradation conversion curve data. (Step S104).
[0172]
Next, it is determined whether or not the scene reference image data to be processed is a parallax image (step S105). If it is determined in step S105 that the scene reference image data is not a parallax image (step S105; NO), the process proceeds to step S108 described later.
[0173]
If it is determined in step S105 that the scene reference image data is a parallax image (step S105; YES), a parallax amount is calculated from the parallax image (step S106). Next, a hardness correction value and a brightness correction value corresponding to the parallax amount calculated in step S106 are calculated based on the graph of FIG. 8 (step S107).
[0174]
When the scene reference image data is not a parallax image, when the hardness correction value is input by the hardness / brightness setting input unit 109, the input hardness correction value actually corrects the gradation conversion curve. Is determined as a hardness correction value (step S108). When the scene reference image data is a parallax image, when a hardness correction value is input by the hardness / brightness setting input unit 109, the input hardness correction value and the amount of parallax in step S107 are determined. The sum of the calculated hardness correction values is determined as the hardness correction value for actually correcting the gradation conversion curve (step S108).
[0175]
When the hardness correction value is determined, the specific area data is read from the gradation conversion curve data memory 116 (step S109), and the gradation conversion curve is corrected according to the hardness correction value determined in step S108. (Step S110).
[0176]
When the scene reference image data is not a parallax image, when the brightness correction value is input by the hardness / brightness setting input unit 109, the input brightness correction value actually corrects the gradation conversion curve. Is determined as a brightness correction value (step S111). When the scene reference image data is a parallax image, when a brightness correction value is input by the hardness / brightness setting input unit 109, the input brightness correction value and the parallax amount calculated in step S107 are set. The sum of the brightness correction values calculated accordingly is determined as the brightness correction value for actually correcting the gradation conversion curve (step S111).
[0177]
When the brightness correction value is determined, the movement trajectory data is read from the gradation conversion curve data memory 116 (step S112), and the gradation conversion curve is corrected according to the brightness correction value determined in step S111. (Step S113). Next, the appreciation image reference data is regenerated based on the corrected gradation conversion curve (step S114), and the image processing ends.
[0178]
As described above, according to the first embodiment, the gradation conversion curve is adjusted based on the hardness correction value of the viewing image reference data, and the gradation conversion curve is adjusted based on the brightness correction value. By performing image processing that suppresses interference of effects, an ideal tone conversion curve can be set. In addition, the load related to the setting work can be reduced, and the efficiency of the setting work of the gradation conversion curve can be improved. Further, when the scene reference image data is a parallax image, a hardness correction value and a brightness correction value are calculated based on the parallax amount of the parallax image, and a gradation is calculated based on the hardness correction value and the brightness correction value. By adjusting the conversion curve, the image quality of the stereoscopic display image can be improved.
[0179]
[Example 2]
First, the configuration in the second embodiment will be described.
[0180]
<Configuration of image processing unit>
FIG. 16 is a block diagram showing a functional configuration of the image processing unit 70 according to the thirtieth aspect of the present invention. As shown in FIG. 16, the image processing unit 70 includes an image adjustment processing unit 701, a film scan data processing unit 702, a reflection original scan data processing unit 703, an image data format decoding processing unit 704, a template processing unit 705, and CRT specific processing. Section 706, printer specific processing section (1) 707, printer specific processing section (2) 708, image data creation processing section 709, header information analysis section 102, apparatus characteristic correction processing section 103a, processing condition table 103b, scene reference image data The generation unit 104, the appreciation image reference data generation unit 107, the gradation conversion curve data memory 116, the shooting information data processing unit 106, and the parallax amount / correction value calculation unit 119 are configured. In the following, only the differences from the image processing unit 70 of the first embodiment (see FIG. 6) among the components constituting the image processing unit 70 of the second embodiment will be described.
[0181]
When the image data format decoding processing unit 704 determines that the image data has been input from the image transfer unit 30 or the communication unit (input) 32, the header information analysis unit 102 captures image capturing device characteristic correction data and imaging information. Decrypt the data.
[0182]
The shooting information data processing unit 106 calculates the hardness correction value and the brightness correction value of the viewing image reference data from the information regarding the type of the subject and the shooting information included in the shooting information data from the header information analysis unit 102 (Table 1 and Table 2), and outputs the calculation result to the appreciation image reference data generation unit 107. The parallax amount / correction value calculation unit 119 calculates a parallax amount from the parallax image, and calculates a hardness correction value and a brightness correction value (see FIG. 18) according to the parallax amount and the type of the subject.
[0183]
The appreciation image reference data generation unit 107 generates appreciation image reference data from the gradation conversion curve data and the scene reference image data. The appreciation image reference data generation unit 107 also calculates the hardness correction value and the brightness correction value calculated by the photographing information data processing unit 106, and the hardness correction value and the brightness calculated by the parallax amount / correction value calculation unit 119. From the correction value, a hardness correction value and a brightness correction value for actually correcting the gradation conversion curve are determined, and based on the determined hardness correction value and the brightness correction value, a gradation conversion curve is obtained. A correction (change) process is performed, and viewing image reference data is generated again.
[0184]
<Configuration of image processing device>
Next, an image processing apparatus 115 according to the sixteenth aspect of the present invention will be described with reference to the block diagram of FIG. The image processing apparatus 115 constitutes a part of the image processing unit 70 of FIG. 16, and includes an input unit 101, a header information analysis unit 102, a first processing unit 113, and a second processing unit 114 as shown in FIG. Composed. The header information analysis unit 102 is connected to the first processing unit 113, and the storage device 110, the output device 111, and the display device 112 are connected to the second processing unit 114. Hereinafter, only differences from the image processing apparatus 115 according to the first embodiment (see FIG. 7) among the respective units constituting the image processing apparatus 115 according to the second embodiment will be described.
[0185]
The header information analysis unit 102 analyzes the header information of the image data read from the input unit 101 and divides it into subject information, imaging device characteristic correction data attached to the image data, and imaging information data.
[0186]
The first processing unit 113 includes an apparatus characteristic correction processing unit 103a, a processing condition table 103b, a scene reference image data generation unit 104, a temporary storage memory 105, and a parallax amount / correction value calculation unit 119. In the first processing unit 113, the description of the configuration other than the parallax amount / correction value calculation unit 119 is the same as the description in the first embodiment, and is omitted here.
[0187]
The parallax amount / correction value calculation unit 119 calculates the parallax amount from the parallax image, and based on the relationship between the parallax amount and the hardness correction value illustrated in FIG. A correction value is calculated. Further, the parallax amount / correction value calculation unit 119 calculates a brightness correction value according to the type of subject and the calculated parallax amount from the relationship between the parallax amount and the brightness correction value illustrated in FIG. In FIG. 18A, when the subject is a person, the tone is softened as the amount of parallax increases, and when the subject is a landscape or a still life, the tone correction is performed so that the tone is increased as the amount of parallax increases. Value is set. In FIG. 18B, when the subject is a person, the brightness correction value is set so that the brightness is increased as the amount of parallax increases, and when the subject is a still object, the brightness is set to be constant regardless of the amount of parallax. Yes.
[0188]
The second processing unit 114 includes an appreciation image reference data generation unit 107, a temporary storage memory 108, a gradation conversion curve data memory 116, and a photographing information data processing unit 106. The description of the configuration of the temporary storage memory 108 and the gradation conversion curve data memory 116 is the same as that described in the first embodiment, and is omitted here.
[0189]
The shooting information data processing unit 106 calculates the hardness correction value of the viewing image reference data from the information regarding the type of subject included in the shooting information data input from the header information analysis unit 102, and the shooting information included in the shooting information data The brightness correction value of the viewing image reference data is calculated from the information regarding the condition, and the calculation result is output to the viewing image reference data generation unit 107.
[0190]
Hereinafter, conditions for adjusting the hardness of the gradation conversion curve according to the type of subject will be exemplified. Table 1 shows reference values of the difference (Δ hardness) and Fc value (hardness adjustment coefficient) of hardness (L * 20 to 75) from the initial gradation conversion curve for each subject.
[Table 1]

[0191]
Next, conditions for adjusting the brightness (brightness) of the gradation conversion curve according to the shooting conditions will be exemplified. Table 2 shows the difference in brightness (L * 50) from the initial gradation conversion curve for each shooting condition (Δ brightness) and F_LIndicates the reference value of the value (brightness adjustment factor).
[Table 2]

[0192]
The appreciation image reference data generation unit 107 reads the scene reference image data stored in the temporary storage memory 105, and when the output medium is designated by the setting input unit (not shown), the gradation conversion curve data memory 116 Then, gradation conversion curve data corresponding to the designated output medium is read, and appreciation image reference data is generated based on the read gradation conversion curve data.
[0193]
The appreciation image reference data generation unit 107 calculates the sum of the hardness correction value calculated by the shooting information data processing unit 106 and the hardness correction value calculated by the parallax amount / correction value calculation unit 119 as an actual floor. It is determined as a hardness correction value for correcting the tone conversion curve, the specific area data is read from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected (changed) based on the determined hardness correction value. Process. Furthermore, the viewing image reference data generation unit 107 calculates the sum of the brightness correction value calculated by the shooting information data processing unit 106 and the brightness correction value calculated by the parallax amount / correction value calculation unit 119 as an actual floor. It is determined as a brightness correction value for correcting the tone conversion curve, the movement trajectory data is read from the tone conversion curve data memory 116, and the tone conversion curve is corrected (changed) based on the determined brightness correction value. Process. The appreciation image reference data generation unit 107 regenerates the appreciation image reference data based on the corrected gradation conversion curve.
[0194]
In the above description, the sum (C + D) of the hardness correction value (C) calculated by the photographing information data processing unit 106 and the hardness correction value (D) calculated by the parallax amount / correction value calculation unit 119 is calculated as follows. Although it is determined as the hardness correction value for actually correcting the gradation conversion curve, the present invention is not limited to this. The same applies to the determination of the brightness correction value.
[0195]
Next, the operation in the second embodiment will be described.
Image processing in the second embodiment will be described with reference to the flowchart of FIG.
[0196]
First, after input of scene reference image data is instructed (step S201), when an output medium is designated by a setting input unit (not shown) (step S202), the gradation conversion curve data memory 116 reads the step S202. In step S203, gradation conversion curve data corresponding to the output medium specified in step S203 is read, and appreciation image reference data is generated from the scene reference image data based on the read gradation conversion curve data. (Step S204).
[0197]
Next, it is determined whether or not the scene reference image data to be processed is a parallax image (step S205). If it is determined in step S205 that the scene reference image data is a parallax image (step S205; YES), a parallax amount is calculated from the parallax image (step S206). Next, the shooting information data recorded in the header of the scene reference image data is read from the header information analysis unit 102, and the type of the subject is specified. Then, based on the graph of FIG. 18, the type of the specified subject and the hardness correction value and the brightness correction value corresponding to the parallax amount calculated in step S206 are calculated (step S207).
[0198]
When it is determined in step S205 that the scene reference image data is not a parallax image (step S205; NO), the shooting information data recorded in the header of the scene reference image data is read from the header information analysis unit 102, The type of subject is specified. Then, a hardness correction value is calculated from the identified subject type, for example, based on Table 1, and the calculated hardness correction value is used to actually correct the tone conversion curve. It is determined as a value (step S208).
[0199]
When the scene reference image data is a parallax image, a hardness correction value is calculated based on the type of subject specified in step S207 based on Table 1, and the calculated hardness correction value and in step S207. The sum of the calculated hardness correction values is determined as a hardness correction value for actually correcting the gradation conversion curve (step S208). When the hardness correction value is determined, the specific area data is read from the gradation conversion curve data memory 116 (step S209), and the gradation conversion curve is corrected according to the hardness correction value determined in step S208. (Step S210).
[0200]
Next, the shooting information data recorded in the header of the scene reference image data is read from the header information analysis unit 102, and the shooting conditions are specified. Then, for example, the brightness correction value is calculated from the specified shooting conditions based on Table 2, and the sum of the calculated brightness correction value and the brightness correction value calculated in step S207 is actually The brightness correction value for correcting the gradation conversion curve is determined (step S211).
[0201]
When the brightness correction value is determined, the movement trajectory data is read from the gradation conversion curve data memory 116 (step S212), and the gradation conversion curve is corrected according to the brightness correction value determined in step S211. (Step S213). Next, the appreciation image reference data is regenerated based on the corrected gradation conversion curve (step S214), and the image processing ends.
[0202]
As described above, according to the second embodiment, the hardness correction value of the viewing image reference data is determined according to the type of the subject, the gradation conversion curve is adjusted based on the hardness correction value, and the shooting condition is set. Accordingly, by determining the brightness correction value of the viewing image reference data and adjusting the gradation conversion curve based on the brightness correction value, an ideal gradation conversion curve can be set. In addition, it is possible to reduce the load related to the gradation conversion curve setting operation, and the gradation conversion curve setting operation is further improved in efficiency. Further, when the scene reference image data is a parallax image, the hardness correction value and the brightness correction value are calculated based on the parallax amount of the parallax image and the type of the subject, and the hardness correction value and the brightness correction value are calculated. By adjusting the gradation conversion curve based on this, the image quality of the stereoscopic display image can be further improved.
[0203]
[Example 3]
First, the configuration in the third embodiment will be described.
[0204]
<Configuration of image processing unit>
FIG. 20 is a block diagram showing a functional configuration of the image processing unit 70 according to the invention of claim 31. As shown in FIG. 20, the image processing unit 70 includes an image adjustment processing unit 701, a film scan data processing unit 702, a reflection original scan data processing unit 703, an image data format decoding processing unit 704, a template processing unit 705, and CRT specific processing. Section 706, printer specific processing section (1) 707, printer specific processing section (2) 708, image data creation processing section 709, header information analysis section 102, apparatus characteristic correction processing section 103a, processing condition table 103b, scene reference image data The generation unit 104, the appreciation image reference data generation unit 107, the gradation conversion curve data memory 116, the shooting information data processing unit 106, the condition calculation unit 303, and the parallax amount / correction value calculation unit 119 are configured. In the following, only the differences from the image processing unit 70 of the second embodiment (see FIG. 16) among the units constituting the image processing unit 70 of the third embodiment will be described.
[0205]
The shooting information data processing unit 106 determines whether or not there is a specific combination of the type of subject and shooting conditions from the information regarding the type of subject and shooting information included in the shooting information data from the header information analysis unit 102, If there is a specific combination, the data of the combination is output to the condition calculation unit 303.
[0206]
The condition calculation unit 303 stores in advance data of a hardness correction value and a brightness correction value that match each type of subject and shooting information (see Table 3 described later), and the shooting information data processing unit 106. The hardness correction value and the brightness correction value of the viewing image reference data are calculated in accordance with the combination data input from.
[0207]
The appreciation image reference data generation unit 107 generates appreciation image reference data from the gradation conversion curve data and the scene reference image data. The viewing image reference data generation unit 107 also calculates the hardness correction value and the brightness correction value calculated by the condition processing unit 303, and the hardness correction value and the brightness correction calculated by the parallax amount / correction value calculation unit 119. The hardness correction value and the brightness correction value for actually correcting the gradation conversion curve are determined from the values, and the gradation conversion curve is corrected based on the determined hardness correction value and the brightness correction value ( Change) processing is performed, and the viewing image reference data is generated again.
[0208]
<Configuration of image processing device>
Next, an image processing apparatus 115 according to the seventeenth aspect of the present invention will be described with reference to the block diagram of FIG. The image processing apparatus 115 constitutes a part of the image processing unit 70 in FIG. 20, and includes an input unit 101, a header information analysis unit 102, a first processing unit 113, and a second processing unit 114 as shown in FIG. Composed. The header information analysis unit 102 is connected to the first processing unit 113, and the storage device 110, the output device 111, and the display device 112 are connected to the second processing unit 114. Hereinafter, only the differences from the image processing apparatus 115 (see FIG. 17) of the second embodiment will be described among the components constituting the image processing apparatus 115 of the third embodiment.
[0209]
The description of the configuration of the header information analysis unit 102 and the first processing unit 113 is the same as the description in the second embodiment, and is omitted here.
[0210]
The second processing unit 114 includes an appreciation image reference data generation unit 107, a temporary storage memory 108, a gradation conversion curve data memory 116, a shooting information data processing unit 106, and a condition calculation unit 303. The description of the configuration of the temporary storage memory 108 and the gradation conversion curve data memory 116 is the same as that described in the first embodiment, and is omitted here.
[0211]
The shooting information data processing unit 106 determines whether or not there is a specific combination of the type of subject and shooting conditions from the information regarding the type of subject and shooting information included in the shooting information data from the header information analysis unit 102, If there is a specific combination, the data of the combination is output to the condition calculation unit 303.
[0212]
The condition calculation unit 303 stores in advance data of a hardness correction value and a brightness correction value that match each type of subject and shooting information (see Table 3 described later), and the shooting information data processing unit 106 The hardness correction value and the brightness correction value of the viewing image reference data are calculated in accordance with the combination data input from.
[0213]
Hereinafter, setting examples of the hardness correction value and the brightness (brightness) correction value according to a combination of a specific subject type and shooting conditions will be described. Table 3 shows differences in hardness (L * 20 to 75) from the initial gradation conversion curve (Δ hardness) and corresponding Fc values when the subject type is portrait and the shooting conditions are strobe and backlight. (Hardness adjustment coefficient), the difference between brightness (L * 50) from the initial gradation conversion curve (Δ brightness) and the corresponding F_LIndicates the reference value of the value (brightness adjustment factor).
[Table 3]

[0214]
The appreciation image reference data generation unit 107 reads the scene reference image data stored in the temporary storage memory 105, and when the output medium is designated by the setting input unit (not shown), the gradation conversion curve data memory 116 Then, gradation conversion curve data corresponding to the designated output medium is read, and appreciation image reference data is generated based on the read gradation conversion curve data.
[0215]
Also, the appreciation image reference data generation unit 107 converts the sum of the hardness correction value calculated by the condition processing unit 303 and the hardness correction value calculated by the parallax amount / correction value calculation unit 119 into an actual gradation conversion. The hardness correction value for correcting the curve is determined, the specific area data is read from the gradation conversion curve data memory 116, and the gradation conversion curve correction (change) processing is performed based on the determined hardness correction value. Do. Further, the appreciation image reference data generation unit 107 converts the brightness correction value calculated by the condition processing unit 303 and the brightness correction value calculated by the parallax amount / correction value calculation unit 119 into an actual tone conversion. The brightness correction value for correcting the curve is determined, the movement trajectory data is read out from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected (changed) based on the determined brightness correction value. Do. The appreciation image reference data generation unit 107 regenerates the appreciation image reference data based on the corrected gradation conversion curve.
[0216]
In the above description, the sum (E + F) of the hardness correction value (E) calculated by the condition processing unit 303 and the hardness correction value (F) calculated by the parallax amount / correction value calculation unit 119 is actually calculated. Although it is determined as the hardness correction value for correcting the gradation conversion curve, the present invention is not limited to this. The same applies to the determination of the brightness correction value.
[0217]
Next, the operation in the third embodiment will be described.
Image processing in the third embodiment will be described with reference to the flowchart of FIG.
[0218]
First, after input of scene reference image data is instructed (step S301), an output medium is designated by a setting input unit (not shown) (step S302). In step S303, gradation conversion curve data corresponding to the output medium designated in step S303 is read out, and appreciation image reference data is generated from the scene reference image data based on the read out gradation conversion curve data. (Step S304).
[0219]
Next, it is determined whether or not the scene reference image data to be processed is a parallax image (step S305). If it is determined in step S305 that the scene reference image data is a parallax image (step S305; YES), the parallax amount is calculated from the parallax image (step S306). Next, the shooting information data recorded in the header of the scene reference image data is read from the header information analysis unit 102, and the type of the subject is specified. Then, based on the graph of FIG. 18, the type of the specified subject and the hardness correction value and the brightness correction value corresponding to the parallax amount calculated in step S306 are calculated (step S307).
[0220]
When it is determined in step S305 that the scene reference image data is not a parallax image (step S305; NO), the shooting information data recorded in the header of the scene reference image data is read from the header information analysis unit 102, The type of subject and shooting conditions are specified. Then, based on the combination of the specified subject type and shooting conditions, for example, based on Table 3, a hardness correction value and a brightness correction value are calculated, and these calculated hardness correction value and brightness correction value are calculated. Then, it is determined as a hardness correction value and a brightness correction value for actually correcting the gradation conversion curve (step S308).
[0221]
When the scene reference image data is a parallax image, the sum of the hardness correction value calculated based on the combination of the type of subject and the shooting conditions and the hardness correction value calculated according to the parallax amount in step S307 is obtained. It is determined as a hardness correction value for actually correcting the gradation conversion curve. The sum of the brightness correction value calculated based on the combination of the type of subject and the shooting conditions and the brightness correction value calculated according to the amount of parallax in step S307 actually corrects the gradation conversion curve. Is determined as a brightness correction value (step S308).
[0222]
When the hardness correction value and the brightness correction value are determined, specific area data is read from the gradation conversion curve data memory 116 (step S309), and the gradation conversion curve is determined according to the hardness correction value determined in step S308. The correction process is performed (step S310).
[0223]
Next, movement trajectory data is read from the gradation conversion curve data memory 116 (step S311), and a gradation conversion curve correction process is performed according to the brightness correction value determined in step S308 (step S312). Next, the appreciation image reference data is regenerated based on the corrected gradation conversion curve (step S313), and the image processing ends.
[0224]
As described above, according to the third embodiment, the hardness correction value and the brightness correction value of the viewing image reference data are determined according to the combination of the type of the subject and the shooting conditions, and the determined hardness correction is performed. By adjusting the gradation conversion curve based on the value and the brightness correction value, it is possible to reduce the load related to the gradation conversion curve setting work, and the gradation conversion curve setting work is more efficient. It becomes. Further, when the scene reference image data is a parallax image, the hardness correction value and the brightness correction value are calculated based on the parallax amount of the parallax image and the type of the subject, and the hardness correction value and the brightness correction value are calculated. By adjusting the gradation conversion curve based on this, the image quality of the stereoscopic display image can be further improved.
[0225]
[Example 4]
First, the configuration in the fourth embodiment will be described.
[0226]
<Configuration of image processing unit>
FIG. 23 is a block diagram showing a functional configuration of the image processing unit 70 according to the invention as set forth in claim 32. As shown in FIG. 23, the image processing unit 70 includes an image adjustment processing unit 701, a film scan data processing unit 702, a reflection original scan data processing unit 703, an image data format decoding processing unit 704, a template processing unit 705, and CRT specific processing. Section 706, printer specific processing section (1) 707, printer specific processing section (2) 708, image data creation processing section 709, header information analysis section 102, apparatus characteristic correction processing section 103a, processing condition table 103b, scene reference image data A generation unit 104, an appreciation image reference data generation unit 107, a gradation conversion curve data memory 116, a hardness / brightness setting input unit 109, a saturation correction data calculation unit 304, and a parallax amount / correction value calculation unit 119 are configured. . In the following, only the differences between the image processing unit 70 of the first embodiment (see FIG. 6) and the components constituting the image processing unit 70 of the fourth embodiment will be described.
[0227]
The saturation correction data calculation unit 304 uses the hardness correction value specified by the hardness / brightness setting input unit 109 (and the hardness correction value calculated according to the parallax amount) of the appreciation image reference data. The saturation adjustment amount is calculated.
[0228]
The appreciation image reference data generation unit 107 generates appreciation image reference data from the gradation conversion curve data and the scene reference image data. The appreciation image reference data generation unit 107 also includes a hardness correction value and a brightness correction value specified by the hardness / brightness setting input unit 107, and a hardness correction calculated by the parallax amount / correction value calculation unit 119. The hardness correction value and the brightness correction value for actually correcting the gradation conversion curve are determined from the value and the brightness correction value, and the gradation is determined based on the determined hardness correction value and the brightness correction value. A correction (change) process is applied to the conversion curve. Furthermore, the appreciation image reference data generation unit 107 generates appreciation image reference data again based on the corrected gradation conversion curve and the saturation adjustment amount calculated by the saturation correction data calculation unit 304.
[0229]
<Configuration of image processing device>
Next, an image processing apparatus 115 according to the eighteenth aspect of the present invention will be described with reference to the block diagram of FIG. The image processing apparatus 115 constitutes a part of the image processing unit 70 of FIG. 23, and includes an input unit 101, a header information analysis unit 102, a first processing unit 113, and a second processing unit 114 as shown in FIG. Composed. The header information analysis unit 102 is connected to the first processing unit 113, and the storage device 110, the output device 111, and the display device 112 are connected to the second processing unit 114. Hereinafter, only differences from the image processing apparatus 115 according to the first embodiment (see FIG. 7) among the components constituting the image processing apparatus 115 according to the fourth embodiment will be described.
[0230]
The description of the configuration of the header information analysis unit 102 and the first processing unit 113 is the same as the description in the first embodiment, and is omitted here.
[0231]
The second processing unit 114 includes an appreciation image reference data generation unit 107, a temporary storage memory 108, a gradation conversion curve data memory 116, a hardness / brightness setting input unit 109, and a saturation correction data calculation unit 304. The description of the configuration of the temporary storage memory 108, the gradation conversion curve data memory 116, and the hardness / brightness setting input unit 109 is the same as that described in the first embodiment, and is omitted here.
[0232]
The saturation correction data calculation unit 304 uses the hardness correction value specified by the hardness / brightness setting input unit 109 (and the hardness correction value calculated according to the parallax amount) of the appreciation image reference data. The saturation adjustment amount is calculated. Hereinafter, an example of a definition formula for calculating the saturation adjustment amount according to the degree to which the gradation conversion curve is adjusted by the hardness correction value will be shown. Fc is the hardness adjustment coefficient corresponding to the specified hardness correction value, DG is the difference (Δ hardness) from the initial tone conversion curve of hardness (L * 25 to 75), and saturation adjustment amount (%) ) Is PS, the saturation adjustment amount PS is expressed by the following equation (11).
## EQU11 ##

Expression (11) shows a case where the saturation adjustment amount (emphasis amount) is set to + 10% (emphasis) when the hardness adjustment amount is 0, that is, the hardness adjustment coefficient is 0. . FIG. 25 shows the relationship between DG (= Δγ) and PS indicated by equation (11).
[0233]
The appreciation image reference data generation unit 107 reads the scene reference image data stored in the temporary storage memory 105, and when the output medium is designated by the setting input unit (not shown), the gradation conversion curve data memory 116 Then, gradation conversion curve data corresponding to the designated output medium is read, and appreciation image reference data is generated based on the read gradation conversion curve data.
[0234]
The appreciation image reference data generation unit 107 calculates the sum of the hardness correction value input from the hardness / brightness setting input unit 109 and the hardness correction value calculated by the parallax amount / correction value calculation unit 119. It is determined as a hardness correction value for actually correcting the gradation conversion curve, the specific area data is read from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected based on the determined hardness correction value. (Change) process. Furthermore, the viewing image reference data generation unit 107 calculates the sum of the brightness correction value input from the hardness / brightness setting input unit 109 and the brightness correction value calculated by the parallax amount / correction value calculation unit 119. It is determined as a brightness correction value for actually correcting the gradation conversion curve, the movement trajectory data is read from the gradation conversion curve data memory 116, and the gradation conversion curve is corrected based on the determined brightness correction value. (Change) process. The appreciation image reference data generation unit 107 generates appreciation image reference data again based on the corrected gradation conversion curve and the saturation adjustment amount calculated by the saturation correction data calculation unit 304.
[0235]
In the above description, the sum of the hardness correction value (A) input from the hardness / brightness setting input unit 109 and the hardness correction value (B) calculated by the parallax amount / correction value calculation unit 119 (A + B) ) Is determined as a hardness correction value for actually correcting the gradation conversion curve, but is not limited to this. The same applies to the determination of the brightness correction value.
[0236]
Next, the operation in the fourth embodiment will be described.
Image processing according to the fourth embodiment will be described with reference to the flowchart of FIG.
[0237]
First, after input of scene reference image data is instructed (step S401), when an output medium is designated by a setting input unit (not shown) (step S402), the gradation conversion curve data memory 116 reads the step S402. In step S403, gradation conversion curve data corresponding to the output medium designated in step S403 is read out, and appreciation image reference data is generated from the scene reference image data based on the read out gradation conversion curve data. (Step S404).
[0238]
Next, it is determined whether or not the scene reference image data to be processed is a parallax image (step S405). If it is determined in step S405 that the scene reference image data is not a parallax image (step S405; NO), the process proceeds to step S408 described later.
[0239]
If it is determined in step S405 that the scene reference image data is a parallax image (step S405; YES), a parallax amount is calculated from the parallax image (step S406). Next, a hardness correction value and a brightness correction value corresponding to the parallax amount calculated in step S406 are calculated based on the graph of FIG. 8 (step S407).
[0240]
When the scene reference image data is not a parallax image, when the hardness correction value is input by the hardness / brightness setting input unit 109, the input hardness correction value actually corrects the gradation conversion curve. Is determined as a hardness correction value (step S408). When the scene reference image data is a parallax image, when a hardness correction value is input by the hardness / brightness setting input unit 109, the input hardness correction value and the amount of parallax in step S407 are determined. The sum of the calculated hardness correction values is determined as the hardness correction value for actually correcting the gradation conversion curve (step S408).
[0241]
When the hardness correction value is determined, the specific area data is read from the gradation conversion curve data memory 116 (step S409), and the gradation conversion curve is corrected according to the hardness correction value determined in step S408. (Step S410).
[0242]
When the scene reference image data is not a parallax image, when the brightness correction value is input by the hardness / brightness setting input unit 109, the input brightness correction value actually corrects the gradation conversion curve. Is determined as a brightness correction value (step S411). When the scene reference image data is a parallax image, when a brightness correction value is input by the hardness / brightness setting input unit 109, the input brightness correction value and the amount of parallax in step S407 are determined. The sum of the calculated brightness correction values is determined as the brightness correction value for actually correcting the gradation conversion curve (step S411).
[0243]
When the brightness correction value is determined, movement trajectory data is read from the gradation conversion curve data memory 116 (step S412), and the gradation conversion curve is corrected according to the brightness correction value determined in step S411. (Step S413).
[0244]
Next, the saturation adjustment amount is calculated based on the hardness correction value determined in step S408 (step S414). Next, the appreciation image reference data is regenerated based on the gradation conversion curve subjected to the correction processing and the saturation adjustment amount (step S415), and the image processing ends.
[0245]
As described above, according to the fourth embodiment, the tone conversion curve is adjusted based on the hardness correction value of the viewing image reference data, the tone conversion curve is adjusted based on the brightness correction value, and the hardness correction is performed. Setting the gradation conversion curve by determining the saturation adjustment amount based on the value and generating the viewing image reference data based on the adjusted (corrected) gradation conversion curve and the saturation adjustment amount Therefore, the setting operation of an ideal gradation conversion curve can be further improved. Further, when the scene reference image data is a parallax image, a hardness correction value and a brightness correction value are calculated based on the parallax amount of the parallax image, and a gradation is calculated based on the hardness correction value and the brightness correction value. By adjusting the conversion curve, the image quality of the stereoscopic display image can be improved.
[0246]
Note that the description content in each of the above embodiments can be changed as appropriate without departing from the spirit of the present invention.
[0247]
For example, by combining the second and third embodiments, the hardness of the viewing image reference data is set according to the type of the subject, the brightness of the viewing image reference data is set according to the shooting condition, and the type of the subject The brightness and brightness of the viewing image reference data may be set according to the combination of the shooting conditions.
[0248]
Also, by combining the second and fourth embodiments, the hardness of the viewing image reference data is set according to the type of the subject, the brightness of the viewing image reference data is set according to the shooting conditions, and the viewing image is referenced. You may make it adjust the saturation of appreciation image reference data according to the grade which adjusted the hardness of data.
[0249]
Further, by combining the third and fourth embodiments, the hardness and brightness of the viewing image reference data is set according to the combination of the type of subject and the shooting conditions, and the hardness of the viewing image reference data is adjusted according to the degree of adjustment. Thus, the saturation of the viewing image reference data may be adjusted.
[0250]
Further, by combining the second embodiment, the third embodiment, and the fourth embodiment, the hardness of the viewing image reference data is set according to the type of the subject, and the brightness of the viewing image reference data is set according to the shooting conditions. In addition, the hardness and brightness of the viewing image reference data are set according to the combination of the type of subject and the shooting conditions, and the saturation of the viewing image reference data is adjusted according to the degree to which the hardness of the viewing image reference data is adjusted. You may do it.
[0251]
【The invention's effect】
According to the present invention, when the scene reference image data is a parallax image, the hardness correction value and the brightness correction value are determined based on the parallax amount of the parallax image, and the hardness correction value and the brightness correction value are determined. Based on this, the tone conversion curve indicating the conversion from the scene reference image data to the appreciation image reference data is adjusted, so that the image quality of the stereoscopic display image can be improved. In addition, the hardness of the viewing image reference data is adjusted by changing the shape of the gradation conversion curve using a specific area including a predetermined position on the gradation conversion curve as a non-moving area, and the specific area is a curve in which the specific area is defined in advance. By adjusting the brightness of the viewing image reference data by changing the shape of the gradation conversion curve so as to move, the efficiency of the gradation conversion curve setting work can be improved. Further, it is possible to adjust the hardness of the viewing image reference data in which the brightness fluctuation is suppressed. Furthermore, it is possible to adjust the brightness of the viewing image reference data in which the variation in hardness is suppressed.
[0252]
In addition, by adjusting the hardness of the viewing image reference data according to the type of the subject and adjusting the brightness of the viewing image reference data according to the shooting conditions, it is possible to improve the efficiency of setting the gradation conversion curve. it can. In addition, by adjusting the hardness and brightness of the viewing image reference data according to the combination of the specific subject type and the shooting conditions, it is possible to further improve the efficiency of setting the gradation conversion curve.
[0253]
In addition, since the saturation of the viewing image reference data can be adjusted according to the correction value of the hardness of the viewing image reference data, the setting operation of the gradation conversion curve is made efficient, and preferable viewing of the viewing image is performed. Data can be obtained.
[Brief description of the drawings]
FIG. 1 is a diagram showing a gradation conversion curve for converting scene reference image data to appreciation image reference data.
2 is a diagram showing a predetermined position 1 on the gradation conversion curve of FIG. 1 and a specific area 2 including the predetermined position 1. FIG.
FIG. 3 is a diagram for explaining a movement trajectory of a specific area 2 in FIG. 2;
FIG. 4 is a perspective view showing an external configuration of an image recording apparatus 1 in the present embodiment.
5 is a block diagram showing an internal configuration of the image recording apparatus 1. FIG.
FIG. 6 is a block diagram showing a functional configuration of an image processing unit 70 in Embodiment 1 of the present invention.
FIG. 7 is a block diagram showing a functional configuration of the image processing apparatus 115 according to the first embodiment of the present invention.
FIG. 8 is a diagram showing the relationship between the parallax amount and the hardness correction value (FIG. 8A) and the relationship between the parallax amount and the brightness correction value (FIG. 8B).
FIG. 9 is a diagram for explaining a parallax amount calculation method;
FIG. 10 is a diagram for explaining a subject detection method;
FIG. 11 is a diagram for explaining a subject detection method;
FIG. 12 is a diagram illustrating an example of a gradation conversion curve.
FIG. 13 is a diagram illustrating an example of a gradation conversion curve.
FIG. 14 is a diagram illustrating an example of a movement locus of a specific region (non-moving region) in a gradation conversion curve.
15 is a flowchart showing image processing in Embodiment 1. FIG.
FIG. 16 is a block diagram showing a functional configuration of an image processing unit in Embodiment 2 of the present invention.
FIG. 17 is a block diagram showing a functional configuration of an image processing apparatus 115 in Embodiment 2 of the present invention.
18 shows the relationship between the parallax amount and the hardness correction value for each subject type (FIG. 18A), and the relationship between the parallax amount and the brightness correction value for each subject type (FIG. 18B). Figure.
FIG. 19 is a flowchart illustrating image processing according to the second embodiment.
FIG. 20 is a block diagram illustrating a functional configuration of an image processing unit in Embodiment 3 of the present invention.
FIG. 21 is a block diagram showing a functional configuration of an image processing apparatus 115 in Embodiment 3 of the present invention.
FIG. 22 is a flowchart illustrating image processing according to the third embodiment.
FIG. 23 is a block diagram illustrating a functional configuration of an image processing unit in Embodiment 4 of the present invention.
FIG. 24 is a block diagram showing a functional configuration of an image processing apparatus 115 in Embodiment 4 of the present invention.
FIG. 25 is a view showing a relationship between a difference DG (Δγ) from an initial gradation conversion curve of hardness (L * 25 to 75) and a saturation adjustment amount PS (%).
FIG. 26 is a flowchart illustrating image processing according to the fourth embodiment.
[Explanation of symbols]
1 Image recording device
4 Exposure processing section
5 Print creation department
7 Control unit
8 CRT
9 Film scanner
10 Reflective document input device
11 Operation unit
12 Information input means
14 Image reading part
15 Image writing unit
30 Image transfer means
31 Image transport unit
32 Communication means (input)
33 Communication means (output)
51 External printer
70 Image processing unit
701 Image adjustment processing unit
702 Film scan data processing section
703 Reflected original scan data processing unit
704 Image data format decoding processor
705 Template processing unit
706 CRT-specific processing section
707 Print unique processing section (1)
708 Print specific processing section (2)
709 Image data creation processing unit
71 Data storage means
72 Template storage means
101 Input section
102 Header information analysis unit
103a Processing condition table
103b Device characteristic correction processing unit
104 Scene reference image data generation unit
105, 108 Temporary storage memory
106 Shooting information data processing unit
107 viewing image reference data generation unit
109 Hardness / brightness setting input section
116 Gradation conversion curve data memory
119 Parallax amount / correction value calculation unit
303 Condition calculation unit
304 Saturation correction data calculation unit

Claims (42)

In an image processing method for generating appreciation image reference data by performing image processing optimized for scene appreciation image formation on an output medium on scene reference image data,
A determination step of determining whether or not the scene reference image data is a parallax image;
In the determination step, when it is determined that the scene reference image data is a parallax image, the hardness correction value and the brightness correction value of the viewing image reference data are determined based on the parallax amount of the parallax image. A correction value determination step to be performed;
A first changing step for changing a gradation conversion curve, which is defined in advance for each output medium and indicates a conversion from scene reference image data to appreciation image reference data, based on the determined hardness correction value;
A second changing step of changing the gradation conversion curve based on the determined brightness correction value;
Generating a viewing image reference data based on the gradation conversion curve changed in the first changing step and the second changing step,
In the first changing step, the shape of the gradation conversion curve is changed based on the determined hardness correction value, with a specific region including a predetermined position on the gradation conversion curve as a fixed region,
In the second changing step, the shape of the gradation conversion curve is changed based on the determined brightness correction value so that the specific region moves on a predefined curve. An image processing method. A hardness calculation step of calculating a correction value of the hardness of the viewing image reference data according to the type of the subject;
A brightness calculation step of calculating a correction value of brightness of the appreciation image reference data according to shooting conditions,
In the correction value determination step, a hardness correction value of the viewing image reference data is determined based on the hardness correction value calculated in the hardness calculation step and the parallax amount of the parallax image, and the brightness The brightness correction value of the viewing image reference data is determined based on the brightness correction value calculated in the height calculation step and the parallax amount of the parallax image. Image processing method. A hardness / brightness calculation step of calculating a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions,
Based on the parallax amount of the parallax image and the hardness correction value and the brightness correction value calculated in the hardness / brightness calculation step in the correction value determination step, the hardness of the viewing image reference data The image processing method according to claim 1, wherein a correction value and a brightness correction value are determined. A saturation determination step of determining an adjustment amount of saturation of the viewing image reference data based on the correction value of the hardness determined in the correction value determination step;
In the generation step, appreciation image reference data is generated based on the gradation conversion curve changed in the first change step and the second change step and the determined saturation adjustment amount. The image processing method according to claim 1. A hardness / brightness calculation step of calculating a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions,
Based on the parallax amount of the parallax image, the hardness correction value calculated in the hardness calculation step, and the hardness correction value calculated in the hardness / brightness calculation step in the correction value determination step, The hardness correction value of the viewing image reference data is determined, the parallax amount of the parallax image, the brightness correction value calculated in the brightness calculation step, and the brightness calculated in the hardness / brightness calculation step. The image processing method according to claim 2, wherein a correction value for brightness of the viewing image data is determined based on a correction value for height. A saturation determination step of determining an adjustment amount of saturation of the viewing image reference data based on the correction value of the hardness determined in the correction value determination step;
In the generating step, appreciation image reference data is generated based on the gradation conversion curve changed in the first changing step and the second changing step and the saturation adjustment amount. The image processing method according to claim 2. A saturation determination step of determining an adjustment amount of saturation of the viewing image reference data based on the correction value of the hardness determined in the correction value determination step;
In the generating step, appreciation image reference data is generated based on the gradation conversion curve changed in the first changing step and the second changing step and the adjustment amount of the saturation. The image processing method according to claim 3. A saturation determination step of determining an adjustment amount of saturation of the viewing image reference data based on the correction value of the hardness determined in the correction value determination step;
In the generating step, appreciation image reference data is generated based on the gradation conversion curve changed in the first changing step and the second changing step and the adjustment amount of the saturation. The image processing method according to claim 5. 9. The method according to claim 3, wherein, in the combination of the specific subject type and the photographing condition, the subject type is a portrait and the photographing condition is a backlight. Image processing method. The saturation adjustment amount when the hardness correction value is 0 is a value that emphasizes the saturation of the viewing image reference data, according to any one of claims 4 and 6-8. The image processing method as described. The image processing method according to claim 2, wherein at least a portrait, a landscape, and a still life are included in the types of subjects. The image processing method according to claim 2, wherein the photographing condition includes at least backlighting and flash photography. The input / output value of the gradation conversion curve is L *, and the predetermined position in the specific region is a position where the input L * is 40 or more and less than 50. An image processing method according to claim 1. The image processing method according to claim 1, wherein initial values of the hardness and brightness of the gradation conversion curve defined in advance for each output medium are stored for each user. . In an image processing device that generates scene image reference data by performing image processing optimized for scene image formation on an output medium on scene reference image data,
A determination unit that determines whether or not the scene reference image data is a parallax image;
When the determination unit determines that the scene reference image data is a parallax image, the hardness correction value and the brightness correction value of the viewing image reference data are determined based on the parallax amount of the parallax image. A correction value determination unit to perform,
A first changing unit configured to change a gradation conversion curve that is defined in advance for each output medium and indicates conversion from scene reference image data to appreciation image reference data based on the determined hardness correction value;
A second changing unit that changes the gradation conversion curve based on the determined brightness correction value;
A generating unit that generates appreciation image reference data based on the gradation conversion curve changed by the first changing unit and the second changing unit;
The first changing unit changes a shape of the gradation conversion curve based on the determined hardness correction value, with a specific region including a predetermined position on the gradation conversion curve as a non-moving region,
The second changing unit changes the shape of the gradation conversion curve based on the determined brightness correction value so that the specific area moves on a predefined curve. An image processing apparatus. A hardness calculation unit that calculates a correction value of the hardness of the viewing image reference data according to the type of the subject;
A brightness calculation unit that calculates a correction value of the brightness of the appreciation image reference data according to shooting conditions,
The correction value determination unit determines a correction value of hardness of the viewing image reference data based on a correction value of hardness calculated by the hardness calculation unit and a parallax amount of the parallax image, and the brightness 16. The image according to claim 15, wherein a brightness correction value of the appreciation image reference data is determined based on a brightness correction value calculated by a height calculation unit and a parallax amount of the parallax image. Processing equipment. The correction value determination unit includes a hardness / brightness calculation unit that calculates a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions. Based on the parallax amount of the parallax image, the hardness correction value and the brightness correction value calculated by the hardness / brightness calculation unit, the hardness correction value and the brightness of the viewing image reference data The image processing apparatus according to claim 15, wherein a correction value is determined. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generating unit generates appreciation image reference data based on the gradation conversion curve changed by the first changing unit and the second changing unit and the determined saturation adjustment amount. The image processing apparatus according to claim 15, characterized in that: The correction value determination unit includes a hardness / brightness calculation unit that calculates a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions. Based on the parallax amount of the parallax image, the hardness correction value calculated by the hardness calculation unit, and the hardness correction value calculated by the hardness / brightness calculation unit, A hardness correction value is determined, based on the parallax amount of the parallax image, the brightness correction value calculated by the brightness calculation unit, and the brightness correction value calculated by the hardness / brightness calculation unit The image processing apparatus according to claim 16, wherein a correction value for brightness of the viewing image data is determined. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. The image processing apparatus according to claim 16. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. The image processing apparatus according to claim 17. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. The image processing apparatus according to claim 19. 23. The combination of any one of claims 17, 19, 21, and 22, wherein in the combination of the specific subject type and the photographing condition, the subject type is a portrait and the photographing condition is a backlight. Image processing device. The saturation adjustment amount when the correction value of the hardness is 0 is a value that emphasizes the saturation of the viewing image reference data. The image processing apparatus described. The image processing apparatus according to any one of claims 16, 17, and 19 to 24, wherein the types of subjects include at least a portrait, a landscape, and a still life. The image processing apparatus according to any one of claims 16, 17, and 19 to 25, wherein the photographing conditions include at least backlighting and flash photography. The input / output value of the gradation conversion curve is L *, and the predetermined position in the specific region is a position where the input L * is 40 or more and less than 50. An image processing apparatus according to claim 1. The image processing apparatus according to any one of claims 15 to 27, wherein initial values of hardness and brightness of a gradation conversion curve defined in advance for each output medium are stored for each user. . In an image recording apparatus that generates scene image reference data by performing image processing optimized for scene image formation on an output medium on scene reference image data, and forms the generated scene image data on the output medium ,
A determination unit that determines whether or not the scene reference image data is a parallax image;
When the determination unit determines that the scene reference image data is a parallax image, the hardness correction value and the brightness correction value of the viewing image reference data are determined based on the parallax amount of the parallax image. A correction value determination unit to perform,
A first changing unit configured to change a gradation conversion curve that is defined in advance for each output medium and indicates conversion from scene reference image data to appreciation image reference data based on the determined hardness correction value;
A second changing unit that changes the gradation conversion curve based on the determined brightness correction value;
A generating unit that generates appreciation image reference data based on the gradation conversion curve changed by the first changing unit and the second changing unit;
The first changing unit changes a shape of the gradation conversion curve based on the determined hardness correction value, with a specific region including a predetermined position on the gradation conversion curve as a non-moving region,
The second changing unit changes the shape of the gradation conversion curve based on the determined brightness correction value so that the specific area moves on a predefined curve. An image recording apparatus. A hardness calculation unit that calculates a correction value of the hardness of the viewing image reference data according to the type of the subject;
A brightness calculation unit that calculates a correction value of the brightness of the appreciation image reference data according to shooting conditions,
The correction value determination unit determines a correction value of hardness of the viewing image reference data based on the correction value of hardness calculated by the hardness calculation unit and the amount of parallax of the parallax image, and the brightness 30. The image according to claim 29, wherein a brightness correction value of the viewing image reference data is determined based on a brightness correction value calculated by a height calculation unit and a parallax amount of the parallax image. Recording device. The correction value determination unit includes a hardness / brightness calculation unit that calculates a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions. Based on the parallax amount of the parallax image, the hardness correction value and the brightness correction value calculated by the hardness / brightness calculation unit, the hardness correction value and the brightness of the viewing image reference data 30. The image recording apparatus according to claim 29, wherein a correction value is determined. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generating unit generates appreciation image reference data based on the gradation conversion curve changed by the first changing unit and the second changing unit and the determined saturation adjustment amount. 30. The image recording apparatus according to claim 29, characterized in that: The correction value determination unit includes a hardness / brightness calculation unit that calculates a hardness correction value and a brightness correction value of the viewing image reference data according to a combination of a specific subject type and shooting conditions. Based on the parallax amount of the parallax image, the hardness correction value calculated by the hardness calculation unit, and the hardness correction value calculated by the hardness / brightness calculation unit, A hardness correction value is determined, based on the parallax amount of the parallax image, the brightness correction value calculated by the brightness calculation unit, and the brightness correction value calculated by the hardness / brightness calculation unit 31. The image recording apparatus according to claim 30, wherein a correction value for brightness of the viewing image data is determined. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. The image recording apparatus according to claim 30. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. 32. The image recording apparatus according to claim 31. A saturation determination unit that determines an adjustment amount of the saturation of the viewing image reference data based on the correction value of the hardness determined by the correction value determination unit;
The generation unit generates appreciation image reference data based on the gradation conversion curve changed by the first change unit and the second change unit and the saturation adjustment amount. 34. The image recording apparatus according to claim 33. 37. The combination of any one of the specific subject type and shooting conditions, wherein the subject type is portrait and the shooting condition is backlight. Image recording device. 37. The saturation adjustment amount when the hardness correction value is 0 is a value that emphasizes the saturation of the viewing image reference data. The image recording apparatus described. The image recording apparatus according to any one of claims 30, 31, and 33 to 38, wherein the types of subjects include at least a portrait, a landscape, and a still life. 40. The image recording apparatus according to any one of claims 30, 31, 33 to 39, wherein the photographing condition includes at least backlighting and strobe photographing. The input / output value of the gradation conversion curve is L *, and the predetermined position in the specific region is a position where the input L * is 40 or more and less than 50. An image recording apparatus according to claim 1. The image recording apparatus according to any one of claims 29 to 41, wherein initial values of hardness and brightness of a gradation conversion curve defined in advance for each output medium are stored for each user. .

Images