JP4019660B2 - Image data processing apparatus, image data processing method, and program - Google Patents

Description

なお、上記式（１）において、
ｔはガラス１１１の厚みを示し、
θは鏡１１０の水平面に対する角度を示し、
ｎ₁は空気中における屈折率を示し、
ｎ₂はガラス１１１の屈折率を示す。
【００５８】
そして、ＣＰＵ１１は、ステップＳ１２で得られた補正画素データと、ステップＳ１３で求められた光路差ｄの値とをもとに、光路差に相当する画素数の算出処理を実行し（ステップＳ１４）、鏡１１０における光路差ｄに相当する、撮影画像データ中の画素数を求め、ステップＳ１５へ移行する。
【００５９】
ステップＳ１５では、ステップＳ１４で求められた画素数と、ステップＳ１２で得られた補正画素データとをもとにして、画像データの補正を行う。
詳細に説明すると、ガラス１１１の表面における反射光は、反射蒸着面１１２における反射光とは光路差ｄだけ離れている。従って、カメラ１０３の撮像素子が、光路差ｄだけ離れた位置で受光した光をもとにして減算すべき画素データを求め、この画素データを、補正対象の画素データから減算すれば、ガラス１１１の表面における反射光の影響を除くことができる。
【００６０】
ステップＳ１５における処理を式で示すと、下記式（２）に示す通りになる。ＣＰＵ１１は、下記式（２）に示す処理を、画像データワークメモリ１２ｂに格納された画像データ中の全ての画素データについて行うことにより、画像の補整を行う。
【数２】

【００６１】
そして、ＣＰＵ１１は、ステップＳ１５で補正された後の画素データを含む画像データを、先に画像データワークメモリ１２ｂに格納されていた画像データに置き換えて画像データメモリ１２ａに格納し（ステップＳ１６）、ステップＳ８（図４）へ移行する。
【００６２】
図６は、図５のステップＳ１４に示す光路差に相当する画素数の算出処理を、より詳細に示すフローチャートである。
【００６３】
図５に示す処理において、ＣＰＵ１１は、まず、カメラ１０３における撮影条件を取得して、ＲＡＭ１２のワークエリア１２ｄに記憶する（ステップＳ２１）。ここで撮影条件とは、撮影解像度、撮影倍率、撮影距離を指し、以後、撮影倍率の値をＺ、撮影距離の値をＲとする。
【００６４】
続いて、ＣＰＵ１１は、記憶装置１３に格納された実寸算出式係数テーブル１３ａを参照し、ステップＳ２１で取得した撮影解像度に対応するパラメータａ，ｂ，ｃを取得する（ステップＳ２２）。
【００６５】
そして、ＣＰＵ１１は、１ミリメートルに相当する撮影画像中の画素数を求める（ステップＳ２３）。この画素数は、例えば、下記式（３）に示す演算を行うことにより求められる。
【数３】

【００６６】
その後、ＣＰＵ１１は、ステップＳ２３で求められた画素数をもとに、ステップＳ１２で求められる光路差ｄに相当する画素数を算出し（ステップＳ２４）、ステップＳ１５（図５）へ移行する。
【００６７】
以上の処理によって、画像処理装置１０においては、鏡１１０に映る被写体１０５の鏡像をカメラ１０３により撮影した画像について、ガラス１１１の表面における反射光の影響を除く処理を施すことにより、鮮明な画像を得ることができる。これにより、鮮明な画像を必要とする場合であっても、鏡を用いて撮影を行うことが可能になる。
【００６８】
また、鏡の角度を変えて複数の画像を撮影した場合であっても、鏡の表面における反射光の影響が除かれているので、各画像が異なる具合に不鮮明になってしまうようなことがない。このため、鏡の角度を厳密に調整する等の作業を行う必要がなく、鏡を利用した撮影を手軽に行うことができる。
【００６９】
特に、撮影条件等をもとに、既に撮影された画像について補正を行うので、従来用いていたカメラを用いることができる。このため、上記第１の実施の形態における画像処理装置１０は、カメラ１０３内部の機構等に改良を加えた場合に比べて、非常に容易に、かつ低コストで実現できる。
【００７０】
なお、上記第１の実施の形態においては、図１２に示す撮影装置１００を利用して撮影された画像を処理する場合について説明としたが、本発明はこれに限定されるものではなく、鏡を用いて撮影を行った画像のデータであれば容易に適用できる。また、例えば、ＣＣＤ等の撮像素子を有するカメラ１０３を利用した場合について説明したが、カメラ１０３に代えて銀塩カメラによって撮影を行った場合であっても、撮影されたフィルムをフィルムスキャナで読み取る等の処理により画像データをデジタルデータとして得ることができれば、本発明を容易に適用することができる。
【００７１】
また、上記の画像処理装置１０による処理は、撮影装置１００に限らず、カメラ内部に鏡を有する場合についても適用できる。以下、この場合について、第２の実施の形態として説明する。
【００７２】
〔第２の実施の形態〕
図７は、本発明を適用した第２の実施の形態におけるカメラの撮像系２０について、その概略構成を示す図である。本第２の実施の形態においては、撮像系２０を有するカメラにより撮影された画像を、上記画像処理装置１０（図１）によって処理する場合について説明する。従って、画像処理装置１０が有するＩ／Ｆ１８は、撮像系２０を有するカメラに接続されているものとする。
【００７３】
図７に示す撮像系２０においては、入射光をレンズ２１によって集光し、鏡２２によって反射させ、撮像素子２３によって受光する。従って、撮像素子２３により鏡２２に映る鏡像を撮影することになる。
【００７４】
また、鏡２２は一般的な鏡として、一面に反射蒸着面が形成されたガラスによってなるものであり、鏡２２への入射光の大部分が反射蒸着面で反射される一方、入射光の一部はガラス表面で反射され、ＣＣＤ等によってなる撮像素子２３に入射する。従って、撮像素子２３により撮影された画像は、鏡２２のガラス表面における反射光の影響で不鮮明な画像になってしまうおそれがある。
【００７５】
図８は、本第２の実施の形態における画像処理装置１０の動作を示すフローチャートである。
【００７６】
図８に示す処理において、ＣＰＵ１１は、まず、カメラのシャッターがＯＮにされたか否かを判別し（ステップＳ３１）、シャッターがＯＮにされていない場合は、撮像素子２３により得られる画像の取り込みを行う（ステップＳ３２）。続いて、ＣＰＵ１１は、取り込んだ画像をＲＡＭ１２内の画像データワークメモリ１２ｂに格納し（ステップＳ３３）、画像データワークメモリ１２ｂに格納した画像をもとに表示情報を生成して表示部１６に出力して、表示部１６の画面上に撮像素子２３により得られる画像を表示させ（ステップＳ３４）、後述するステップＳ４１に移行する。
【００７７】
一方、カメラのシャッターがＯＮにされた場合（ステップＳ３１；Ｙｅｓ）、ＣＰＵ１１は、カメラ１０３が有する撮像素子２３により受光された画像のデータを取得し、ＲＡＭ１２内の画像データワークメモリ１２ｂに取り込み、さらにＲ，Ｇ，Ｂの色要素に分解することで、各画素の色調アナログデータを取得する（ステップＳ３５）。
【００７８】
次いで、ＣＰＵ１１は、ステップＳ３で取得した各画素の色調アナログデータを増幅し（ステップＳ３６）、さらにＡ／Ｄ変換を行って（ステップＳ３７）、各画素の色調データを示すデジタルデータを生成して画像データメモリ１２ａに格納する（ステップＳ３８）。
【００７９】
そして、ＣＰＵ１１は、画像データメモリ１２ａ内の画像データについて画像データ補正処理を実行し（ステップＳ３９）、撮影画像の画像データを補整して、より鮮明な画像の画像データを得る。このステップＳ３９における画像データ補正処理は、上記第１の実施の形態において図５に示した処理と同様である。
【００８０】
その後、ＣＰＵ１１は、補正された画像データを、ＲＡＭ１２内の画像データメモリ１２ａ若しくは画像データ保存メモリ１２ｃに格納して保存し（ステップＳ４０）、ステップＳ４１に移行する。
【００８１】
ステップＳ４１では、撮影が終了したか否かを判別し、終了していない場合はステップＳ３１に戻る。
なお、ステップＳ４０で保存された画像データは、その後Ｄ／Ａ変換によってアナログ画像データに変換され、表示部１６の画面上に表示させることもできる。
【００８２】
このように、鏡２２を利用した撮像系２０を有するカメラで撮影された画像について本発明を適用すれば、鏡２２のガラス表面における反射光の影響を除くことで、より鮮明な画像を得ることができる。
【００８３】
また、本発明は、撮影を行う場合に限られず、鏡を用いて画像を投影する場合についても適用できる。以下、この場合について、第３の実施の形態として説明する。
【００８４】
〔第３の実施の形態〕
図９は、本発明を適用した第３の実施の形態におけるプロジェクターの投影光学系３０について、その概略構成を示す図である。
本第３の実施の形態においては、投影光学系３０を有するプロジェクターにより投影される画像を、上記画像処理装置１０（図１）によって処理する場合について説明する。従って、画像処理装置１０が有するＩ／Ｆ１８は、投影光学系３０を有するプロジェクターに接続されているものとする。
【００８５】
投影光学系３０は、光源３１により発せられた光を、凹面鏡３２によってＬＣＤ３３に向けて反射させる。そして、ＬＣＤ３３を透過した光を凹レンズ３４により拡散し、鏡３５によって反射させて、図示しないスクリーン等に投影するものである。
ＬＣＤ３３には、画像処理装置１０の制御に従って画像が表示されるので、光源３１からの光がＬＣＤ３３を透過することにより、ＬＣＤ３３に表示された画像をスクリーン等に投影することができる。
【００８６】
図１０は、鏡３５の構成を示すとともに、鏡３５における反射の様子を模式化して示す図である。
図１０に示すように、鏡３５は、ガラス３５１と、ガラス３５１の一面に形成された反射蒸着面３５２とによって構成される。そして、鏡３５に入射する入射光のうち大部分は反射蒸着面３５２で反射されて放射されるが、入射光の一部はガラス３５１の表面で反射する。このため、鏡３５への入射光は、ガラス３５１の表面における反射光と、反射蒸着面３５２における反射光とに分かれて放射されてしまい、スクリーン上の画像は不鮮明なものとなるおそれがある。
【００８７】
従って、本第３の実施の形態においては、ＬＣＤ３３に表示される画像を画像処理装置１０によって処理し、鏡で反射されることで適切な画像となるように補正することで、鮮明な投影画像を得られるようにするものである。
【００８８】
ここで、図１０に模式的に示すように、鏡３５の反射光として、Ａ〜Ｌの１０本の光線を投影する場合を例にとって説明する。Ａ〜Ｌの１０本の光線は、互いに、ガラス３５１の表面における反射光と反射蒸着面３５２における反射光との光路差に相当する間隔を有している。
【００８９】
上述のように、Ａ〜Ｌの１０本の光線をそのまま鏡３５に入射させた場合、反射光は、ガラス３５１の表面における反射光と、反射蒸着面３５２における反射光とに分かれてしまう。
【００９０】
そこで、鏡３５への入射光を、Ａ´、Ａ´−ｂ、Ｂ´−ｃ、Ｃ´−ｄ、Ｄ´−ｅ、Ｅ´−ｆ、Ｆ´−ｇ、Ｇ´−ｈ、Ｈ´−ｉ、Ｉ´−ｊ、Ｊ´−ｋ、Ｋ´−ｌの１１本の光線を入射光とする。なお、これら１１本の光線は、互いに、ガラス３５１の表面における反射光と反射蒸着面３５２における反射光との光路差ｄに相当する間隔を有している。なお、Ａ´，Ｂ´，Ｃ´，Ｄ´，Ｅ´，Ｆ´，Ｇ´，Ｈ´，Ｉ´，Ｊ´，Ｋ´、及び、ａ，ｂ，ｃ，ｄ，ｅ，ｆ，ｇ，ｈ，ｉ，ｊ，ｋ，ｌは、それぞれ、光線Ａ，Ｂ，Ｃ，Ｄ，Ｅ，Ｆ，Ｇ，Ｈ，Ｉ，Ｊ，Ｋ，Ｌの一部と等しく、かつ、光量（強度）が異なる光である。
【００９１】
すると、上記１１本の光線は、一部がガラス３５１の表面で反射され、大部分は反射蒸着面３５２で反射され、光路差ｄだけ離れて放射される。このため、光線Ａ´は光線Ａ´−ｂと重ね合わされて放射される。同様に、光線Ａ´−ｂは光線Ｂ´−ｃと、光線Ｂ´−ｃは光線Ｃ´−ｄと、光線Ｃ´−ｄは光線Ｄ´−ｅと、光線Ｄ´−ｅは光線Ｅ´−ｆと、光線Ｅ´−ｆは光線Ｆ´−ｇと、光線Ｆ´−ｇは光線Ｇ´−ｈと、光線Ｇ´−ｈは光線Ｈ´−ｉと、光線Ｈ´−ｉは光線Ｉ´−ｊと、光線Ｉ´−ｊは光線Ｊ´−ｋと、光線Ｊ´−ｋは光線Ｋ´−ｌと、それぞれ重ね合わされて放射される。
【００９２】
従って、Ａ´，Ｂ´，Ｃ´，Ｄ´，Ｅ´，Ｆ´，Ｇ´，Ｈ´，Ｉ´，Ｊ´，Ｋ´、及び、ａ，ｂ，ｃ，ｄ，ｅ，ｆ，ｇ，ｈ，ｉ，ｊ，ｋ，ｌの光量（強度）を、光線Ａ，Ｂ，Ｃ，Ｄ，Ｅ，Ｆ，Ｇ，Ｈ，Ｉ，Ｊ，Ｋ，Ｌに対して適切な値に設定することにより、鏡３５からの反射光を、重なりのない光線Ａ，Ｂ，Ｃ，Ｄ，Ｅ，Ｆ，Ｇ，Ｈ，Ｉ，Ｊ，Ｋ，Ｌとすることができる。
【００９３】
図１１は、本第３の実施の形態における画像処理装置１０の動作を示すフローチャートである。
【００９４】
図１１に示す処理において、画像処理装置１０は、まず、投影光学系３０の光源３１を点灯させ（ステップＳ５１）、続いて、投影すべき画像として記憶装置１３に格納された画像データを読み出して、画像データワークメモリ１２ｂに格納する（ステップＳ５２）。
【００９５】
ここで、ＣＰＵ１１は、画像データワークメモリ１２ｂに格納された画像データを補整する処理を実行する（ステップＳ５３）。このステップＳ５３における処理で、ＣＰＵ１１は、上記第１の実施の形態において図５に示す処理と同様に、鏡３５における補正画素データ値を求め、次いで鏡３５において生じる光路差ｄを求め、さらに光路差ｄに相当する画素数を算出し、画像データワークメモリ１２ｂに格納された画像データに含まれる各画素のデータを補正する処理を行う。
【００９６】
そして、ＣＰＵ１１は、補正された画像データをもとにＬＣＤ３３へ補正された画像を出力して表示させる（ステップＳ５４）。
その後、ＣＰＵ１１は、投影が終了したか否かを判別し、終了していない場合はステップＳ５１へ戻る。
【００９７】
このように、投影光学系３０を有するプロジェクターに本発明を適用することにより、鏡を利用して画像を投影する場合において、鏡を構成するガラス表面における反射光の影響を除いて、鮮明な画像を投影することが可能になる。また、投影光学系３０を有するプロジェクターにおいて、その投影光学系の構造に改良を加える場合に比べ、本発明は、非常に安価に、かつ容易に適用することができる。
【００９８】
そして、本発明によれば、鏡の影響によって画像が不鮮明になることを気にせずに画像を投影することができるので、手軽に鮮明な投影画像を得られる上、スクリーンの設置等を厳密に行う必要がなくなる。
【００９９】
なお、上記第３の実施の形態においては、投影光学系３０の中に鏡を含む例について説明したが、本発明はこれに限定されるものではなく、例えば、プロジェクターの外部に鏡を設置し、この鏡を利用して画像をスクリーン等に投影する場合についても、勿論適用することができる。
【０１００】
また、上記の実施の形態においては、画像処理装置１０を構成する各部の構成は任意であり、その他の具体的な細部構成についても適宜に変更可能であることは勿論である。
【０１０１】
【発明の効果】
本発明の画像データ処理装置によれば、鏡の表面における反射光と鏡の裏面の反射材で反射された光との光路差を求めた上で、画像データから鏡の表面における反射光の影響を排除するので、鏡の表面における反射光の影響を、効率よく、確実に排除して、鮮明な画像を得ることができる。
【図面の簡単な説明】
【図１】本発明を適用した第１の実施の形態における画像処理装置１０の構成を示す図である。
【図２】図１に示すＲＡＭ１２の構成を模式的に示す図である。
【図３】図１の記憶装置１３に格納される実寸算出式係数テーブル１３ａの構成を模式的に示す図である。
【図４】図１の画像処理装置１０の動作を示すゼネラルフローである。
【図５】図４のステップＳ７に示す画像データ補正処理を詳細に示すフローチャートである。
【図６】図５のステップＳ１４に示す光路差に相当する画素数の算出処理を詳細に示すフローチャートである。
【図７】本発明を適用した第２の実施の形態におけるカメラの撮像系２０について、その概略構成を示す図である。
【図８】第２の実施の形態における画像処理装置１０の動作を示すフローチャートである。
【図９】本発明を適用した第３の実施の形態におけるプロジェクターの投影光学系３０について、その概略構成を示す図である。
【図１０】図９の鏡３５の構成を示すとともに、鏡３５における反射の様子を模式化して示す図である。
【図１１】第３の実施の形態における画像処理装置１０の動作を示すフローチャートである。
【図１２】鏡を利用した撮影装置の一例としての画像処理装置１００を示す図である。
【図１３】図１２に示す鏡１１０の構成を詳細に示すとともに、鏡１１０における光線の反射の様子を模式的に示す図である。
【図１４】図１２に示す画像処理装置１００による撮影画像の例を示す図であり、（ａ）は被写体１０５を示し、（ｂ）は画像処理装置１００により得られる撮影画像を示す。
【図１５】図１２に示す鏡１１０における光線の反射の様子を模式化し、より詳細に示す図である。
【符号の説明】
１０ 画像処理装置
１１ ＣＰＵ
１２ ＲＡＭ
１２ａ 画像データメモリ
１２ｂ 画像データワークメモリ
１２ｃ 画像データ保存メモリ
１２ｄ ワークエリア
１３ 記憶装置
１３ａ 実寸算出式係数テーブル
１４ 記録媒体
１５ 入力部
１６ 表示部
１７ 伝送制御部
１８ Ｉ／Ｆ
１９ バス
２０ 撮像系
２１ レンズ
２２ 鏡
２３ 撮像素子
３０ 投影光学系
３１ 光源
３２ 凹面鏡
３３ ＬＣＤ
３４ 凹レンズ
３５ 鏡
３５１ ガラス
３５２ 反射蒸着面
１００ 撮影装置
１０１ ケース
１０２ フード
１０３ カメラ
１０４ 台座
１０５ 被写体
１０６ 被写体画像
１１０ 鏡
１１１ ガラス
１１２ 反射蒸着面
１２０ モータ
１２１ 角度検出装置[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image data processing apparatus that performs data processing of a captured image, an image data processing method in the image data processing apparatus, and a control program in the image data processing apparatus.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, there has been a photographing apparatus that uses a mirror and photographs a surface other than the front surface such as the upper surface of a subject with a camera located in front of the subject. Here, an example of an imaging device will be described with reference to FIG.
[0003]
FIG. 12 is a diagram illustrating an image processing apparatus 100 as an example of an imaging apparatus using a mirror. The image processing apparatus 100 is an apparatus that displays an image of a subject 105 placed on a pedestal 104 in a case 101 on a mirror 110 and captures a mirror image reflected on the mirror 110 with a camera 103.
[0004]
A hood 102 is attached to one end side of the case 101 so as to be rotatable with respect to the case 101. In addition, a mirror 110 that projects an image of the upper surface of the subject 105 is installed above the pedestal 104, and a camera 103 is attached to the end of the hood 102 so as to face the mirror 110. For this reason, as the hood 102 rotates, the imaging surface of the camera 103 faces the front of the subject 105 and the mirror 110.
[0005]
As described above, the camera 103 captures a front image of the subject 105 and also captures an upper surface of the subject 105 by capturing an image reflected on the mirror 110.
[0006]
Further, a motor 120 that changes the angle of the mirror 110 and an angle detection device 121 that detects the angle of the mirror 110 are attached to the mirror 110. For this reason, the angle of the mirror 110 can be moved to an angle suitable for shooting, and further, by detecting the angle of the mirror 110, the shooting conditions are acquired together with the shooting conditions on the camera 103 side, It can also be applied to data processing of captured images.
[0007]
[Problems to be solved by the invention]
However, the conventional image processing apparatus 100 has a problem that the sharpness of the captured image is impaired due to the characteristics of the mirror 110.
[0008]
FIG. 13 is a diagram schematically illustrating the configuration of the mirror 110 and the manner in which the light beam is reflected by the mirror 110.
Usually, a mirror is formed by forming a reflective vapor deposition surface on one surface of a transparent flat glass by vapor deposition or application of a reflective material such as metal. A so-called mirror image is obtained when light incident on the mirror is reflected by the reflective vapor deposition surface.
[0009]
However, in practice, a part of the light incident on the mirror is reflected on the glass surface and is emitted through a different path from the light reflected by the reflective vapor deposition surface.
As shown in FIG. 13, when the incident light 131 is incident on the mirror 110, a part of the incident light 131 is reflected by the surface of the glass 111 and is emitted as reflected light 132. Further, the remainder of the incident light 131 enters the inside of the glass 111, is reflected by the reflective vapor deposition surface 112, and is radiated as reflected light 133 from the glass 111. Note that light incident on the glass 111 from the air and light emitted from the glass 111 into the air are refracted by the difference between the refractive index in the air and the refractive index of the glass 111.
[0010]
That is, the incident light 131 is divided and emitted into the reflected light 132 reflected by the glass surface and the reflected light 133 reflected by the reflective vapor deposition surface 112. The reflected light 132 is light that does not enter the inside of the glass 111, while the reflected light 133 is light that reaches the reflective vapor deposition surface 112 and undergoes refraction twice. Therefore, the reflected light 132 and the reflected light 133 are parallel, and an optical path difference indicated by d in the figure is generated between the reflected light 132 and the reflected light 133.
[0011]
In many cases, the reflected light 132 on the surface of the glass 111 is a small part of the incident light on the mirror 110, and the reflected light 133 on the reflective vapor deposition surface 112 accounts for an overwhelmingly large proportion.
[0012]
For this reason, the mirror image obtained by the mirror 110 is an image in which the image of the reflected light 132 on the surface of the glass 111 and the image of the reflected light 133 on the reflective vapor deposition surface 112 are overlapped by being shifted by the optical path difference d. The light amount (intensity) of the reflected light 132 is smaller than the light amount (intensity) of the reflected light 133.
[0013]
Therefore, for example, when the image processing apparatus 100 captures a mirror image of the subject 105 as shown in FIG. 14A, the captured image has two optical path differences d as shown in FIG. 14B. It will be an image that overlaps by shifting by the amount. One of the two images that are shifted and overlapped is a thin image due to weak light.
[0014]
FIG. 15 is a diagram schematically showing a state of reflection of light rays in the mirror 110 and showing in more detail.
In the example shown in FIG. 15, it is assumed that three light beams indicated by reference signs A, B, and C in the figure enter the mirror 110 as incident light. The reflected light in this case is four light beams denoted by reference symbols Ak, A1, B2, and Cz in the drawing.
[0015]
That is, the incident lights A, B, and C are reflected by the surface of the glass 111 and the reflective vapor deposition surface 112, respectively, and are divided into the reflected lights Ak and Az, the reflected lights Bk and Bz, and the reflected lights Ck and Cz. . Further, the reflected light Az reflected by the reflective vapor deposition surface 112 and the reflected light Bk reflected by the surface of the glass 111 overlap the incident light A. Similarly, the incident light B reflected by the reflective vapor deposition surface 112. The reflected light Bz and the reflected light Ck reflected by the surface of the glass 111 are overlapped with the reflected light Bz.
For this reason, the reflected light radiated from the mirror 110 is reflected light Ak, reflected light A1 that is the sum of the reflected light Az and reflected light Bk, reflected light B2 that is the sum of the reflected light Bz and reflected light Ck, It becomes four rays of light Cz.
[0016]
And when these reflected light Ak, A1, B2, Cz is image | photographed with a camera, a picked-up image turns into an image with which the clearness was impaired. For example, since the reflected light Ak is only a part of the incident light A, the amount of light (intensity) is inferior to that of the incident light A, so that the ends of the incident light A, B, and C are blurred. In addition, the reflected light A1 is light in which different incident light A and incident light B overlap, and since the frequency components are different from both incident light A and B, the reflected light A1 is light that faithfully reflects the color and brightness of the subject. It is gone. Similarly, the reflected light B2 has different frequency components from both the incident light B and C, and does not faithfully reflect the color or brightness of the subject. The reflected light Cz is lighter than the incident light C. The light is inferior in (intensity) and blurs the edge of the image.
[0017]
In this way, an image obtained by taking a mirror image using a mirror is blurred at the edge of the image, that is, at the boundary between the subject and the background, and the color and brightness differ from the subject at other portions than the boundary. There is a problem that the image becomes unclear and the image becomes unclear as a whole.
[0018]
Furthermore, since the influence of the reflected light on the mirror surface varies depending on the angle of the mirror, when a plurality of images are taken while changing the angle of the mirror, the unclearness of each image differs. For this reason, when it is desired to take a plurality of more uniform images, it is necessary to adjust the angle of the mirror strictly, which is very troublesome.
[0019]
Such a problem appears particularly prominently when shooting at a high resolution or when the image sensor of the camera 103 has a high sensitivity, and therefore cannot be ignored when a clearer image is required. It was difficult to shoot using a mirror.
[0020]
SUMMARY OF THE INVENTION An object of the present invention is to eliminate an image disturbance due to the influence of reflected light on the surface of a mirror and obtain a clearer image in an image data processing apparatus that processes an image reflected by a mirror. .
[0021]
[Means for Solving the Problems]
The image data processing apparatus of the present invention is reflected by image data generating means for generating captured image data obtained by capturing a mirror image reflected in a mirror, reflected light on the surface of the mirror, and a reflective material on the back surface of the mirror. An optical path difference calculating means for obtaining an optical path difference generated between the light and a reflection on the surface of the mirror from the image data generated by the image data generating means based on the optical path difference calculated by the optical path difference calculating means. And a component removing unit that removes a component caused by light.
[0028]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0029]
[First Embodiment]
First, the configuration will be described.
FIG. 1 is a block diagram showing a configuration of an image processing apparatus 10 according to a first embodiment to which the present invention is applied. As shown in FIG. 1, the image processing apparatus 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a storage device 13, a recording medium 14 included in the storage device 13, an input unit 15, a display unit 16, Each unit including a transmission control unit 17 and an I / F 18 is configured, and each unit excluding the recording medium 14 is connected by a bus 19.
[0030]
An image processing apparatus 10 illustrated in FIG. 1 includes, for example, an imaging apparatus 100 including various components such as a case 101, a hood 102, a camera 103, a pedestal 104, a mirror 110, a motor 120, and an angle detection device 121 as illustrated in FIG. On the other hand, the camera 103, the motor 120, and the angle detection device 121 are connected to each other through the I / F 18. In the first embodiment, the photographing apparatus 100 includes a motor, a potentiometer, and the like (not shown), and changes the attachment angle of the hood 102 to the case 101 and the height of the pedestal 104 according to the control of the image processing apparatus 10. Is possible.
[0031]
The CPU 11 reads out a control program stored in the storage device 13 in accordance with an instruction input from the input unit 15, expands and executes the control program in a work area provided in the RAM 12, and passes through each unit of the image processing apparatus 10 and the I / F 18. To control connected devices.
[0032]
Specifically, the CPU 11 reads the shooting application program stored in the storage device 13 and executes a shooting process (FIG. 4) to be described later. The angle of the hood 102 is adjusted according to the position of the subject and the surface to be shot. The camera 103 controls shooting conditions and the operation of the motor 120. Then, the CPU 11 causes the camera 103 to perform shooting, acquires image data obtained by the imaging element included in the camera 103, corrects the image data, converts the image data into a video signal, and outputs the video signal. When correcting the image data, the CPU 11 obtains an optical path difference between the reflected light reflected by the surface of the glass 111 of the mirror 110 and the reflected light reflected by the reflective vapor deposition surface 112 of the mirror 110, and based on the optical path difference, The process which removes the influence of the reflected light reflected on the glass 111 surface of 110 is performed. In the photographing process, the CPU 11 stores the acquired image data or the corrected image data in the storage device 13 and outputs a video signal to the display unit 16, thereby displaying an image on the screen of the display unit 16. Is displayed.
[0033]
The RAM 12 generates a work area or the like for temporarily storing a program executed by the CPU 11, data related to the program, and the like.
FIG. 2 is a diagram schematically showing the configuration of the RAM 12 shown in FIG.
[0034]
As shown in FIG. 2, various storage areas such as an image data memory 12a, an image data work memory 12b, an image data storage memory 12c, and a work area 12d are secured in the RAM 12.
Among these, the image data work memory 12b is a storage area for temporarily storing image data obtained by photographing with the camera 103, and the image data stored in the image data work memory 12b is corrected by the CPU 11. Etc. are performed. The image data obtained by correcting the image data stored in the image data work memory 12b is stored in the image data memory 12a.
[0035]
Furthermore, the image data storage memory 12c is a storage area for sequentially storing image data processed by the CPU 11, and the work area 12d temporarily stores various programs executed by the CPU 11, data related to these programs, and the like. This is a storage area for storing.
[0036]
The storage device 13 includes a recording medium 14 in which programs, data, and the like are stored. The recording medium 14 includes a magnetic or optical recording medium or a semiconductor memory. The recording medium 14 is fixedly provided in the storage device 13 or is detachably mounted.
[0037]
The program, data, etc. stored in the recording medium 14 are partly or entirely received from the transmission control unit 17 via another transmission medium such as a network line from other devices such as a server or a client and stored. In addition, the recording medium 14 may be a recording medium of a server built on a network. Furthermore, the program may be transmitted to a server or a client via a transmission medium such as a network line and installed in these devices.
[0038]
The storage device 13 is set with a photographing application program for causing the camera 103 to photograph a subject, an image photographed by the camera 103, an image data corrected by the processing of the CPU 11, and various conditions. In addition to various files such as the shooting condition table file, an actual size calculation program for calculating the actual size of the subject, an actual size calculation formula coefficient table showing the relationship between the size in the captured image and the actual size, and an actual size calculation formula coefficient table The actual size calculation processing program and the like for calculating the size and actual size in the captured image are stored.
[0039]
FIG. 3 is a diagram schematically showing the configuration of the actual size calculation formula coefficient table 13 a stored in the storage device 13.
As shown in FIG. 3, in the actual size calculation formula coefficient table 13a, the shooting resolution of the camera 103 and the values at the shooting resolutions of the parameters a, b, and c are set in association with each other. The values of the parameters a, b, and c in the actual size calculation formula coefficient table 13a indicate the correspondence between the size in the image captured by the camera 103 and the actual size, and the calculation processing of the number of pixels corresponding to the optical path difference described later (FIG. Referenced in 5).
[0040]
The input unit 15 includes a keyboard, a pointing device, and the like that include numeric keys, character keys, various function keys, and the like. The input unit 15 generates an operation signal corresponding to an operation on the keyboard and the pointing device, and outputs the operation signal to the CPU 11.
[0041]
The display unit 16 includes a display screen configured by a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), or the like, and an input instruction from the input unit 15 is displayed on the display screen according to display information input from the CPU 11. And the result of processing by the CPU 11 is displayed. Further, the display unit 16 displays an image generated by the photographing process of the CPU 11 based on the video signal input from the CPU 11.
[0042]
The transmission control unit 17 is an interface that can be connected to a transmission medium connected to various networks such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. Here, the transmission medium is constituted by a metal wire such as a telephone line, a coaxial cable, an optical fiber cable or the like, and forms the network by being connected to various devices.
[0043]
The I / F unit 18 is an interface for inputting / outputting various instruction signals, position information, and the like from the image processing apparatus 10 to each unit of the photographing apparatus 100. For example, a USB (Universal Serial Bus) port or an RS- Serial input / output terminals such as 232C terminal, parallel input / output terminals, SCSI interface, infrared communication device conforming to IrDA (Infrared Data Association) standard, etc. are provided, and can be connected to various devices by wired or wireless communication means. Is possible.
[0044]
Next, the operation of the present embodiment will be described.
FIG. 4 is a general flow showing the operation of the image processing apparatus 10 in the first embodiment.
[0045]
In the processing shown in FIG. 4, the CPU 11 first moves the hood 102 according to the position of the subject 105 set on the photographing apparatus 100 and the surface of the subject to be photographed, the mounting angle of the camera 103, and the pedestal 104. The height is adjusted (step S1).
[0046]
Subsequently, the CPU 11 drives the motor 120 to adjust the angle of the mirror 110, and causes the angle detection device 121 to read the angle of the mirror 110 (step S2).
[0047]
Here, the CPU 11 causes the camera 103 to perform photographing of the subject 105, acquires image data obtained by an image sensor such as a CCD (Charge Coupled Device) included in the camera 103, and stores the image data in the image data work memory 12 b in the RAM 12. The color tone analog data of each pixel is acquired by taking in and further dividing into R, G, and B color elements (step S3).
[0048]
Next, the CPU 11 amplifies the color tone analog data of each pixel acquired in step S3 (step S4), further performs A / D conversion (Analog to Digital Conversion) (step S5), and indicates the color tone data of each pixel. Digital data is generated and stored in the image data memory 12a (step S6).
[0049]
Then, the CPU 11 executes an image data correction process on the image data in the image data memory 12a (step S7), and corrects the image data of the photographed image to obtain a clearer image data.
[0050]
Thereafter, the CPU 11 performs D / A conversion (Digital to Analog Conversion) on the corrected image data to generate analog image data (step S8), further converts it into a video image, and outputs it (step S9).
[0051]
Through the above-described photographing process, the CPU 11 performs a correction that excludes the influence of the mirror 110 from the image photographed by the camera 103, obtains a clearer image, and further displays the obtained image on the screen of the display unit 16. .
[0052]
FIG. 5 is a flowchart showing in more detail the image data correction process shown in step S7 of FIG.
[0053]
As shown in FIG. 5, in the image data correction process, the CPU 11 first reads the image data generated in step S6 and stored in the image data memory 12a (step S11).
[0054]
Subsequently, the CPU 11 calculates a value of data to be corrected among the data of each pixel in the image data stored in the image data memory 12a (step S12). That is, the image photographed by the camera 103 is a mirror image of the subject 105 reflected on the mirror 110. Therefore, the data of each pixel of the image photographed by the camera 103 is data including light reflected by the surface of the glass 111 as well as light reflected by the reflective vapor deposition surface 112 of the mirror 110.
[0055]
As described with reference to FIGS. 12 to 15, the light reflected by the glass 111 surface of the mirror 110 is a small part of the light received by the image sensor of the camera 103, and the incident light to the mirror 110 is large. The portion is reflected by the reflective vapor deposition surface 112. For this reason, in the image data correction processing shown in FIG. 4, the CPU 11 removes the component due to the light reflected by the glass 111 from the pixel data of the photographed image, so that the image data by only the light reflected by the reflective vapor deposition surface 112 is obtained. Is generated to obtain clearer image data.
[0056]
Therefore, in step S12, the ratio of the reflected light on the surface of the glass 111 in the data of each pixel in the image data stored in the image data memory 12a is calculated. This ratio is obtained as, for example, “0.03” as the ratio in the pixel data, and this value is hereinafter referred to as the value of the correction pixel data. Note that the value of the correction pixel data differs depending on the material constituting the mirror 110, the angle of the mirror 110, and the like. In step S12, if the correction pixel data becomes smaller than a predetermined value, it is determined that it is not necessary to perform correction, and “correction pixel data = 0” may be set.
[0057]
Next, the CPU 11 calculates the position of the pixel to be corrected (step S13). As described based on FIG. 13, the reflected light on the surface of the glass 111 that causes a blurred image is shifted from the reflected light on the reflective vapor deposition surface 112 by an optical path difference d. For this reason, in step S13, in order to remove the influence of the reflected light on the surface of the glass 111, the optical path difference d is obtained. The value of this optical path difference d can be obtained, for example, by performing the calculation shown in the following formula (1).
[Expression 1]

In the above formula (1),
t indicates the thickness of the glass 111;
θ represents the angle of the mirror 110 with respect to the horizontal plane,
n ₁ Indicates the refractive index in air,
n ₂ Indicates the refractive index of the glass 111.
[0058]
Then, the CPU 11 performs a process of calculating the number of pixels corresponding to the optical path difference based on the corrected pixel data obtained in step S12 and the value of the optical path difference d obtained in step S13 (step S14). The number of pixels in the captured image data corresponding to the optical path difference d in the mirror 110 is obtained, and the process proceeds to step S15.
[0059]
In step S15, the image data is corrected based on the number of pixels obtained in step S14 and the corrected pixel data obtained in step S12.
More specifically, the reflected light on the surface of the glass 111 is separated from the reflected light on the reflective vapor deposition surface 112 by an optical path difference d. Therefore, if the image sensor of the camera 103 obtains pixel data to be subtracted based on the light received at a position separated by the optical path difference d, and subtracts this pixel data from the pixel data to be corrected, the glass 111 The influence of the reflected light on the surface of can be removed.
[0060]
The processing in step S15 is expressed by the following equation (2). The CPU 11 corrects the image by performing the processing represented by the following formula (2) for all the pixel data in the image data stored in the image data work memory 12b.
[Expression 2]

[0061]
Then, the CPU 11 replaces the image data including the pixel data corrected in step S15 with the image data previously stored in the image data work memory 12b and stores the image data in the image data memory 12a (step S16). The process proceeds to step S8 (FIG. 4).
[0062]
FIG. 6 is a flowchart showing in more detail the calculation processing of the number of pixels corresponding to the optical path difference shown in step S14 of FIG.
[0063]
In the process shown in FIG. 5, the CPU 11 first acquires the shooting conditions for the camera 103 and stores it in the work area 12d of the RAM 12 (step S21). Here, the shooting conditions indicate the shooting resolution, shooting magnification, and shooting distance. Hereinafter, the shooting magnification value is Z and the shooting distance value is R.
[0064]
Subsequently, the CPU 11 refers to the actual size calculation formula coefficient table 13a stored in the storage device 13 and acquires parameters a, b, and c corresponding to the imaging resolution acquired in step S21 (step S22).
[0065]
And CPU11 calculates | requires the pixel count in the picked-up image corresponded to 1 millimeter (step S23). This number of pixels is obtained by performing, for example, the calculation shown in the following formula (3).
[Equation 3]

[0066]
Thereafter, the CPU 11 calculates the number of pixels corresponding to the optical path difference d obtained in step S12 based on the number of pixels obtained in step S23 (step S24), and proceeds to step S15 (FIG. 5).
[0067]
With the above processing, in the image processing apparatus 10, a clear image is obtained by performing processing that removes the influence of reflected light on the surface of the glass 111 on the image obtained by capturing the mirror image of the subject 105 reflected on the mirror 110 with the camera 103. Obtainable. As a result, even when a clear image is required, it is possible to take a picture using a mirror.
[0068]
Even when a plurality of images are taken by changing the angle of the mirror, the influence of the reflected light on the surface of the mirror is removed, so that each image may become unclear. Absent. For this reason, it is not necessary to perform operations such as strictly adjusting the angle of the mirror, and photographing using the mirror can be easily performed.
[0069]
In particular, since a previously taken image is corrected based on the shooting conditions and the like, a conventionally used camera can be used. For this reason, the image processing apparatus 10 according to the first embodiment can be realized very easily and at a low cost as compared with the case where the mechanism inside the camera 103 is improved.
[0070]
In the first embodiment, the case where an image captured using the imaging device 100 shown in FIG. 12 is processed has been described. However, the present invention is not limited to this, and a mirror is used. Any data can be easily applied if it is data of an image taken using. In addition, for example, the case where the camera 103 having an image sensor such as a CCD is used has been described. However, even when the photographing is performed by a silver salt camera instead of the camera 103, the photographed film is read by the film scanner. If the image data can be obtained as digital data by such processing, the present invention can be easily applied.
[0071]
The processing by the image processing apparatus 10 is not limited to the photographing apparatus 100 but can be applied to a case where a mirror is provided inside the camera. Hereinafter, this case will be described as a second embodiment.
[0072]
[Second Embodiment]
FIG. 7 is a diagram showing a schematic configuration of the imaging system 20 of the camera according to the second embodiment to which the present invention is applied. In the second embodiment, a case will be described in which an image captured by a camera having an imaging system 20 is processed by the image processing apparatus 10 (FIG. 1). Accordingly, it is assumed that the I / F 18 included in the image processing apparatus 10 is connected to a camera including the imaging system 20.
[0073]
In the imaging system 20 shown in FIG. 7, incident light is collected by a lens 21, reflected by a mirror 22, and received by an imaging device 23. Therefore, a mirror image reflected on the mirror 22 is captured by the image sensor 23.
[0074]
The mirror 22 is a general mirror made of glass having a reflective vapor deposition surface formed on one surface, and most of the incident light on the mirror 22 is reflected by the reflective vapor deposition surface, while one of the incident light is reflected on the mirror 22. The part is reflected by the glass surface and is incident on the image sensor 23 formed by a CCD or the like. Therefore, an image photographed by the image sensor 23 may be unclear due to the influence of reflected light on the glass surface of the mirror 22.
[0075]
FIG. 8 is a flowchart showing the operation of the image processing apparatus 10 in the second embodiment.
[0076]
In the process shown in FIG. 8, the CPU 11 first determines whether or not the camera shutter is turned on (step S31). If the shutter is not turned on, the image obtained by the image sensor 23 is captured. It performs (step S32). Subsequently, the CPU 11 stores the captured image in the image data work memory 12b in the RAM 12 (step S33), generates display information based on the image stored in the image data work memory 12b, and outputs the display information to the display unit 16. Then, an image obtained by the image sensor 23 is displayed on the screen of the display unit 16 (step S34), and the process proceeds to step S41 described later.
[0077]
On the other hand, when the shutter of the camera is turned on (step S31; Yes), the CPU 11 acquires the data of the image received by the image sensor 23 included in the camera 103, loads it into the image data work memory 12b in the RAM 12, Further, the color tone analog data of each pixel is acquired by decomposing the color elements into R, G, and B color elements (step S35).
[0078]
Next, the CPU 11 amplifies the color tone analog data of each pixel acquired in step S3 (step S36), further performs A / D conversion (step S37), and generates digital data indicating the color tone data of each pixel. The image data is stored in the image data memory 12a (step S38).
[0079]
Then, the CPU 11 executes an image data correction process on the image data in the image data memory 12a (step S39), and corrects the image data of the photographed image to obtain a clearer image data. The image data correction process in step S39 is the same as the process shown in FIG. 5 in the first embodiment.
[0080]
Thereafter, the CPU 11 stores and stores the corrected image data in the image data memory 12a or the image data storage memory 12c in the RAM 12 (step S40), and proceeds to step S41.
[0081]
In step S41, it is determined whether or not shooting has been completed. If not, the process returns to step S31.
Note that the image data stored in step S40 can be converted to analog image data by D / A conversion and displayed on the screen of the display unit 16.
[0082]
Thus, if the present invention is applied to an image taken by a camera having the imaging system 20 using the mirror 22, a clearer image can be obtained by removing the influence of the reflected light on the glass surface of the mirror 22. Can do.
[0083]
Further, the present invention is not limited to the case of shooting, but can also be applied to the case of projecting an image using a mirror. Hereinafter, this case will be described as a third embodiment.
[0084]
[Third Embodiment]
FIG. 9 is a diagram showing a schematic configuration of the projection optical system 30 of the projector in the third embodiment to which the invention is applied.
In the third embodiment, a case will be described in which an image projected by a projector having the projection optical system 30 is processed by the image processing apparatus 10 (FIG. 1). Accordingly, it is assumed that the I / F 18 included in the image processing apparatus 10 is connected to a projector including the projection optical system 30.
[0085]
The projection optical system 30 reflects the light emitted from the light source 31 toward the LCD 33 by the concave mirror 32. The light transmitted through the LCD 33 is diffused by the concave lens 34, reflected by the mirror 35, and projected onto a screen or the like (not shown).
Since the image is displayed on the LCD 33 according to the control of the image processing apparatus 10, the image displayed on the LCD 33 can be projected onto a screen or the like when the light from the light source 31 passes through the LCD 33.
[0086]
FIG. 10 is a diagram schematically showing the configuration of the mirror 35 and the state of reflection at the mirror 35.
As shown in FIG. 10, the mirror 35 includes a glass 351 and a reflective vapor deposition surface 352 formed on one surface of the glass 351. Most of the incident light incident on the mirror 35 is reflected and emitted by the reflective vapor deposition surface 352, but a part of the incident light is reflected by the surface of the glass 351. For this reason, the incident light to the mirror 35 is radiated separately from the reflected light on the surface of the glass 351 and the reflected light on the reflective vapor deposition surface 352, and the image on the screen may become unclear.
[0087]
Therefore, in the third embodiment, the image displayed on the LCD 33 is processed by the image processing apparatus 10 and corrected so as to be an appropriate image by being reflected by the mirror, thereby obtaining a clear projected image. It is to be able to obtain.
[0088]
Here, as schematically shown in FIG. 10, a case where ten light beams A to L are projected as reflected light of the mirror 35 will be described as an example. The ten light beams A to L have a distance corresponding to the optical path difference between the reflected light on the surface of the glass 351 and the reflected light on the reflective vapor deposition surface 352.
[0089]
As described above, when the ten light beams A to L are directly incident on the mirror 35, the reflected light is divided into reflected light on the surface of the glass 351 and reflected light on the reflective vapor deposition surface 352.
[0090]
Therefore, the incident light to the mirror 35 is converted into A ′, A′-b, B′-c, C′-d, D′-e, E′-f, F′-g, G′-h, and H ′. Eleven rays of -i, I'-j, J'-k, and K'-l are used as incident light. Note that these 11 light beams have a distance corresponding to the optical path difference d between the reflected light on the surface of the glass 351 and the reflected light on the reflective vapor deposition surface 352. A ′, B ′, C ′, D ′, E ′, F ′, G ′, H ′, I ′, J ′, K ′, and a, b, c, d, e, f, g , H, i, j, k, and l are equal to a part of the light rays A, B, C, D, E, F, G, H, I, J, K, and L, respectively, and the light amount (intensity). Are different lights.
[0091]
Then, a part of the eleven rays are reflected by the surface of the glass 351, and most of the eleven rays are reflected by the reflective vapor deposition surface 352, and are emitted by being separated by the optical path difference d. For this reason, the light beam A ′ is emitted while being superimposed on the light beam A′-b. Similarly, the light beam A′-b is the light beam B′-c, the light beam B′-c is the light beam C′-d, the light beam C′-d is the light beam D′-e, and the light beam D′-e is the light beam E ′. '-F, ray E'-f is ray F'-g, ray F'-g is ray G'-h, ray G'-h is ray H'-i, ray H'-i The light beam I′-j, the light beam I′-j, and the light beam J′-k are emitted in a superimposed manner with the light beam K′-l, respectively.
[0092]
Therefore, A ′, B ′, C ′, D ′, E ′, F ′, G ′, H ′, I ′, J ′, K ′, and a, b, c, d, e, f, g , H, i, j, k, and l are set to appropriate values for the light rays A, B, C, D, E, F, G, H, I, J, K, and L. Thereby, the reflected light from the mirror 35 can be made into the light rays A, B, C, D, E, F, G, H, I, J, K, and L which do not overlap.
[0093]
FIG. 11 is a flowchart showing the operation of the image processing apparatus 10 according to the third embodiment.
[0094]
In the process shown in FIG. 11, the image processing apparatus 10 first turns on the light source 31 of the projection optical system 30 (step S51), and then reads the image data stored in the storage device 13 as an image to be projected. Then, it is stored in the image data work memory 12b (step S52).
[0095]
Here, the CPU 11 executes a process for correcting the image data stored in the image data work memory 12b (step S53). In the process in step S53, the CPU 11 obtains the correction pixel data value in the mirror 35, and then obtains the optical path difference d generated in the mirror 35, and the optical path, as in the process shown in FIG. 5 in the first embodiment. The number of pixels corresponding to the difference d is calculated, and processing for correcting the data of each pixel included in the image data stored in the image data work memory 12b is performed.
[0096]
Then, the CPU 11 outputs and displays the corrected image on the LCD 33 based on the corrected image data (step S54).
Thereafter, the CPU 11 determines whether or not the projection has ended. If not, the CPU 11 returns to step S51.
[0097]
In this way, by applying the present invention to a projector having the projection optical system 30, when projecting an image using a mirror, a clear image can be obtained except for the influence of reflected light on the glass surface constituting the mirror. Can be projected. Further, in the projector having the projection optical system 30, the present invention can be applied very inexpensively and easily compared with the case where the structure of the projection optical system is improved.
[0098]
According to the present invention, the image can be projected without worrying about the image becoming unclear due to the influence of the mirror, so that a clear projected image can be easily obtained and the installation of the screen or the like can be strictly performed. No need to do it.
[0099]
In the third embodiment, the example in which the mirror is included in the projection optical system 30 has been described. However, the present invention is not limited to this, and for example, a mirror is installed outside the projector. Of course, the present invention can also be applied to a case where an image is projected onto a screen or the like using this mirror.
[0100]
Further, in the above-described embodiment, the configuration of each unit configuring the image processing apparatus 10 is arbitrary, and it is needless to say that other specific detailed configurations can be appropriately changed.
[0101]
【The invention's effect】
According to the image data processing apparatus of the present invention, after obtaining the optical path difference between the reflected light on the mirror surface and the light reflected by the reflective material on the back surface of the mirror, the influence of the reflected light on the mirror surface from the image data. Therefore, the influence of the reflected light on the mirror surface can be efficiently and surely eliminated, and a clear image can be obtained.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of an image processing apparatus 10 according to a first embodiment to which the present invention is applied.
FIG. 2 is a diagram schematically showing a configuration of a RAM 12 shown in FIG.
3 is a diagram schematically showing a configuration of an actual size calculation formula coefficient table 13a stored in the storage device 13 of FIG. 1; FIG.
4 is a general flow showing the operation of the image processing apparatus 10 of FIG.
FIG. 5 is a flowchart showing in detail an image data correction process shown in step S7 of FIG.
6 is a flowchart showing in detail a process for calculating the number of pixels corresponding to the optical path difference shown in step S14 of FIG.
FIG. 7 is a diagram showing a schematic configuration of an imaging system 20 of a camera according to a second embodiment to which the present invention is applied.
FIG. 8 is a flowchart showing an operation of the image processing apparatus 10 according to the second embodiment.
FIG. 9 is a diagram showing a schematic configuration of a projection optical system 30 of a projector according to a third embodiment to which the invention is applied.
10 is a diagram schematically showing the configuration of the mirror 35 of FIG. 9 and the state of reflection by the mirror 35. FIG.
FIG. 11 is a flowchart showing an operation of the image processing apparatus 10 according to the third embodiment.
FIG. 12 is a diagram illustrating an image processing apparatus 100 as an example of an imaging apparatus using a mirror.
13 is a diagram showing in detail the configuration of the mirror 110 shown in FIG. 12, and schematically showing the state of light rays reflected by the mirror 110. FIG.
14 is a diagram illustrating an example of a captured image obtained by the image processing apparatus 100 illustrated in FIG. 12, in which (a) illustrates a subject 105 and (b) illustrates a captured image obtained by the image processing apparatus 100. FIG.
15 is a diagram schematically showing a state of reflection of light rays in the mirror 110 shown in FIG. 12, and showing in more detail.
[Explanation of symbols]
10 Image processing device
11 CPU
12 RAM
12a Image data memory
12b Image data work memory
12c Image data storage memory
12d work area
13 Storage device
13a Actual size calculation formula coefficient table
14 Recording media
15 Input section
16 Display section
17 Transmission control unit
18 I / F
19 Bus
20 Imaging system
21 Lens
22 mirrors
23 Image sensor
30 Projection optical system
31 Light source
32 Concave mirror
33 LCD
34 Concave lens
35 mirrors
351 glass
352 reflective deposition surface
100 photographing device
101 cases
102 Food
103 cameras
104 pedestal
105 subjects
106 Subject image
110 mirror
111 glass
112 Reflective deposition surface
120 motor
121 Angle detector

Claims (3)

Image data generation means for generating captured image data obtained by capturing a mirror image reflected in a mirror;
An optical path difference calculating means for obtaining an optical path difference generated between the reflected light on the surface of the mirror and the light reflected by the reflector on the back surface of the mirror;
Based on the optical path difference calculated by the optical path difference calculating means, from the image data generated by the image data generating means, a component removing means for removing a component due to reflected light on the surface of the mirror;
An image data processing apparatus comprising: Generate shot image data obtained by shooting a mirror image reflected in the mirror,
Find the optical path difference that occurs between the reflected light on the surface of the mirror and the light reflected by the reflector on the back surface of the mirror,
Based on the optical path difference calculated by the optical path difference calculating means, an image in the image data processing apparatus is characterized in that a component due to reflected light on the surface of the mirror is removed from the image data generated by the image data generating means. Data processing method. The computer,
Image data generating means for generating captured image data obtained by capturing a mirror image reflected in a mirror ;
An optical path difference calculating means for obtaining an optical path difference generated between the reflected light on the surface of the mirror and the light reflected by the reflector on the back surface of the mirror;
Based on the optical path difference calculated by the optical path difference calculating means, a component removing means for removing a component due to reflected light on the surface of the mirror from the image data generated by the image data generating means.
Program to function as.

Images