JP3554257B2 - Display control device and method - Google Patents

Description

【００３１】
更に、観察者の右眼がディスプレイデバイス１０６の中心Ｃ_０から水平方向にｘずれた位置にある場合、画像表示面中央のレンチキュラレンズの光軸に対して市松状パターン１０４の対応する発光部１０２の中心Ｄがその基準位置Ｄ_０から水平方向に以下のｄ_０だけずらすことにより、適切な立体視が行える。
【００３２】
【数２】

【００３３】
なお、本実施形態では、以上の様な視点位置に対応した光指向性の制御を視点追従制御と称する。
【００３４】
図５は、本実施形態による視点追従制御を説明するフローチャートである。本処理は、デバイスドライバ３１０内のシステムコントローラ３１２に実装された不図示のＣＰＵが、不図示のメモリに格納された制御プログラムを実行することにより実現されるものとする。
【００３５】
まずステップＳ１０１において、基準位置Ｘ_０を決定する。この基準位置Ｘ_０とは、視点検出部３２０によって検出された視点位置とのずれ量ｘを求めるための基準となる位置である。以下、ステップＳ１０１による処理について図６を参照して説明する。
【００３６】
図６は、本実施形態による基準位置Ｘ_０の決定処理を説明するフローチャートである。ステップＳ２０１では、３次元画像表示を行うウインドウ（以下、３次元表示ウインドウ）を抽出する。図７は本実施形態による３次元表示ウインドウの表示状態を説明する図である。図７において、ウインドウ３３ａ、３３ｂ、３３ｃはそれぞれ３次元画像を表示するウインドウである。なお、各ウインドウが３次元表示を行うか否かは、ウインドウ内に表示される画像ファイルを調べることにより（例えば拡張子等を参照する）判断することができる。ステップＳ２０１では、これらウインドウ３３ａ、３３ｂ、３３ｃが抽出されることになる。
【００３７】
ステップＳ２０２では、ステップＳ２０１で抽出されたウインドウに関して重心位置を算出する。そして、算出された重心位置に対して視点検出部３２０で検出された視点位置が追従範囲にあるか否かを判断し、追従範囲内にあればステップＳ２０８へ進み、その重心位置を基準位置Ｘ_０に決定する。
【００３８】
以上の処理により、複数の３次元表示ウインドウが表示されている場合には、それらの重心位置が基準位置Ｘ_０に設定されることになる。なお、図８に示すように、３次元表示用ウインドウが１つだけ表示されているような場合は、ステップＳ２０２で算出される重心位置がその３次元表示用ウインドウの中心と一致することになる。また、アクティブな３次元表示用ウインドウにおいてのみ３次元表示を行い、非アクティブな３次元表示用ウインドウにおいては２次元表示が行われるような場合は、アクティブな３次元表示用ウインドウの中心を基準位置Ｘ_０とするようにしてもよい（この場合、ステップＳ２０１で３次元表示を実行している３次元表示ウインドウを抽出するようにすればよい）。
【００３９】
一方、ステップＳ２０３において、算出された重心位置と検出された視点位置との関係により、視点位置が追従範囲にないと判定された場合は、ステップＳ２０４へ進み、３次元表示ウインドウの表示内容を２次元表示とする。このとき、２次元表示が行われている旨を明示するように、ウインドウ枠等を変化させてもよい。なお、このとき、自発光型表示素子１０１の表示を市松パターンから全面発光状態に切換て、２次元表示装置として動作するようにしてもよい。そして、ステップＳ２０５、Ｓ２０６において、視点位置が追従範囲内に戻るのを監視する。視点位置が追従範囲内に戻った場合は、ステップＳ２０７において、ステップＳ２０４で２次元表示に変更したウインドウを３次元表示に戻す。その後、ステップＳ２０１へ戻り、上述のようにして基準位置Ｘ_０を決定する。
【００４０】
なお、ステップＳ２０５における視点位置が追従範囲には行ったか否かの判定は例えば次のように行える。すなわち、ステップＳ２０４で２次元表示に変更したウインドウによる重心位置と視点位置の相対位置関係を監視する。ここで、ウインドウの重心位置は、ドラッグ操作によるウインドウの移動により変化する可能性があるので、少なくとも該当するウインドウに対するドラッグ操作が行われた場合には重心位置を計算しなおす。このようにして、視点位置の移動及び／或いはウインドウの移動によって視点位置が追従範囲に入ったならば、ステップＳ２０６からステップＳ２０７へ処理を進めることになる。
【００４１】
再び図５に戻り、ステップＳ１０２において観察者の視点位置とディスプレイとの距離Ｌ_０を取得する。また、ステップＳ１０３では、ステップＳ１０１で決定された基準位置Ｘ_０からの視点位置の水平方向のずれ量ｘを算出する。
【００４２】
ステップＳ１０４では、観察者の光軸方向の移動により生じるクロストークの補正を行う。すなわち、ステップＳ１０２で得られた距離Ｌ_０を用いて自発光型表示素子１０１上の市松状パターン１０４の水平方向のピッチＰ_ｍを上述の式（１）によって計算しなおし、そのピッチＰ_ｍによって自発光型表示素子１０１上の市松上パターン表示を行う。
【００４３】
続いて、ステップＳ１０５以降において、ステップＳ１０３で算出されたずれ量ｘを用いて水平方向の位置ずれに起因するクロストークの補正を行う。
【００４４】
まず、ステップＳ１０５において、水平方向のずれ量ｘを予め設定されている基準の眼間距離Ｅ（たとえば６５ｍｍ）で除算し、整数である商Ｎと、その絶対値がＥ以下である余りｓを得る。すなわち、ｘ、Ｅ、Ｎ、ｓは、
ｘ＝Ｎ・Ｅ＋ｓ （ただし、Ｎは整数、｜ｓ｜＜Ｅ）
なる関係を有する。
【００４５】
ステップＳ１０６では、ステップＳ１０５で得られたＮが奇数か偶数かを判断し、偶数ならばステップＳ１０７へ、奇数ならばステップＳ１０８へそれぞれ進む。ステップＳ１０７において、デバイスドライバ３１０は、第１の横ストライプ画像をディスプレイデバイス１０６に表示し、ステップＳ１０８においてデバイスドライバ３１０は第２の横ストライプ画像をディスプレイデバイス１０６に表示する。第１と第２の横ストライプ画像の関係は、図１において左目用のストライプ画像と右目用ストライプ画像の表示位置を入れ換えた関係にあり、左右の眼の夫々に左右の視差画像が正しく観察されるようにする。
【００４６】
ステップＳ１０９では、ｓの絶対値が予め定められた値、例えばＥ／１０より大きいか小さいかを判別する。もし、小さければステップＳ１１０へ進み、発光パターンを基準位置に戻す。また、ｓがＥ／１０よりも大きければ、ステップＳ１１１へ進み、発光パターンを基準位置より、数式（２）で与えられる分移動する。すなわち、
ｓ・ｔ_１／（Ｌ_０＋ｔ_２）
だけ移動する。なお、本実施形態はＥ／１０をしきい値としたが、このしきい値は左右像の光学的分離状況等を加味して決定される。
【００４７】
以上のように第１の実施形態によれば、任意の位置に表示された３次元表示ウインドウに関して、適切な視点追従制御を行うことが可能となる。また、複数の３次元表示ウインドウが表示されていても、それらのウインドウに関して適切な視点追従制御を行うことが可能となる。
【００４８】
なお、上記実施形態では、３次元表示ウインドウについて算出された重心位置に対して視点位置が視点追従範囲外となった場合に、３次元表示ウインドウを２次元表示として、視点位置が追従範囲に戻るの待つが、これに限らない。例えば複数の３次元表示ウインドウのうち、検出された視点位置から遠いものから順に一つずつ２次元表示し、重心計算の対象から外すようにしてもよい。このようにすれば、例えば図７のような表示において、ウインドウ３３ａ、３３ｂ、３３ｃの重心位置を用いると視点位置が追従範囲を越える場合に、例えばウインドウ３３ｃを２次元表示として、ウインドウ３３ａと３３ｂの重心位置と視点位置の関係を調べ、視点位置が追従範囲に入った場合は、その重心位置を基準位置とするようにしてもよい。
【００４９】
なお、本実施形態では、視点追従制御において光指向性の制御を行うが、これに加えて運動視差制御を行うようにしてもよい。運動視差とは、検出された視点位置に応じて、徐々に物体の側面が見えてくるといったように、物体の表示状態を変えていくものである。この場合、検出された視点位置のずれ量に応じて立体像を更新していくので、図５、図６のフローチャートで説明した手法によって検出された視点位置のずれ量ｘに基づいて立体像の更新、描画を行う。
【００５０】
この結果、以下の運動視差制御を実現できる。
（１）観察者の移動にともなってウインドウの立体像が更新、描画される。
（２）ウインドウの移動（ドラッグ）に伴って、ウインドウの立体像が更新、描画される。
【００５１】
なお、例えばウインドウの移動中には２次元の運動視差画像を表示するようにしてもよい。この場合、ウインドウの移動終了後には、３次元表示に戻すことになる。
【００５２】
また、上記実施形態の光学系は、図１３に示すように、特開平１０−７８５６３号等に開示されているような、シリンドリカルレンズを水平方向に並べたレンチキュラ１３０１を用いた構成でもよい。
【００５３】
＜第２の実施形態＞
上記第１の実施形態では、自発光型表示素子１０１に市松状パターン１０４を表示して立体視を可能とした。本実施形態では、市松状に光透過部と非透過部を設けたマスクパターンを用いる場合を説明する。
【００５４】
図９は第２の実施形態による立体表示装置の構成を示す図である。同図において、第１の実施形態（図１）と同様の構成には同一の参照番号を付してある。
【００５５】
図９において、９０１はバックライト光源（面光源）であり、９０２は市松状の開口部９０３と遮光部９０４を有するマスク基板である。第２の実施形態では、第１の実施形態における市松状パターン１０４を表示した自発光型表示素子１０１とを、バックライト光源９０１とマスク基板９０２で置き換えた構成となっている。また、９１０は、アクチュエータであり、マスク基板９０２を水平方向に移動する。第１の実施形態では、マスクパターン１０４の表示を移動することにより水平方向の補正を行ったが、第２の実施形態では、マスク基板９０２をアクチュエータ９１０によって移動することにより水平方向の視点追従を行う。
【００５６】
以上のように、第２の実施形態では、視点追従制御を行うに際して、マスク基板９０２の移動という機械的な動作が必要となる。このような移動を視点追従のための動作を行っている最中は、光指向性が刻々と変化し、観察者にとって見苦しいものとなってしまう。第２の実施形態では、このような問題に対処する。
【００５７】
図１０は第２の実施形態による視点追従制御を説明するフローチャートである。図１０において、ステップＳ１０１、Ｓ１０３、Ｓ１０５〜Ｓ１０９は上述の第１の実施形態（図５）と同様の処理である。ただし、マスク基板９０２では、開口部と遮光部のピッチＰ_ｍを変更することが容易ではないので、第２の実施形態では光軸方向の観察者の移動に対するクロストークの補正は実行しないものとする（すなわち、ステップＳ１０２とＳ１０４は省略される）。
【００５８】
ステップＳ１０９において、ｓ≦Ｅ／１０の場合は、ステップＳ３０１へ進み、マスク基板９０２を基準位置へ移動する。また、ｓ＞Ｅ／１０となった場合はステップＳ３０２へ進み、数式（２）で与えられる分移動する。すなわち、
ｓ・ｔ_１／（Ｌ_０＋ｔ_２）
だけ移動する。
【００５９】
その後、ステップＳ３０３へ進み、マスク基板９０２が上記ステップＳ３０１及びＳ３０２によって移動中か否かを判断し、移動中であればステップＳ３０４で遅延処理を行う。遅延処理としては、
（１）マスク基板９０２の移動中はディスプレイデバイス１０６上に何も表示しない。
（２）マスク基板９０２の移動中は、３次元ウインドウ内の表示を禁止する。
（３）マスク基板９０２の移動中は、ディスプレイデバイス１０６上の表示を全て２次元表示とすること等が挙げられる。
【００６０】
また、図６のフローチャートで説明した処理により、観察者が追従範囲外に出てしまった場合は、
（１）３次元表示ウインドウの表示を２次元表示とし、２次元表示であることを明示するウインドウ枠に変更する。
（２）視点位置が追従範囲に戻るまで視点追従制御を中止する。
という処理が行われることになる。
【００６１】
また、第２の実施形態において、ウインドウのドラッグ操作による移動速度が、視点追従制御の追従速度を越えた場合に、すべての３次元表示ウインドウを２次元表示とするように制御してもよい。
【００６２】
なお、図９に示した構成において、光の拡散状態と透過状態の２状態の制御ができる、高分子分散型液晶で構成された光指向制御素子（ＰＤＬＣ）等をディスプレイデバイス１０６とレンチキュラレンズ１０５の間、或いはレンチキュラレンズ１０５とマスク基板９０２の間に設けて、２次元表示と３次元表示の切り換えを行えるようにしてもよい。すなわち、ＰＤＬＣを拡散状態として光指向性を打ち消すことにより２次元表示装置となり、透過状態とすることにより３次元表示装置となる。なお、ＰＤＬＣの代わりに拡散シートの挿入状態と非挿入状態を切換えるようにしてもよい。
【００６３】
また、上記のように２次元表示と３次元表示の切換を行える装置において、２次元表示状態となっている場合、マスク基板９０２の移動は表示状態に影響を及ぼさない。従って、２次元表示となっている間は、３次元表示状態に切り換わったときにマスク基板の追従遅れが少なくなるような位置にマスク基板９０２を移動しておく（以下、マスク基板のバックグランド処理という）ようにしてもよい。以下、この処理を説明する。
【００６４】
図１１は第２の実施形態によるマスク基板９０２のバックグランド処理について説明するフローチャートである。図１１に示されるフローチャートは、図１０のステップＳ１０３とステップＳ１０５の間に挿入される。
【００６５】
まず、ステップＳ４０１において、当該表示装置が３次元表示状態にあるかどうかを判断する。すなわち、ＰＤＬＣが透過状態にある場合、或いは拡散シートが挿入されていない場合は３次元表示状態であり、この場合はそのままステップＳ１０５へ進み、上述した視点追従制御を実行する。
【００６６】
一方、ＰＤＬＣが拡散状態にある場合、或いは拡散シートが挿入された状態にある場合は、２次元表示状態であり、処理はステップＳ４０２へ進む。ステップＳ４０２では、３次元表示ウインドウ（３次元表示される可能性のあるウインドウ）を抽出する。そして、ステップＳ４０３において、ステップＳ４０２で抽出されたウインドウの重心位置を求め、この重心位置と視点位置とに基づいてマスク基板を最適な位置に移動する。
【００６７】
以上のように処理することにより、２次元表示状態から３次元表示状態に切り換わった際に、マスク基板９０２が既に適切な位置に移動しているので、スムースな表示切換が可能となる。
【００６８】
なお、上記実施形態ではマスク基板９０２を移動したが、例えばレンチキュラレンズのような他の光学部材を移動するようにしてもよい。
【００６９】
＜第３の実施形態＞
上述した第１の実施形態では、光軸方向の観察者の移動に対して、市松パターンのピッチＰ_ｍを制御することで対応した。しかしながら、第２の実施形態のようなマスク基板を用いた場合は、市松パターンのピッチを変更することは困難であり、このため第２の実施形態では光軸方向の補正を行っていない。第３の実施形態では、市松パターンのピッチを制御せずに、３次元表示ウインドウの表示サイズを制御することにより、観察者の光軸方向の移動に対する画質の維持を行う。
【００７０】
図１２は第３の実施形態による３次元表示ウインドウのサイズ決定処理を説明するフローチャートである。なお、図１２に示されるフローチャートは、図１０に示されるフローチャートのステップＳ１０１とステップＳ１０３の間に挿入されるものとする。
【００７１】
まず、ステップＳ５０１において、ディスプレイデバイス１０６と視点位置との距離Ｌ_０を取得する。次に、ステップＳ５０２では、３次元表示ウインドウの幅に基づいて、立体視可能な距離範囲を算出する。ウインドウの幅と、立体視可能な距離範囲は、例えば文献「３Ｄ映像 Ｖｏｌ．７ Ｎｏ．２， １９９３／Ｍａｒｃｈ、４〜７ページ」に記載されている立体視領域に基づいて算出される。上述の文献では、レンチキュラ方式について言及しているが、他の直視型立体ディスプレイにも適用できる。設計上の立体視最適距離をＤ０、立体視できる最近距離をＤＦ、立体視できる最遠距離をＤＳ、ウインドウの横幅をＡ（ｍｍ）、眼間距離をＫ（通常６５ｍｍ）、ｎを画像数とした場合に以下のように表わされる。
【００７２】
【数３】

【００７３】
ステップＳ５０３では、上記の式のＡに処理対象の３次元表示ウインドウの幅を代入し、当該ウインドウの立体視可能範囲を求める。そして、この求まった立体視可能範囲に、ステップＳ５０１で得られた距離Ｌ_０が入っているかを判断する。距離Ｌ_０が立体視可能範囲に入らない場合は、この距離Ｌ_０が立体視可能範囲に収まるように当該ウインドウの幅を変更する。以上の処理をすべての３次元表示ウインドウに対して行う（ステップＳ５０５）。
【００７４】
以上のように、第３の実施形態によれば、ディスプレイデバイス１０６と視点位置との距離が、立体視可能となるように３次元表示ウインドウ幅が調整されるので、観察者は多様な視点位置で、高品位な立体視を行うことができる。
【００７５】
なお、本実施形態の目的は、前述した実施形態の機能を実現するソフトウェアのプログラムコードを記録した記憶媒体を、システムあるいは装置に供給し、そのシステムあるいは装置のコンピュータ（またはＣＰＵやＭＰＵ）が記憶媒体に格納されたプログラムコードを読出し実行することによっても、達成されることは言うまでもない。
【００７６】
この場合、記憶媒体から読出されたプログラムコード自体が前述した実施形態の機能を実現することになり、そのプログラムコードを記憶した記憶媒体は本実施形態を構成することになる。
【００７７】
プログラムコードを供給するための記憶媒体としては、例えば、フロッピディスク，ハードディスク，光ディスク，光磁気ディスク，ＣＤ−ＲＯＭ，ＣＤ−Ｒ，磁気テープ，不揮発性のメモリカード，ＲＯＭなどを用いることができる。
【００７８】
また、コンピュータが読出したプログラムコードを実行することにより、前述した実施形態の機能が実現されるだけでなく、そのプログラムコードの指示に基づき、コンピュータ上で稼働しているＯＳ（オペレーティングシステム）などが実際の処理の一部または全部を行い、その処理によって前述した実施形態の機能が実現される場合も含まれることは言うまでもない。
【００７９】
さらに、記憶媒体から読出されたプログラムコードが、コンピュータに挿入された機能拡張ボードやコンピュータに接続された機能拡張ユニットに備わるメモリに書込まれた後、そのプログラムコードの指示に基づき、その機能拡張ボードや機能拡張ユニットに備わるＣＰＵなどが実際の処理の一部または全部を行い、その処理によって前述した実施形態の機能が実現される場合も含まれることは言うまでもない。
【００８０】
【発明の効果】
以上説明したように、本発明によれば、表示画面中の任意の位置に任意のサイズで表示することが可能なウインドウ内に３次元画像を表示する場合に、適切な視点追従制御を行うことが可能となる。
【図面の簡単な説明】
【図１】第１の実施形態による立体画像表示装置の概略構成を示す図である。
【図２】第１の実施形態による立体画像表示装置の立体観察を説明する図である。
【図３】第１の実施形態による立体表示システムの構成を示すブロック図である。
【図４】本実施形態による光学系の諸元を説明する図である。
【図５】本実施形態による視点追従制御を説明するフローチャートである。
【図６】本実施形態による基準位置Ｘ_０の決定処理を説明するフローチャートである。
【図７】本実施形態による３次元表示ウインドウの表示状態を説明する図である。
【図８】本実施形態による３次元表示ウインドウの表示状態を説明する図である。
【図９】第２の実施形態による立体表示装置の構成を示す図である。
【図１０】第２の実施形態による視点追従制御を説明するフローチャートである。
【図１１】第２の実施形態によるマスク基板９０２のバックグランド処理について説明するフローチャートである。
【図１２】第３の実施形態による３次元表示ウインドウのサイズ決定処理を説明するフローチャートである。
【図１３】水平方向にシリンドリカルレンズを配置したレンチキュラを用いた光学系を示す図である。[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a display control apparatus and a display control method for a display apparatus that allows a user to observe a stereoscopic image using parallax between a right eye and a left eye. In particular, the present invention relates to a display control device and a display control method for a display device capable of switching between a normal two-dimensional image and a three-dimensional image for display, or capable of displaying a two-dimensional image and a three-dimensional image in a mixed manner.
[0002]
[Prior art]
Conventionally, a three-dimensional display device capable of switching between two-dimensional display and three-dimensional display and performing mixed display has been proposed. As a method of performing stereoscopic display on a display, a stereoscopic image display method using a parallax barrier (hereinafter, referred to as a parallax barrier method) and a lenticular method are widely known.
[0003]
For the parallax barrier method, see S.M. H. Kaplan, "Theory of Parallax Barriers", J. Amer. SMPTE, Vol. 59, no. 7, pp. According to this method, a stripe image in which at least left and right parallax images are alternately arranged among a plurality of parallax images from a plurality of viewpoints is provided at a predetermined distance from the image. Performing stereoscopic viewing by observing a parallax image corresponding to each eye with left and right eyes through a slit having a predetermined opening provided at a position only apart (called a parallax barrier) Can be.
[0004]
On the other hand, the lenticular method also displays a stereoscopic image using the binocular parallax of the right eye and the left eye, and a lenticular with a large number of semi-cylindrical lenses is provided on the front of the display and spatially enters the left and right eyes The image is separated so that the user can observe a stereoscopic image.
[0005]
However, in these systems, the range in which the observer can view stereoscopically is only a width of about 65 mm between both eyes. Therefore, it is necessary for the observer to observe while fixing the position of the head, and there is a problem that it is very difficult to use.
[0006]
In order to cope with such a problem, Japanese Patent Application Laid-Open No. 2-44995 discloses a method in which the positions of both eyes of an observer are detected, and a lenticular lens is movably supported in a horizontal direction to determine a relative position in a horizontal direction with respect to a display element. A method has been proposed in which the stereoscopic viewing area is expanded by controlling the movement. Further, Japanese Patent Application Laid-Open No. Hei 2-50145 proposes a method of detecting a position of both eyes of an observer and exchanging an image display according to the position of the observer to widen a stereoscopic viewing area. Further, Japanese Patent Application Laid-Open No. 10-232367 proposes a stereoscopic image display device that prevents the occurrence of crosstalk due to a change in the distance between an observer and the stereoscopic image display device.
[0007]
[Problems to be solved by the invention]
However, in any of the above-described methods of following the viewpoint, the amount of movement of the viewpoint is always calculated by a coordinate system fixed to the display screen, and only considers the case where a three-dimensional image is displayed on the entire display screen. . For example, a three-dimensional image is displayed in a window that can be moved arbitrarily in the display screen, and when this window is moved, the viewpoint relatively moves. However, such a case is taken into consideration. Absent.
[0008]
That is, no consideration is given to viewpoint tracking when a three-dimensional image is displayed in a window opened at an arbitrary position on the display screen. Further, when one or a plurality of windows are displayed on one screen, and three-dimensional display is performed on each of the one or a plurality of windows, consideration should be given to how to control viewpoint tracking. Has not been done.
[0009]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problem, and has an advantage in that, when a three-dimensional image is displayed in a window that can be displayed at an arbitrary position in an arbitrary size on a display screen, viewpoint tracking control is appropriately performed. It is intended to be able to perform.
[0010]
[Means for Solving the Problems]
A display control device according to the present invention for achieving the above object has, for example, the following configuration. That is,
A display control device that generates a light directivity for allowing a parallax image to be observed by each of right and left eyes and enables a three-dimensional image to be observed,
Detecting means for detecting the viewpoint position of the observer;
Acquiring means for acquiring a reference position for viewpoint tracking based on the position of the three-dimensional display window being displayed;
And control means for controlling the state of generation of the light directivity so as to follow the viewpoint based on the viewpoint position detected by the detection means and the reference position acquired by the acquisition means.
[0011]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
[0012]
<First embodiment>
FIG. 1 is a diagram illustrating a schematic configuration of the stereoscopic image display device according to the first embodiment. In FIG. 1, reference numeral 101 denotes a self-luminous display element such as a CRT, on which a checkered light-emitting pattern 104 having a light-emitting portion 102 and a non-light-emitting portion 103 is displayed. Reference numeral 105 denotes a lenticular lens, which gives directivity to light emitted from the light emitting unit 102. The lenticular lens 105 is a cylindrical lens array made of a transparent resin or glass, and is configured by arranging vertically long cylindrical lenses in the left-right direction. Reference numeral 106 denotes a display device. In this example, a transmission type liquid crystal element in which a display pixel portion (display surface) is formed between two glass substrates is used.
[0013]
It is desirable that the self-luminous display element 101 and the display device 106 display a light emitting pattern and a stripe image in synchronization with each pixel or each scanning line.
[0014]
110 is a display drive circuit, 112 is a position sensor for detecting the position of the observer 113, and 111 is a control unit. The position sensor 112 detects the position of the observer in the horizontal direction and the position in the optical axis direction (front-back direction). The control unit 111 also controls the light emission pattern of the self-luminous display element 101. In addition, as a method for the position sensor 112 to detect the position of the observer 113 in the optical axis direction, a well-known autofocus method used in a silver halide camera, a video camera, or the like can be applied.
[0015]
FIG. 2 is a diagram illustrating stereoscopic observation of the stereoscopic image display device according to the first embodiment. The figure is a horizontal cross-sectional view, in which (A) is a cross-sectional view along a horizontal plane including line AA in FIG. 1 and (B) is a cross-sectional view along a horizontal plane including line BB in FIG. ).
[0016]
The control unit 111 inputs a parallax image for the right eye and a parallax image for the left eye, and converts each of the two input parallax images into a number of horizontal stripe-shaped stripe images R. _i And L _i , And as shown in FIG. ₁ L ₂ R ₃ L ₄ R ₅ L ₆ Are alternately arranged to synthesize one horizontal stripe image. The horizontal stripe image thus synthesized is input to the display drive circuit 110 and is displayed as shown in FIG.
[0017]
At this time, R ₁ , R ₃ The stripe (R) of the right parallax image displayed in _i 2) reaches the observer's right eye as shown in FIG. 2A due to the light directivity of the three-dimensional image display device. That is, the light emitted from the light emitting unit 102 of the checkered pattern 104 is transmitted to the right eye E of the observer by the cylindrical lens of the lenticular lens 105. _R Directivity is given to head toward. This right eye E _R The luminous flux traveling toward the horizontal direction is a horizontally long stripe image (here, image R) displayed on a display device 106 provided between the lenticular lens 3 and the observer. _i ) Is modulated by the right eye E _R Incident on.
[0018]
Similarly, L ₂ , L ₄ ... stripes of the left parallax image (L _i ) Indicates the left eye E of the observer as shown in FIG. 2B due to the light directivity of the stereoscopic image display device. _L To reach.
[0019]
In this way, the observer observes the corresponding parallax image with each of the left and right eyes, and stereoscopic vision becomes possible.
[0020]
FIG. 3 is a block diagram showing the configuration of the stereoscopic display system according to the first embodiment. In FIG. 3, reference numeral 300 denotes a host computer, which can handle two-dimensional images and three-dimensional images. In the host computer 300, a CPU 301 executes various processes according to a control program stored in a memory 302. The host computer 300 updates a signal to the device driver 310 every time the drawing data is updated. The memory 302 includes a ROM, a RAM, or a magnetic disk driver.
[0021]
Reference numeral 310 denotes a display driver that controls the entire drawing of the stereoscopic display according to the present embodiment, and corresponds to the control unit 111 in FIG. An object analysis unit 311 determines and analyzes the type of drawing data. A system controller 312 plays a central role in various controls. The system controller 312 includes a CPU and a memory, and executes various processes such as viewpoint tracking control described below. Reference numeral 313 denotes a 2D3D drawing unit which controls drawing of data actually drawn on the stereoscopic display, that is, a conventionally handled two-dimensional image or stripe-combined three-dimensional image.
[0022]
A switching drive unit 314 controls the self-luminous display element 101 to switch between three-dimensional display and two-dimensional display. That is, as shown in FIG. 1, three-dimensional display is possible by displaying the checkerboard pattern 104, and when the entire surface is in a light emitting state, the backlight becomes a normal backlight and two-dimensional display is possible. A tracking control unit 315 changes the checkerboard pattern 104 based on the viewpoint position input from the viewpoint detection unit 320 so that stereoscopic viewing can be performed correctly at the detected viewpoint position. The viewpoint tracking control will be described later in detail.
[0023]
The viewpoint detection unit 320 includes the position sensor 112, detects the viewpoint position of the observer 113, and outputs the information to the device driver 310.
[0024]
The stereoscopic display 330 displays a two-dimensional image or a three-dimensional image on the display device 106 according to the drawing data output from the 2D3D drawing unit 313. In this example, the display unit 330 includes the display drive circuit 110 and the display device 106.
[0025]
The 2D3D switching unit 332 turns on / off the display of the checkerboard pattern 104 of the self-luminous display element 101 according to a signal from the switching drive unit 314. In addition, the viewpoint tracking unit 333 controls the display position of the checkered pattern 104 and the display pitch of the light emitting unit and the non-light emitting unit according to the signal of the tracking control unit 315.
[0026]
The device driver 310 may be connected as an external device of the host computer 300 or may be mounted on a throttle in the host computer 300. Further, it may be implemented as one software of the host computer or a configuration in which the software and the electronic circuit are mixed. That is, the host computer 300 includes a CPU 301 and a memory 302 in which a control program for realizing the processing procedure described with reference to the attached flowchart is stored, and various functions realized by the display driver 310 are realized by the CPU 301 of the host computer 300. You may do so.
[0027]
The viewpoint tracking control of the present embodiment in the stereoscopic image display device having the above-described structure will be described below. According to the present embodiment, the correction of the crosstalk caused by the displacement of the observer in the horizontal direction is performed by moving the checkered pattern 104 formed on the display surface of the self-luminous display element 101. In addition, crosstalk caused by a change in the distance between the observer and the display device is caused by changing the pitch between the light-emitting portion and the non-light-emitting portion in the checkered pattern 104 of the self-luminous display element 101.
[0028]
FIG. 4 is a diagram illustrating the specifications of the optical system according to the present embodiment. In FIG. 4, one horizontal line for displaying the right stripe pixels of the display device 106, the lenticular lens 105, and the screen of the self-luminous display element 101 for displaying the checkered pattern 104 are simply shown. .
[0029]
The converted distance between the display screen of the checkered pattern 104 and the lenticular lens 105 (the distance obtained by converting the thickness of a member such as glass into air) is t. ₁ , The converted distance between the lenticular lens 105 and the display device 106 is t ₂ , The converted distance between the display device 106 and the observer is L ₀ And the pitch of the lenticular lens 105 is P ₁ , The pitch of the light emitting and non-light emitting portions of the checkerboard pattern is P _m Then, the optical system of the present embodiment satisfies the following equation from the similarity condition of the triangle.
[0030]
(Equation 1)

[0031]
Further, the right eye of the observer is positioned at the center C of the display device 106. ₀ When the position is shifted by x in the horizontal direction from the center of the lenticular lens at the center of the image display surface, the center D of the corresponding light emitting portion 102 of the checkered pattern 104 is set at the reference position D thereof. ₀ From the following d horizontally ₀ By shifting the distance only, appropriate stereoscopic vision can be performed.
[0032]
(Equation 2)

[0033]
In the present embodiment, the control of the light directivity corresponding to the viewpoint position as described above is referred to as viewpoint tracking control.
[0034]
FIG. 5 is a flowchart illustrating the viewpoint tracking control according to the present embodiment. This processing is realized by a CPU (not shown) mounted on the system controller 312 in the device driver 310 executing a control program stored in a memory (not shown).
[0035]
First, in step S101, the reference position X ₀ To determine. This reference position X ₀ Is a position serving as a reference for obtaining a shift amount x from the viewpoint position detected by the viewpoint detection unit 320. Hereinafter, the processing in step S101 will be described with reference to FIG.
[0036]
FIG. 6 shows a reference position X according to the present embodiment. ₀ It is a flowchart for explaining the determination processing. In step S201, a window for displaying a three-dimensional image (hereinafter, a three-dimensional display window) is extracted. FIG. 7 is a diagram illustrating the display state of the three-dimensional display window according to the present embodiment. In FIG. 7, windows 33a, 33b, and 33c are windows for displaying a three-dimensional image. Whether or not each window performs three-dimensional display can be determined by examining an image file displayed in the window (for example, referring to an extension or the like). In step S201, these windows 33a, 33b, and 33c are extracted.
[0037]
In step S202, the position of the center of gravity is calculated for the window extracted in step S201. Then, it is determined whether or not the viewpoint position detected by the viewpoint detection unit 320 is within the tracking range with respect to the calculated center of gravity. ₀ To decide.
[0038]
When a plurality of three-dimensional display windows are displayed by the above processing, the position of their center of gravity is set to the reference position X. ₀ Will be set to When only one three-dimensional display window is displayed as shown in FIG. 8, the position of the center of gravity calculated in step S202 matches the center of the three-dimensional display window. . In the case where three-dimensional display is performed only in the active three-dimensional display window and two-dimensional display is performed in the inactive three-dimensional display window, the center of the active three-dimensional display window is set at the reference position. X ₀ (In this case, the three-dimensional display window executing the three-dimensional display in step S201 may be extracted).
[0039]
On the other hand, if it is determined in step S203 that the viewpoint position is not in the tracking range based on the relationship between the calculated center-of-gravity position and the detected viewpoint position, the process proceeds to step S204, and the display content of the three-dimensional display window is changed to two. Dimension display. At this time, the window frame or the like may be changed so as to clearly indicate that the two-dimensional display is being performed. At this time, the display of the self-luminous display element 101 may be switched from a checkered pattern to a full-luminous state to operate as a two-dimensional display device. Then, in steps S205 and S206, it is monitored that the viewpoint position returns within the tracking range. If the viewpoint position has returned to the tracking range, the window changed to two-dimensional display in step S204 is returned to three-dimensional display in step S207. Thereafter, the flow returns to step S201, and the reference position X is determined as described above. ₀ To determine.
[0040]
The determination as to whether or not the viewpoint position has reached the tracking range in step S205 can be performed, for example, as follows. That is, the relative positional relationship between the position of the center of gravity and the viewpoint position in the window changed to the two-dimensional display in step S204 is monitored. Here, since the position of the center of gravity of the window may change due to the movement of the window by the drag operation, the position of the center of gravity is calculated again at least when the drag operation is performed on the corresponding window. In this way, if the viewpoint position has entered the following range due to the movement of the viewpoint position and / or the movement of the window, the process proceeds from step S206 to step S207.
[0041]
Returning to FIG. 5 again, in step S102, the distance L between the observer's viewpoint position and the display is displayed. ₀ To get. Also, in step S103, the reference position X determined in step S101 ₀ Is calculated in the horizontal direction x of the viewpoint position from the camera.
[0042]
In step S104, crosstalk caused by movement of the observer in the optical axis direction is corrected. That is, the distance L obtained in step S102 ₀ Of the checkerboard pattern 104 on the self-luminous display element 101 in the horizontal direction _m Is recalculated by the above equation (1), and the pitch P _m Thus, a checkered pattern display on the self-luminous display element 101 is performed.
[0043]
Subsequently, in and after step S105, the crosstalk due to the horizontal position shift is corrected using the shift amount x calculated in step S103.
[0044]
First, in step S105, the horizontal shift amount x is divided by a preset reference interocular distance E (for example, 65 mm), and a quotient N as an integer and a remainder s whose absolute value is equal to or less than E are calculated. obtain. That is, x, E, N, and s are:
x = NE * s (where N is an integer, | s | <E)
Have the relationship
[0045]
In step S106, it is determined whether N obtained in step S105 is odd or even. If it is even, the process proceeds to step S107, and if it is odd, the process proceeds to step S108. In step S107, the device driver 310 displays the first horizontal stripe image on the display device 106, and in step S108, the device driver 310 displays the second horizontal stripe image on the display device 106. The relationship between the first and second horizontal stripe images is such that the display positions of the left-eye stripe image and the right-eye stripe image are switched in FIG. 1, and the left and right parallax images are correctly observed by the left and right eyes, respectively. So that
[0046]
In step S109, it is determined whether the absolute value of s is larger or smaller than a predetermined value, for example, E / 10. If smaller, the process proceeds to step S110, and the light emission pattern is returned to the reference position. If s is greater than E / 10, the process proceeds to step S111, and the light emission pattern is moved from the reference position by the amount given by equation (2). That is,
st ₁ / (L ₀ + T ₂ )
Just move. In the present embodiment, the threshold value is E / 10, but the threshold value is determined in consideration of the optical separation state of the left and right images.
[0047]
As described above, according to the first embodiment, it is possible to perform appropriate viewpoint tracking control for a three-dimensional display window displayed at an arbitrary position. Further, even if a plurality of three-dimensional display windows are displayed, it is possible to perform appropriate viewpoint tracking control on those windows.
[0048]
In the above embodiment, when the viewpoint position is outside the viewpoint tracking range with respect to the barycenter position calculated for the three-dimensional display window, the three-dimensional display window is set to two-dimensional display, and the viewpoint position returns to the tracking range. Wait, but not limited to this. For example, two or more three-dimensional display windows may be displayed two-dimensionally one by one in order from the one farthest from the detected viewpoint position, and may be excluded from the center of gravity calculation. In this way, for example, in the display as shown in FIG. 7, if the viewpoint position exceeds the tracking range by using the center of gravity of the windows 33a, 33b and 33c, for example, the window 33c is set to a two-dimensional display and the windows 33a and 33b are displayed. The relationship between the position of the center of gravity and the viewpoint position is checked, and if the viewpoint position falls within the tracking range, the position of the center of gravity may be used as the reference position.
[0049]
In the present embodiment, the control of the light directivity is performed in the viewpoint tracking control. In addition, the motion parallax control may be performed. The motion parallax changes the display state of the object such that the side of the object gradually appears in accordance with the detected viewpoint position. In this case, since the stereoscopic image is updated in accordance with the detected shift amount of the viewpoint position, the stereoscopic image is updated based on the shift amount x of the viewpoint position detected by the method described in the flowcharts of FIGS. Update and draw.
[0050]
As a result, the following motion parallax control can be realized.
(1) The stereoscopic image of the window is updated and drawn as the observer moves.
(2) The three-dimensional image of the window is updated and drawn with the movement (drag) of the window.
[0051]
For example, a two-dimensional motion parallax image may be displayed while the window is moving. In this case, after the movement of the window is completed, the display is returned to the three-dimensional display.
[0052]
Further, as shown in FIG. 13, the optical system of the above embodiment may have a configuration using a lenticular 1301 in which cylindrical lenses are arranged in a horizontal direction, as disclosed in Japanese Patent Application Laid-Open No. 10-78563.
[0053]
<Second embodiment>
In the first embodiment, a checkered pattern 104 is displayed on the self-luminous display element 101 to enable stereoscopic viewing. In the present embodiment, a case will be described in which a mask pattern having light-transmitting portions and non-transmitting portions provided in a checkered pattern is used.
[0054]
FIG. 9 is a diagram illustrating a configuration of a stereoscopic display device according to the second embodiment. In the figure, the same components as those of the first embodiment (FIG. 1) are denoted by the same reference numerals.
[0055]
In FIG. 9, reference numeral 901 denotes a backlight light source (surface light source); and 902, a mask substrate having a checkered opening 903 and a light shielding portion 904. The second embodiment has a configuration in which the self-luminous display element 101 displaying the checkered pattern 104 in the first embodiment is replaced by a backlight light source 901 and a mask substrate 902. An actuator 910 moves the mask substrate 902 in the horizontal direction. In the first embodiment, the horizontal correction is performed by moving the display of the mask pattern 104. In the second embodiment, the horizontal viewpoint tracking is performed by moving the mask substrate 902 by the actuator 910. Do.
[0056]
As described above, in the second embodiment, when performing the viewpoint tracking control, a mechanical operation of moving the mask substrate 902 is required. While such movement is being performed for the purpose of following the viewpoint, the light directivity changes every moment, which makes the observer unsightly. The second embodiment addresses such a problem.
[0057]
FIG. 10 is a flowchart illustrating viewpoint tracking control according to the second embodiment. In FIG. 10, steps S101, S103, S105 to S109 are the same processes as in the above-described first embodiment (FIG. 5). However, in the mask substrate 902, the pitch P between the opening and the light shielding portion is _m Since it is not easy to change the crosstalk, it is assumed in the second embodiment that the correction of the crosstalk for the movement of the observer in the optical axis direction is not executed (that is, steps S102 and S104 are omitted).
[0058]
If s ≦ E / 10 in step S109, the process advances to step S301 to move the mask substrate 902 to the reference position. If s> E / 10, the flow advances to step S302 to move by the amount given by equation (2). That is,
st ₁ / (L ₀ + T ₂ )
Just move.
[0059]
Thereafter, the process proceeds to step S303, where it is determined whether the mask substrate 902 is moving in steps S301 and S302, and if it is moving, a delay process is performed in step S304. As delay processing,
(1) Nothing is displayed on the display device 106 while the mask substrate 902 is moving.
(2) The display in the three-dimensional window is prohibited while the mask substrate 902 is moving.
(3) While the mask substrate 902 is moving, the display on the display device 106 may be entirely two-dimensional.
[0060]
Also, if the observer goes out of the tracking range by the processing described in the flowchart of FIG.
(1) The display of the three-dimensional display window is changed to a two-dimensional display, and is changed to a window frame that clearly indicates that the display is a two-dimensional display.
(2) Stop the viewpoint tracking control until the viewpoint position returns to the tracking range.
Is performed.
[0061]
In the second embodiment, when the moving speed of the window by the drag operation exceeds the tracking speed of the viewpoint tracking control, all the three-dimensional display windows may be controlled to be two-dimensionally displayed.
[0062]
In the configuration shown in FIG. 9, a light directing control element (PDLC) or the like made of polymer dispersed liquid crystal, which can control two states of a light diffusion state and a transmission state, is provided with a display device 106 and a lenticular lens 105. Or between the lenticular lens 105 and the mask substrate 902 to switch between two-dimensional display and three-dimensional display. In other words, a two-dimensional display device is obtained by canceling the light directivity by setting the PDLC in a diffusion state, and a three-dimensional display device is obtained by setting the PDLC in a transmission state. In addition, you may make it switch the insertion state and non-insertion state of a diffusion sheet instead of PDLC.
[0063]
In the device capable of switching between two-dimensional display and three-dimensional display as described above, when the two-dimensional display state is set, the movement of the mask substrate 902 does not affect the display state. Therefore, during the two-dimensional display, the mask substrate 902 is moved to a position where the delay in following the mask substrate when switching to the three-dimensional display state is reduced (hereinafter, the background of the mask substrate). Processing). Hereinafter, this process will be described.
[0064]
FIG. 11 is a flowchart illustrating a background process of the mask substrate 902 according to the second embodiment. The flowchart shown in FIG. 11 is inserted between step S103 and step S105 in FIG.
[0065]
First, in step S401, it is determined whether the display device is in a three-dimensional display state. That is, when the PDLC is in the transmission state or when the diffusion sheet is not inserted, the display is in the three-dimensional display state. In this case, the process directly proceeds to step S105, and the above-described viewpoint tracking control is executed.
[0066]
On the other hand, when the PDLC is in the diffusion state or when the diffusion sheet is inserted, the display is in the two-dimensional display state, and the process proceeds to step S402. In step S402, a three-dimensional display window (a window that may be three-dimensionally displayed) is extracted. Then, in step S403, the position of the center of gravity of the window extracted in step S402 is obtained, and the mask substrate is moved to an optimum position based on the position of the center of gravity and the viewpoint position.
[0067]
By performing the processing as described above, when switching from the two-dimensional display state to the three-dimensional display state, the mask substrate 902 has already been moved to an appropriate position, so that smooth display switching can be performed.
[0068]
In the above embodiment, the mask substrate 902 is moved, but another optical member such as a lenticular lens may be moved.
[0069]
<Third embodiment>
In the first embodiment described above, the checkerboard pattern pitch P _m Was controlled by controlling However, when the mask substrate as in the second embodiment is used, it is difficult to change the pitch of the checkered pattern, and therefore, in the second embodiment, the correction in the optical axis direction is not performed. In the third embodiment, the image quality is maintained with respect to the movement of the observer in the optical axis direction by controlling the display size of the three-dimensional display window without controlling the pitch of the checkerboard pattern.
[0070]
FIG. 12 is a flowchart illustrating a process for determining the size of a three-dimensional display window according to the third embodiment. Note that the flowchart shown in FIG. 12 is inserted between step S101 and step S103 of the flowchart shown in FIG.
[0071]
First, in step S501, the distance L between the display device 106 and the viewpoint position is determined. ₀ To get. Next, in step S502, a distance range in which stereoscopic viewing is possible is calculated based on the width of the three-dimensional display window. The width of the window and the distance range in which stereoscopic viewing is possible are calculated based on a stereoscopic viewing area described in, for example, a document “3D Video Vol. Although the above-mentioned documents refer to the lenticular system, the present invention can be applied to other direct-view type stereoscopic displays. The optimal stereoscopic distance in design is D0, the nearest distance for stereoscopic viewing is DF, the farthest distance for stereoscopic viewing is DS, the width of the window is A (mm), the interocular distance is K (typically 65 mm), and n is the number of images. Is expressed as follows.
[0072]
(Equation 3)

[0073]
In step S503, the width of the three-dimensional display window to be processed is substituted for A in the above equation, and a stereoscopically viewable range of the window is obtained. Then, the distance L obtained in step S501 is set in the obtained stereoscopically viewable range. ₀ Judge whether it is included. Distance L ₀ Is not within the stereoscopically viewable range, the distance L ₀ Is changed so that is within the stereoscopically viewable range. The above processing is performed on all three-dimensional display windows (step S505).
[0074]
As described above, according to the third embodiment, the three-dimensional display window width is adjusted so that the distance between the display device 106 and the viewpoint position can be stereoscopically viewed. Thus, high-quality stereoscopic viewing can be performed.
[0075]
An object of the present embodiment is to supply a storage medium storing a program code of software for realizing the functions of the above-described embodiment to a system or an apparatus, and to store the storage medium in a computer (or CPU or MPU) of the system or the apparatus. It goes without saying that this is also achieved by reading and executing the program code stored in the medium.
[0076]
In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present embodiment.
[0077]
As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, and the like can be used.
[0078]
When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also an OS (Operating System) running on the computer based on the instruction of the program code. It goes without saying that a case where some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.
[0079]
Further, after the program code read from the storage medium is written into a memory provided on a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.
[0080]
【The invention's effect】
As described above, according to the present invention, when a three-dimensional image is displayed in a window that can be displayed at an arbitrary position in an arbitrary size on a display screen, appropriate viewpoint tracking control is performed. Becomes possible.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a schematic configuration of a stereoscopic image display device according to a first embodiment.
FIG. 2 is a diagram illustrating stereoscopic observation of the stereoscopic image display device according to the first embodiment.
FIG. 3 is a block diagram illustrating a configuration of a stereoscopic display system according to the first embodiment.
FIG. 4 is a diagram illustrating specifications of the optical system according to the present embodiment.
FIG. 5 is a flowchart illustrating viewpoint tracking control according to the embodiment.
FIG. 6 shows a reference position X according to the embodiment. ₀ It is a flowchart for explaining the determination processing.
FIG. 7 is a diagram illustrating a display state of a three-dimensional display window according to the embodiment.
FIG. 8 is a diagram illustrating a display state of a three-dimensional display window according to the embodiment.
FIG. 9 is a diagram illustrating a configuration of a stereoscopic display device according to a second embodiment.
FIG. 10 is a flowchart illustrating viewpoint tracking control according to a second embodiment.
FIG. 11 is a flowchart illustrating background processing of a mask substrate 902 according to the second embodiment.
FIG. 12 is a flowchart illustrating a process for determining the size of a three-dimensional display window according to the third embodiment.
FIG. 13 is a diagram showing an optical system using a lenticular having cylindrical lenses arranged in a horizontal direction.

Claims (35)

A display control device that generates a light directivity for allowing a parallax image to be observed by each of right and left eyes and enables a three-dimensional image to be observed,
Detecting means for detecting the viewpoint position of the observer;
Acquiring means for acquiring a reference position for viewpoint tracking based on the position of the three-dimensional display window being displayed;
Display control means for controlling the state of generation of the light directivity so as to perform viewpoint tracking based on the viewpoint position detected by the detection means and the reference position acquired by the acquisition means. apparatus. The display control device according to claim 1, wherein the acquisition unit acquires a center position of an active three-dimensional display window as a reference position. The display control device according to claim 1, wherein the acquisition unit calculates a position of a center of gravity of the three-dimensional display window being displayed, and uses the calculated position as a reference position. 2. The display control device according to claim 1, further comprising a display change unit configured to display all display contents in a two-dimensional manner when the viewpoint position with respect to the reference position is out of a tracking range. 5. The three-dimensional display window is returned from the two-dimensional display to the three-dimensional display when the viewpoint position falls within the following range in a state where the two-dimensional display is performed by the display changing unit. Display control device. The display control device according to claim 1, further comprising: a unit configured to execute a motion parallax display based on the reference position acquired by the acquisition unit and a viewpoint position detected by the detection unit. 4. The control unit according to claim 3, wherein when the viewpoint position with respect to the reference position goes out of a tracking range, the control unit changes the combination of three-dimensional display windows for which the center of gravity position is to be calculated, and attempts to follow the viewpoint. 3. The display control device according to 1. The detecting means further detects a distance between the viewpoint position and the image display surface,
The display control device according to claim 1, further comprising a second control unit that controls light directivity based on the distance. The display control device according to claim 1, wherein the control unit performs viewpoint tracking by controlling movement of an optical member. The display control device according to claim 9, wherein three-dimensional display is prohibited while the optical member is being moved to follow the viewpoint. The display control device according to claim 9, wherein display of an image on a display screen is prohibited while the optical member is being moved to follow the viewpoint. Switching means for removing the light directivity and functioning as a two-dimensional image display device;
The display control device according to claim 9, further comprising a moving unit that moves the optical member to a standby position when the switching unit functions as a two-dimensional image display device. 13. The display control device according to claim 12, wherein the moving unit extracts windows capable of three-dimensional display, and determines the standby position based on the positions of the centers of gravity. The control means detects a moving speed of the three-dimensional window, and switches the three-dimensional window to a two-dimensional display when the moving speed exceeds a speed of tracking the viewpoint by the control means. The display control device according to claim 9. The detecting means further detects a distance between the viewpoint position and the image display surface,
The display control device according to claim 9, wherein a display width of the three-dimensional window is limited based on the distance. 16. The display control device according to claim 15, wherein the display width of the three-dimensional window is limited based on the distance and a distance between eyes of an observer. 2. The display control device according to claim 1, further comprising: a means for displaying an object including the three-dimensional display window as a graphical user interface. A control method of a display control device that generates a light directivity for allowing a parallax image to be observed by right and left eyes and enables a three-dimensional image to be observed,
A detection step of detecting a viewpoint position of the observer;
An acquisition step of acquiring a reference position for viewpoint tracking based on the position of the three-dimensional display window being displayed;
A display control step of: controlling a generation state of the light directivity so as to perform viewpoint tracking based on the viewpoint position detected in the detection step and the reference position acquired in the acquisition step. Method. 19. The display control method according to claim 18, wherein the acquiring step acquires the center position of an active three-dimensional display window as a reference position. 19. The display control method according to claim 18, wherein in the acquiring step, the position of the center of gravity of the three-dimensional display window being displayed is calculated and used as a reference position. 19. The display control method according to claim 18, further comprising a display changing step of, when the viewpoint position with respect to the reference position goes out of the tracking range, changing the display contents to two-dimensional display. 22. The three-dimensional display window is returned from the two-dimensional display to the three-dimensional display when the viewpoint position enters the tracking range in a state where the two-dimensional display is performed in the display changing step. Display control method. 19. The display control method according to claim 18, further comprising the step of executing a motion parallax display based on the reference position acquired in the acquiring step and the viewpoint position detected in the detecting step. 21. The method according to claim 20, wherein in the control step, when the viewpoint position with respect to the reference position is out of a tracking range, a viewpoint tracking is attempted by changing a combination of three-dimensional display windows for which a center of gravity position is to be calculated. Display control method described in 1. The detecting step further detects a distance between the viewpoint position and the image display surface,
19. The display control method according to claim 18, further comprising a second control step of controlling light directivity based on the distance. 19. The display control method according to claim 18, wherein the control step performs viewpoint tracking by controlling movement of an optical member. 27. The display control method according to claim 26, wherein three-dimensional display is prohibited while the optical member is moving to follow the viewpoint. 27. The display control method according to claim 26, wherein image display on a display screen is prohibited while the optical member is being moved to follow the viewpoint. A moving step of moving the optical member to a standby position while functioning as a two-dimensional image display device by switching means for removing the light directivity and functioning as a two-dimensional image display device. The display control method according to claim 26, wherein: 30. The display control method according to claim 29, wherein in the moving step, windows capable of three-dimensional display are extracted, and the standby position is determined based on their barycentric positions. The control step detects a moving speed of the three-dimensional window, and switches the three-dimensional window to a two-dimensional display when the moving speed exceeds a speed of following the viewpoint in the control step. The display control method according to claim 26. The detecting step further detects a distance between the viewpoint position and the image display surface,
The display control method according to claim 26, wherein a display width of the three-dimensional window is limited based on the distance. 33. The display control method according to claim 32, wherein the display width of the three-dimensional window is limited based on the distance and the distance between eyes of a viewer. 19. The display control method according to claim 18, further comprising a step of displaying an object including the three-dimensional display window as a graphical user interface. A storage medium storing a control program for realizing a display control method according to any one of claims 18 to 34 by a computer.

Images