JP2006128842A - Stereoscopic video signal generator - Google Patents
Stereoscopic video signal generator Download PDFInfo
- Publication number
- JP2006128842A JP2006128842A JP2004311713A JP2004311713A JP2006128842A JP 2006128842 A JP2006128842 A JP 2006128842A JP 2004311713 A JP2004311713 A JP 2004311713A JP 2004311713 A JP2004311713 A JP 2004311713A JP 2006128842 A JP2006128842 A JP 2006128842A
- Authority
- JP
- Japan
- Prior art keywords
- parallax
- images
- frame
- eye
- stereoscopic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
本発明は、立体映像の撮影・編集効率と表示品質の向上を目的とした立体映像信号生成装置に関するものである。 The present invention relates to a stereoscopic video signal generation apparatus for the purpose of improving the shooting / editing efficiency and display quality of stereoscopic video.
両眼立体視画像においては、右眼用と左眼用の視差画像中の対象物の水平表示位置の差によって立体感を得る。通常、画像中の主題の奥行き感を適切な量に設定するため、２枚の視差画像全体を水平方向に互いにずらして表示する。 In the binocular stereoscopic image, a stereoscopic effect is obtained by the difference in the horizontal display position of the object in the parallax images for the right eye and the left eye. In general, in order to set the depth of the subject in the image to an appropriate amount, the entire two parallax images are displayed while being shifted from each other in the horizontal direction.
しかしながら、既存の立体映像信号生成装置は、左眼用と右眼用２本の視差映像の表示位置は撮影時あるいは編集時の状態で固定されているため、映像中の主題が左右前後に移動した場合などは閲覧者の両眼に及ぼす視差が視力の適正範囲を超え、立体映像を正常に視認できない場合があった。 However, since the display positions of the two parallax images for left eye and right eye are fixed at the time of shooting or editing, the existing stereoscopic video signal generation device moves the subject in the video to the left and right and back and forth In such a case, the parallax exerted on the viewer's eyes exceeds the appropriate range of visual acuity, and stereoscopic images may not be viewed normally.
以下、図１、図２により、既存の立体映像信号生成装置における左眼用と右眼用２本の視差映像の相対的表示位置と両眼視差の関係を説明する。 Hereinafter, the relationship between the relative display position of the two parallax images for the left eye and the right eye and the binocular parallax in the existing stereoscopic video signal generation apparatus will be described with reference to FIGS.
図１の左部分は、左眼用視差映像のフレームＦＬと右眼用視差映像のフレームＦＲが重なり、さらに左眼用視差映像の点ＰＬと右眼用視差映像の点ＰＲが重なっている場合を示す。この場合、閲覧者の眼には点ＰＬと点ＰＲが表示スクリーンと同一平面上に見える。 In the left part of FIG. 1, the left-eye parallax video frame FL and the right-eye parallax video frame FR overlap, and the left-eye parallax video point PL and the right-eye parallax video point PR overlap. Indicates. In this case, the point PL and the point PR are visible on the same plane as the display screen to the viewer's eyes.
図１の右部分は、左眼用視差映像のフレームＦＬと右眼用視差映像のフレームＦＲの間隔を互いに左と右に移動し、点ＰＬと点ＰＲに一定の間隔をもたせた場合を示す。この場合、閲覧者の眼には点ＰＬと点ＰＲは脳内で融合してひとつの虚像ＰＲＬとして表示スクリーンの手前に見える。フレームの移動の方向を逆にした場合は、同様に表示スクリーンの奥に見えることになる。 The right part of FIG. 1 shows a case where the interval between the frame FL of the left-eye parallax image and the frame FR of the right-eye parallax image is moved to the left and right, and the points PL and PR are given a certain interval. . In this case, the point PL and the point PR are fused in the brain to the viewer's eyes and appear as a virtual image PRL in front of the display screen. If the direction of frame movement is reversed, it will appear behind the display screen as well.
以上は、左眼用視差映像のフレーム１枚と右眼用視差映像のフレーム１枚から成る立体静止画像の場合で、両者の表示位置の調整は、その１組に対して行えば十分である。 The above is a case of a stereoscopic still image composed of one frame for left-eye parallax video and one frame for right-eye parallax video, and it is sufficient to adjust the display position of both of them. .
図２は、通常１秒間に２４フレーム以上からなる立体動画像（以下、立体映像）の場合で、既存の立体映像信号生成装置の場合は左眼用と右眼用２本の視差映像の表示位置が固定のため、映像中の主題（点ＰＬと点ＰＲ）が左右前後に動いた場合に虚像ＰＲＬが閲覧者の視力の限界を超え、立体映像として正常に視認できない場合を示している。 FIG. 2 shows a case of a stereoscopic video image (hereinafter, “stereoscopic video”) generally consisting of 24 frames or more per second. In the case of an existing stereoscopic video signal generation device, display of two parallax images for the left eye and right eye is displayed. Since the position is fixed, the virtual image PRL exceeds the limit of the visual acuity of the viewer when the subject (point PL and point PR) in the video moves back and forth, and the stereoscopic image cannot be normally visually recognized.
本発明の目的は、まさに、両眼立体視映像においてこうした立体映像として正常に視認できない場合を未然に解消することにある。
以上で述べたように、既存の立体映像信号生成装置の場合は左眼用と右眼用２本の視差映像の表示位置が固定のため、映像中の主題が左右前後に動いた場合、あるいは２本の視差映像にもともと垂直方向のずれが存在する場合にその虚像が閲覧者の視力の限界を超え、立体映像として破たんする場合が生じる。 As described above, in the case of an existing stereoscopic video signal generation device, the display positions of two parallax images for the left eye and right eye are fixed, so that the subject in the video moves back and forth, or When there is a vertical shift between the two parallax images, the virtual image may exceed the viewer's visual acuity and break down as a stereoscopic image.
本発明の目的は、まさに、そのような立体映像中の主題の動きや２本の視差映像にもともと垂直方向のずれが存在する場合に生じる立体映像としての破たんをオリジナル映像に手を加えずに動的に解消することにある。 The purpose of the present invention is to make the original video without changing the stereoscopic video that occurs when there is a vertical shift in the motion of the subject and the two parallax images. It is to resolve dynamically.
本発明は、上記課題を解決するため、まず、前処理として左眼用と右眼用の２本の視差映像の左右上下の表示位置を任意に選択したキーフレームごとに適正に設定するためのフレーム視差編集機能を立体映像信号生成装置に実装する。 In order to solve the above-described problems, the present invention first sets, as preprocessing, the left and right and upper and lower display positions of the left-eye and right-eye parallax images appropriately for each arbitrarily selected key frame. A frame parallax editing function is implemented in the stereoscopic video signal generation device.
また、そこで設定・格納した表示位置データをもとに左右の視差映像の表示位置をフレームごとに補間、調整し、かつ映像表示位置の移動によって生じる左右の非重層部分の削除ならびに重層部分の拡大全画面表示を立体映像を表示しながら実時間で実現するためのフレーム視差制御機能を立体映像信号生成装置に実装する。 In addition, the display position of the left and right parallax images is interpolated and adjusted for each frame based on the display position data set and stored there, and the left and right non-multilayer portions are deleted and the multilayer portion is enlarged by moving the image display position. A frame parallax control function for realizing full-screen display in real time while displaying stereoscopic video is implemented in the stereoscopic video signal generating device.
本発明により、立体映像はその主題の動き、またオリジナルの視差映像の間に存在する多少の上下のずれにかかわらず、常に適正な両眼視差のもとで立体表示可能となる。図３は、主題の動きに対して、その虚像が前後に移動し、その虚像の位置を左右の視差映像の表示位置を調整することによって視力の範囲内にとどめる様子を示している。 According to the present invention, stereoscopic images can always be displayed stereoscopically under proper binocular parallax, regardless of the movement of the subject and the slight vertical shift that exists between the original parallax images. FIG. 3 shows how the virtual image moves back and forth with respect to the movement of the subject, and the position of the virtual image is kept within the range of visual acuity by adjusting the display positions of the left and right parallax images.
また、結果的に立体映像の両眼視差をオリジナル画像に手を加えることなしに自由に調整可能になるため、立体映像の撮影ならびに編集が従来と比較して大幅に簡単になる。 Further, as a result, the binocular parallax of the stereoscopic video can be freely adjusted without modifying the original image, so that the shooting and editing of the stereoscopic video is greatly simplified as compared with the conventional case.
以下、本発明の実施の形態を図４?５に基づいて説明する。 Hereinafter, embodiments of the present invention will be described with reference to FIGS.
図４は、本発明のフレーム視差編集機能を実装した立体映像信号生成装置のデジタル処理の流れを示す。ここでは、まず、左眼用と右眼用のムービー形式をデジタル処理に必要な形式に変換し、それぞれのバッファーに保持する。 FIG. 4 shows the flow of digital processing of the stereoscopic video signal generation apparatus in which the frame parallax editing function of the present invention is implemented. Here, first, the left-eye and right-eye movie formats are converted into formats necessary for digital processing, and are stored in respective buffers.
次に左眼用と右眼用の視差映像の表示位置は外部操作によって編集者によって選択されたキーフレームごとに適正に調整され、その位置データがハードディスクに格納される。 Next, the display positions of the left-eye and right-eye parallax images are appropriately adjusted for each key frame selected by the editor by an external operation, and the position data is stored in the hard disk.
この間、立体映像生成から立体映像信号出力までの処理は実時間で進行し、編集者は映像の立体視効果を確認しながらキーフレームの表示位置を設定できる。以上が、本発明のフレーム視差編集機能付き立体映像信号生成装置の実施形態である。 During this time, the processing from the generation of the stereoscopic video to the output of the stereoscopic video signal proceeds in real time, and the editor can set the display position of the key frame while confirming the stereoscopic effect of the video. The above is the embodiment of the stereoscopic video signal generation apparatus with a frame parallax editing function of the present invention.
図５は、本発明による映像表示位置を動的に制御する機能を実装した立体映像信号生成装置のデジタル処理の流れを示す。ここでは、まず、上と同様に左眼用と右眼用の視差映像のムービー形式をデジタル処理に必要な形式に変換し、それぞれのバッファーに保持する。 FIG. 5 shows a flow of digital processing of the stereoscopic video signal generation apparatus in which the function of dynamically controlling the video display position according to the present invention is implemented. Here, first, as in the above case, the left-eye and right-eye parallax movie formats are converted into formats necessary for digital processing, and stored in the respective buffers.
次に左眼用と右眼用の視差映像の表示位置は前処理で設定されたキーフレームの表示位置を読み込み、それを基にキーフレーム間の表示位置を補間しながら動的にオリジナル映像の表示位置を補正する。 Next, the display positions of the left-eye and right-eye parallax images are read from the keyframe display positions set in the preprocessing, and the original image is dynamically changed while interpolating the display positions between the keyframes based on the read position. Correct the display position.
また、さらにそこでは、左眼用と右眼用の視差映像の表示位置の変化によって生ずる左右２フレーム間の非重層部分が削除され、全体的に小さくなった重層部分を表示スクリーンサイズに対応して拡大し、立体映像生成から立体映像信号出力までのデジタル処理を実時間で進める。以上が、本発明のフレーム視差制御機能付き立体映像信号生成装置の実施形態である。 In addition, the non-overlapping portion between the left and right frames caused by the change in the display position of the left-eye and right-eye parallax images is deleted, and the overlapping portion that has become smaller as a whole corresponds to the display screen size. Digital processing from 3D image generation to 3D image signal output in real time. The above is the embodiment of the stereoscopic video signal generation apparatus with a frame parallax control function of the present invention.
本発明の具体的な実施例としては、ハイビジョン・プロジェクターなど既存の立体表示装置と組み合わせたステレオ・ハイビジョン・シアターなどがあげられる。 Specific examples of the present invention include a stereo high-definition theater combined with an existing stereoscopic display device such as a high-vision projector.
Ｓ 表示スクリーン面
ＦＬ 左眼用視差映像のフレーム
ＦＲ 右眼用視差映像のフレーム
ＰＬ 左眼用視差映像フレーム内の点
ＰＲ 右眼用視差映像フレーム内の点
ＰＲＬ 閲覧者の脳内で融合して生じた点の立体融合虚像
ｄ 左右の映像の表示位置のずれ量
S Display screen plane FL Left-eye parallax video frame FR Right-eye parallax video frame PL Point PR in the left-eye parallax video frame Point PRL in the right-eye parallax video frame Fusion in the viewer's brain Stereo fusion virtual image d of the generated point d Amount of deviation of the display position of the left and right images
Claims (2)
For binocular stereoscopic digital video, the display position of the left-eye parallax video and right-eye parallax video is changed in units of frames based on the position data for each key frame set and stored by the above frame parallax editing function. A stereoscopic video signal generation device having a frame parallax control function for performing stereoscopic display while performing the above-described operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004311713A JP2006128842A (en) | 2004-10-27 | 2004-10-27 | Stereoscopic video signal generator |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004311713A JP2006128842A (en) | 2004-10-27 | 2004-10-27 | Stereoscopic video signal generator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JP2006128842A true JP2006128842A (en) | 2006-05-18 |
Family
ID=36723085
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2004311713A Pending JP2006128842A (en) | 2004-10-27 | 2004-10-27 | Stereoscopic video signal generator |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP2006128842A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101909219A (en) * | 2010-07-09 | 2010-12-08 | 深圳超多维光电子有限公司 | Stereoscopic display method, tracking type stereoscopic display and image processing device |
| JP2011205346A (en) * | 2010-03-25 | 2011-10-13 | Canon Inc | Image processor and method for controlling image processor |
| US8855472B2 (en) | 2011-07-26 | 2014-10-07 | Panasonic Corporation | Video editing apparatus, video editing method, program, and integrated circuit |
| US9392261B2 (en) | 2011-03-23 | 2016-07-12 | Kabushiki Kaisha Toshiba | Image processing apparatus, image processing method, and camera module for frame timing adjustment |
-
2004
- 2004-10-27 JP JP2004311713A patent/JP2006128842A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011205346A (en) * | 2010-03-25 | 2011-10-13 | Canon Inc | Image processor and method for controlling image processor |
| CN101909219A (en) * | 2010-07-09 | 2010-12-08 | 深圳超多维光电子有限公司 | Stereoscopic display method, tracking type stereoscopic display and image processing device |
| CN101909219B (en) * | 2010-07-09 | 2011-10-05 | 深圳超多维光电子有限公司 | Stereoscopic display method, tracking type stereoscopic display |
| US9392261B2 (en) | 2011-03-23 | 2016-07-12 | Kabushiki Kaisha Toshiba | Image processing apparatus, image processing method, and camera module for frame timing adjustment |
| US8855472B2 (en) | 2011-07-26 | 2014-10-07 | Panasonic Corporation | Video editing apparatus, video editing method, program, and integrated circuit |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101310212B1 (en) | Insertion of 3d objects in a stereoscopic image at relative depth | |
| KR101569150B1 (en) | 3 3D video apparatus and method for providing OSD applied to the same | |
| JP4251952B2 (en) | Stereoscopic image display apparatus and stereoscopic image display method | |
| JP5820276B2 (en) | Combining 3D images and graphical data | |
| EP2448276B1 (en) | GUI providing method, and display apparatus and 3D image providing system using the same | |
| US8514275B2 (en) | Three-dimensional (3D) display method and system | |
| US20110018966A1 (en) | Receiving Device, Communication System, Method of Combining Caption With Stereoscopic Image, Program, and Data Structure | |
| US7660472B2 (en) | System and method for managing stereoscopic viewing | |
| JP5573682B2 (en) | 3D image viewing system, display system, optical shutter, and 3D image viewing method | |
| EP2357833A2 (en) | 3D display device and method for correcting image thereof | |
| US20110157303A1 (en) | Method and system for generation of captions over steroscopic 3d images | |
| CA2824829C (en) | Method and apparatus for transmitting/receiving a digital broadcasting signal | |
| JPWO2011080878A1 (en) | Image reproduction device and display device | |
| JP2010283528A (en) | Video processor and method of controlling the same | |
| JP5955851B2 (en) | Transfer of 3D image data | |
| JP2010268037A (en) | Image conversion method and image conversion apparatus | |
| JP5371727B2 (en) | 3D image processing apparatus and control method for 3D image processing apparatus | |
| JP2011211657A (en) | Electronic apparatus and image output method | |
| JP2006128842A (en) | Stereoscopic video signal generator | |
| JP2012138655A (en) | Image processing device and image processing method | |
| JP2013057697A (en) | Stereoscopic image displaying apparatus | |
| JP2014207492A (en) | Stereoscopic image display device | |
| JP5911325B2 (en) | Stereoscopic image processing apparatus and stereoscopic image display apparatus | |
| US20120249872A1 (en) | Video signal processing apparatus and video signal processing method | |
| JP2012142800A (en) | Image processing device, image processing method, and computer program |