WO2013010603A1 - Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras - Google Patents
Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras Download PDFInfo
- Publication number
- WO2013010603A1 WO2013010603A1 PCT/EP2012/002038 EP2012002038W WO2013010603A1 WO 2013010603 A1 WO2013010603 A1 WO 2013010603A1 EP 2012002038 W EP2012002038 W EP 2012002038W WO 2013010603 A1 WO2013010603 A1 WO 2013010603A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- camera
- depth
- cameras
- partial
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/144—Processing image signals for flicker reduction
Definitions
- the invention relates to a method for producing a stereo film, wherein a first image, which is supplied by a first modrigg with at least two cameras, a second image of a secondhotrigg follows, further comprising a disparity table for determining the displacement of a specific pixel in one of a first partial image supplied to a first camera of the first camera rig relative to an identical pixel in a second partial image supplied by a second camera of the first camera rig, in order to obtain information about the depth content of the first image composed of the first partial image and the second partial image ,
- stereo films are known from the prior art. Such films project a special image for each eye of the beholder, so that the viewer is reassembled into a three-dimensional image.
- two cameras in a camera rig are combined with the camera rigs used to shoot the scenes. While a first stage is aligned with two cameras from a first angle on a scene to be filmed on this, a secondstagerigg with two other cameras combined there is directed from a different angle on the scene. If the second camera rig is then "recut" from the first camera rig, then a sequence of pictures supplied by the first camera rig will follow a sequence of frames following the trimming which is supplied by the other camera rig, In the case of three-dimensional films, unwanted effects often occur to the observer due to the cutting.
- a very deep impression is achieved, such that, for example, an object of the scene is perceived far in front of a virtual screen plane by the viewer, whereas when cutting it, the object is perceived by the viewer far behind the screen plane, or at least not at the position previously considered from the other perspective.
- This object is achieved according to the invention in that the depth information of the disparity table of the first image of the first camera rig is used to process the second image of the second camera rig.
- a disparity table is understood as meaning such an information combination which makes it possible to assess the depth impression of the first image.
- the impression of depth is created by means of a depth image analysis, which can also be called transverse disparity or disparity.
- Such disparity is an offset in the position that the same
- the object in the image occupies two different image planes.
- an image is to be understood as meaning the composition of two partial images, wherein each of the two partial images is supplied by one of the two cameras of a specific camera rig.
- the invention implemented in a Stereoscopic Image Processor can analyze a scene and provide metadata regarding the depth and depth information of a next and distant object, but also provide real-time information regarding the overall space.
- the SIP can also perform image processing and manipulation.
- Depth impression in the previously available first image to be adjusted If the second field is shifted horizontally, then you can fall back on a common depth effect generation. If the second partial image, ie a right partial image, is shifted from a left partial image to the right, the depth effect increases, whereas in the opposite direction the depth effect is reduced. This is due to the visual rays, which are almost parallel to each other when viewing a distant object, whereas in a fairly close object, it may also come to a crossing of the visual lines. The disparities are arranged around a zero point, so they can assume both negative and positive values.
- the second partial image of the second camera pose is shifted so far in a shifting step until the same disparity exists between the two partial images of the second image as between the two partial images of the first image.
- the eye of the beholder does not have to change then and negative effects remain almost completely.
- the method can be further improved if, by means of a zoom setting, the second image is enlarged or reduced with a correction step as a function of the disparity table of the first image, until the second image is corrected
- Depth distance between a point located in the foreground and in the background of the second image corresponds to the distance between these two points in the second image.
- Changing the zoom setting changes the perceived depth distance from a first object in the scene to a second object in the scene.
- the disparities also decrease when the zoom setting acts only as a digital zoom and does not mechanically affect the physical lenses of the second camera rig cameras.
- the first and second partial image of the second image is increased or decreased.
- the disparities are also reduced linearly to reduce the size of the image, so that the negative consequences caused by too high disparities when cutting are avoided in the observer. If the correction step is carried out at the same time as the shift step or this, then a positive result can be achieved particularly quickly in the first of the two cases, whereas in the second case a particularly accurate result can be achieved.
- a depth budget is understood to be the area created by the disparities. For example, if the smallest disparity is -50 and the largest disparity is 0, the image has a depth budget of -50 to 0.
- blurring is achieved in one or more areas of the second image
- Gaussian blur algorithm used.
- the Gaussian soft-crystal algorithm uses the surrounding pixels according to a
- Gaussian normal distribution recalculates the pixels to be blurred.
- the invention also relates to a control or regulation of a plurality of 3D cameras, which are suitable for recording a stereo film, wherein the
- Control or regulation is designed so that they can perform the inventive method.
- FIG. 1 shows a flow diagram of a first exemplary embodiment of a method according to the invention:
- a first image is recorded with a first camera rig, which has two cameras.
- a subsequent second step 20 the disparities in the first image are detected.
- a disparity table is created, which can also be referred to as a disparity map.
- step 40 trimming takes place during the production of the film sequence of the stereo film from the first camera rig to the second camera rig.
- the second Kamerigigg includes two cameras.
- a second image is taken with the second camera rig and its two cameras.
- a sub-step 61 which is followed by a subsequent step 62 in the exemplary embodiment illustrated here, the shifting of a partial image of the second image to another partial image of the second image takes place, these two partial images forming the second image in total.
- a correction step is performed, so the zoom setting in the second image is changed.
- the disparity distribution is changed in total in the displacement step 61, whereas in the correction step 62 the present disparities are changed per se.
- a softening step 63 may also be performed.
- the softening step includes identifying regions of the second image that have too much or too little disparity compared to the disparities of the first image. A blurring of these areas is realized, for example, by means of a Gaussian blur algorithm.
- each ofrigg 100 two cameras 1 10 and 120 are included, which provide an image analysis unit 130 image data of a stereoscopic image pair.
- the image analysis unit 130 determines the scene depth in terms of proximity, center, and a more distant area in real time.
- This processed data is forwarded to a changeover switch 140, also referred to as a switcher.
- the switch 140 allows a user to choose between the source data for an output interface 160, with the interposition of an image processor 150.
- the image processor 150 contains static depth budget parameters, in particular background data relating to a maximum permissible change per unit of time.
- the image processor 150 manages dynamic statistics from depth information obtained from the metadata, calculates rates of change and swings, and ensures that these values are within the depth budget to be used.
- the image pair is passed to the output interface 160 unchanged. If this happens frequently in succession, the result is a video sequence.
- an image is altered, eg blurred, blurred, darkened, desaturated / desaturated and / or masked or marked.
- the intervention may also include a black or white screen, that is a shutter of black or white and then to a new picture content.
- the entire image of the image pair can also be blurred. This is particularly advantageous if there is no exact disparity card. The procedure is repeated for each stereoscopic image pair.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Studio Devices (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12720434.5A EP2735163A1 (de) | 2011-07-18 | 2012-05-11 | Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras |
JP2014520542A JP6259758B2 (ja) | 2011-07-18 | 2012-05-11 | ステレオフィルムのシーン間の遷移を滑らかにし、複数の3dカメラを制御または調整する方法 |
US14/493,276 US9602801B2 (en) | 2011-07-18 | 2014-09-22 | Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras |
US15/422,277 US10165249B2 (en) | 2011-07-18 | 2017-02-01 | Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102011107765.4 | 2011-07-18 | ||
DE102011107765A DE102011107765B3 (de) | 2011-07-18 | 2011-07-18 | Verfahren zum Glätten von Übergängen zwischen Szenen eines Stereofilms sowie Steuerung oder Regelung mehrerer 3D-Kameras |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14233729 A-371-Of-International | 2012-05-11 | ||
US14/493,276 Continuation US9602801B2 (en) | 2011-07-18 | 2014-09-22 | Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013010603A1 true WO2013010603A1 (de) | 2013-01-24 |
Family
ID=46062236
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2012/002038 WO2013010603A1 (de) | 2011-07-18 | 2012-05-11 | Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP2735163A1 (ja) |
JP (1) | JP6259758B2 (ja) |
DE (1) | DE102011107765B3 (ja) |
WO (1) | WO2013010603A1 (ja) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009139740A1 (en) * | 2008-05-12 | 2009-11-19 | Thomson Licensing | System and method for measuring potential eyestrain of stereoscopic motion pictures |
WO2012037075A1 (en) * | 2010-09-14 | 2012-03-22 | Thomson Licensing | Method of presenting three-dimensional content with disparity adjustments |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06105340A (ja) * | 1992-09-16 | 1994-04-15 | Oki Electric Ind Co Ltd | 複数視点3次元画像入力装置 |
US6005607A (en) * | 1995-06-29 | 1999-12-21 | Matsushita Electric Industrial Co., Ltd. | Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus |
JP3366894B2 (ja) * | 2000-03-30 | 2003-01-14 | コナミ株式会社 | 3次元画像合成装置及び方法、情報記憶媒体、プログラム配信装置及び方法 |
JP5094219B2 (ja) * | 2006-06-29 | 2012-12-12 | パナソニック株式会社 | 画像処理装置、画像処理方法、プログラム、記録媒体および集積回路 |
JP4695664B2 (ja) * | 2008-03-26 | 2011-06-08 | 富士フイルム株式会社 | 立体動画像処理装置および方法並びにプログラム |
JP5355208B2 (ja) * | 2009-05-01 | 2013-11-27 | 富士フイルム株式会社 | 3次元表示装置及びデジタルズーム補正方法 |
JP2010226391A (ja) * | 2009-03-23 | 2010-10-07 | Nikon Corp | 画像処理装置、プログラムおよび画像処理方法 |
JP5444955B2 (ja) * | 2009-08-31 | 2014-03-19 | ソニー株式会社 | 立体画像表示システム、視差変換装置、視差変換方法およびプログラム |
US8711204B2 (en) * | 2009-11-11 | 2014-04-29 | Disney Enterprises, Inc. | Stereoscopic editing for video production, post-production and display adaptation |
-
2011
- 2011-07-18 DE DE102011107765A patent/DE102011107765B3/de not_active Expired - Fee Related
-
2012
- 2012-05-11 WO PCT/EP2012/002038 patent/WO2013010603A1/de active Application Filing
- 2012-05-11 EP EP12720434.5A patent/EP2735163A1/de not_active Withdrawn
- 2012-05-11 JP JP2014520542A patent/JP6259758B2/ja not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009139740A1 (en) * | 2008-05-12 | 2009-11-19 | Thomson Licensing | System and method for measuring potential eyestrain of stereoscopic motion pictures |
WO2012037075A1 (en) * | 2010-09-14 | 2012-03-22 | Thomson Licensing | Method of presenting three-dimensional content with disparity adjustments |
Non-Patent Citations (3)
Title |
---|
JÄGER T ET AL: "Blickrichtungsabhängige Schärfentiefereduzierung für stereoskopische Displays", FKT FERNSEH UND KINOTECHNIK, FACHVERLAG SCHIELE & SCHON GMBH., BERLIN, DE, vol. 63, no. 12, 1 December 2009 (2009-12-01), pages 713 - 717, XP001555507, ISSN: 1430-9947 * |
MARK HORTON: "Stereoscopic3D Post using 3ality Digital 3flex SIP2100", 1 November 2008 (2008-11-01), pages 1 - 14, XP002677614, Retrieved from the Internet <URL:http://www.quantel.com/repository/files/whitepapers_sip2100november08.pdf> [retrieved on 20120606] * |
SANJEEV KOPPAL ET AL: "A Viewer-Centric Editor for 3D Movies", IEEE COMPUTER GRAPHICS AND APPLICATIONS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 31, no. 1, 1 January 2011 (2011-01-01), pages 20 - 35, XP011340492, ISSN: 0272-1716, DOI: 10.1109/MCG.2010.37 * |
Also Published As
Publication number | Publication date |
---|---|
EP2735163A1 (de) | 2014-05-28 |
JP6259758B2 (ja) | 2018-01-10 |
JP2014525186A (ja) | 2014-09-25 |
DE102011107765B3 (de) | 2012-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102006055641B4 (de) | Anordnung und Verfahren zur Aufnahme und Wiedergabe von Bildern einer Szene und/oder eines Objektes | |
DE602004008794T2 (de) | Bildwiedergabe mit interaktiver bewegungsparallaxe | |
DE69534763T2 (de) | Vorrichtung zur Darstellung stereoskopischer Bilder und Bildaufnahmevorrichtung dafür | |
EP2174188B1 (de) | Vorrichtung zur automatischen Positionierung von gekoppelten Kameras zur plastischen Bilddarstellung | |
AT394459B (de) | Verfahren zum gewinnen von bildern zur verwendung beim darstellen eines dreidimensionalen scheinbildes und bildaufzeichnungstraeger, auf dem erste und zweite gruppen von serien derartiger bilder gespeichert sind | |
EP3427474B1 (de) | Bildverarbeitungsverfahren, bildverarbeitungsmittel und bildverarbeitungsvorrichtung zur erzeugung von abbildungen eines teils eines dreidimensionalen raums | |
DE19640936A1 (de) | Positionsadaptiver Autostereoskoper Monitor (PAM) | |
DE102007021518B4 (de) | Verfahren zum Verarbeiten eines Videodatensatzes | |
DE102018118187A1 (de) | Verfahren und Datenverarbeitungssystem zur Synthese von Bildern | |
EP2229784A1 (de) | Verfahren und vorrichtung zur echtzeit-multiview-erzeugung | |
DE102011008886A1 (de) | Verfahren und Vorrichtung zur Stereobasis-Erweiterung von stereoskopischen Bildern und Bildfolgen | |
DE102014006717A1 (de) | Verfahren zur Erzeugung einer dreidimensionalen Information eines Objektes mit einem Digitalmikroskop und Datenverarbeitungsprogramm zur Abarbeitung des Verfahrens | |
DE4123895A1 (de) | Verfahren zur autostereokopischen bild-, film- und fernsehwiedergabe | |
DE102010024042B4 (de) | Verfahren und Vorrichtung zur Aufnahme von dreidimensionalem Bildmaterial für unterschiedliche Darstellungsgrößen unter Ausnutzung des jeweils vollen Tiefenbudgets | |
DE69331218T2 (de) | Verfahren und vorrichtung zum kopieren eines 3-d bildes | |
DE102011107765B3 (de) | Verfahren zum Glätten von Übergängen zwischen Szenen eines Stereofilms sowie Steuerung oder Regelung mehrerer 3D-Kameras | |
AT521845A1 (de) | Verfahren zur Fokuseinstellung einer Filmkamera | |
WO2011032642A1 (de) | Verfahren und vorrichtung zum erzeugen von teilansichten und/oder einer raumbildvorlage aus einer 2d-ansicht für eine stereoskopische wiedergabe | |
DE102011016171B4 (de) | Verfahren zum Ausrichten einer 3D-Kamera und Verfahren zum Steuern einer 3D-Kamera während des Filmens | |
DE112012002679T5 (de) | Vorrichtung und Verfahren zum Codieren/Decodieren von Mehrfachansicht-Bildern | |
DE102011109301B4 (de) | Verfahren zum Korrigieren der Zoom-Einstellung und/oder des vertikalen Versatzes von Teilbildern eines Stereofilms sowie Steuerung oder Regelung eines Kamerarigs mit zwei Kameras | |
DE4100992C2 (ja) | ||
WO2020201571A1 (de) | Verfahren zur immersiven anzeige von stereokopischen bildern und bildfolgen | |
DE102010009737A1 (de) | Verfahren und Anordnung zur Wiedergabe von 3D-Bildinhalten | |
WO2011029440A1 (de) | Bildaufnahme und visualisierung mit räumlichem bildeindruck |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12720434 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2014520542 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012720434 Country of ref document: EP |