WO2013010603A1 - Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras - Google Patents

Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras Download PDF

Info

Publication number
WO2013010603A1
WO2013010603A1 PCT/EP2012/002038 EP2012002038W WO2013010603A1 WO 2013010603 A1 WO2013010603 A1 WO 2013010603A1 EP 2012002038 W EP2012002038 W EP 2012002038W WO 2013010603 A1 WO2013010603 A1 WO 2013010603A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
camera
depth
cameras
partial
Prior art date
Application number
PCT/EP2012/002038
Other languages
German (de)
English (en)
French (fr)
Inventor
Martin Borchert
Howard Postley
Original Assignee
3Ality Digital Systems, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3Ality Digital Systems, Llc filed Critical 3Ality Digital Systems, Llc
Priority to EP12720434.5A priority Critical patent/EP2735163A1/de
Priority to JP2014520542A priority patent/JP6259758B2/ja
Publication of WO2013010603A1 publication Critical patent/WO2013010603A1/de
Priority to US14/493,276 priority patent/US9602801B2/en
Priority to US15/422,277 priority patent/US10165249B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/128Adjusting depth or disparity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/144Processing image signals for flicker reduction

Definitions

  • the invention relates to a method for producing a stereo film, wherein a first image, which is supplied by a first modrigg with at least two cameras, a second image of a secondhotrigg follows, further comprising a disparity table for determining the displacement of a specific pixel in one of a first partial image supplied to a first camera of the first camera rig relative to an identical pixel in a second partial image supplied by a second camera of the first camera rig, in order to obtain information about the depth content of the first image composed of the first partial image and the second partial image ,
  • stereo films are known from the prior art. Such films project a special image for each eye of the beholder, so that the viewer is reassembled into a three-dimensional image.
  • two cameras in a camera rig are combined with the camera rigs used to shoot the scenes. While a first stage is aligned with two cameras from a first angle on a scene to be filmed on this, a secondstagerigg with two other cameras combined there is directed from a different angle on the scene. If the second camera rig is then "recut" from the first camera rig, then a sequence of pictures supplied by the first camera rig will follow a sequence of frames following the trimming which is supplied by the other camera rig, In the case of three-dimensional films, unwanted effects often occur to the observer due to the cutting.
  • a very deep impression is achieved, such that, for example, an object of the scene is perceived far in front of a virtual screen plane by the viewer, whereas when cutting it, the object is perceived by the viewer far behind the screen plane, or at least not at the position previously considered from the other perspective.
  • This object is achieved according to the invention in that the depth information of the disparity table of the first image of the first camera rig is used to process the second image of the second camera rig.
  • a disparity table is understood as meaning such an information combination which makes it possible to assess the depth impression of the first image.
  • the impression of depth is created by means of a depth image analysis, which can also be called transverse disparity or disparity.
  • Such disparity is an offset in the position that the same
  • the object in the image occupies two different image planes.
  • an image is to be understood as meaning the composition of two partial images, wherein each of the two partial images is supplied by one of the two cameras of a specific camera rig.
  • the invention implemented in a Stereoscopic Image Processor can analyze a scene and provide metadata regarding the depth and depth information of a next and distant object, but also provide real-time information regarding the overall space.
  • the SIP can also perform image processing and manipulation.
  • Depth impression in the previously available first image to be adjusted If the second field is shifted horizontally, then you can fall back on a common depth effect generation. If the second partial image, ie a right partial image, is shifted from a left partial image to the right, the depth effect increases, whereas in the opposite direction the depth effect is reduced. This is due to the visual rays, which are almost parallel to each other when viewing a distant object, whereas in a fairly close object, it may also come to a crossing of the visual lines. The disparities are arranged around a zero point, so they can assume both negative and positive values.
  • the second partial image of the second camera pose is shifted so far in a shifting step until the same disparity exists between the two partial images of the second image as between the two partial images of the first image.
  • the eye of the beholder does not have to change then and negative effects remain almost completely.
  • the method can be further improved if, by means of a zoom setting, the second image is enlarged or reduced with a correction step as a function of the disparity table of the first image, until the second image is corrected
  • Depth distance between a point located in the foreground and in the background of the second image corresponds to the distance between these two points in the second image.
  • Changing the zoom setting changes the perceived depth distance from a first object in the scene to a second object in the scene.
  • the disparities also decrease when the zoom setting acts only as a digital zoom and does not mechanically affect the physical lenses of the second camera rig cameras.
  • the first and second partial image of the second image is increased or decreased.
  • the disparities are also reduced linearly to reduce the size of the image, so that the negative consequences caused by too high disparities when cutting are avoided in the observer. If the correction step is carried out at the same time as the shift step or this, then a positive result can be achieved particularly quickly in the first of the two cases, whereas in the second case a particularly accurate result can be achieved.
  • a depth budget is understood to be the area created by the disparities. For example, if the smallest disparity is -50 and the largest disparity is 0, the image has a depth budget of -50 to 0.
  • blurring is achieved in one or more areas of the second image
  • Gaussian blur algorithm used.
  • the Gaussian soft-crystal algorithm uses the surrounding pixels according to a
  • Gaussian normal distribution recalculates the pixels to be blurred.
  • the invention also relates to a control or regulation of a plurality of 3D cameras, which are suitable for recording a stereo film, wherein the
  • Control or regulation is designed so that they can perform the inventive method.
  • FIG. 1 shows a flow diagram of a first exemplary embodiment of a method according to the invention:
  • a first image is recorded with a first camera rig, which has two cameras.
  • a subsequent second step 20 the disparities in the first image are detected.
  • a disparity table is created, which can also be referred to as a disparity map.
  • step 40 trimming takes place during the production of the film sequence of the stereo film from the first camera rig to the second camera rig.
  • the second Kamerigigg includes two cameras.
  • a second image is taken with the second camera rig and its two cameras.
  • a sub-step 61 which is followed by a subsequent step 62 in the exemplary embodiment illustrated here, the shifting of a partial image of the second image to another partial image of the second image takes place, these two partial images forming the second image in total.
  • a correction step is performed, so the zoom setting in the second image is changed.
  • the disparity distribution is changed in total in the displacement step 61, whereas in the correction step 62 the present disparities are changed per se.
  • a softening step 63 may also be performed.
  • the softening step includes identifying regions of the second image that have too much or too little disparity compared to the disparities of the first image. A blurring of these areas is realized, for example, by means of a Gaussian blur algorithm.
  • each ofrigg 100 two cameras 1 10 and 120 are included, which provide an image analysis unit 130 image data of a stereoscopic image pair.
  • the image analysis unit 130 determines the scene depth in terms of proximity, center, and a more distant area in real time.
  • This processed data is forwarded to a changeover switch 140, also referred to as a switcher.
  • the switch 140 allows a user to choose between the source data for an output interface 160, with the interposition of an image processor 150.
  • the image processor 150 contains static depth budget parameters, in particular background data relating to a maximum permissible change per unit of time.
  • the image processor 150 manages dynamic statistics from depth information obtained from the metadata, calculates rates of change and swings, and ensures that these values are within the depth budget to be used.
  • the image pair is passed to the output interface 160 unchanged. If this happens frequently in succession, the result is a video sequence.
  • an image is altered, eg blurred, blurred, darkened, desaturated / desaturated and / or masked or marked.
  • the intervention may also include a black or white screen, that is a shutter of black or white and then to a new picture content.
  • the entire image of the image pair can also be blurred. This is particularly advantageous if there is no exact disparity card. The procedure is repeated for each stereoscopic image pair.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
PCT/EP2012/002038 2011-07-18 2012-05-11 Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras WO2013010603A1 (de)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP12720434.5A EP2735163A1 (de) 2011-07-18 2012-05-11 Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras
JP2014520542A JP6259758B2 (ja) 2011-07-18 2012-05-11 ステレオフィルムのシーン間の遷移を滑らかにし、複数の3dカメラを制御または調整する方法
US14/493,276 US9602801B2 (en) 2011-07-18 2014-09-22 Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras
US15/422,277 US10165249B2 (en) 2011-07-18 2017-02-01 Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102011107765.4 2011-07-18
DE102011107765A DE102011107765B3 (de) 2011-07-18 2011-07-18 Verfahren zum Glätten von Übergängen zwischen Szenen eines Stereofilms sowie Steuerung oder Regelung mehrerer 3D-Kameras

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14233729 A-371-Of-International 2012-05-11
US14/493,276 Continuation US9602801B2 (en) 2011-07-18 2014-09-22 Method for smoothing transitions between scenes of a stereo film and controlling or regulating a plurality of 3D cameras

Publications (1)

Publication Number Publication Date
WO2013010603A1 true WO2013010603A1 (de) 2013-01-24

Family

ID=46062236

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/002038 WO2013010603A1 (de) 2011-07-18 2012-05-11 Verfahren zum glätten von übergängen zwischen szenen eines stereofilms sowie steuerung oder regelung mehrerer 3d-kameras

Country Status (4)

Country Link
EP (1) EP2735163A1 (ja)
JP (1) JP6259758B2 (ja)
DE (1) DE102011107765B3 (ja)
WO (1) WO2013010603A1 (ja)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009139740A1 (en) * 2008-05-12 2009-11-19 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
WO2012037075A1 (en) * 2010-09-14 2012-03-22 Thomson Licensing Method of presenting three-dimensional content with disparity adjustments

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06105340A (ja) * 1992-09-16 1994-04-15 Oki Electric Ind Co Ltd 複数視点3次元画像入力装置
US6005607A (en) * 1995-06-29 1999-12-21 Matsushita Electric Industrial Co., Ltd. Stereoscopic computer graphics image generating apparatus and stereoscopic TV apparatus
JP3366894B2 (ja) * 2000-03-30 2003-01-14 コナミ株式会社 3次元画像合成装置及び方法、情報記憶媒体、プログラム配信装置及び方法
JP5094219B2 (ja) * 2006-06-29 2012-12-12 パナソニック株式会社 画像処理装置、画像処理方法、プログラム、記録媒体および集積回路
JP4695664B2 (ja) * 2008-03-26 2011-06-08 富士フイルム株式会社 立体動画像処理装置および方法並びにプログラム
JP5355208B2 (ja) * 2009-05-01 2013-11-27 富士フイルム株式会社 3次元表示装置及びデジタルズーム補正方法
JP2010226391A (ja) * 2009-03-23 2010-10-07 Nikon Corp 画像処理装置、プログラムおよび画像処理方法
JP5444955B2 (ja) * 2009-08-31 2014-03-19 ソニー株式会社 立体画像表示システム、視差変換装置、視差変換方法およびプログラム
US8711204B2 (en) * 2009-11-11 2014-04-29 Disney Enterprises, Inc. Stereoscopic editing for video production, post-production and display adaptation

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009139740A1 (en) * 2008-05-12 2009-11-19 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
WO2012037075A1 (en) * 2010-09-14 2012-03-22 Thomson Licensing Method of presenting three-dimensional content with disparity adjustments

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
JÄGER T ET AL: "Blickrichtungsabhängige Schärfentiefereduzierung für stereoskopische Displays", FKT FERNSEH UND KINOTECHNIK, FACHVERLAG SCHIELE & SCHON GMBH., BERLIN, DE, vol. 63, no. 12, 1 December 2009 (2009-12-01), pages 713 - 717, XP001555507, ISSN: 1430-9947 *
MARK HORTON: "Stereoscopic3D Post using 3ality Digital 3flex SIP2100", 1 November 2008 (2008-11-01), pages 1 - 14, XP002677614, Retrieved from the Internet <URL:http://www.quantel.com/repository/files/whitepapers_sip2100november08.pdf> [retrieved on 20120606] *
SANJEEV KOPPAL ET AL: "A Viewer-Centric Editor for 3D Movies", IEEE COMPUTER GRAPHICS AND APPLICATIONS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 31, no. 1, 1 January 2011 (2011-01-01), pages 20 - 35, XP011340492, ISSN: 0272-1716, DOI: 10.1109/MCG.2010.37 *

Also Published As

Publication number Publication date
EP2735163A1 (de) 2014-05-28
JP6259758B2 (ja) 2018-01-10
JP2014525186A (ja) 2014-09-25
DE102011107765B3 (de) 2012-12-06

Similar Documents

Publication Publication Date Title
DE102006055641B4 (de) Anordnung und Verfahren zur Aufnahme und Wiedergabe von Bildern einer Szene und/oder eines Objektes
DE602004008794T2 (de) Bildwiedergabe mit interaktiver bewegungsparallaxe
DE69534763T2 (de) Vorrichtung zur Darstellung stereoskopischer Bilder und Bildaufnahmevorrichtung dafür
EP2174188B1 (de) Vorrichtung zur automatischen Positionierung von gekoppelten Kameras zur plastischen Bilddarstellung
AT394459B (de) Verfahren zum gewinnen von bildern zur verwendung beim darstellen eines dreidimensionalen scheinbildes und bildaufzeichnungstraeger, auf dem erste und zweite gruppen von serien derartiger bilder gespeichert sind
EP3427474B1 (de) Bildverarbeitungsverfahren, bildverarbeitungsmittel und bildverarbeitungsvorrichtung zur erzeugung von abbildungen eines teils eines dreidimensionalen raums
DE19640936A1 (de) Positionsadaptiver Autostereoskoper Monitor (PAM)
DE102007021518B4 (de) Verfahren zum Verarbeiten eines Videodatensatzes
DE102018118187A1 (de) Verfahren und Datenverarbeitungssystem zur Synthese von Bildern
EP2229784A1 (de) Verfahren und vorrichtung zur echtzeit-multiview-erzeugung
DE102011008886A1 (de) Verfahren und Vorrichtung zur Stereobasis-Erweiterung von stereoskopischen Bildern und Bildfolgen
DE102014006717A1 (de) Verfahren zur Erzeugung einer dreidimensionalen Information eines Objektes mit einem Digitalmikroskop und Datenverarbeitungsprogramm zur Abarbeitung des Verfahrens
DE4123895A1 (de) Verfahren zur autostereokopischen bild-, film- und fernsehwiedergabe
DE102010024042B4 (de) Verfahren und Vorrichtung zur Aufnahme von dreidimensionalem Bildmaterial für unterschiedliche Darstellungsgrößen unter Ausnutzung des jeweils vollen Tiefenbudgets
DE69331218T2 (de) Verfahren und vorrichtung zum kopieren eines 3-d bildes
DE102011107765B3 (de) Verfahren zum Glätten von Übergängen zwischen Szenen eines Stereofilms sowie Steuerung oder Regelung mehrerer 3D-Kameras
AT521845A1 (de) Verfahren zur Fokuseinstellung einer Filmkamera
WO2011032642A1 (de) Verfahren und vorrichtung zum erzeugen von teilansichten und/oder einer raumbildvorlage aus einer 2d-ansicht für eine stereoskopische wiedergabe
DE102011016171B4 (de) Verfahren zum Ausrichten einer 3D-Kamera und Verfahren zum Steuern einer 3D-Kamera während des Filmens
DE112012002679T5 (de) Vorrichtung und Verfahren zum Codieren/Decodieren von Mehrfachansicht-Bildern
DE102011109301B4 (de) Verfahren zum Korrigieren der Zoom-Einstellung und/oder des vertikalen Versatzes von Teilbildern eines Stereofilms sowie Steuerung oder Regelung eines Kamerarigs mit zwei Kameras
DE4100992C2 (ja)
WO2020201571A1 (de) Verfahren zur immersiven anzeige von stereokopischen bildern und bildfolgen
DE102010009737A1 (de) Verfahren und Anordnung zur Wiedergabe von 3D-Bildinhalten
WO2011029440A1 (de) Bildaufnahme und visualisierung mit räumlichem bildeindruck

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12720434

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014520542

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2012720434

Country of ref document: EP