EP2153668A1 - Verfahren und vorrichtung zur herstellung eines zusammengesetzten bildes oder einer sequenz von zusammengesetzten bildern, die eine verbesserte tiefenwahrnehmung in bezug auf mindestens ein subjekt erzeugen - Google Patents

Verfahren und vorrichtung zur herstellung eines zusammengesetzten bildes oder einer sequenz von zusammengesetzten bildern, die eine verbesserte tiefenwahrnehmung in bezug auf mindestens ein subjekt erzeugen

Info

Publication number
EP2153668A1
EP2153668A1 EP08805946A EP08805946A EP2153668A1 EP 2153668 A1 EP2153668 A1 EP 2153668A1 EP 08805946 A EP08805946 A EP 08805946A EP 08805946 A EP08805946 A EP 08805946A EP 2153668 A1 EP2153668 A1 EP 2153668A1
Authority
EP
European Patent Office
Prior art keywords
image
composite
initial
animated sequence
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP08805946A
Other languages
English (en)
French (fr)
Inventor
Olivier Martinet
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
In-Relief Group
Original Assignee
In-Relief Group
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by In-Relief Group filed Critical In-Relief Group
Publication of EP2153668A1 publication Critical patent/EP2153668A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00Details of stereoscopic systems
    • H04N2213/006Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes

Definitions

  • the present invention relates to the technical field of so-called relief images offering an increased perception of perspectives and volumes.
  • the invention relates to a method for producing a composite image inducing an enhanced perception of the relief of at least one subject, the method comprising the following steps:
  • Creating the composite image by merging the first and second secondary and / or initial images so that at least in the area of the subject one of two blocks of the composite image is from the first or secondary image and a block every two comes from the second or secondary image, the tiles coming from the first and second secondary and / or initial images being arranged in a checkered pattern in the composite image,
  • the visualization of the composite image induces in the observer a sensation of relief or a perception of the relief very much greater than that produced by the observation of the first initial image or the second initial image.
  • This accentuated perception of the relief results, according to the plaintiff, from the way the brain reconstructs the relief.
  • the brain simultaneously receives the image perceived by the left eye and the image perceived by the right eye.
  • the offsets of the values of the pavers thus juxtaposed are then perceived as a checkerboard by the observer.
  • an optical mixture is produced and the zones of the image will appear more or less scintillating depending on the differences in contrast between the paving stones next to each other.
  • This flicker will be interpreted by the brain as relief information thus inducing, during the observation of the composite image according to the invention, an increased perception of the relief.
  • the possible recording of the composite image can be achieved in various ways, such as for example by printing the composite image on a support, recording the composite image on a magnetic medium or electronic or the recording of the composite image on a film or film by any appropriate means.
  • the first and second initial images can be obtained in different ways and for example correspond to two images taken simultaneously from two different points, or correspond to two images taken one after the other after a displacement. of the camera or subject with respect to the camera, or the second image may be calculated or constructed from the first image to provide a different viewing angle from that of the first image.
  • the fusion between the first or second initial image and the second initial or secondary image can be carried out for the entire surface of the two initial and / or secondary images or for only part of this surface depending on the effects. sought and / or the technical means implemented.
  • the method for producing a composite image further comprises the following steps:
  • the working window can therefore correspond to all or only a part of the first initial image, just as the first secondary image can, depending on the dimensions of the working window, having a surface equivalent to that of the first or lower initial image.
  • the first and second initial images have identical dimensions and shape, although this is not strictly necessary.
  • the second secondary image has the same dimensions as the first secondary image.
  • the shape of the working window can be varied and, for example, adapted to the shape of the subject or subjects whose relief must be accentuated.
  • the shape of the working window will be chosen to be rectangular.
  • the method for producing the composite image comprises a step of defining the fineness of the paving. This definition of the fineness of the paving makes it possible to emphasize more or less the relief effect obtained by the fusion of the images.
  • the paving may have a structure of pavers of different shapes, insofar as this pavement structure ensures regular tiling of the images.
  • a regular paving will be adopted from a rectangular block and more preferably from a square shape.
  • the definition of the fineness of paving will then consist in determining the dimension of the side of the paving stone adopted.
  • the adopted tiling corresponds to a decomposition of the images in pixels. This characteristic makes it possible in particular to adapt the tiling to the device used to ensure the visualization of the composite image.
  • the method for producing the composite image comprises a step of deforming the second initial image or of the second secondary image so as to make the position coincide, in the tiling, reference points common to the first or secondary image and to the second initial or secondary image.
  • the invention also aims at enabling the production of still or moving images offering an accentuated perception of the relief or reliefs.
  • the invention also relates to a method for producing a composite animated sequence inducing an enhanced perception of the relief of at least one subject comprising at least one succession of composite images each obtained according to the method according to the invention.
  • the initial images may come from different types of sources such as, for example, films, videos or computer-generated images or drawings.
  • the first and second initial images at the origin of each composite image of the composite animated sequence are extracted from the same initial animated sequence comprising a succession initial images of the subject in a context.
  • This form of implementation of the method is more particularly suited to the production of a composite animated sequence from a film or a monoscopic animated sequence.
  • two successive composite images of the composite animated sequence are produced from two initial initial images corresponding to two successive images. of the initial animated sequence and of two second initial images which are each temporally offset from the corresponding first initial image and come after the corresponding first initial image in the initial image sequence of the initial animated sequence.
  • the method comprises a step of defining the time difference between each first initial image and the second initial image that is associated.
  • the first and second initial images at the origin of each composite image of the composite animated sequence are respectively extracted from a first initial animated sequence comprising a succession of initial images of the subject in a context and a second initial animated sequence comprising a succession of initial images of the subject in the same context, the second animated sequence offering an angle of observation of the subject different from the angle d observation of the first initial animated sequence.
  • This second form of the process is more particularly adapted to the treatment of fibers made according to a stereoscopic method.
  • the first and second initial animated sequences are synchronized with each other.
  • the invention also relates to a device for producing at least one composite image and / or at least one composite animated sequence inducing an accentuated perception of the relief of at least one subject, a device comprising storage means and means calculation method characterized in that:
  • the storage means are adapted to ensure at least a temporary recording of initial images, And in that the calculation means are adapted to implement a production method according to the invention and to produce the composite image and / or the composite animated sequence from the initial images recorded on the storage means as well as optionally at least temporarily recording the image and / or the composite animated sequence on the storage means.
  • Such a device may for example be constituted by a workstation or a personal computer performing all or part of the operations or states of the method according to the invention under the control of an operator.
  • Such a device can also be constituted by a system operating automatically and not requiring special supervision.
  • the device calculation means for producing at least one composite image and / or at least one composite animated sequence are adapted to perform the production of the composite image and / or the composite animated sequence in real time.
  • the device is suitable for producing composite images or composite animated sequences from images or initial monoscopic sequences broadcast over the air or wired.
  • the device according to the invention comprises means for receiving the initial images. Such reception means may then comprise a connection interface to a wired network or a radio reception interface.
  • the device is adapted to allow the diffusion of composite images or sequences of composite animated images that it has generated.
  • the device according to the invention comprises means for broadcasting the composite image and / or the composite animated sequence.
  • These broadcasting means may for example comprise a video interface intended to be connected to a screen or a projector.
  • These means of diffusion can also be constituted by a screen as te! or by a unit for broadcasting composite images on a wired or wireless network.
  • the device for producing at least one composite image and / or at least one composite animated sequence comprises means for defining a tiling set implemented for the production of the composite image and / or the composite animated sequence.
  • Such means may for example be constituted by an interface allowing a user to choose the size and / or shape of the paving used. These means of definition then allow the user to determine according to his tastes the result obtained.
  • the device for producing at least one composite image and / or at least one composite animated sequence comprises means for defining a time shift for the production of the composite animated sequence from an initial animated sequence.
  • Fig. 1 is a schematic representation of a device for producing a composite image or a composite animated sequence according to the invention.
  • Fig. 1 is an example of a composite image obtained by the implementation of the method according to the invention.
  • Fig. 3 is a first initial image used for the production of the composite image according to FIG. 2.
  • Fig. 4 is a second initial image used for the production of the composite image according to FIG. 2.
  • Fig. 5 is a juxtaposition of enlargements of a detail, identified by a dashed frame in FIG. 2, the part A corresponding to the first initial image and the part B corresponding to the composite image.
  • Fig. 6 is an enlargement on a larger scale of the composite image showing the paving used.
  • Fig. 7 is a schematic representation of an initial animated sequence used for the generation of a composite animated sequence.
  • Fig. 8 is a schematic representation of a secondary animated sequence generated from the initial animated sequence illustrated in FIG. 7.
  • Fig. 9 is a schematic representation of a composite animated sequence obtained from the initial animated sequence illustrated in FIG. 7.
  • Fig. 10 is a schematic representation of a method according to the invention for generating a composite animated sequence from the initial left and right animated sequences of a stereoscopic initial animated sequence.
  • the aim of the invention is to enable the production of composite images by means of a device as schematically illustrated in FIG. 1 and designated as a whole by reference numeral 1.
  • the device 1 is, for example, constituted by a central unit a personal computer comprising a computing unit 2 connected to storage means such as a random access memory unit 3 and a hard disk drive 3.
  • the calculation unit 2 is furthermore allocated to a broadcasting unit such as A video interface 5 connected to a monitor 6.
  • the device 1 also comprises reception means 7 such as for example a wired network interface.
  • the computing unit is also tuned to an information input interface 8 connected to a keyboard 9 which can be used as a means of defining a tiling or time shift.
  • the device 1, and more particularly the computing unit 2 are adapted to ensure the production of a composite image Ic as illustrated in FIG. 2 from a first initial image II and a second initial image 12, respectively illustrated in FIG. 3 and 4.
  • the initial images II and 12 are, for example, recorded on the storage means 4.
  • the initial images II and 12 correspond to two views at a slightly different angle of the same subject S, here a unicorn sculpture.
  • the method according to the invention proposes to merge the initial images II and 12 in order to obtain the composite image Ic which offers a perception of accentuated relief.
  • two secondary images I'I and I'2 of the same size and smaller than the initial images II and 12 are extracted from the initial images.
  • the secondary images I'I and I'2 each correspond to a window of work, materialized in solid lines in Figs. 3 and 4, placed so that the secondary images include the subject whose perception of the relief must be accentuated.
  • an identical tiling is applied to each of the secondary images I'I and I'2 and in this case a rectangular base tiling made at the pixel scale as shown in FIGS. 5 and 6.
  • the composite image Ic is then obtained by merging the two secondary images I 7 I and I'2 so as to keep only one block out of two of one or the other of the two images, the blocks preserved being arranged in a checkerboard pattern, as is more particularly apparent from FIG. 6.
  • Part A of Fig.5 shows an enlargement of a region of the first initial image II decomposed into a pixel while part B shows the corresponding region of the composite image Ic of which every second pixel is from the first initial image II and more particularly of the first secondary image I'I and every second pixel comes from the second initial image 12 and more particularly from the first secondary image I'2.
  • Fig. 6 shows on a larger scale the checkerboard effect resulting from the merger of secondary images I'I and I'2 according to the invention. The observation of FIG. 6 makes it possible to perceive the flicker of the pixels at the origin of the accentuated perception of the relief of the composite image Ic. It should be noted that the method according to the invention makes it possible to offer an enhanced perception of relief from a single image without using particular viewing or projection devices.
  • the invention also proposes to implement methods of producing a composite image for the production of composite animated sequences offering an enhanced perception of relief.
  • the invention makes it possible to produce this composite animated sequence from an animated sequence of a film or a video made according to traditional methods making it possible to obtain a so-called monoscopic sequence in that it is made from a single lens camera or according to a generation process simulating such a single lens camera.
  • the initial animated sequence Si illustrated schematically in FIG. 7, comprises a succession of initial images T1, T2, T3, Tn of a subject S according to different angles of observation which vary due to either a movement of the camera either of a movement of the subject.
  • each of the secondary images T'1, T'2, T'3, T'n is extracted from the corresponding initial image according to a working window F substantially centered according to the example illustrated on the subject S.
  • each composite image Td, Tc2, Tc3, Tc (n) of the composite animated sequence being obtained by the fusion of a secondary image T'i (n) of the secondary animated sequence with the following secondary image T'i (n + 1) after application of the tiling in accordance with what has been previously described.
  • each composite image Tc (n) of the composite animated sequence Sc satisfies the following relation:
  • Tc (n) [T'i (n) + Ti (n + 1)] / 2.
  • each first secondary image T'i (n) with each second secondary image T'i (n + 1) to constitute each composite image of the animated sequence Tc (n) will be carried out so as to make coincide at least one reference point ⁇ common to the two secondary images.
  • it may be performed a deformation of the second secondary image T'i (n + 1) by applying for example morphing methods.
  • Tc (n) [T'i (n) + Ti (n + d)] / 2.
  • the invention also proposes to make a composite animated sequence Sc using as first image TgI, Tg2, Tg3, ... Tg (Ii) and second image TdI, Td2, Td3 ... Td (n) at the origin of each composite image Tel, Tc2, Tc3 ... Tc (n) of the composite animated sequence, the images of the initial animated sequences left Sg and right Sd of a stereoscopic animated sequence Si.
  • each composite image Tc (n) of the composite animated sequence verifies the relation:
  • Tc (n) [Tg (n) + Td (n)] / 2.
  • each first image TgI, Tg2, Tg3 ... Tg (n) and each second image TdI, Td2, Td3 ... Td (n) at the origin of each composite image Tel, Tc2, Tc3 ... Tc (n) will be carried out after application of a tiling and so as to make coincide the S subjects and at least one reference point of the latter. Furthermore, this merger can be performed after possibly performing an extraction of a secondary image from each first image and each second image at the origin of each composite image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
EP08805946A 2007-06-06 2008-06-06 Verfahren und vorrichtung zur herstellung eines zusammengesetzten bildes oder einer sequenz von zusammengesetzten bildern, die eine verbesserte tiefenwahrnehmung in bezug auf mindestens ein subjekt erzeugen Withdrawn EP2153668A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0755521A FR2917188B1 (fr) 2007-06-06 2007-06-06 Procede et dispositif de production d'une image composite ou d'une sequence d'images composites induisant une perception accentuee du relief d'au moins un sujet.
PCT/FR2008/051010 WO2009001008A1 (fr) 2007-06-06 2008-06-06 Procede et dispositif de production d'une image composite ou d'une sequence d'images composites induisant une perception accentuee du relief d'au moins un sujet

Publications (1)

Publication Number Publication Date
EP2153668A1 true EP2153668A1 (de) 2010-02-17

Family

ID=39027626

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08805946A Withdrawn EP2153668A1 (de) 2007-06-06 2008-06-06 Verfahren und vorrichtung zur herstellung eines zusammengesetzten bildes oder einer sequenz von zusammengesetzten bildern, die eine verbesserte tiefenwahrnehmung in bezug auf mindestens ein subjekt erzeugen

Country Status (4)

Country Link
US (1) US20100239183A1 (de)
EP (1) EP2153668A1 (de)
FR (1) FR2917188B1 (de)
WO (1) WO2009001008A1 (de)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0306448A2 (de) * 1987-09-02 1989-03-08 International Business Machines Corporation Verfahren und Vorrichtung zur Übertragung und zum Empfang von dreidimensionalen Videobildern

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE158129T1 (de) * 1992-03-23 1997-09-15 Canon Kk Bildaufnahmevorrichtung mit mehreren linsen und korrektur von falschregistrierung
US6310650B1 (en) * 1998-09-23 2001-10-30 Honeywell International Inc. Method and apparatus for calibrating a tiled display
US7058239B2 (en) * 2001-10-29 2006-06-06 Eyesee360, Inc. System and method for panoramic imaging
JP2004153691A (ja) * 2002-10-31 2004-05-27 Casio Comput Co Ltd 撮像装置、撮像方法及びプログラム
CA2442603C (en) * 2003-10-01 2016-11-22 Aryan Saed Digital composition of a mosaic image
JP2007258989A (ja) * 2006-03-22 2007-10-04 Eastman Kodak Co デジタルカメラ、構図補正装置、および、構図補正方法
US8072504B2 (en) * 2008-08-27 2011-12-06 Micron Technology, Inc. Method and system for aiding user alignment for capturing partially overlapping digital images
US8179412B2 (en) * 2009-08-19 2012-05-15 Eastman Kodak Company Merging image pixels based on main-scan misalignment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0306448A2 (de) * 1987-09-02 1989-03-08 International Business Machines Corporation Verfahren und Vorrichtung zur Übertragung und zum Empfang von dreidimensionalen Videobildern

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Orchid 3D", 30 September 2011 (2011-09-30), IBC 2011 AMSTERDAM, XP055012726 *
See also references of WO2009001008A1 *

Also Published As

Publication number Publication date
US20100239183A1 (en) 2010-09-23
WO2009001008A1 (fr) 2008-12-31
FR2917188A1 (fr) 2008-12-12
FR2917188B1 (fr) 2009-09-11

Similar Documents

Publication Publication Date Title
US11631227B2 (en) Methods and devices for selecting objects in images
AU2008279375B2 (en) Generation of three-dimensional movies with improved depth control
US20120176481A1 (en) Processing image data from multiple cameras for motion pictures
EP2362668A2 (de) Verfahren und Vorrichtung zur Verarbeitung von stereoskopischen Videobildern
US9325886B2 (en) Specular and diffuse image generator using polarized light field camera and control method thereof
KR20140030138A (ko) 입체 화상 및 비디오를 생성하는 방법, 시스템, 장치 및 관련 프로세스 로직
US20130128008A1 (en) Smart pseudoscopic-to-orthoscopic conversion (spoc) protocol for three-dimensional (3d) display
FR2982448A1 (fr) Procede de traitement d'image stereoscopique comprenant un objet incruste et dispositif correspondant
FR3076931A1 (fr) Procede d’authentification d’une signature tridimensionnelle
FR2887999A1 (fr) Procede et dispositif de visualisation autostereoscopique avec adaptation de la distance de vision optimale
WO2016135451A1 (en) An image processing method and apparatus for determining depth within an image
Birklbauer et al. Light‐Field Retargeting
WO2020161205A1 (fr) Ensemble constitue d'un reseau bidimensionnel de dispositifs micro-optiques et d'un reseau de micro-images, procede pour sa fabrication, et document de securite le comportant
KR101451236B1 (ko) 3차원 영상 변환 방법 및 그 장치
EP2153668A1 (de) Verfahren und vorrichtung zur herstellung eines zusammengesetzten bildes oder einer sequenz von zusammengesetzten bildern, die eine verbesserte tiefenwahrnehmung in bezug auf mindestens ein subjekt erzeugen
Swash et al. Pre-processing of holoscopic 3D image for autostereoscopic 3D displays
WO2017212130A1 (fr) Dispositif individuel d'immersion visuelle pour personne en mouvement
Bouchard et al. Half-occluded regions and detection of pseudoscopy
Zhou et al. Enhanced reconstruction of partially occluded objects with occlusion removal in synthetic aperture integral imaging
Navarro et al. Optical slicing of large scenes by synthetic aperture integral imaging
EP2406962B1 (de) Zum erfassen mehrerer bilder für multiskopische restitution mit gesteuerter deformation ausgelegtes system und verfahren
Burini et al. Blind detection for disparity-coherent stereo video watermarking
Javidi et al. Three-Dimensional Imaging
JP2006129225A (ja) 立体映像表示装置及び立体映像表示方法
US20100164952A1 (en) Stereoscopic image production method and system

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20091203

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20101102

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20120101