DE19961428C2 - Method and device for visualizing a process at a defined point in time - Google Patents

Method and device for visualizing a process at a defined point in time

Info

Publication number
DE19961428C2
DE19961428C2 DE19961428A DE19961428A DE19961428C2 DE 19961428 C2 DE19961428 C2 DE 19961428C2 DE 19961428 A DE19961428 A DE 19961428A DE 19961428 A DE19961428 A DE 19961428A DE 19961428 C2 DE19961428 C2 DE 19961428C2
Authority
DE
Germany
Prior art keywords
film
characterized
method according
images
process
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn - After Issue
Application number
DE19961428A
Other languages
German (de)
Other versions
DE19961428A1 (en
Inventor
Florian Maier
Original Assignee
Florian Maier
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Florian Maier filed Critical Florian Maier
Priority to DE19961428A priority Critical patent/DE19961428C2/en
Publication of DE19961428A1 publication Critical patent/DE19961428A1/en
Application granted granted Critical
Publication of DE19961428C2 publication Critical patent/DE19961428C2/en
Anticipated expiration legal-status Critical
Withdrawn - After Issue legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/243Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2625Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
    • H04N5/2627Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect for providing spin image effect, 3D stop motion effect or temporal freeze effect
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189Recording image signals; Reproducing recorded image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/334Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/337Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using polarisation multiplexing

Abstract

The process is used to visualize complicated short-term processes that are difficult to access with previous methods. With the method, the object to be examined is optically recorded with digital photo cameras from systematically different perspectives, the digitized images are automatically read out, stored and processed accordingly. These images can preferably be combined into a moving viewing process around the apparently frozen short-term process around the apparently frozen short-term process and possibly viewed in three dimensions. The invention therefore makes it possible, with simple and thus inexpensive means, to view the process on the object to be observed in excellent spatial resolution from different perspectives.

Description

The invention relates to a method and a device for visualizing a Process from different arbitrarily neighboring perspectives to a defi time within a moving scene.

This is due to the simultaneous recording of a moving scene with several Cameras reached, the still images are played back one after the other and so enable camera movement at a defined point in time.

State of the art

A method is known which makes it possible to "freeze" a real filmed scene allow; d. H. where the camera seems to focus on the "frozen" scene can move around. This is done as part of a "special effects" in Ki noproductions applied.

To implement such a method, PCT application WO 96/19892 A1 a device for generating a time-independent virtual cameo known within a film scene with which an object, for example multiple, interconnected photo cameras at a defined time is recorded. A conventional film to be exposed is used which runs through all light-tightly connected cameras and via one with Hole masks equipped trigger device is exposed at the same time. This be thinned film is fed into a magazine. The from different perspectives The pictures taken are then taken by suitable measures (e.g. by Digitization of film negatives on CD) to form a final film represents and can in a chronological virtual sequence (within a film) be played.

In another device disclosed there, several digital video Finger cameras arranged in a two-dimensional, bendable retaining ring. The too observing moving scene is from different height and side perspectives ven recorded synchronously and from the multitude of recorded simultaneously Any virtual video film can be put together using a computer be made, in which there is also a temporal "backward running" of an event can be represented.  

problem

A disadvantage of this method and the device is the enormously complex up equipment, and the costly post-processing that the present Process only for complex "special effects" in cinema productions or in that makes advertising available.

When running with photo cameras - apart from the elaborate light dense construction of the connected cameras - the recorded mate rial developed and then scanned to digitally in the PC to be able to be further processed.

When executed with digital video finger cameras, numerous are mutually exclusive Corresponding digital image sequences were recorded, creating an oversize sional amount of digital image information accrues. Furthermore, it can occur men that the process to be recorded precisely to the interested one Time is not recorded due to the reading technology of a CCD chip.

The invention is based, both the method and the task the corresponding device versatile and inexpensive with simpler means implement. The priority should not be on the (including from the film industry) for a long time only the entertainment effect aimed at, son it is supposed to visualize complicated processes in the different areas z. B. in research.

Troubleshooting

As a solution to this, the invention proposes a method and a device the features of claims 1 and 10 respectively.

There are therefore several digital ones (as exemplified in the single figure) Cameras placed around a scene (i.e. a moving object to be viewed), all via a so-called signal switch in a particularly simple manner with one Data processing program (e.g. a PC) are connected. As a signal switch to understand an interface in which all camera signal outputs open and in which any of these inputs can be tapped. The cameras are then triggered at the same time in an event-controlled manner. This can be done, for example, by a signal triggered by a light barrier follow, which is self-controlled by the event to be recorded. This ensures  that the short-term process of interest is actually recorded and the amount of image information is essentially limited to this event is.

The images recorded in this way can be digitally processed in two different ways become. On the one hand, the image processing PC is operated manually, for example by egg NEN push button, over the signal switch step by step with a different came ra connected and controlled in such a way that the order of the Captured images are retained according to the camera positions (e.g. from reached clockwise). On the other hand, the digitized images can be software controls are recorded. This is achieved by digitizing the software t captured image in a file, automatically via the signal switch between the Ka meras and the files of the series assigned to the respective image follow named accordingly. The files then appear as numbered image files available and can be converted into a corresponding video as a film strip file editing program (e.g. Adobe Premiere®) imported and as a so-called avi (Windows®-based film format). For the slowed down Playing the film is an interpolation by PC between the individual shots advantageous. Here images are artificially placed between the original photos expects. A so-called morph program can be used for this (cf. also EP 0 520 179 B1).

A preferred embodiment of the method according to the invention enables also a three-dimensional representation of this so-called camera get ride. By changing the perspective when panning the camera namely according to the invention to obtain a three-dimensional information with different possibilities can be represented. There are particularly suitable for this There are two simple options.

A well-known Nuoptix® 3D Glasses can be used for three-dimensional visualization. Through the camera the ride is based on the Pulfrich effect (see: TV and cinema Technik, 45th year, No. 3/1991, page 145 f) the viewer a three-dimensional colored representation of the standing scene. The disadvantage of this method is that the film (and thus the camera pan) must not be stopped, because otherwise the scene would lose its three-dimensionality.  

Another simple method uses the so-called anaglyph method (see on this: Stereoscopy - Museum for Transport and Technology, Berlin [Gerhard Kemmer, 1989], page 88, ISBN: 3-9801602-1-2) and thus makes the three-dimensional view The scene can also be held while stopped. A copy of the avi film created, one film preferred red and the other film preferred is colored blue (the exact procedure can be found in the relevant literature revoked). These two differently colored films are now in said Video editing program appropriately timed to each other and transparently overlapped in equal proportions. When viewing with a Anaglyph glasses, the one glass corresponding to the coloration red, the other glass is colored blue, the film can now have three-dimensional information on be removed. A disadvantage of this method is the loss of color information. To keep the color information, there are other known ones Possibilities (z. B. the polarization method) with which the invention Use of the image sequence can be obtained, however, with more complex measures.

Achieved advantages

A particular advantage of the invention is that the method is based on due to its simple measures - as well as the corresponding device because of their simple structure - in the most diverse areas, in particular can also be used in research institutions. So compli graced processes, especially those that are too fast for the eye capture the outgoing moment ("freeze") and in a coherent, look at the plastic representation. Wear this procedure and device thus contributing to a far better visualization and helping complicated processes ge easier to grasp or to make visible at all. The purely digital Image acquisition and processing, u. a. over the turnout, noticeably too fast results in (time saving) and is considerably cheaper than known ones Procedures and orders.

Claims (13)

1.Procedure for visualizing a process from different perspectives that are adjacent at a defined point in time within a moving scene with the following measures:
  • a) An object is captured with several digital photo cameras, which are arranged on a continuous curve, from different perspectives at a defined point in time;
  • b) the defined point in time is triggered by events;
  • c) the digitized images are read out from the photo cameras in a data processing program in a predetermined order via a signal switch to which the outputs (interfaces) of each photo camera are connected;
  • d) the digital image signals read out are stored in files of a data memory;
  • e) in an image processing program, these files are called up in an order corresponding to the photo camera setup and, if necessary, intermediate images are calculated;
  • f) the images thus obtained are combined into a film using suitable software, and
  • g) the film is played and possibly stopped at a certain perspective with a still image.
2. The method according to claim 1, characterized in that the event-driven Triggering, for example caused by physical changes, which are caused by the process to be visualized itself.
3. The method according to any one of the preceding claims, characterized in that the photo cameras are arranged on an arc around the object.
4. The method according to any one of the preceding claims, characterized in that the cameras are set up at the same neighboring distance.
5. The method according to any one of claims 1-4, characterized in that the Reading of the digital image signals via the signal switch is controlled manually.
6. The method according to any one of claims 1-4, characterized in that the Reading of the digital image signals via the signal switch from program controlled running.  
7. The method according to any one of the preceding claims, characterized in that the files are numbered according to the camera position.
8. The method according to any one of the preceding claims, characterized in that the film for three-dimensional viewing with a Nuoptix® 3D Principle corresponding glasses is considered.
9. The method according to any one of claims 1-8, characterized in that a second to the first time-delayed film, the one on moving speed speed and eye relief is coordinated, with a film of which left eye and the other film the viewer's right eye over one the known suitable 3D method is assigned.
10. Device for performing the method according to claim 1 with the following features:
  • a) a plurality of digital photo cameras, which are arranged on a steady curve and are focused on the process to be recorded from different perspectives;
  • b) a triggering device for the image recording, which is triggered by the event to be recorded;
  • c) a signal switch to which the outputs (interfaces) of each photo camera are connected on the input side;
  • d) a PC connected to the signal switch on the output side
    with a data processing program that can read the digitized images in a predetermined order via the signal switch from the photo cameras;
    with a data memory in which the read digital image signals can be stored in files;
    with an image processing program in which these files can be called up in an order corresponding to the camera setup and, if necessary, intermediate images can be calculated;
    with suitable software with which the images obtained in this way can be combined to form a film,
  • e) a playback device for the film, possibly with the possibility of still images.
11. The device according to claim 10, characterized in that the photo cameras are arranged on an arc around the object.
12. The apparatus according to claim 11, characterized in that the photo cameras are set up at the same neighboring distance.  
13. The device according to one of claims 10 to 12, characterized by a glasses corresponding to the respective 3D principle through which the film can be viewed in three dimensions.
DE19961428A 1999-12-17 1999-12-17 Method and device for visualizing a process at a defined point in time Withdrawn - After Issue DE19961428C2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE19961428A DE19961428C2 (en) 1999-12-17 1999-12-17 Method and device for visualizing a process at a defined point in time

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE19961428A DE19961428C2 (en) 1999-12-17 1999-12-17 Method and device for visualizing a process at a defined point in time

Publications (2)

Publication Number Publication Date
DE19961428A1 DE19961428A1 (en) 2001-09-20
DE19961428C2 true DE19961428C2 (en) 2002-03-07

Family

ID=7933407

Family Applications (1)

Application Number Title Priority Date Filing Date
DE19961428A Withdrawn - After Issue DE19961428C2 (en) 1999-12-17 1999-12-17 Method and device for visualizing a process at a defined point in time

Country Status (1)

Country Link
DE (1) DE19961428C2 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4062045A (en) * 1975-06-02 1977-12-06 The President Of Hokkaido University Three-dimensional television system
WO1990008343A1 (en) * 1989-01-13 1990-07-26 Sandin Daniel J Computer-generated autostereography method and apparatus
EP0637815A2 (en) * 1993-08-04 1995-02-08 Canon Kabushiki Kaisha Image processing method and image processing apparatus
WO1996019892A1 (en) * 1994-12-21 1996-06-27 Digital Air, Inc. System for producing time-independent virtual camera movement in motion pictures
DE69222695T2 (en) * 1991-06-27 1998-05-07 Eastman Kodak Co Autostereoscopic photography system with electronically interpolated images
DE69410262T2 (en) * 1994-09-07 1998-12-17 Imco Electro Optics Ltd Method and device for high-speed imaging
EP0921376A1 (en) * 1997-12-03 1999-06-09 Mixed Reality Systems Laboratory Inc. Panoramic image acquisition system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4062045A (en) * 1975-06-02 1977-12-06 The President Of Hokkaido University Three-dimensional television system
WO1990008343A1 (en) * 1989-01-13 1990-07-26 Sandin Daniel J Computer-generated autostereography method and apparatus
DE69222695T2 (en) * 1991-06-27 1998-05-07 Eastman Kodak Co Autostereoscopic photography system with electronically interpolated images
EP0637815A2 (en) * 1993-08-04 1995-02-08 Canon Kabushiki Kaisha Image processing method and image processing apparatus
DE69410262T2 (en) * 1994-09-07 1998-12-17 Imco Electro Optics Ltd Method and device for high-speed imaging
WO1996019892A1 (en) * 1994-12-21 1996-06-27 Digital Air, Inc. System for producing time-independent virtual camera movement in motion pictures
EP0921376A1 (en) * 1997-12-03 1999-06-09 Mixed Reality Systems Laboratory Inc. Panoramic image acquisition system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HUANG, H., u.a.: Generation of multiviewpoint video from stereoscopic video. In: IEEE Transac- tion on Consumer Electronics, Vol. 45, No. 1, Febr. 1999, S. 124-134 *
SAND, R.: Dreidimensionales Fernsehen mit "Nuoptix 3D". In: Fernseh- und Kinotechnik, 45. Jg., Nr. 3/1991, S. 145-146 *

Also Published As

Publication number Publication date
DE19961428A1 (en) 2001-09-20

Similar Documents

Publication Publication Date Title
US8760566B2 (en) Video refocusing
US20180218236A1 (en) Artificially rendering images using interpolation of tracked control points
US20190080499A1 (en) Artificially rendering images using viewpoint interpolation and extrapolation
US9094674B2 (en) Generation of three-dimensional movies with improved depth control
US8897596B1 (en) System and method for rapid image sequence depth enhancement with translucent elements
EP2862356B1 (en) Method and apparatus for fusion of images
Adelson et al. Single lens stereo with a plenoptic camera
US8401336B2 (en) System and method for rapid image sequence depth enhancement with augmented computer-generated elements
Tanimoto Free-viewpoint television
EP2705495B1 (en) Method, graphical user interface, and computer program product for processing of a light field image
Muller et al. Reliability-based generation and view synthesis in layered depth video
CN102362495B (en) The long-range of assembled view for multiple cameras with the video conference endpoint of display wall presents device and method of operation
US8878896B2 (en) Apparatus method and system for imaging
DE19714101C2 (en) Method and device for processing image data
US8290358B1 (en) Methods and apparatus for light-field imaging
ES2232715T3 (en) System to produce virtual camera movement independent of time in film films.
JP3231330B2 (en) 3D imaging system
Shum et al. Rendering with concentric mosaics
US5973700A (en) Method and apparatus for optimizing the resolution of images which have an apparent depth
JP4351996B2 (en) Method for generating a stereoscopic image from a monoscope image
US6141034A (en) Immersive imaging method and apparatus
US8749620B1 (en) 3D light field cameras, images and files, and methods of using, operating, processing and viewing same
CA2506608C (en) Critical alignment of parallax images for autostereoscopic display
US6754370B1 (en) Real-time structured light range scanning of moving scenes
Smolic et al. Three-dimensional video postproduction and processing

Legal Events

Date Code Title Description
OP8 Request for examination as to paragraph 44 patent law
D2 Grant after examination
8364 No opposition during term of opposition
R084 Declaration of willingness to licence
R120 Application withdrawn or ip right abandoned
R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: H04N0013020000

Ipc: H04N0013243000