WO2018077525A1 - Détermination d'au moins un ensemble de données intermédiaires approximatif pour une application en temps réel - Google Patents

Détermination d'au moins un ensemble de données intermédiaires approximatif pour une application en temps réel Download PDF

Info

Publication number
WO2018077525A1
WO2018077525A1 PCT/EP2017/072794 EP2017072794W WO2018077525A1 WO 2018077525 A1 WO2018077525 A1 WO 2018077525A1 EP 2017072794 W EP2017072794 W EP 2017072794W WO 2018077525 A1 WO2018077525 A1 WO 2018077525A1
Authority
WO
WIPO (PCT)
Prior art keywords
record
previous
data
determining
real
Prior art date
Application number
PCT/EP2017/072794
Other languages
German (de)
English (en)
Inventor
Martin Bischoff
Philipp Emanuel Stelzig
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Publication of WO2018077525A1 publication Critical patent/WO2018077525A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Definitions

  • the present invention relates to a method for determining at least one approximated intermediate data set for a real-time application. Furthermore, the invention is directed to a corresponding computer program product.
  • Virtual Reality or Virtual Reality (VR)
  • VR Virtual Reality
  • Virtual reality be ⁇ records the representation of a virtual world, which is compu ⁇ tergeneriert.
  • the virtual world may be based on the real world.
  • VR glasses Furthermore, virtual reality is closely related to VR glasses.
  • the user is advantageously no longer dependent on a monitor, but has a 3D image available and can turn the head comfortably in all directions to follow the virtual world.
  • FIG. 4 illustrates an exemplary method for processing a sequence of computational results, which arise iteratively / successively, into an animation with individual images and their disadvantageous jumps according to the prior art. The individual method steps are shown sequentially from top to bottom and are shown in FIG Explained in detail below:
  • the computational results of the iterations i-2, i + 1 are entered, which are further processed into individual images in the last row.
  • the Iteratio ⁇ nen i-2, ..., i + 1 are to be understood as a computational steps.
  • the duration of an iteration may vary and may take several seconds, for example.
  • An example of an iterative method is a shape optimization process in which, based on predefined forces, an optimized structure is calculated which withstands the forces and additionally has the lowest possible weight.
  • the calculation results of individual iterations i-2, i + 1 are illustrated graphically, namely as a rectangle, a circle and a triangle. The calculation results can be understood as data to be illustrated in the animation.
  • the further processed results are graphically illustrated.
  • the individual calculation result ⁇ se to a time-continuous sequence of Rechenergeb- nissen further processed.
  • the individual optimization ⁇ (mesh) can be further processed structures such that a continuously running deformation process of a (mesh) structure to the next takes place.
  • the previous calculation result 10 is simply used as intermediate result 20 between two successive calculation results, namely the preceding 10 and subsequent calculation result 30.
  • the product resulting from the re ⁇ chen restroom still image is presented to the user in the animation in the last row.
  • the present invention therefore has for its object to provide a method for determining at least one approximated intermediate data record for a real-time application, which enables a continuous animation of the resulting individual images.
  • a procedural for determining at least an approximate motes for a real-time application solved comprising: a. Determining at least one previous record, b. Determine at least an approximate insectsat ⁇ zes between the at least one previous data record and at least one subsequent data record, wherein c. the determination is based on at least two data records, wherein the at least two data records are the at least two preceding data records or the one record of the at least two records is the at least one previous record and the other record of the at least two records is at least one further approximate intermediate record between at least two previous records.
  • the method according to the invention determines an approximated intermediate data record or multiple intermediate data records.
  • the data records have a specific time sequence, since the data records originate from a parallel computing process, which yields successive intermediate results.
  • the intermediate data record corresponds to the data record between a preceding data record and a subsequent data record.
  • the data sets each represent a mesh structure.
  • the intermediate data sets are approximated in contrast to the prior art. As a result, the previous records are not used as intermediate records.
  • the intermediate data set is approximated by its determination being based on at least two data sets.
  • the Bestim ⁇ mung may be based on two or more previous data sets. Therefore, a calculation result in the animation is displayed delayed exactly one iteration.
  • the determination can be made on the directly preceding and thus temporally last or closest data record and based on another intermediate data record.
  • the further intermediate data record is also approximated.
  • the first approximation alternative can be used. Its destination may also be based on two or more previous records. Therefore, a calculation result is represented exactly half Ite ⁇ ration delayed.
  • This second josrungsalterna ⁇ tive allows an even earlier and more real-time Einbin ⁇ dung of the calculation results.
  • the inventive method a steady Abfol ⁇ ge of the calculation results is made possible without any jumps.
  • the sequence of calculation results is also continuous without pauses and still images. The same applies to the calculation results from the resul ⁇ animal end frames.
  • the user of a 3D glasses gets a continuous and continuous animation of the individual images ⁇ shown and runs no risk of "Virtual
  • the at least one previous data record is a known data record.
  • the at least one subsequent data record is an unknown data record.
  • the one or more vorangegange ⁇ nen records is already known and established.
  • the other subsequent data sets are future-oriented and uncertain, and therefore only previous data sets can be included in the determination of the one or more approximated intermediate data sets.
  • This known information advantageously allows the approximation.
  • the approximation can also be understood as an estimate.
  • the at least one approximated intermediate data record is an interpolated data record which is determined by interpolation of the at least two preceding data sets.
  • the at least one intermediate data record is an extrapolated data record which is determined by extrapolation of the at least one preceding data record and the at least one further approximated intermediate data record. Accordingly, for the determination of one or more approximate intermediate data sets, the above alternatively ⁇ ven approximations can be used, which both require at least two records for the approximation.
  • the first alternative is interpolation and the second alternative is extrapolation.
  • the interpolation allows a continuous presentation of the intermediate results.
  • the extrapolation made ⁇ light any prediction or estimate of the next Rechener- gebnisses.
  • the method further comprises displaying the at least one preceding data record, the at least one approximated intermediate data record and / or the at least one subsequent data record as individual images in an animation in real time.
  • the one or more approximated intermediate data sets are determined for real-time application.
  • a real-time application is a 3D animation or illustration.
  • the records are further processed into corresponding frames wei ⁇ and presented to the user of a VR glasses in real time. This animation is advantageously up-to-date, continuous and continuous.
  • the determination furthermore takes into account feedback with at least one input data record of a user.
  • the user can For example, VR glasses interact with the VR glasses and directly affect the above determination of the one or more approximate intermediate data sets in real time.
  • VR glasses interact with the VR glasses and directly affect the above determination of the one or more approximate intermediate data sets in real time.
  • the input is taken into account in the determination and the one or more approximated intermediate data sets are changed accordingly. This advantageously allows an interactive method.
  • the invention further relates to a computer program product having a computer program comprising means for performing the inventive method when the Computerpro ⁇ program is brought to a program-controlled device for execution tion.
  • a computer program product such as a computer program means may, for example, be used as a storage medium, e.g.
  • Memory card USB stick, CD-ROM, DVD, or even in the form of a downloadable file provided by a server in a network or delivered.
  • This can be done, for example, in a wireless communication network by the transmission of a corresponding file with the Computerprogrammpro ⁇ domestic product, or the computer program means.
  • a program-controlled device is in particular a Steuereinrich ⁇ tion, such as an industrial control PC or ei ⁇ ne programmable logic controller or a programmable logic controller, short PLC, or a microprocessor for a smart card or the like in question.
  • FIG. 1 shows a flowchart of the method for determining at least one approximated intermediate data record for a real-time application according to an embodiment of the invention.
  • FIG. 2 shows a flow diagram of the method for determining at least one approximated intermediate data set for a real-time application according to a further embodiment of the invention.
  • Fig. 3 shows the flowchart of the method according to a
  • Embodiment of the invention with user feedback Embodiment of the invention with user feedback.
  • Fig. 4 shows a method for processing a sequence
  • FIG. 1 and FIG. 2 illustrate flowcharts of the method in detail.
  • the method determines at least one approximate intermediate data set 20 for a real-time application.
  • the intermediate data set 20 is between a preceding one
  • FIG. 2 shows an exemplary extrapolation according to a further embodiment.
  • counters (i *) are also used, (i *) refers to the values illustrated in the frame that was active at the end of iteration (i).
  • (i *) refers to the values illustrated in the frame that was active at the end of iteration (i).
  • an interpolation of the values (i * -1) and the calculation result of iteration (i-1) is illustrated.
  • FIG. 3 shows the above flow diagram according to FIG. 1 or FIG. 2, which is supplemented by user feedback.
  • the user feedback is indicated by arrows.
  • the user or user 50 is called the user of a VR glasses and can submit a feedback with one or more input data sets 40 to the above method.
  • An exemplary input data set 40 are force vectors, based on which the rigidity of a component must be optimized. These input data records 40 of the user 50 are defined Kgs ⁇ NEN during an iteration i of the iteration i + 1 respectively input through a button.
  • the user 50 can recognize current changes and adjust the input data sets 40 for the parallel process.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un procédé de détermination d'au moins un ensemble de données intermédiaires approximatif (20) pour une application en temps réel, comprenant : la détermination d'au moins un ensemble de données antérieur (10); la détermination d'au moins un ensemble de données intermédiaires approximatif (20) entre l'au moins un ensemble de données antérieur (10) et au moins un ensemble de données postérieur (30), la détermination étant basée sur au moins deux ensembles de données, les au moins deux ensembles de données étant les au moins deux ensembles de données antérieurs (10, 10') ou un ensemble de données des au moins deux ensembles de données étant l'au moins un ensemble de données antérieur (10) et l'autre ensemble des au moins deux ensembles de données étant au moins un autre ensemble de données intermédiaires approximatif (20') entre les au moins deux ensembles de données antérieurs (10, 10'). L'invention concerne en outre un produit de programme informatique correspondant.
PCT/EP2017/072794 2016-10-27 2017-09-12 Détermination d'au moins un ensemble de données intermédiaires approximatif pour une application en temps réel WO2018077525A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102016221204.4A DE102016221204A1 (de) 2016-10-27 2016-10-27 Bestimmung mindestens eines genäherten Zwischendatensatzes für eine Echtzeitanwendung
DE102016221204.4 2016-10-27

Publications (1)

Publication Number Publication Date
WO2018077525A1 true WO2018077525A1 (fr) 2018-05-03

Family

ID=59966707

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2017/072794 WO2018077525A1 (fr) 2016-10-27 2017-09-12 Détermination d'au moins un ensemble de données intermédiaires approximatif pour une application en temps réel

Country Status (2)

Country Link
DE (1) DE102016221204A1 (fr)
WO (1) WO2018077525A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999051029A2 (fr) * 1998-04-01 1999-10-07 Koninklijke Philips Electronics N.V. Procede et systeme permettant de generer des trames d'affichage a partir d'une sequence de trames source en synthetisant une ou plusieurs trames intermediaires uniquement a partir d'une trame source qui les precede immediatement
US20090147853A1 (en) * 2007-12-10 2009-06-11 Qualcomm Incorporated Resource-adaptive video interpolation or extrapolation
US20120310610A1 (en) * 2011-05-31 2012-12-06 Sony Computer Entertainment Inc. Program, information storage medium, information processing system, and information processing method
US20150029218A1 (en) * 2013-07-25 2015-01-29 Oliver Michael Christian Williams Late stage reprojection
US9240069B1 (en) * 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8208563B2 (en) * 2008-04-23 2012-06-26 Qualcomm Incorporated Boundary artifact correction within video units

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999051029A2 (fr) * 1998-04-01 1999-10-07 Koninklijke Philips Electronics N.V. Procede et systeme permettant de generer des trames d'affichage a partir d'une sequence de trames source en synthetisant une ou plusieurs trames intermediaires uniquement a partir d'une trame source qui les precede immediatement
US20090147853A1 (en) * 2007-12-10 2009-06-11 Qualcomm Incorporated Resource-adaptive video interpolation or extrapolation
US20120310610A1 (en) * 2011-05-31 2012-12-06 Sony Computer Entertainment Inc. Program, information storage medium, information processing system, and information processing method
US20150029218A1 (en) * 2013-07-25 2015-01-29 Oliver Michael Christian Williams Late stage reprojection
US9240069B1 (en) * 2015-06-30 2016-01-19 Ariadne's Thread (Usa), Inc. Low-latency virtual reality display system

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
CAFFORIO C ET AL: "MOTION COMPENSATED IMAGE INTERPOLATION", IEEE TRANSACTIONS ON COMMUNICATIONS, IEEE SERVICE CENTER, PISCATAWAY, NJ. USA, vol. 38, no. 2, 1 February 1990 (1990-02-01), pages 215 - 222, XP000113142, ISSN: 0090-6778, DOI: 10.1109/26.47856 *
ELY S R: "MPEG VIDEO CODING: A basic tutorial introduction", BBC RESEARCH DEPARTMENT REPORT, BRITISH BROADCASTING CO. TADWORTH, GB, no. 1996/3, 1 January 1996 (1996-01-01), pages 1 - 10, XP002338690 *
FLIERL M ET AL: "Generalized B pictures and the draft H.264/AVC video-compression standard", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS, USA, vol. 13, no. 7, 1 July 2003 (2003-07-01), pages 587 - 597, XP011099251, ISSN: 1051-8215, DOI: 10.1109/TCSVT.2003.814963 *
JOSEPH LASZLO ET AL: "Interactive control for physically-based animation", COMPUTER GRAPHICS. SIGGRAPH 2000 CONFERENCE PROCEEDINGS. NEW ORLEANS, LA, JULY 23 - 28, 2000; [COMPUTER GRAPHICS PROCEEDINGS. SIGGRAPH], NEW YORK, NY : ACM, US, 1 July 2000 (2000-07-01), pages 201 - 208, XP058374777, ISBN: 978-1-58113-208-3, DOI: 10.1145/344779.344876 *
SCHWARZ H ET AL: "Overview of the Scalable Extension of the H.264/MPEG-4 AVC Video Coding Standard", 21. JVT MEETING; 78. MPEG MEETING; 20-10-2006 - 27-10-2006; HANGZHOU,CN; (JOINT VIDEO TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ),, no. JVT-U145, 20 October 2006 (2006-10-20), XP030006791 *
WILLIAM R MARK ET AL: "Post-rendering 3D warping", PROCEEDINGS OF 1997 SYMPOSIUM ON INTERACTIVE 3 D GRAPHICS 27-30 APRIL 1997 PROVIDENCE, RI, USA; [PROCEEDINGS OF THE SYMPOSIUM ON INTERACTIVE 3D GRAPHICS], ACM, PROCEEDINGS 1997 SYMPOSIUM ON INTERACTIVE 3D GRAPHICS ACM NEW YORK, NY, USA, 30 April 1997 (1997-04-30), pages 7 - ff, XP058285072, ISBN: 978-0-89791-884-8, DOI: 10.1145/253284.253292 *
YEN-LIN LEE ET AL: "High frame rate Motion Compensated Frame Interpolation in High-Definition video processing", ACOUSTICS SPEECH AND SIGNAL PROCESSING (ICASSP), 2010 IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 14 March 2010 (2010-03-14), pages 858 - 861, XP031697181, ISBN: 978-1-4244-4295-9 *

Also Published As

Publication number Publication date
DE102016221204A1 (de) 2018-05-03

Similar Documents

Publication Publication Date Title
DE202017106132U1 (de) Neuronale Netze zum Auswählen von durch einen Roboteragenten auszuführenden Aktionen
DE112018002793T5 (de) Bildverarbeitungssystem und bildverarbeitungsverfahren
DE3851207T2 (de) Verfahren zur Bedienung eines Rechnergraphiksystems.
WO2017114883A1 (fr) Procédé de configuration d'une cosimulation pour un système complet
WO2017153355A1 (fr) Procédé et dispositif d'exécution de rendu d'un regard
DE102007028226A1 (de) Auswertungsverfahren für eine zeitliche Sequenz von Röntgenbildern und hiermit korrespondierende Gegenstände
DE112017004424T5 (de) Befehlswerterzeugungsvorrichtung
DE102015102459B4 (de) Verfahren und Vorrichtung zur Ansteuerung eines Simulators
DE102012223587A1 (de) Verfahren zum Testen einer Applikation
WO2018077525A1 (fr) Détermination d'au moins un ensemble de données intermédiaires approximatif pour une application en temps réel
EP3386207A1 (fr) Procédé de fonctionnement d'un système de traitement de données destiné à fournir un contenu vidéo interactif
EP2642359A1 (fr) Dispositif de développement et méthode pour créer un programme de calculateur embarqué
DE602005002846T2 (de) Verfahren zur Datenverarbeitung und assoziiertes Softwareprogramm
WO2019206776A1 (fr) Procédé et dispositif de détermination de la configuration de réseau d'un réseau de neurones artificiels
WO2010028718A2 (fr) Procédé de traitement d'images stéréo
DE102018114229A1 (de) Verfahren zum Bestimmen eines Bewegungszustands eines Objekts in Abhängigkeit einer erzeugten Bewegungsmaske und eines erzeugten Begrenzungsrahmens, Fahrerassistenzsystem sowie Kraftfahrzeug
EP3433152B1 (fr) Procédé d'évaluation de données d'environnement dans un appareil de commande d'un véhicule automobile, appareil de commande et véhicule automobile
DE112017006542T5 (de) Anzeigesystem
WO2017050997A1 (fr) Procédé, programme informatique et système de transmission de données pour produire une image interactive
EP3018633A1 (fr) Procédé de mise en évidence visuelle de structures spatiales
DE102006048847A1 (de) Anpassung eines digitalen Bildes für die Anzeige auf einem Bildschirm
EP3264267A1 (fr) Procede et dispositif de representation ou d'actualisation d'une interface utilisateur graphique d'un systeme d'observation et de commande industrielle
WO2012150203A1 (fr) Procédé pour changer l'échelle de données vidéo et un dispositif pour mettre en œuvre le procédé
WO2016192821A1 (fr) Procédé de fonctionnement d'un dispositif à lunettes intelligentes et dispositif à lunettes intelligentes
EP4244814A2 (fr) Procédé de compression de données de modèle et système informatique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17772332

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17772332

Country of ref document: EP

Kind code of ref document: A1