WO1998030015B1 - Model-based view extrapolation for interactive virtual reality systems - Google Patents
Model-based view extrapolation for interactive virtual reality systemsInfo
- Publication number
- WO1998030015B1 WO1998030015B1 PCT/IL1997/000394 IL9700394W WO9830015B1 WO 1998030015 B1 WO1998030015 B1 WO 1998030015B1 IL 9700394 W IL9700394 W IL 9700394W WO 9830015 B1 WO9830015 B1 WO 9830015B1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- view
- providing
- reference view
- client
- extrapolated
- Prior art date
Links
- 230000002452 interceptive Effects 0.000 title 1
- 238000009877 rendering Methods 0.000 claims 4
- 238000007906 compression Methods 0.000 claims 2
- 230000000875 corresponding Effects 0.000 claims 1
- 230000001131 transforming Effects 0.000 claims 1
Abstract
A method by which a client and a server cooperate to render views of a virtual reality world within which a user of the client navigates. The server sends the client a reference view (R) and a model to use to extrapolate the reference view in response to the user's virtual movement. The client sends the server a record of the user's virtual movement (M). Both the client and the server perform the model-based extrapolation of the reference view. The server also performs an exact update of the reference view. When the extrapolated reference view deviates too much from the updated reference view, the server sends the client the difference (D) between the extrapolated and updated reference views, so that the client can update its reference view.
Claims
1. In a system in which a server and a client cooperate to render a plurality of views of a virtual world, each view corresponding to a viewpoint, a method for generating the views in real time, comprising the steps of:
(a) transmitting a first reference view to the client;
(b) transmitting at least a portion of a model to the client;
(c) extrapolating said first reference view, based on said at least portion of said model, thereby providing an extrapolated view;
(d) transmitting at least one correction dataset to the client; and
(e) correcting said extrapolated view based on said at least one correction dataset, thereby providing at least one second reference view.
2. The method of claim 1, wherein said extrapolating is effected by the steps of:
(i) transforming said model to the viewpoint of said extrapolated view;
(ii) rendering said model; and
(iii) backprojecting said model to said first reference view.
3. The method of claim 1, further comprising the steps of:
(f) rendering an exact view, by the server; and
(g) subtracting said extrapolated view from said exact view, thereby providing a difference image to use as one of said at least one correction dataset.
4. The method of claim 3, further comprising the step of: (h) compressing said difference image.
5. The method of claim 1, further comprising the step of:
(f) replacing said first reference view with one of said at least one second reference view.
6. The method of claim 1, wherein said correction dataset includes a difference image.
7. The method of claim 1, wherein said extrapolating of said first reference view is effected a plurality of times, thereby providing a plurality of extrapolated views, and wherein said correcting is effected on only a portion of said plurality of extrapolated views.
8. In a system for rendering a plurality of views , each of the views associated with a viewpoint, a method for reconstructing at least one of the plurality of views, comprising the steps of:
(a) providing a set of at least one reference view;
(b) providing range data;
(c) extrapolating said set of at least one reference view based on said range data and on at least one of the viewpoints, thereby providing at least one extrapolated view;
(d) providing at least one correction dataset; and
(e) correcting said at least one extrapolated view based on said at least one correction dataset, thereby providing at least one new reference view.
9. The method of claim 8, wherein, for at least one of said at least one reference view, said extrapolating is effected a plurality of times, thereby providing a plurality of extrapolated views, said correcting being effected on only a portion of said plurality of extrapolated views.
10. The method of claim 8, wherein said range data is provided as part of a geometric model.
11. The method of claim 8, further comprising the step of:
(f) adding said new reference view to said set of at least one reference view.
12. The method of claim 8, wherein said extrapolating includes motion compensation.
13. The method of claim 12, wherein said motion compensation includes backprojection.
14. The method of claim 8, wherein said correction dataset is a difference between an exact view and said extrapolated view.
15. The method of claim 14, further comprising the step of:
(f) rendering said exact view, based on a virtual reality world.
16. The method of claim 8, further comprising the step of: (f) compressing said correction dataset.
17. The method of claim 16, wherein said compressing is effected using a lossy compression.
18. The method of claim 17, wherein said lossy compression is JPEG.
19. The method of claim 8, wherein only enough of said range data is provided to enable said extrapolating.
20. The method of claim 8, wherein said plurality of views are rendered cooperatively by a sender and a receiver.
21. The method of claim 20, wherein said providing of said set of said at least one reference view, said providing of said range data, and said providing of said at least one correction dataset are effected by sending said set of said at least one reference view, said range data and said at least one correction dataset from said sender to said receiver.
22. The method of claim 20, wherein said extrapolating and said correcting are effected both by said sender and by said receiver.
23. The method of claim 20, wherein said receiver includes a client that includes a virtual camera, said at least one viewpoint being provided by said virtual camera, said range data being provided in accordance with said at least one viewpoint.
24. The method of claim 23, wherein said range data is included in a portion of a geometric model sent from said sender to said receiver, said portion of said geometric model being selected according to said at least one viewpoint.
25. The method of claim 23, wherein said range data is included in a portion of a geometric model sent from said sender to said receiver, said portion of said geometric model being selected according to a required level of detail.
26. The method of claim 20, wherein said sender includes a server and wherein said receiver includes a client, said server and said client being connected via a network.
27. The method of claim 26, further comprising the steps of:
(f) establishing at least one of the viewpoints, by said client.
28. The method of claim 27, further comprising the steps of:
(g) providing said at least one viewpoint to said server, by said client; and (h) determining said at least one correction dataset based on said at least one viewpoint, by said server.
29. The method of claim 27, wherein said establishing of said at least one viewpoint is effected in accordance with user navigation.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP97946028A EP0965222A4 (en) | 1996-12-29 | 1997-11-30 | Model-based view extrapolation for interactive virtual reality systems |
| BR9714574A BR9714574A (en) | 1996-12-29 | 1997-11-30 | Method for generating views in real time and reconstructing at least one of the views from a plurality of views |
| AU51330/98A AU5133098A (en) | 1996-12-29 | 1997-11-30 | Model-based view extrapolation for interactive virtual reality systems |
| CA 2275212 CA2275212A1 (en) | 1996-12-29 | 1997-11-30 | Model-based view extrapolation for interactive virtual reality systems |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IL119928 | 1996-12-29 | ||
| IL11992896A IL119928A (en) | 1996-12-29 | 1996-12-29 | Model-based view extrapolation for interactive virtual reality systems |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| WO1998030015A2 WO1998030015A2 (en) | 1998-07-09 |
| WO1998030015A3 WO1998030015A3 (en) | 1998-10-22 |
| WO1998030015B1 true WO1998030015B1 (en) | 1998-12-10 |
Family
ID=11069635
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL1997/000394 WO1998030015A2 (en) | 1996-12-29 | 1997-11-30 | Model-based view extrapolation for interactive virtual reality systems |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US6307567B1 (en) |
| EP (1) | EP0965222A4 (en) |
| JP (1) | JPH10320584A (en) |
| AU (1) | AU5133098A (en) |
| BR (1) | BR9714574A (en) |
| CA (1) | CA2275212A1 (en) |
| IL (1) | IL119928A (en) |
| WO (1) | WO1998030015A2 (en) |
Families Citing this family (67)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7920143B1 (en) * | 1997-03-27 | 2011-04-05 | At&T Intellectual Property Ii, L.P. | Method for defining animation parameters for an animation definition interface |
| US6970172B2 (en) | 1997-03-27 | 2005-11-29 | At&T Corp. | Method for defining MPEG 4 animation parameters for an animation definition interface |
| DE19822211B4 (en) * | 1998-05-18 | 2004-02-05 | Eads Deutschland Gmbh | Method for reducing the data throughput during the transmission of at least partially changeable object-related data between communicating communication modules, and a device for carrying out the method |
| GB9817834D0 (en) * | 1998-08-14 | 1998-10-14 | British Telecomm | Predicting avatar movement in a distributed virtual environment |
| US10511573B2 (en) * | 1998-10-30 | 2019-12-17 | Virnetx, Inc. | Agile network protocol for secure communications using secure domain names |
| US6559845B1 (en) * | 1999-06-11 | 2003-05-06 | Pulse Entertainment | Three dimensional animation system and method |
| US6330281B1 (en) | 1999-08-06 | 2001-12-11 | Richfx Ltd. | Model-based view extrapolation for interactive virtual reality systems |
| US6747672B1 (en) | 1999-11-01 | 2004-06-08 | Medical Learning Company, Inc. | Virtual patient hot spots |
| US6692258B1 (en) * | 2000-06-26 | 2004-02-17 | Medical Learning Company, Inc. | Patient simulator |
| US7386432B1 (en) | 1999-11-01 | 2008-06-10 | Medical Learning Co., Inc./Web Simulator | Web simulator |
| US6972775B1 (en) | 1999-11-01 | 2005-12-06 | Medical Learning Company, Inc. | Morphing patient features using an offset |
| US6525731B1 (en) * | 1999-11-09 | 2003-02-25 | Ibm Corporation | Dynamic view-dependent texture mapping |
| US8930844B2 (en) * | 2000-08-22 | 2015-01-06 | Bruce Carlin | Network repository of digitalized 3D object models, and networked generation of photorealistic images based upon these models |
| US20080040227A1 (en) | 2000-11-03 | 2008-02-14 | At&T Corp. | System and method of marketing using a multi-media communication system |
| US6990452B1 (en) | 2000-11-03 | 2006-01-24 | At&T Corp. | Method for sending multi-media messages using emoticons |
| US7203648B1 (en) | 2000-11-03 | 2007-04-10 | At&T Corp. | Method for sending multi-media messages with customized audio |
| US6976082B1 (en) | 2000-11-03 | 2005-12-13 | At&T Corp. | System and method for receiving multi-media messages |
| US6963839B1 (en) | 2000-11-03 | 2005-11-08 | At&T Corp. | System and method of controlling sound in a multi-media communication application |
| US7091976B1 (en) | 2000-11-03 | 2006-08-15 | At&T Corp. | System and method of customizing animated entities for use in a multi-media communication application |
| US20020080143A1 (en) * | 2000-11-08 | 2002-06-27 | Morgan David L. | Rendering non-interactive three-dimensional content |
| US7671861B1 (en) * | 2001-11-02 | 2010-03-02 | At&T Intellectual Property Ii, L.P. | Apparatus and method of customizing animated entities for use in a multi-media communication application |
| US6795090B2 (en) | 2001-11-13 | 2004-09-21 | Eastman Kodak Company | Method and system for panoramic image morphing |
| EP1483741A2 (en) | 2002-03-01 | 2004-12-08 | t5 Labs Ltd | Centralised interactive graphical application server |
| US9314691B2 (en) | 2002-12-10 | 2016-04-19 | Sony Computer Entertainment America Llc | System and method for compressing video frames or portions thereof based on feedback information from a client device |
| US9061207B2 (en) | 2002-12-10 | 2015-06-23 | Sony Computer Entertainment America Llc | Temporary decoder apparatus and method |
| US9446305B2 (en) | 2002-12-10 | 2016-09-20 | Sony Interactive Entertainment America Llc | System and method for improving the graphics performance of hosted applications |
| US8964830B2 (en) | 2002-12-10 | 2015-02-24 | Ol2, Inc. | System and method for multi-stream video compression using multiple encoding formats |
| US10201760B2 (en) | 2002-12-10 | 2019-02-12 | Sony Interactive Entertainment America Llc | System and method for compressing video based on detected intraframe motion |
| US8526490B2 (en) | 2002-12-10 | 2013-09-03 | Ol2, Inc. | System and method for video compression using feedback including data related to the successful receipt of video content |
| US8366552B2 (en) | 2002-12-10 | 2013-02-05 | Ol2, Inc. | System and method for multi-stream video compression |
| US9108107B2 (en) | 2002-12-10 | 2015-08-18 | Sony Computer Entertainment America Llc | Hosting and broadcasting virtual events using streaming interactive video |
| US20090118019A1 (en) | 2002-12-10 | 2009-05-07 | Onlive, Inc. | System for streaming databases serving real-time applications used through streaming interactive video |
| US9138644B2 (en) | 2002-12-10 | 2015-09-22 | Sony Computer Entertainment America Llc | System and method for accelerated machine switching |
| US8549574B2 (en) * | 2002-12-10 | 2013-10-01 | Ol2, Inc. | Method of combining linear content and interactive content compressed together as streaming interactive video |
| US9077991B2 (en) | 2002-12-10 | 2015-07-07 | Sony Computer Entertainment America Llc | System and method for utilizing forward error correction with video compression |
| US8711923B2 (en) | 2002-12-10 | 2014-04-29 | Ol2, Inc. | System and method for selecting a video encoding format based on feedback data |
| US9192859B2 (en) | 2002-12-10 | 2015-11-24 | Sony Computer Entertainment America Llc | System and method for compressing video based on latency measurements and other feedback |
| US20050017968A1 (en) * | 2003-07-21 | 2005-01-27 | Stephan Wurmlin | Differential stream of point samples for real-time 3D video |
| US7995064B2 (en) * | 2004-10-12 | 2011-08-09 | Imvu, Inc. | Computer-implemented chat system having dual channel communications and self-defining product structures |
| US9630104B2 (en) * | 2006-10-23 | 2017-04-25 | Konrad V. Sherinian | Systems, methods, and apparatus for transmitting virtual world content from a server system to a client |
| US9168457B2 (en) | 2010-09-14 | 2015-10-27 | Sony Computer Entertainment America Llc | System and method for retaining system state |
| US8239775B2 (en) * | 2007-12-14 | 2012-08-07 | International Business Machines Corporation | Method and apparatus for a computer simulated environment |
| US8154553B2 (en) | 2008-05-22 | 2012-04-10 | Playcast Media System, Ltd. | Centralized streaming game server |
| WO2009138878A2 (en) * | 2008-05-12 | 2009-11-19 | Playcast Media Systems, Ltd. | Centralized streaming game server |
| US8321903B2 (en) | 2008-07-28 | 2012-11-27 | Playcast Media Systems, Ltd. | External services allocation in closed on-demand systems |
| JP5977023B2 (en) * | 2011-11-07 | 2016-08-24 | 株式会社スクウェア・エニックス・ホールディングス | Drawing system, program, and recording medium |
| GB201206059D0 (en) * | 2012-04-04 | 2012-05-16 | Tangentix Ltd | Hybrid client-server graphical content delivery method and apparatus |
| US11052288B1 (en) | 2013-01-19 | 2021-07-06 | Bertec Corporation | Force measurement system |
| US10231662B1 (en) | 2013-01-19 | 2019-03-19 | Bertec Corporation | Force measurement system |
| US8847989B1 (en) | 2013-01-19 | 2014-09-30 | Bertec Corporation | Force and/or motion measurement system and a method for training a subject using the same |
| US9081436B1 (en) | 2013-01-19 | 2015-07-14 | Bertec Corporation | Force and/or motion measurement system and a method of testing a subject using the same |
| US9526443B1 (en) | 2013-01-19 | 2016-12-27 | Bertec Corporation | Force and/or motion measurement system and a method of testing a subject |
| US11311209B1 (en) | 2013-01-19 | 2022-04-26 | Bertec Corporation | Force measurement system and a motion base used therein |
| US10856796B1 (en) | 2013-01-19 | 2020-12-08 | Bertec Corporation | Force measurement system |
| US10646153B1 (en) | 2013-01-19 | 2020-05-12 | Bertec Corporation | Force measurement system |
| US9770203B1 (en) | 2013-01-19 | 2017-09-26 | Bertec Corporation | Force measurement system and a method of testing a subject |
| US10413230B1 (en) | 2013-01-19 | 2019-09-17 | Bertec Corporation | Force measurement system |
| US11857331B1 (en) | 2013-01-19 | 2024-01-02 | Bertec Corporation | Force measurement system |
| US10010286B1 (en) | 2013-01-19 | 2018-07-03 | Bertec Corporation | Force measurement system |
| US11540744B1 (en) | 2013-01-19 | 2023-01-03 | Bertec Corporation | Force measurement system |
| US8704855B1 (en) * | 2013-01-19 | 2014-04-22 | Bertec Corporation | Force measurement system having a displaceable force measurement assembly |
| WO2015099613A1 (en) * | 2013-12-26 | 2015-07-02 | Singapore University Of Technology And Design | A method and apparatus for reducing data bandwidth between a cloud server and a thin client |
| SG2014000889A (en) * | 2014-01-03 | 2015-08-28 | Creative Tech Ltd | A system suitable for one or both of audio processing and graphics processing and a method of processing in association therewith |
| EP2960864B1 (en) * | 2014-06-23 | 2018-12-05 | Harman Becker Automotive Systems GmbH | Device and method for processing a stream of video data |
| CN107301679A (en) * | 2016-04-15 | 2017-10-27 | 孙万霖 | Virtual reality house viewing system |
| US11176098B2 (en) * | 2017-06-01 | 2021-11-16 | Edx Technologies, Inc. | Methods and systems for providing customized virtual and augmented realities |
| JP7436338B2 (en) * | 2020-09-28 | 2024-02-21 | Kddi株式会社 | Information processing systems, terminals, servers and programs |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3523424C1 (en) * | 1985-06-29 | 1986-10-30 | Deutsche Forschungs- und Versuchsanstalt für Luft- und Raumfahrt e.V., 5000 Köln | Method for the transmission and reproduction of video scenes, in particular aerial scenes, with a reduced frame rate with a relative movement of the recorded scene relative to the recording sensor |
| US5394521A (en) * | 1991-12-09 | 1995-02-28 | Xerox Corporation | User interface with multiple workspaces for sharing display system objects |
| CA2040273C (en) * | 1990-04-13 | 1995-07-18 | Kazu Horiuchi | Image displaying system |
| US5276785A (en) * | 1990-08-02 | 1994-01-04 | Xerox Corporation | Moving viewpoint with respect to a target in a three-dimensional workspace |
| JP2671619B2 (en) * | 1991-03-06 | 1997-10-29 | 富士通株式会社 | Video generation processor |
| US5414521A (en) * | 1991-09-12 | 1995-05-09 | Ansley; David A. | Dynamic distortion correction apparatus and method |
| US5369449A (en) * | 1991-11-08 | 1994-11-29 | Matsushita Electric Industrial Co., Ltd. | Method for predicting move compensation |
| US5613048A (en) * | 1993-08-03 | 1997-03-18 | Apple Computer, Inc. | Three-dimensional image synthesis using view interpolation |
| US5682506A (en) * | 1994-09-12 | 1997-10-28 | General Electric Company | Method and system for group visualization of virtual objects |
| JP3735890B2 (en) * | 1995-06-16 | 2006-01-18 | ソニー株式会社 | Online terminal device and image display method |
| US5737533A (en) * | 1995-10-26 | 1998-04-07 | Wegener Internet Projects Bv | System for generating a virtual reality scene in response to a database search |
| US5764235A (en) * | 1996-03-25 | 1998-06-09 | Insight Development Corporation | Computer implemented method and system for transmitting graphical images from server to client at user selectable resolution |
| US5808613A (en) * | 1996-05-28 | 1998-09-15 | Silicon Graphics, Inc. | Network navigator with enhanced navigational abilities |
| US5793382A (en) * | 1996-06-10 | 1998-08-11 | Mitsubishi Electric Information Technology Center America, Inc. | Method for smooth motion in a distributed virtual reality environment |
-
1996
- 1996-12-29 IL IL11992896A patent/IL119928A/en not_active IP Right Cessation
-
1997
- 1997-11-30 AU AU51330/98A patent/AU5133098A/en not_active Abandoned
- 1997-11-30 WO PCT/IL1997/000394 patent/WO1998030015A2/en not_active Application Discontinuation
- 1997-11-30 CA CA 2275212 patent/CA2275212A1/en not_active Abandoned
- 1997-11-30 EP EP97946028A patent/EP0965222A4/en not_active Withdrawn
- 1997-11-30 BR BR9714574A patent/BR9714574A/en not_active IP Right Cessation
- 1997-12-22 US US08/995,568 patent/US6307567B1/en not_active Expired - Lifetime
- 1997-12-22 JP JP35260297A patent/JPH10320584A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO1998030015B1 (en) | Model-based view extrapolation for interactive virtual reality systems | |
| US6307567B1 (en) | Model-based view extrapolation for interactive virtual reality systems | |
| EP0700018B1 (en) | Interactive picture providing method | |
| US7111045B2 (en) | Image distribution system, and image distribution method and program therefor | |
| WO2001084501A3 (en) | Method for interactive multi-user sustomizable web data retrieval and rendering | |
| US5825336A (en) | Remote operation apparatus | |
| US6625812B2 (en) | Method and system for preserving and communicating live views of a remote physical location over a computer network | |
| US20090128555A1 (en) | System and method for creating and using live three-dimensional avatars and interworld operability | |
| EP0726677A3 (en) | A video-on-demand system | |
| EP0874486A3 (en) | Information providing method which enables data communication costs to be reduced, and information providing system for implementing the method | |
| EP1056273A3 (en) | Method and system for providing high quality images from a digital video stream | |
| EP0853420A3 (en) | System of data compression by subsampling and preferably adaptive accounting for sending images to a printer | |
| JPH11175426A (en) | Service repeater system | |
| US5862347A (en) | Information display system, information distributor and information display apparatus | |
| US20040255304A1 (en) | User profile opening apparatus and method | |
| KR102181859B1 (en) | System and method for providing holoportation | |
| CN112887666B (en) | Video processing method and device, network camera, server and storage medium | |
| AU751703B2 (en) | Method and apparatus for providing error correction | |
| EP1061676A2 (en) | Data broadcast system, for broadcasting multimedia data; receiving terminal device for receiving said multimedia data | |
| EP1710719B1 (en) | Image transmission method, computer-readable image transmission program, and image transmission apparatus | |
| CN115729351A (en) | Interactive processing system based on meta universe | |
| US20030132939A1 (en) | Interactive navigation through real-time live video space created in a given remote geographic location | |
| CN114972588A (en) | Construction method, construction device and control method of vehicle-mounted virtual animation | |
| US7333497B2 (en) | Moving picture server and method of controlling same | |
| KR19990048678A (en) | Remote virtual space experience system using virtual reality and 3D tracker |