CA2385548A1 - Method and system for time/motion compensation for head mounted displays - Google Patents
Method and system for time/motion compensation for head mounted displays Download PDFInfo
- Publication number
- CA2385548A1 CA2385548A1 CA002385548A CA2385548A CA2385548A1 CA 2385548 A1 CA2385548 A1 CA 2385548A1 CA 002385548 A CA002385548 A CA 002385548A CA 2385548 A CA2385548 A CA 2385548A CA 2385548 A1 CA2385548 A1 CA 2385548A1
- Authority
- CA
- Canada
- Prior art keywords
- camera
- image
- data
- head mounted
- position data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
Abstract
A method and system for time-motion compensation for use with head mounted displays is disclosed. According to the method, a remote camera captures an image for display on a head-mounted display (HMD) including a viewing window . The image and camera position data is transmitted to a system including the HMD for display to a wearer of the HMD. The HMD position is determined. An offset between the HMD position and a known position of the HMD is determine d as is an offset between the camera position and a known position of the camera. The image is offset relative to the viewing window of the image base d on the difference between the two determined offsets.
Claims (22)
1. A method of motion compensation for head mounted displays comprising the steps of:
providing a captured image from an image capture device to a head mounted display including a display having a field of view;
providing camera position data relating to a position of the camera and associated with the captured image;
providing HMD position data relating to a position of the head mounted display;
transforming the image to vary a displayed location of static objects within the image relative to the field of view in accordance with the camera position data and the HMD
position data; and, displaying portions of the image at the displayed locations, those portions remaining within the field of view.
providing a captured image from an image capture device to a head mounted display including a display having a field of view;
providing camera position data relating to a position of the camera and associated with the captured image;
providing HMD position data relating to a position of the head mounted display;
transforming the image to vary a displayed location of static objects within the image relative to the field of view in accordance with the camera position data and the HMD
position data; and, displaying portions of the image at the displayed locations, those portions remaining within the field of view.
2. A method according to claim 1 wherein the HMD position data is data relating to the present position of the head mounted display and wherein the camera position data is data relating to the position of the camera when the associated image is captured and wherein the step of transforming the image includes the steps of:
determining an offset between the HMD position and the camera position; and, offsetting the image such that it is offset an amount proportional to the offset between the HMD position and the camera position.
determining an offset between the HMD position and the camera position; and, offsetting the image such that it is offset an amount proportional to the offset between the HMD position and the camera position.
3. A method according to claim 2 wherein portions of the field of view for which image data is unavailable are filled with a predetermined fill.
4. A method according to claim 3 wherein the predetermined fill has features for maintaining orientation of a wearer of the head mounted display.
5. A method according to claim 1 wherein the captured image is larger than the image necessary to fill the field of view of the head mounted display, and wherein only a portion of the captured image is displayed.
6. A method according to claim 1 wherein the system comprises two head mounted displays and two cameras.
7. A method according to claim 1 wherein the system comprises:
an independent position sensor for sensing the camera position and for providing the camera position data.
an independent position sensor for sensing the camera position and for providing the camera position data.
8. A method according to claim 7 wherein the system comprises:
an independent position sensor for sensing the head mounted display position and for providing the HMD position data.
an independent position sensor for sensing the head mounted display position and for providing the HMD position data.
9. A method according to claim 1 wherein the system comprises:
an independent position sensor for sensing the head mounted display position and for providing the HMD position data.
an independent position sensor for sensing the head mounted display position and for providing the HMD position data.
10. A method according to claim 1 wherein the system comprises:
a mechanism for moving the camera; and means for transmitting the HMD position data to a system in communication with the mechanism for moving the camera, wherein the mechanism for moving the camera moves the camera in response to a change in HMD position data.
a mechanism for moving the camera; and means for transmitting the HMD position data to a system in communication with the mechanism for moving the camera, wherein the mechanism for moving the camera moves the camera in response to a change in HMD position data.
11. A method according to claim 1 wherein the HMD position data comprises orientation data.
12. A method according to claim 11 wherein the camera position data comprises orientation data.
13. A method according to claim 12 wherein the camera position data comprises displacement data.
14. A method according to claim 1 wherein the HMD position data comprises displacement data.
15. A method according to claim 14 wherein the camera position data comprises displacement data.
16 16. A method according to claim 15 wherein the camera position data comprises orientation data.
17. A method according to claim 1 comprising the step of transforming the image to reduce perspective distortion, wherein the camera includes a range sensor.
18. A motion compensation apparatus for head mounted displays comprising:
a head mounted display for displaying portions of an image at displayed locations, those portions remaining within the field of view;
an image capture device for providing a captured image to a head mounted display including a monitor having a field of view;
a sensor for providing camera position data relating to a position of the camera and associated with the captured image;
a sensor for providing HMD position data relating to a position of the head mounted display; and a processor for transforming the image to vary a displayed location of static objects within the image relative to the field of view in accordance with the camera position data and the HMD position data.
a head mounted display for displaying portions of an image at displayed locations, those portions remaining within the field of view;
an image capture device for providing a captured image to a head mounted display including a monitor having a field of view;
a sensor for providing camera position data relating to a position of the camera and associated with the captured image;
a sensor for providing HMD position data relating to a position of the head mounted display; and a processor for transforming the image to vary a displayed location of static objects within the image relative to the field of view in accordance with the camera position data and the HMD position data.
19. A motion compensation apparatus for head mounted displays according to claim 18 wherein the image capture device comprises a range sensor.
20. A motion compensation apparatus for head mounted displays according to claim 19 wherein the range sensor includes a stereoscopic imaging system.
21. A method according to claim 2 comprising the step of:
when portions of the field of view for which image data is unavailable are detected, determining earlier captured image data that when transformed in dependence upon its associated camera position data and the HMD position data is for display within the portions; and, displaying with those portions of the field of view the transformed earlier captured image data.
when portions of the field of view for which image data is unavailable are detected, determining earlier captured image data that when transformed in dependence upon its associated camera position data and the HMD position data is for display within the portions; and, displaying with those portions of the field of view the transformed earlier captured image data.
22. A method according to claim 21 wherein the step of displaying transformed earlier captured image data includes a step of de-emphasising the transformed earlier captured image data.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15513299P | 1999-09-22 | 1999-09-22 | |
| US60/155,132 | 1999-09-22 | ||
| PCT/CA2000/001063 WO2001022149A1 (en) | 1999-09-22 | 2000-09-22 | Method and system for time/motion compensation for head mounted displays |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2385548A1 true CA2385548A1 (en) | 2001-03-29 |
| CA2385548C CA2385548C (en) | 2010-09-21 |
Family
ID=22554218
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2385548A Expired - Fee Related CA2385548C (en) | 1999-09-22 | 2000-09-22 | Method and system for time/motion compensation for head mounted displays |
Country Status (4)
| Country | Link |
|---|---|
| JP (1) | JP2003510864A (en) |
| CA (1) | CA2385548C (en) |
| GB (1) | GB2372169B (en) |
| WO (1) | WO2001022149A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110709803A (en) * | 2017-11-14 | 2020-01-17 | 深圳市柔宇科技有限公司 | Data processing method and device |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7734101B2 (en) | 2000-10-11 | 2010-06-08 | The United States Of America As Represented By The Secretary Of The Army | Apparatus and system for testing an image produced by a helmet-mounted display |
| CN101127834B (en) * | 2003-05-20 | 2011-04-06 | 松下电器产业株式会社 | Image capturing system |
| JP2007333929A (en) * | 2006-06-14 | 2007-12-27 | Nikon Corp | Video display system |
| JP4851412B2 (en) | 2007-09-27 | 2012-01-11 | 富士フイルム株式会社 | Image display apparatus, image display method, and image display program |
| US20140098296A1 (en) * | 2012-10-04 | 2014-04-10 | Ati Technologies Ulc | Method and apparatus for changing a perspective of a video |
| GB201305402D0 (en) | 2013-03-25 | 2013-05-08 | Sony Comp Entertainment Europe | Head mountable display |
| CN105721856B (en) * | 2014-12-05 | 2017-12-15 | 北京蚁视科技有限公司 | A kind of remote image display methods for near-to-eye |
| DE102016102808A1 (en) * | 2016-02-17 | 2017-08-17 | Krauss-Maffei Wegmann Gmbh & Co. Kg | Method for controlling a sighting device arranged to be directionally arranged on a vehicle |
| KR20170106161A (en) * | 2016-03-11 | 2017-09-20 | 주식회사 상화 | Virtual reality experience apparatus |
| KR102528318B1 (en) * | 2016-12-26 | 2023-05-03 | 엘지디스플레이 주식회사 | Apparatus and method for measuring latency of head mounted display |
| JP2018137609A (en) * | 2017-02-22 | 2018-08-30 | 株式会社東芝 | Partial image processing device |
| JP7121523B2 (en) * | 2018-04-10 | 2022-08-18 | キヤノン株式会社 | Image display device, image display method |
| WO2019204012A1 (en) * | 2018-04-20 | 2019-10-24 | Covidien Lp | Compensation for observer movement in robotic surgical systems having stereoscopic displays |
| GB2614698A (en) * | 2021-11-15 | 2023-07-19 | Mo Sys Engineering Ltd | Controlling adaptive backdrops |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2115179B (en) * | 1978-12-21 | 1984-01-18 | Redifon Simulation Ltd | Improvements in or relating to visual display apparatus |
| GB9121707D0 (en) * | 1991-10-12 | 1991-11-27 | British Aerospace | Improvements in computer-generated imagery |
| JPH06326944A (en) * | 1993-05-14 | 1994-11-25 | Olympus Optical Co Ltd | Head-mounted type video display device |
| US5579026A (en) * | 1993-05-14 | 1996-11-26 | Olympus Optical Co., Ltd. | Image display apparatus of head mounted type |
| US5610678A (en) * | 1993-12-30 | 1997-03-11 | Canon Kabushiki Kaisha | Camera including camera body and independent optical viewfinder |
| JPH07199280A (en) * | 1993-12-30 | 1995-08-04 | Canon Inc | Camera system |
| JPH0821975A (en) * | 1994-07-06 | 1996-01-23 | Olympus Optical Co Ltd | Head-mounted type video display system |
| US5933125A (en) * | 1995-11-27 | 1999-08-03 | Cae Electronics, Ltd. | Method and apparatus for reducing instability in the display of a virtual environment |
-
2000
- 2000-09-22 JP JP2001525460A patent/JP2003510864A/en active Pending
- 2000-09-22 CA CA2385548A patent/CA2385548C/en not_active Expired - Fee Related
- 2000-09-22 GB GB0206051A patent/GB2372169B/en not_active Expired - Fee Related
- 2000-09-22 WO PCT/CA2000/001063 patent/WO2001022149A1/en active Application Filing
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110709803A (en) * | 2017-11-14 | 2020-01-17 | 深圳市柔宇科技有限公司 | Data processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2001022149A1 (en) | 2001-03-29 |
| JP2003510864A (en) | 2003-03-18 |
| GB0206051D0 (en) | 2002-04-24 |
| GB2372169B (en) | 2004-05-26 |
| CA2385548C (en) | 2010-09-21 |
| GB2372169A (en) | 2002-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2385548A1 (en) | Method and system for time/motion compensation for head mounted displays | |
| US7312766B1 (en) | Method and system for time/motion compensation for head mounted displays | |
| US20050117186A1 (en) | Liquid crystal display with adaptive color | |
| EP1158473A3 (en) | Surround surveillance system for mobile body, and mobile body, car, and train using the same | |
| WO2002080106A3 (en) | Method, system and device for augmented reality | |
| EP1213683A3 (en) | Position and orientation determining method and apparatus and storage medium | |
| EP1486945A3 (en) | Device and method for image data compensation in response to variations of ambient temperature and display system employing the same | |
| EP1501019A3 (en) | Apparatus and method for automatically compensating for an image gradient of a mobile communication terminal | |
| JP2008146109A (en) | Image processing method and image processor | |
| AU2007219287A1 (en) | A System and Method for Dynamically Correcting Parallax in Head Borne Video Systems | |
| EP1199876A3 (en) | Image processing system and ordering system | |
| ATE400967T1 (en) | COMMUNICATION SYSTEM | |
| EP1152279B1 (en) | Immersive display system | |
| WO2005017602A3 (en) | Three-dimensional image display system | |
| CN110895676A (en) | Dynamic object tracking | |
| KR20030048013A (en) | A method and system of revision for 3-dimensional image | |
| EP1178460A3 (en) | Automatically adapting digital picture frame display | |
| EP1170952A3 (en) | Surveillance system | |
| JP2002230586A (en) | Image system for supporting three-dimensional survey using composite reality | |
| JP3259031B2 (en) | Measurement result or analysis result projection apparatus and method | |
| JPH06189906A (en) | Visual axial direction measuring device | |
| JP2017046233A (en) | Display device, information processor, and control method of the same | |
| CA2526281A1 (en) | Stabilization of the effects of jitter on a displayed image | |
| US20090169127A1 (en) | Anti-vibration system for the display screen of an image display device | |
| JP2010171695A (en) | Television conference device and displaying/imaging method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20190923 |