JP7423683B2 - 画像表示システム - Google Patents
画像表示システム Download PDFInfo
- Publication number
- JP7423683B2 JP7423683B2 JP2022078412A JP2022078412A JP7423683B2 JP 7423683 B2 JP7423683 B2 JP 7423683B2 JP 2022078412 A JP2022078412 A JP 2022078412A JP 2022078412 A JP2022078412 A JP 2022078412A JP 7423683 B2 JP7423683 B2 JP 7423683B2
- Authority
- JP
- Japan
- Prior art keywords
- user
- image
- display
- screen
- space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 claims description 104
- 238000012545 processing Methods 0.000 claims description 76
- 238000000034 method Methods 0.000 description 49
- 230000008569 process Effects 0.000 description 29
- 210000003128 head Anatomy 0.000 description 27
- 230000036544 posture Effects 0.000 description 16
- 238000004364 calculation method Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000004913 activation Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000009434 installation Methods 0.000 description 8
- 230000003190 augmentative effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000013461 design Methods 0.000 description 4
- 239000003550 marker Substances 0.000 description 4
- 230000009466 transformation Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 210000002784 stomach Anatomy 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
- Controls And Circuits For Display Device (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- User Interface Of Digital Computer (AREA)
Description
画像表示装置31は、実施例1に示した画像表示システム10と同じものであり、ディスプレイ11、2つのユーザ空間撮像部12-1、12-2、記憶部13、および処理部14を有している。画像取得装置33は、表示空間撮像部34、処理部35、および音声取得部36を有している。
Claims (1)
- 画像を表示可能な画面を有するディスプレイと、
前記ディスプレイの前記画面に表示される画像を見るユーザが存在しうる前記画面より前方のユーザ空間を撮像し、ユーザ空間画像を取得する複数のユーザ空間撮像部と、
所定の基準座標空間における前記画面の位置、姿勢および形状を示す画面配置データと、前記基準座標空間上の三次元オブジェクトを表す三次元データと、を保持する記憶部と、
複数の前記ユーザ空間撮像部のそれぞれで取得される前記ユーザ空間画像に基づいて、前記ユーザ空間撮像部毎に前記基準座標空間上のユーザ視点位置に相当する位置の座標を算出し、複数の前記ユーザ視点位置に相当する位置の座標から1つのユーザ視点位置の座標を算出し、該座標と前記画面配置データと前記三次元データに基づいて、前記ユーザ視点位置から前記画面を介して仮想空間上の前記三次元オブジェクトを見たときのような見え方となる前記三次元オブジェクトの表示画像を生成し、該表示画像を前記ディスプレイの前記画面に表示させる処理部と、
を有する、
画像表示システム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022078412A JP7423683B2 (ja) | 2018-03-08 | 2022-05-11 | 画像表示システム |
JP2024005462A JP2024054137A (ja) | 2018-03-08 | 2024-01-17 | 画像表示システム |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2018/009092 WO2019171557A1 (ja) | 2018-03-08 | 2018-03-08 | 画像表示システム |
JP2020504604A JP7073481B2 (ja) | 2018-03-08 | 2018-03-08 | 画像表示システム |
JP2022078412A JP7423683B2 (ja) | 2018-03-08 | 2022-05-11 | 画像表示システム |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020504604A Division JP7073481B2 (ja) | 2018-03-08 | 2018-03-08 | 画像表示システム |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2024005462A Division JP2024054137A (ja) | 2018-03-08 | 2024-01-17 | 画像表示システム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2022122876A JP2022122876A (ja) | 2022-08-23 |
JP7423683B2 true JP7423683B2 (ja) | 2024-01-29 |
Family
ID=67846986
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020504604A Active JP7073481B2 (ja) | 2018-03-08 | 2018-03-08 | 画像表示システム |
JP2022078412A Active JP7423683B2 (ja) | 2018-03-08 | 2022-05-11 | 画像表示システム |
JP2024005462A Pending JP2024054137A (ja) | 2018-03-08 | 2024-01-17 | 画像表示システム |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020504604A Active JP7073481B2 (ja) | 2018-03-08 | 2018-03-08 | 画像表示システム |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2024005462A Pending JP2024054137A (ja) | 2018-03-08 | 2024-01-17 | 画像表示システム |
Country Status (3)
Country | Link |
---|---|
US (3) | US11425350B2 (ja) |
JP (3) | JP7073481B2 (ja) |
WO (1) | WO2019171557A1 (ja) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11186289B2 (en) * | 2018-03-30 | 2021-11-30 | Toyota Jidosha Kabushiki Kaisha | Concealment system for improved safe driving |
US10997630B2 (en) * | 2018-12-20 | 2021-05-04 | Rovi Guides, Inc. | Systems and methods for inserting contextual advertisements into a virtual environment |
US20230067565A1 (en) * | 2019-09-30 | 2023-03-02 | Kyocera Corporation | Three-dimensional display device, three-dimensional display system, head-up display, and mobile object |
EP4053630A4 (en) * | 2019-10-31 | 2022-12-21 | Sony Group Corporation | IMAGE DISPLAY DEVICE |
JPWO2022168244A1 (ja) * | 2021-02-04 | 2022-08-11 | ||
JP2023007233A (ja) * | 2021-07-01 | 2023-01-18 | 塁 佐藤 | 画像表示システム及び画像表示方法 |
WO2024095356A1 (ja) * | 2022-11-01 | 2024-05-10 | 株式会社バーチャルウインドウ | グラフィックス生成装置、グラフィックス生成方法及びプログラム |
CN115934020B (zh) * | 2023-01-05 | 2023-05-30 | 南方科技大学 | 一种基于弧形屏幕的裸眼3d显示方法及终端 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000276613A (ja) | 1999-03-29 | 2000-10-06 | Sony Corp | 情報処理装置および情報処理方法 |
JP2014086775A (ja) | 2012-10-19 | 2014-05-12 | Nippon Telegr & Teleph Corp <Ntt> | 映像コミュニケーションシステム及び映像コミュニケーション方法 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3292354B2 (ja) | 1994-12-13 | 2002-06-17 | 横河電機株式会社 | 3次元画像表示装置 |
JP2011151676A (ja) * | 2010-01-22 | 2011-08-04 | Panasonic Electric Works Co Ltd | 映像表示システム |
US8913009B2 (en) * | 2010-02-03 | 2014-12-16 | Nintendo Co., Ltd. | Spatially-correlated multi-display human-machine interface |
JP5439281B2 (ja) * | 2010-05-27 | 2014-03-12 | エヌ・ティ・ティ・コムウェア株式会社 | ユーザ視点空間映像提示装置、ユーザ視点空間映像提示方法及びプログラム |
US20130113701A1 (en) * | 2011-04-28 | 2013-05-09 | Taiji Sasaki | Image generation device |
JP5818322B2 (ja) * | 2012-06-06 | 2015-11-18 | 日本電信電話株式会社 | 映像生成装置、映像生成方法及びコンピュータプログラム |
JP6168597B2 (ja) * | 2013-06-25 | 2017-07-26 | Kddi株式会社 | 情報端末装置 |
JP6031016B2 (ja) * | 2013-09-17 | 2016-11-24 | 日本電信電話株式会社 | 映像表示装置及び映像表示プログラム |
CN113050802A (zh) * | 2014-12-18 | 2021-06-29 | 脸谱科技有限责任公司 | 用于在虚拟现实环境中导航的方法、系统及设备 |
-
2018
- 2018-03-08 US US16/975,605 patent/US11425350B2/en active Active
- 2018-03-08 JP JP2020504604A patent/JP7073481B2/ja active Active
- 2018-03-08 WO PCT/JP2018/009092 patent/WO2019171557A1/ja active Application Filing
-
2022
- 2022-05-11 JP JP2022078412A patent/JP7423683B2/ja active Active
- 2022-06-30 US US17/854,405 patent/US11750789B2/en active Active
-
2023
- 2023-06-12 US US18/208,664 patent/US20230328215A1/en active Pending
-
2024
- 2024-01-17 JP JP2024005462A patent/JP2024054137A/ja active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000276613A (ja) | 1999-03-29 | 2000-10-06 | Sony Corp | 情報処理装置および情報処理方法 |
JP2014086775A (ja) | 2012-10-19 | 2014-05-12 | Nippon Telegr & Teleph Corp <Ntt> | 映像コミュニケーションシステム及び映像コミュニケーション方法 |
Also Published As
Publication number | Publication date |
---|---|
US20200413021A1 (en) | 2020-12-31 |
WO2019171557A1 (ja) | 2019-09-12 |
JPWO2019171557A1 (ja) | 2021-02-04 |
US11750789B2 (en) | 2023-09-05 |
JP2024054137A (ja) | 2024-04-16 |
US20230328215A1 (en) | 2023-10-12 |
JP2022122876A (ja) | 2022-08-23 |
US20220337801A1 (en) | 2022-10-20 |
US11425350B2 (en) | 2022-08-23 |
JP7073481B2 (ja) | 2022-05-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7423683B2 (ja) | 画像表示システム | |
US10256859B2 (en) | System and method for immersive and interactive multimedia generation | |
JP6933727B2 (ja) | 画像処理装置、画像処理方法、およびプログラム | |
US20180046874A1 (en) | System and method for marker based tracking | |
WO2018116790A1 (ja) | 不整合検出システム、複合現実システム、プログラム及び不整合検出方法 | |
WO2018214697A1 (zh) | 图形处理方法、处理器和虚拟现实系统 | |
US20100194863A1 (en) | Systems and methods for simulating three-dimensional virtual interactions from two-dimensional camera images | |
WO2017020766A1 (zh) | 场景提取方法、物体定位方法及其系统 | |
JP2016522463A5 (ja) | ||
Jia et al. | 3D image reconstruction and human body tracking using stereo vision and Kinect technology | |
CN110554770A (zh) | 静态遮挡物 | |
US11156830B2 (en) | Co-located pose estimation in a shared artificial reality environment | |
KR20160096392A (ko) | 직관적인 상호작용 장치 및 방법 | |
US20130201099A1 (en) | Method and system for providing a modified display image augmented for various viewing angles | |
JP2018106661A (ja) | 不整合検出システム、複合現実システム、プログラム及び不整合検出方法 | |
WO2017163648A1 (ja) | 頭部装着装置 | |
WO2018173205A1 (ja) | 情報処理システム、その制御方法、及びプログラム | |
WO2023277020A1 (ja) | 画像表示システム及び画像表示方法 | |
US20180101226A1 (en) | Information processing apparatus | |
WO2018173206A1 (ja) | 情報処理装置 | |
US20230071828A1 (en) | Information processing apparatus, information processing system, and information processing method | |
JP6739539B2 (ja) | 情報処理装置 | |
Nakamura et al. | A Mutual Motion Capture System for Face-to-face Collaboration. | |
CN115552468A (zh) | 用于计算3d环境的合成表示的计算高效方法 | |
Tran et al. | Robust Hybrid Tracking with Life-Size Avatar in Mixed Reality Environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220608 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20220608 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230704 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20230901 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20231027 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20231219 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20240117 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7423683 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |