JP6585929B2 - システム、システムの制御方法 - Google Patents

システム、システムの制御方法 Download PDF

Info

Publication number
JP6585929B2
JP6585929B2 JP2015112403A JP2015112403A JP6585929B2 JP 6585929 B2 JP6585929 B2 JP 6585929B2 JP 2015112403 A JP2015112403 A JP 2015112403A JP 2015112403 A JP2015112403 A JP 2015112403A JP 6585929 B2 JP6585929 B2 JP 6585929B2
Authority
JP
Japan
Prior art keywords
image
mode
virtual object
display
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2015112403A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016224810A5 (enExample
JP2016224810A (ja
Inventor
大矢　崇
崇 大矢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP2015112403A priority Critical patent/JP6585929B2/ja
Priority to EP16001150.8A priority patent/EP3101523B1/en
Priority to US15/166,307 priority patent/US10095458B2/en
Priority to CN201610373474.XA priority patent/CN106227329B/zh
Publication of JP2016224810A publication Critical patent/JP2016224810A/ja
Publication of JP2016224810A5 publication Critical patent/JP2016224810A5/ja
Application granted granted Critical
Publication of JP6585929B2 publication Critical patent/JP6585929B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/024—Multi-user, collaborative environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Architecture (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2015112403A 2015-06-02 2015-06-02 システム、システムの制御方法 Active JP6585929B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2015112403A JP6585929B2 (ja) 2015-06-02 2015-06-02 システム、システムの制御方法
EP16001150.8A EP3101523B1 (en) 2015-06-02 2016-05-20 Information processing apparatus, information processing method, computer-readable storage medium, and system
US15/166,307 US10095458B2 (en) 2015-06-02 2016-05-27 Information processing apparatus, information processing method, non-transitory computer-readable storage medium, and system
CN201610373474.XA CN106227329B (zh) 2015-06-02 2016-05-31 信息处理装置、信息处理方法及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2015112403A JP6585929B2 (ja) 2015-06-02 2015-06-02 システム、システムの制御方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2019163837A Division JP2020074066A (ja) 2019-09-09 2019-09-09 画像表示装置、画像表示装置の制御方法

Publications (3)

Publication Number Publication Date
JP2016224810A JP2016224810A (ja) 2016-12-28
JP2016224810A5 JP2016224810A5 (enExample) 2018-07-12
JP6585929B2 true JP6585929B2 (ja) 2019-10-02

Family

ID=56092697

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2015112403A Active JP6585929B2 (ja) 2015-06-02 2015-06-02 システム、システムの制御方法

Country Status (4)

Country Link
US (1) US10095458B2 (enExample)
EP (1) EP3101523B1 (enExample)
JP (1) JP6585929B2 (enExample)
CN (1) CN106227329B (enExample)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102471977B1 (ko) * 2015-11-06 2022-11-30 삼성전자 주식회사 복수의 전자장치 사이에서 가상 객체를 표시하는 방법 및 이를 지원하는 전자 장치
JP2017162102A (ja) * 2016-03-08 2017-09-14 株式会社東芝 保守支援方法、保守支援システム、及び保守支援プログラム
US11024064B2 (en) * 2017-02-24 2021-06-01 Masimo Corporation Augmented reality system for displaying patient data
JP7166264B2 (ja) 2017-02-24 2022-11-07 マシモ・コーポレイション 医療モニタリング・データを表示するシステム
KR102755365B1 (ko) * 2017-03-28 2025-01-17 삼성전자주식회사 사용자 움직임 정보에 기초하여 영상을 표시하기 위한 방법 및 장치
EP3622529A1 (en) 2017-05-08 2020-03-18 Masimo Corporation System for pairing a medical system to a network controller by use of a dongle
JP6352574B1 (ja) * 2017-06-27 2018-07-04 サン電子株式会社 ゲームプログラム
US20190212962A1 (en) * 2017-07-14 2019-07-11 Kyocera Document Solutions Inc. Display device and display system
CN107390875B (zh) * 2017-07-28 2020-01-31 腾讯科技（上海）有限公司 信息处理方法、装置、终端设备和计算机可读存储介质
US10748340B1 (en) * 2017-07-31 2020-08-18 Apple Inc. Electronic device with coordinated camera and display operation
JP7073702B2 (ja) * 2017-12-11 2022-05-24 富士フイルムビジネスイノベーション株式会社 情報処理装置及び情報処理プログラム
CN108196674A (zh) * 2017-12-29 2018-06-22 梁穗 用于虚拟感应现实的实体模型、通过虚拟设备感应现实模型的系统及实现方法
US10976982B2 (en) * 2018-02-02 2021-04-13 Samsung Electronics Co., Ltd. Guided view mode for virtual reality
JP7057197B2 (ja) * 2018-04-12 2022-04-19 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
CN108829251A (zh) * 2018-06-14 2018-11-16 北京小米移动软件有限公司 信息提示的方法、装置和存储介质
CN108961424B (zh) * 2018-07-04 2023-04-18 百度在线网络技术（北京）有限公司 虚拟信息处理方法、设备及存储介质
WO2020051509A2 (en) 2018-09-07 2020-03-12 Ocelot Laboratories Llc Transitioning between imagery and sounds of a virtual environment and a real environment
CN112714899A (zh) 2018-10-03 2021-04-27 麦克赛尔株式会社 头戴式显示器和头戴式显示系统
US11808941B2 (en) * 2018-11-30 2023-11-07 Google Llc Augmented image generation using virtual content from wearable heads up display
JP7234264B2 (ja) 2019-02-06 2023-03-07 マクセル株式会社 複合現実表示装置および複合現実表示方法
CN111784271B (zh) * 2019-04-04 2023-09-19 腾讯科技（深圳）有限公司 基于虚拟对象的用户引导方法、装置、设备及存储介质
KR200489627Y1 (ko) * 2019-06-11 2019-07-12 황영진 증강현실을 이용한 멀티플레이 교육 시스템
US12147607B1 (en) * 2019-07-11 2024-11-19 Apple Inc. Transitioning between environments
ES3023569T3 (en) * 2019-11-20 2025-06-02 Daikin Ind Ltd Remote work support system
CN116171573B (zh) * 2020-07-21 2025-09-09 索尼集团公司 信息处理设备、信息处理方法和程序
JP7513723B2 (ja) * 2020-08-06 2024-07-09 マクセル株式会社 仮想現実共有方法及びシステム
JP7594218B2 (ja) * 2021-06-28 2024-12-04 日本電信電話株式会社 画像重畳システム及び画像重畳方法
IT202100017168A1 (it) * 2021-06-30 2022-12-30 Milano Politecnico Metodo per calcolare una o più isoviste di un ambiente fisico o di realtà estesa
CN113740719B (zh) * 2021-09-02 2024-05-14 上海壁仞科技股份有限公司 芯片以及芯片测试方法
US11656835B1 (en) * 2021-12-29 2023-05-23 Transmira, Inc. Systems and methods for spatial conversion and synchronization between geolocal augmented reality and virtual reality modalities associated with real-world physical locations
CN114445603A (zh) * 2022-02-08 2022-05-06 联想(北京)有限公司 获取对象的关注信息的方法、装置及电子设备
EP4502780A4 (en) 2022-09-15 2025-08-06 Samsung Electronics Co Ltd WEARABLE DEVICE FOR PROVIDING INFORMATION ON AN APPLICATION VIA AN EXTERNAL DISPLAY DEVICE AND METHOD FOR CONTROLLING THE SAME

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003051031A (ja) * 2001-05-08 2003-02-21 Komatsu Ltd 製品又はその部品についての電子文書をクライアント端末に表示するためのシステム及び方法
EP1686554A3 (en) * 2005-01-31 2008-06-18 Canon Kabushiki Kaisha Virtual space generating system, image processing apparatus and information processing method
JP4677269B2 (ja) * 2005-04-08 2011-04-27 キヤノン株式会社 情報処理方法およびシステム
JP4738870B2 (ja) 2005-04-08 2011-08-03 キヤノン株式会社 情報処理方法、情報処理装置および遠隔複合現実感共有装置
JP4933164B2 (ja) * 2005-07-01 2012-05-16 キヤノン株式会社 情報処理装置、情報処理方法、プログラムおよび記憶媒体
JP4810467B2 (ja) * 2007-02-28 2011-11-09 富士通株式会社 部品選択プログラム、該プログラムを記録した記録媒体、部品選択方法、および部品選択装置
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
US9829997B2 (en) 2013-02-22 2017-11-28 Sony Corporation Head-mounted display system, head-mounted display, and head-mounted display control program
WO2014162852A1 (ja) * 2013-04-04 2014-10-09 ソニー株式会社 画像処理装置、画像処理方法およびプログラム
JP5845211B2 (ja) * 2013-06-24 2016-01-20 キヤノン株式会社 画像処理装置、画像処理方法

Also Published As

Publication number Publication date
US10095458B2 (en) 2018-10-09
CN106227329B (zh) 2019-11-08
EP3101523B1 (en) 2019-07-17
JP2016224810A (ja) 2016-12-28
EP3101523A1 (en) 2016-12-07
US20160357491A1 (en) 2016-12-08
CN106227329A (zh) 2016-12-14

Similar Documents

Publication Publication Date Title
JP6585929B2 (ja) システム、システムの制御方法
JP4553362B2 (ja) システム、画像処理装置、情報処理方法
JP4883774B2 (ja) 情報処理装置及びその制御方法、プログラム
US10386633B2 (en) Virtual object display system, and display control method and display control program for the same
JP2015001760A (ja) 画像処理システム、画像処理装置、画像処理プログラム、および画像処理方法
CN102668556A (zh) 医疗支援装置，医疗支援方法以及医疗支援系统
JP2005174021A (ja) 情報提示方法及び装置
JP2019008623A (ja) 情報処理装置、及び、情報処理装置の制御方法、コンピュータプログラム、記憶媒体
JP2016122392A (ja) 情報処理装置、情報処理システム、その制御方法及びプログラム
JP2017010387A (ja) システム、複合現実表示装置、情報処理方法及びプログラム
EP3229482B1 (en) Master device, slave device, and control method therefor
JP7170798B2 (ja) 画像処理方法、画像処理システム
WO2018139073A1 (ja) 表示制御装置、第２の表示装置、表示制御装置の制御方法、および制御プログラム
JP2017010228A (ja) 情報処理装置、情報処理方法、プログラム
JP4235522B2 (ja) 画像処理装置、画像処理方法、およびプログラム
JP7401245B2 (ja) 画像合成装置、画像合成装置の制御方法およびプログラム
JP2008217119A (ja) システム、画像処理装置、画像処理方法
JP6765846B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP2005251118A (ja) 画像処理方法、画像処理装置
US12249090B2 (en) Information processing device, information processing method, and computer program
JP2009193471A (ja) 表示制御装置、表示処理装置、アプリケーションサーバ、表示制御方法、表示処理方法、アプリケーション実行方法、制御プログラム、および、記録媒体
JP5520772B2 (ja) 立体画像の表示システム及び表示方法
JP2015121892A (ja) 画像処理装置、画像処理方法
JP2014174643A (ja) 画像処理システム、その制御方法、画像処理装置、及び画像処理方法
JP4168768B2 (ja) 画像描画表示システムおよび多地点画像描画表示システム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180604

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180604

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20190523

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190531

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190729

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190809

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190906

R151 Written notification of patent or utility model registration

Ref document number: 6585929

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151