JP2017199954A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2017199954A5 JP2017199954A5 JP2016087032A JP2016087032A JP2017199954A5 JP 2017199954 A5 JP2017199954 A5 JP 2017199954A5 JP 2016087032 A JP2016087032 A JP 2016087032A JP 2016087032 A JP2016087032 A JP 2016087032A JP 2017199954 A5 JP2017199954 A5 JP 2017199954A5
- Authority
- JP
- Japan
- Prior art keywords
- wireless communication
- mounted display
- gaze direction
- head
- processing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims 2
- 238000004590 computer program Methods 0.000 claims 2
- XEEYBQQBJWHFJM-UHFFFAOYSA-N iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 3
- 230000002093 peripheral Effects 0.000 description 2
- 235000005979 Citrus limon Nutrition 0.000 description 1
- 240000002268 Citrus limon Species 0.000 description 1
- 240000007119 Malus pumila Species 0.000 description 1
- 240000008790 Musa x paradisiaca Species 0.000 description 1
- 235000021016 apples Nutrition 0.000 description 1
- 235000021015 bananas Nutrition 0.000 description 1
- 230000000875 corresponding Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Description
（１）本発明の第１の形態によれば、頭部装着型表示装置が提供される。この頭部装着型表示装置は、使用者の視線方向を検出する視線方向検出部と、無線通信部と、前記無線通信部を介して、外部の情報処理装置に対して情報の提示を行う処理部と、を備える。前記処理部は、前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、前記受信したデータに基づく提示情報を、前記情報処理装置に送信する。この形態の頭部装着型表示装置によれば、使用者の視線方向を含む所定の範囲に存在する近距離無線通信端末から受信したデータに基づく提示情報を、情報処理装置に送ることができる。このため、情報処理装置の操作者は、頭部装着型表示装置を装着した使用者と離れた位置に居ながら、その使用者の視線方向の周辺の情報を受けることができる。したがって、この形態の頭部装着型表示装置によれば、離れた位置にいる情報処理装置の操作者に対して、視線方向の情報を適切かつ効率的に提示することができる。 (1) According to a first aspect of the present invention, a head mounted display is provided. This head-mounted display device is a process of presenting information to an external information processing apparatus via a gaze direction detection unit that detects a gaze direction of a user, a wireless communication unit, and the wireless communication unit. And a unit. The processing unit identifies a predetermined range including the gaze direction detected by the gaze direction detection unit, and, via the wireless communication unit, determines between the short distance wireless communication terminal existing in the identified predetermined range and the specified range. Communication is performed, data is received from the near field communication terminal, and presentation information based on the received data is transmitted to the information processing apparatus. According to the head-mounted display device of this aspect, it is possible to send presentation information based on data received from the short distance wireless communication terminal present in a predetermined range including the direction of the user's line of sight to the information processing device. For this reason, the operator of the information processing apparatus can receive the peripheral information of the line of sight of the user while being away from the user wearing the head-mounted display device. Therefore, according to the head-mounted display device of this aspect, it is possible to appropriately and efficiently present the information of the sight line direction to the operator of the information processing apparatus at the distant position.
（６）本発明の第２の形態によれば、頭部装着型表示装置と、情報処理装置と、を備える表示システムが提供される。この表示システムの前記頭部装着型表示装置は、使用者の視線方向を検出する視線方向検出部と、無線通信部と、前記無線通信部を介して、前記情報処理装置に対して情報の提示を行う処理部と、を備える。前記処理部は、前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、前記受信したデータに基づく提示情報を、前記情報処理装置に送信する。この表示システムの前記情報処理装置は、前記頭部装着型表示装置から送られてくる前記提示情報を受信し、前記受信した提示情報に基づいて表示を行う。この形態の表示システムによれば、頭部装着型表示装置を装着した使用者の視線方向を含む所定の範囲に存在する近距離無線通信端末から受信したデータに基づく提示情報を、情報処理装置に送ることができる。このため、情報処理装置の操作者は、頭部装着型表示装置を装着した使用者と離れた位置に居ながら、その使用者の視線方向の周辺の情報を受けることができる。したがって、この形態の表示システムは、離れた位置にいる情報処理装置の操作者に対して、頭部装着型表示装置を装着した使用者の視線方向の情報を適切かつ効率的に提示することができる。 (6) According to a second aspect of the present invention, there is provided a display system comprising a head-mounted display device and an information processing device. The head-mounted display device of the display system presents information to the information processing device via a gaze direction detection unit that detects a gaze direction of the user, a wireless communication unit, and the wireless communication unit. And a processing unit for The processing unit identifies a predetermined range including the gaze direction detected by the gaze direction detection unit, and, via the wireless communication unit, determines between the short distance wireless communication terminal existing in the identified predetermined range and the specified range. Communication is performed, data is received from the near field communication terminal, and presentation information based on the received data is transmitted to the information processing apparatus. The information processing device of the display system receives the presentation information sent from the head-mounted display device, and performs display based on the received presentation information. According to the display system of this aspect, the information processing apparatus is provided with presentation information based on data received from the short distance wireless communication terminal existing in a predetermined range including the line of sight direction of the user wearing the head-mounted display device. Can be sent. For this reason, the operator of the information processing apparatus can receive the peripheral information of the line of sight of the user while being away from the user wearing the head-mounted display device. Therefore, the display system of this aspect can appropriately and efficiently present information on the line of sight of the user wearing the head-mounted display device to the operator of the information processing apparatus at a distant position. it can.
受援者ＨＭＤ４００は、支援者ＨＭＤ１００から送られてくる提示情報を受信し、提示情報を表示する（工程Ｐ９）。具体的には、提示情報に基づいて受援者ＨＭＤ４００の画像処理部１４５（図６）を制御して、受援者ＨＭＤ４００の表示制御部１４７（図６）に提示情報の表示を実行させる。この表示は、工程Ｐ４で表示している撮像画像に重ね合わせて表示する。受援者ＨＭＤ４００によって実行される工程Ｐ１，Ｐ４，Ｐ９が、買い物処理部４５５（図８）に対応している。 The supporter HMD 400 receives the presentation information sent from the supporter HMD 100, and displays the presentation information (process P9). Specifically, based on the presentation information, the image processing unit 145 (FIG. 6) of the supporter HMD 400 is controlled to cause the display control unit 147 (FIG. 6) of the supporter HMD 400 to display the presentation information. This display is displayed superimposed on the captured image displayed in the process P4 . Steps P1, P4, and P9 executed by the support person HMD 400 correspond to the shopping processing unit 455 (FIG. 8).
さらに、視界ＶＲ２ａには、先に説明した所定範囲ＶＡ（図１３参照）に含まれるフルーツ群Ｃ２〜Ｃ４についての提示情報が表示される。この提示情報は、ステップＳ１９０（図１１）によって支援者ＨＭＤ１００から送信されたセットのデータに基づいて作成されたものである。具体的には、セットのデータに含まれる各ＢＬＥ端末５０２〜５０４の撮像画像上の位置に、セットのデータに含まれる提示情報を表示する。すなわち、バナナの群Ｃ２のＢＬＥ端末５０２から得られた提示情報Ｍ２を、そのＢＬＥ端末５０２の位置に表示する。リンゴの群Ｃ３のＢＬＥ端末５０３から得られた提示情報Ｍ３を、そのＢＬＥ端末５０３の位置に表示する。レモンの群Ｃ４のＢＬＥ端末５０４から得られた提示情報Ｍ４を、そのＢＬＥ端末５０４の位置に表示する。各提示情報Ｍ２〜Ｍ４は、商品名、産地、値段、食べ頃、および特徴を示すものである。 Furthermore, presentation information about the fruit groups C2 to C4 included in the predetermined range VA (see FIG. 13) described above is displayed on the view VR2a. This presentation information is created based on the set of data transmitted from the supporter HMD 100 at step S190 (FIG. 11). Specifically, the presentation information included in the data of the set is displayed at a position on the captured image of each of the BLE terminals 502 to 504 included in the data of the set. That is, the presentation information M2 obtained from the BLE terminal 502 of the group C2 of bananas is displayed at the position of the BLE terminal 502. The presentation information M3 obtained from the BLE terminal 503 of the group C3 of apples is displayed at the position of the BLE terminal 503. The presentation information M4 obtained from the BLE terminal 504 of the group C4 of lemons is displayed at the position of the BLE terminal 504. Each of the presentation information M2 to M4 indicates a trade name, a production area, a price, a time of eating, and a feature.
さらに、視界ＶＲ２ａには、視線方向を含む所定範囲（図示せず）に含まれるゴルフクラブ群、図示の例では、「アイアン」の群Ｃ１２と、「ドライバー」の群Ｃ１３についての提示情報が表示される。この提示情報は、支援者ＨＭＤ１００から送信されたセットのデータに基づいて作成されたものである。具体的には、セットのデータに含まれる各ＢＬＥ端末６０２，６０３の撮像画像上の位置に対応付けた位置に、セットのデータに含まれる提示情報を表示する。詳しくは、アイアンの群Ｃ１２のＢＬＥ端末６０２の撮像画像上の位置に基づいて、画像のパターン認識によって、ＢＬＥ端末６０２に対応したゴルフクラブ群の位置を特定し、その特定した位置の上部を、「対応付けた位置」として提示情報Ｍ１２を表示する。ドライバーの群Ｃ１３のＢＬＥ端末６０３から得られた提示情報Ｍ１３についても、同様に、そのＢＬＥ端末６０３の位置に基づく位置に表示する。 Furthermore, the visual field VR2a displays golf club groups included in a predetermined range (not shown) including the line of sight direction, and in the example shown, group C12 of "iron" and group C13 of "driver" Be done. This presentation information is created based on the set of data transmitted from the supporter HMD 100. Specifically, the presentation information included in the data of the set is displayed at the position associated with the position on the captured image of each of the BLE terminals 602 and 603 included in the data of the set. Specifically, the position of the golf club group corresponding to the BLE terminal 602 is specified by pattern recognition of the image based on the position on the captured image of the BLE terminal 602 of the iron group C12, and the upper part of the specified position is The presentation information M12 is displayed as the "associated position". The presentation information M13 obtained from the BLE terminal 603 of the driver group C13 is similarly displayed at a position based on the position of the BLE terminal 603.
Claims (8)
使用者の視線方向を検出する視線方向検出部と、
無線通信部と、
前記無線通信部を介して、外部の情報処理装置に対して情報の提示を行う処理部と、
を備え、
前記処理部は、
前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、
前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、
前記受信したデータに基づく提示情報を、前記情報処理装置に送信する、
頭部装着型表示装置。 A head mounted display,
A gaze direction detection unit that detects a gaze direction of the user;
Wireless communication unit,
A processing unit that presents information to an external information processing apparatus via the wireless communication unit;
Equipped with
The processing unit is
Specifying a predetermined range including the gaze direction detected by the gaze direction detection unit;
Communication is performed with the near-field wireless communication terminal existing in the specified predetermined range via the wireless communication unit, and data is received from the near-field wireless communication terminal,
Transmitting presentation information based on the received data to the information processing apparatus;
Head-mounted display.
前記使用者が視認する方向を撮像するカメラを備え、
前記処理部は、
前記カメラによって撮像された画像の少なくとも一部を送信用撮像画像として、前記無線通信部を介して前記情報処理装置に対して送信する、
頭部装着型表示装置。 The head mounted display according to claim 1, wherein
A camera for capturing an image of a direction viewed by the user;
The processing unit is
At least a part of the image captured by the camera is transmitted to the information processing apparatus via the wireless communication unit as a transmission captured image.
Head-mounted display.
前記処理部は、
前記送信用撮像画像において前記所定の範囲と重複する部分を特定し、該重複する部分について画像加工を行う、
頭部装着型表示装置。 The head mounted display according to claim 2, wherein
The processing unit is
Identifying a portion overlapping the predetermined range in the transmission pickup image, and performing image processing on the overlapping portion;
Head-mounted display.
前記所定の範囲に存在する近距離無線通信端末から受信する前記データは、ショッピング施設内に陳列された商品の種類毎のデータである、
頭部装着型表示装置。 The head mounted display according to any one of claims 1 to 3, wherein
The data received from the short distance wireless communication terminal existing in the predetermined range is data for each type of goods displayed in the shopping facility.
Head-mounted display.
前記外部の情報処理装置は、当該頭部装着型表示装置とは相違する別の頭部装着型表示装置である、
頭部装着型表示装置。 The head mounted display according to any one of claims 1 to 4, wherein
The external information processing apparatus is another head mounted display different from the head mounted display.
Head-mounted display.
前記頭部装着型表示装置は、
使用者の視線方向を検出する視線方向検出部と、
無線通信部と、
前記無線通信部を介して、前記情報処理装置に対して情報の提示を行う処理部と、
を備え、
前記処理部は、
前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、
前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、
前記受信したデータに基づく提示情報を、前記情報処理装置に送信し、
前記情報処理装置は、
前記頭部装着型表示装置から送られてくる前記提示情報を受信し、
前記受信した提示情報に基づいて表示を行う、
表示システム。 A display system comprising a head-mounted display device and an information processing device, the display system comprising:
The head mounted display is:
A gaze direction detection unit that detects a gaze direction of the user;
Wireless communication unit,
A processing unit that presents information to the information processing apparatus via the wireless communication unit;
Equipped with
The processing unit is
Specifying a predetermined range including the gaze direction detected by the gaze direction detection unit;
Communication is performed with the near-field wireless communication terminal existing in the specified predetermined range via the wireless communication unit, and data is received from the near-field wireless communication terminal,
Transmitting presentation information based on the received data to the information processing apparatus;
The information processing apparatus is
Receiving the presentation information sent from the head mounted display;
Display based on the received presentation information,
Display system.
前記無線通信部を介して、外部の情報処理装置に対して情報の提示を行う工程を備え、
前記工程は、
前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、
前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、
前記受信したデータに基づく提示情報を、前記情報処理装置に送信する、
頭部装着型表示装置の制御方法。 A control method of a head-mounted display device including a gaze direction detection unit that detects a gaze direction of a user, and a wireless communication unit,
Providing a step of presenting information to an external information processing apparatus via the wireless communication unit;
Said process is
Specifying a predetermined range including the gaze direction detected by the gaze direction detection unit;
Communication is performed with the near-field wireless communication terminal existing in the specified predetermined range via the wireless communication unit, and data is received from the near-field wireless communication terminal,
Transmitting presentation information based on the received data to the information processing apparatus;
Control method of a head mounted display.
前記無線通信部を介して、外部の情報処理装置に対して情報の提示を行う機能をコンピューターに実現させ、
前記機能は、
前記視線方向検出部によって検出された視線方向を含む所定の範囲を特定し、
前記無線通信部を介して、前記特定された所定の範囲に存在する近距離無線通信端末と間で通信を行い、前記近距離無線通信端末からデータを受信し、
前記受信したデータに基づく提示情報を、前記情報処理装置に送信する、
コンピュータープログラム。 A computer program for controlling a head-mounted display device comprising: a gaze direction detection unit that detects a gaze direction of a user; and a wireless communication unit,
Causing a computer to realize a function of presenting information to an external information processing apparatus via the wireless communication unit;
The function is
Specifying a predetermined range including the gaze direction detected by the gaze direction detection unit;
Communication is performed with the near-field wireless communication terminal existing in the specified predetermined range via the wireless communication unit, and data is received from the near-field wireless communication terminal,
Transmitting presentation information based on the received data to the information processing apparatus;
Computer program.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016087032A JP6784056B2 (en) | 2016-04-25 | 2016-04-25 | Head-mounted display, display system, head-mounted display control method, and computer program |
| US15/488,109 US20170308157A1 (en) | 2016-04-25 | 2017-04-14 | Head-mounted display device, display system, control method for head-mounted display device, and computer program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2016087032A JP6784056B2 (en) | 2016-04-25 | 2016-04-25 | Head-mounted display, display system, head-mounted display control method, and computer program |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2017199954A JP2017199954A (en) | 2017-11-02 |
| JP2017199954A5 true JP2017199954A5 (en) | 2019-05-09 |
| JP6784056B2 JP6784056B2 (en) | 2020-11-11 |
Family
ID=60239623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2016087032A Active JP6784056B2 (en) | 2016-04-25 | 2016-04-25 | Head-mounted display, display system, head-mounted display control method, and computer program |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP6784056B2 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7179511B2 (en) * | 2018-07-09 | 2022-11-29 | 東芝テック株式会社 | Information processing device and information processing method |
| TWI814447B (en) * | 2022-06-15 | 2023-09-01 | 和碩聯合科技股份有限公司 | Communication modulel and head-mounted display device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002297966A (en) * | 2001-03-30 | 2002-10-11 | Toshiba Corp | Perishable commodity purchasing method and system using wearable computer, wearable computer for purchasing perishable commodity and program for purchasing perishable commodity |
| JP2005109920A (en) * | 2003-09-30 | 2005-04-21 | Ricoh Co Ltd | Image information/tag information control system, digital camera, portable telephone, image information/tag information control method, image processing program, and recording medium |
| JP5200819B2 (en) * | 2008-09-25 | 2013-06-05 | ブラザー工業株式会社 | Goods management system |
| JP5651386B2 (en) * | 2010-06-23 | 2015-01-14 | ソフトバンクモバイル株式会社 | Eyeglass type display device |
-
2016
- 2016-04-25 JP JP2016087032A patent/JP6784056B2/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10656424B2 (en) | Information display terminal, information display system, and information display method | |
| US11386600B2 (en) | System and method for displaying virtual image through HMD device | |
| US9401048B2 (en) | Methods and apparatus for augmented reality target detection | |
| US20160217794A1 (en) | Information processing apparatus, information processing method, and program | |
| WO2017025813A3 (en) | Image processing method and apparatus | |
| US20160342204A1 (en) | Head mounted display and method for controlling the same | |
| JP6340301B2 (en) | Head mounted display, portable information terminal, image processing apparatus, display control program, display control method, and display system | |
| US8923805B2 (en) | Emergency rescue system and help-seeking device and emergency rescue method | |
| US10692113B2 (en) | Method for providing customized information through advertising in simulation environment, and associated simulation system | |
| MX2017004469A (en) | Apparatus and method of scanning products and interfacing with a customer's personal mobile device. | |
| TW201624304A (en) | Docking system | |
| CN111492405B (en) | Head-mounted display device and method thereof | |
| KR20160015972A (en) | The Apparatus and Method for Wearable Device | |
| JP6076304B2 (en) | Article information providing apparatus, article information providing system, article information providing method, and article information providing program | |
| US20170308157A1 (en) | Head-mounted display device, display system, control method for head-mounted display device, and computer program | |
| JP2012227814A5 (en) | ||
| KR20170022078A (en) | Display apparatus and controlling method thereof | |
| JP2016009431A5 (en) | ||
| US11257111B2 (en) | Content output system, terminal device, content output method, and recording medium | |
| US20150279112A1 (en) | Method for generating a content in augmented reality mode | |
| JP2017199954A5 (en) | ||
| JP2018022408A5 (en) | ||
| JP2016177097A5 (en) | ||
| KR20140130767A (en) | The smart fitting apparatus and method based real image and social service system using thesame | |
| KR101759799B1 (en) | Method for providing 3d image |