JP2015072415A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2015072415A5 JP2015072415A5 JP2013208872A JP2013208872A JP2015072415A5 JP 2015072415 A5 JP2015072415 A5 JP 2015072415A5 JP 2013208872 A JP2013208872 A JP 2013208872A JP 2013208872 A JP2013208872 A JP 2013208872A JP 2015072415 A5 JP2015072415 A5 JP 2015072415A5
- Authority
- JP
- Japan
- Prior art keywords
- display device
- image
- user
- sound
- display position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 claims 17
- 230000000875 corresponding Effects 0.000 claims 7
- 230000035945 sensitivity Effects 0.000 claims 6
- 238000006243 chemical reaction Methods 0.000 claims 4
- 230000005484 gravity Effects 0.000 claims 3
- 230000005236 sound signal Effects 0.000 claims 2
Description
（６）上記形態の表示装置において、複数の時点における外景の画像を取得する画像取得部を備え；前記表示位置設定部は、複数の時点における前記外景の画像の変化と前記特定の方向とに基づいて前記画像表示位置を設定してもよい。この形態の表示装置によれば、音源方向がより詳細に使用者に認識され、使用者に文字画像が視認される位置が音源方向の近くに設定されるため、使用者に音源方向と目標音源が発する音声を表す文字画像とをより関連付けて認識させやすい。 (6) In the display device of the embodiment includes an image acquiring unit that acquires an image of the outside scene at a plurality of time points; pre Symbol Display position setting section, the outer changes the specific direction of the image of the scene at a plurality of time points The image display position may be set based on the above. According to the display device of this aspect, the sound source direction is recognized by the user in more detail, and the position at which the character image is visually recognized by the user is set near the sound source direction. It is easy to recognize and associate with a character image representing a voice generated by.
Claims (29)
画像を表す画像光を生成し、使用者に前記画像光を視認させると共に、外景を透過させる画像表示部と、
音声を取得する音声取得部と、
前記音声を文字により画像として表した文字画像に変換する変換部と、
特定の方向を設定する特定方向設定部と、
前記特定の方向に基づいて、使用者の視野における前記文字画像を表す文字画像光を視認させる位置である画像表示位置を設定する表示位置設定部と、を備える、表示装置。 A transmissive display device,
An image display unit that generates image light representing an image, allows a user to visually recognize the image light, and transmits an outside scene;
An audio acquisition unit for acquiring audio;
A conversion unit for converting the sound into a character image represented as an image by characters;
A specific direction setting unit for setting a specific direction;
A display position setting unit configured to set an image display position that is a position for visually recognizing the character image light representing the character image in the visual field of the user based on the specific direction.
前記表示位置設定部は、前記画像表示位置を、使用者の視野における前記特定の方向に対応する位置に重複しないように設定する、表示装置。 The display device according to claim 1,
The display position setting unit sets the image display position so as not to overlap with a position corresponding to the specific direction in a user's visual field.
前記表示位置設定部は、前記画像表示位置を、使用者の視野における中心以外に対応する位置に設定する、表示装置。 The display device according to claim 1 or 2,
The display position setting unit sets the image display position to a position corresponding to a position other than the center in the user's visual field.
前記音声取得部は、音源から前記音声取得部への方向に応じて音声を取得する感度が異なり、
前記特定の方向は、取得された音声の感度に基づいて設定される、表示装置。 A display device according to any one of claims 1 to 3,
The sound acquisition unit has different sensitivities for acquiring sound according to the direction from the sound source to the sound acquisition unit,
The display device in which the specific direction is set based on the sensitivity of the acquired sound.
前記特定の方向は、前記音声取得部から音源への方向である、表示装置。 A display device according to any one of claims 1 to 3,
The display device, wherein the specific direction is a direction from the sound acquisition unit to a sound source.
複数の時点における外景の画像を取得する画像取得部を備え、
前記表示位置設定部は、複数の時点における前記外景の画像の変化と前記特定の方向とに基づいて前記画像表示位置を設定する、表示装置。 The display device according to any one of claims 1 to 5, further comprising:
An image acquisition unit that acquires images of outside scenes at a plurality of points in time,
Before Symbol Display position setting unit sets the image display position based on the direction change of the particular image of the outer scene at a plurality of time points, the display device.
前記表示装置から音源までの距離を特定する距離特定部を備え、
前記表示位置設定部は、前記特定された距離に基づいて、前記文字画像光の大きさの変化と前記画像表示位置と設定との少なくとも一方を行なう、表示装置。 The display device according to any one of claims 1 to 6, further comprising:
A distance specifying unit for specifying a distance from the display device to the sound source;
The display device, wherein the display position setting unit performs at least one of a change in the size of the character image light and the image display position and setting based on the specified distance.
前記表示装置から音源までの距離を特定する距離特定部を備え、
前記変換部は、前記特定された距離に基づいて前記文字画像の種類を変更する、表示装置。 The display device according to any one of claims 1 to 7, further comprising:
A distance specifying unit for specifying a distance from the display device to the sound source;
The said conversion part is a display apparatus which changes the kind of said character image based on the specified distance.
前記音声取得部は、音源から前記音声取得部への方向に応じて音声の音量を取得する感度が異なり、
前記表示位置設定部は、異なる同じ音源が発する方向ごとに異なって取得された音声の音量に基づいて、前記画像表示位置を設定する、表示装置。 A display device according to any one of claims 1 to 8,
The sound acquisition unit is different in sensitivity for acquiring sound volume according to the direction from the sound source to the sound acquisition unit,
The display device, wherein the display position setting unit sets the image display position based on a volume of sound acquired differently for each direction in which different same sound sources emit.
前記音声取得部は、音源から前記音声取得部への方向に応じて音声を取得する感度が異なり、前記特定の方向からの音声を取得する感度が最大となるように設定される、表示装置。 A display device according to any one of claims 1 to 9,
The display device, wherein the sound acquisition unit is set so that sensitivity for acquiring sound differs according to a direction from a sound source to the sound acquisition unit, and sensitivity for acquiring sound from the specific direction is maximized.
複数の音源から取得される異なる種類の音声を前記音声の種類ごとに識別する音声識別部と、
使用者による操作を受け付ける操作部と、を備え、
前記特定方向設定部は、前記操作に基づいて、前記音声取得部から、複数の前記音声のうち一の前記音声が取得された音源までの方向である特定音源方向を特定し、
前記表示位置設定部は、使用者の視野において、前記一の前記音声を表す前記文字画像光を視認させる位置を、前記特定音源方向に対応する位置の近くに設定する、表示装置。 The display device according to any one of claims 1 to 10, further comprising:
A voice identification unit for identifying different types of voice acquired from a plurality of sound sources for each type of voice;
An operation unit for receiving an operation by a user,
The specific direction setting unit specifies a specific sound source direction that is a direction from the sound acquisition unit to a sound source from which one of the plurality of sounds is acquired based on the operation,
The display position setting unit is configured to set, in a user's field of view, a position where the character image light representing the one voice is visually recognized near a position corresponding to the specific sound source direction.
前記表示位置設定部は、使用者に視野において、前記一の前記音声を表す前記画像光を視認させる位置を、複数の前記特定音源方向に対応する位置のいずれにも重複しない位置に設定する、表示装置。 The display device according to claim 11,
The display position setting unit sets a position at which the user visually recognizes the image light representing the one sound in a visual field to a position that does not overlap any of a plurality of positions corresponding to the specific sound source directions. Display device.
前記画像表示部は、複数の前記音声を前記音声の種類ごとに異なる前記文字画像光に生成し、使用者に複数の前記音声の種類ごとの前記画像光を視認させ、
前記操作は、使用者の視野において視認される複数の前記音声の種類ごとの前記文字画像光から、一の前記特定音源方向からの前記音声に対応する前記文字画像光を特定する操作である、表示装置。 A display device according to claim 11 or claim 12,
The image display unit generates a plurality of the voices in the character image light that is different for each type of sound, and allows a user to visually recognize the image light for each of the plurality of types of sound,
The operation is an operation of specifying the character image light corresponding to the sound from one specific sound source direction from the character image light for each of a plurality of types of the sound visually recognized in the user's visual field. Display device.
前記画像表示部は、前記音声取得部が前記音声を取得した時点から所定の時間遅らせて前記文字画像光を虚像として使用者に認識させる、表示装置。 A display device according to any one of claims 1 to 13,
The image display unit is a display device that causes a user to recognize the character image light as a virtual image after a predetermined time delay from the time when the sound acquisition unit acquires the sound.
使用者の視線方向を推定する視線方向推定部を備え、
前記画像表示部は、使用者の頭部に装着された状態において使用者に前記画像光を視認させ、
前記表示位置設定部は、前記特定の方向と前記視線方向との関係に基づいて前記画像表示位置を設定する、表示装置。 The display device according to any one of claims 1 to 14, further comprising:
A gaze direction estimation unit for estimating the gaze direction of the user,
The image display unit allows the user to visually recognize the image light in a state of being worn on the user's head,
The display position setting unit sets the image display position based on a relationship between the specific direction and the line-of-sight direction.
前記表示位置設定部は、前記視線方向と前記特定の方向とがなす角度である特定角度が第１の閾値未満の場合に、使用者の視野における前記特定の方向に対応する位置の近くに前記画像表示位置を設定し、前記特定角度が第１の閾値以上の場合に、前記特定の方向とは無関係に前記画像表示位置を設定する、表示装置。 The display device according to claim 15,
The display position setting unit, when a specific angle, which is an angle formed by the line-of-sight direction and the specific direction, is less than a first threshold, is near the position corresponding to the specific direction in the user's visual field. A display device that sets an image display position, and sets the image display position regardless of the specific direction when the specific angle is equal to or greater than a first threshold.
外景の画像を取得する画像取得部を備え、
前記画像表示部は、前記視線方向と前記特定の方向とがなす角度である特定角度が第２の閾値以上の場合に、前記画像取得部が取得した前記特定の方向の画像を表す画像光である特定方向画像光を生成して使用者に視認させ、前記特定角度が第２の閾値未満の場合に、前記特定方向画像光を生成せず、
前記表示位置設定部は、前記特定角度が第２の閾値以上の場合に、前記特定方向画像光を認識させる位置を、前記画像表示位置に重複させず、かつ、前記画像表示位置の近くに設定し、前記特定角度が第２の閾値未満の場合に、使用者の視野における前記特定の方向に対応する位置の近くに前記画像表示位置を設定する、表示装置。 The display device according to claim 15 or 16, further comprising:
An image acquisition unit for acquiring an image of the outside scene,
The image display unit is an image light that represents an image in the specific direction acquired by the image acquisition unit when a specific angle that is an angle formed by the line-of-sight direction and the specific direction is equal to or greater than a second threshold. When a specific direction image light is generated and visually recognized by the user, and the specific angle is less than a second threshold, the specific direction image light is not generated,
The display position setting unit sets a position for recognizing the image light in the specific direction not to overlap the image display position and close to the image display position when the specific angle is equal to or greater than a second threshold. And when the said specific angle is less than a 2nd threshold value, the said image display position is set near the position corresponding to the said specific direction in a user's visual field.
前記取得された音声と、前記取得された音声とは異なる特定音声と、を識別する音声識別部を備え、
前記変換部は、前記取得された音声と前記特定音声とを異なる種類の前記文字画像に変換する、表示装置。 The display device according to any one of claims 1 to 17, further comprising:
A voice identification unit for identifying the acquired voice and a specific voice different from the acquired voice;
The said conversion part is a display apparatus which converts the acquired audio | voice and the said specific audio | voice into the said character image of a different kind.
通信によって音声信号を取得する通信部を備え、
前記特定音声は、前記通信部によって取得された音声信号に基づいて出力される音声である、表示装置。 The display device according to claim 18, further comprising:
A communication unit that acquires an audio signal by communication,
The display device, wherein the specific sound is a sound output based on a sound signal acquired by the communication unit.
画像を表す画像光を生成し、使用者の頭部に装着された状態において使用者に前記画像光を視認させると共に、外景を透過させる画像表示部と、
音声を取得する音声取得部と、
前記音声を文字により画像として表した文字画像に変換する変換部と、
使用者の視線方向を推定する視線方向推定部と、
前記視線方向の変化に基づいて、使用者の視野における前記文字画像を表す文字画像光を視認させる位置である画像表示位置を設定する表示位置設定部と、を備える、頭部装着型表示装置。 A transmissive head-mounted display device,
An image display unit that generates image light representing an image and allows the user to visually recognize the image light while being mounted on the user's head;
An audio acquisition unit for acquiring audio;
A conversion unit for converting the sound into a character image represented as an image by characters;
A gaze direction estimation unit that estimates the gaze direction of the user;
A head-mounted display device comprising: a display position setting unit that sets an image display position that is a position for visually recognizing the character image light representing the character image in the visual field of the user based on the change in the line-of-sight direction.
前記音声取得部は、音源から前記音声取得部への方向に応じて音声の音量を取得する感度が異なり、
前記表示位置設定部は、異なる同じ音源が発する方向ごとに異なって取得された音声の音量に基づいて、前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to claim 20,
The sound acquisition unit is different in sensitivity for acquiring sound volume according to the direction from the sound source to the sound acquisition unit,
The head-mounted display device, wherein the display position setting unit sets the image display position based on sound volume obtained differently for each direction in which different same sound sources emit.
前記視線方向推定部は、前記文字画像光が使用者に認識されている表示状態を基準として、前記視線方向の角速度と角度の変化量との少なくとも一方の特定値を推定し、
前記表示位置設定部は、前記特定値が一定値を超えた場合に、使用者の視野における中央部以外に前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to claim 20 or 21,
The line-of-sight direction estimation unit estimates a specific value of at least one of an angular velocity and an angle change amount in the line-of-sight direction with reference to a display state in which the character image light is recognized by a user,
The display position setting unit is a head-mounted display device that sets the image display position other than the central part in the user's visual field when the specific value exceeds a certain value.
前記視線方向推定部は、重力方向と前記重力方向に垂直な水平方向とを推定し、
前記表示位置設定部は、前記重力方向と前記水平方向に対して前記表示状態における前記特定値に基づいて、使用者の視野における前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to claim 22,
The line-of-sight direction estimation unit estimates a gravity direction and a horizontal direction perpendicular to the gravity direction,
The head-mounted display device, wherein the display position setting unit sets the image display position in a user's field of view based on the specific value in the display state with respect to the gravity direction and the horizontal direction.
前記表示位置設定部は、前記角度の変化量が第３の閾値以上である場合に、使用者の視野における中央部以外に前記画像表示位置を設定し、前記角度の変化量が第３の閾値未満である場合に、使用者の視野における予め設定された位置に前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to claim 22 or claim 23,
The display position setting unit sets the image display position other than the central portion in the user's visual field when the angle change amount is equal to or greater than a third threshold value, and the angle change amount is a third threshold value. The head-mounted display device that sets the image display position to a preset position in the user's visual field when the number is less than.
前記表示位置設定部は、前記角度の変化量が第４の閾値未満の状態で所定の時間が経過した場合に、使用者の視野における中央部分に前記画像表示位置を設定し、前記角度の変化量が第４の閾値以上の場合に、使用者の視野における中央部以外に前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to any one of claims 22 to 24,
The display position setting unit sets the image display position at a central portion in the user's field of view when a predetermined time has elapsed with the change amount of the angle being less than a fourth threshold, and the change of the angle. A head-mounted display device that sets the image display position in a region other than the center in the user's visual field when the amount is equal to or greater than a fourth threshold.
前記表示位置設定部は、前記角速度が第５の閾値以上である場合に、使用者の視野における中央部以外に前記画像表示位置を設定し、前記角速度が第５の閾値未満である場合に、使用者の視野における予め設定された位置に前記画像表示位置を設定する、頭部装着型表示装置。 The head-mounted display device according to any one of claims 22 to 25,
The display position setting unit sets the image display position other than the central part in the user's visual field when the angular velocity is equal to or greater than a fifth threshold, and when the angular velocity is less than the fifth threshold, A head-mounted display device that sets the image display position at a preset position in a user's visual field.
前記表示位置設定部は、前記角速度が第６の閾値未満の状態で所定の時間が経過した場合に、使用者の視野における中央部に前記画像表示位置を設定し、前記角速度が第６の閾値以上の場合に、使用者の視野における中央部以外に前記画像表示位置を設定する、頭部装着型表示装置。 A head-mounted display device according to any one of claims 22 to 26, wherein:
The display position setting unit sets the image display position at a central portion in the user's field of view when the predetermined time has elapsed with the angular velocity being less than a sixth threshold, and the angular velocity is a sixth threshold. In the above case, the head-mounted display device that sets the image display position other than the central portion in the visual field of the user.
音声を取得する工程と、
前記音声を文字により画像として表した文字画像に変換する工程と、
前記文字画像を表す画像光である文字画像光を生成し、使用者に前記文字画像光を視認させると共に、外景を透過させる工程と、
特定の方向を設定する工程と、
前記特定の方向に基づいて、使用者の視野における前記文字画像光を視認させる位置を設定する工程と、を備える、制御方法。 A control method for a transmissive display device, which generates an image light representing an image, allows a user to visually recognize the image light, and includes an image display unit that transmits an outside scene.
Obtaining audio,
Converting the sound into a character image represented as an image by characters;
Generating character image light that is image light representing the character image, allowing the user to visually recognize the character image light, and transmitting the outside scene;
Setting a specific direction;
And a step of setting a position for visually recognizing the character image light in the visual field of the user based on the specific direction.
音声を取得する工程と、
前記音声を文字により画像として表した文字画像に変換する工程と、
前記文字画像を表す画像光である文字画像光を生成し、画像表示部が使用者の頭部に装着された状態において使用者に前記文字画像光を視認させると共に、外景を透過させる工程と、
使用者の視線方向を推定する工程と、
前記視線方向に基づいて、使用者の視野における前記文字画像光を視認させる位置を設定する工程と、を備える、制御方法。 A transmissive head-mounted display device having an image display unit that generates image light representing an image and allows the user to visually recognize the image light while being mounted on the user's head, and transmits an outside scene. Control method,
Obtaining audio,
Converting the sound into a character image represented as an image by characters;
Generating character image light that is image light representing the character image, allowing the user to visually recognize the character image light while the image display unit is mounted on the user's head, and transmitting the outside scene;
Estimating a user's gaze direction;
And a step of setting a position for visually recognizing the character image light in the visual field of the user based on the line-of-sight direction.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013208872A JP6364735B2 (en) | 2013-10-04 | 2013-10-04 | Display device, head-mounted display device, display device control method, and head-mounted display device control method |
| US14/100,421 US9542958B2 (en) | 2012-12-18 | 2013-12-09 | Display device, head-mount type display device, method of controlling display device, and method of controlling head-mount type display device |
| CN201810908748.XA CN108957761B (en) | 2012-12-18 | 2013-12-16 | Display device and control method thereof, head-mounted display device and control method thereof |
| CN201310689438.0A CN103869470B (en) | 2012-12-18 | 2013-12-16 | Display device and its control method, head-mounted display apparatus and its control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2013208872A JP6364735B2 (en) | 2013-10-04 | 2013-10-04 | Display device, head-mounted display device, display device control method, and head-mounted display device control method |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2015072415A JP2015072415A (en) | 2015-04-16 |
| JP2015072415A5 true JP2015072415A5 (en) | 2016-09-23 |
| JP6364735B2 JP6364735B2 (en) | 2018-08-01 |
Family
ID=53014811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2013208872A Active JP6364735B2 (en) | 2012-12-18 | 2013-10-04 | Display device, head-mounted display device, display device control method, and head-mounted display device control method |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP6364735B2 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3377962A1 (en) * | 2016-04-27 | 2018-09-26 | Rovi Guides, Inc. | Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment |
| US10025376B2 (en) | 2016-04-27 | 2018-07-17 | Rovi Guides, Inc. | Methods and systems for displaying additional content on a heads up display displaying a virtual reality environment |
| JP2019057047A (en) | 2017-09-20 | 2019-04-11 | 株式会社東芝 | Display control system, display control method and program |
| JPWO2022270455A1 (en) * | 2021-06-21 | 2022-12-29 | ||
| WO2022270456A1 (en) * | 2021-06-21 | 2022-12-29 | ピクシーダストテクノロジーズ株式会社 | Display control device, display control method, and program |
| CN114822172A (en) * | 2022-06-23 | 2022-07-29 | 北京亮亮视野科技有限公司 | Character display method and device based on AR glasses |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5286667B2 (en) * | 2006-02-22 | 2013-09-11 | コニカミノルタ株式会社 | Video display device and video display method |
| JP2008167373A (en) * | 2007-01-05 | 2008-07-17 | Brother Ind Ltd | Information presentation apparatus |
| JP2009239349A (en) * | 2008-03-25 | 2009-10-15 | Yamaha Corp | Photographing apparatus |
| JP5666219B2 (en) * | 2010-09-10 | 2015-02-12 | ソフトバンクモバイル株式会社 | Glasses-type display device and translation system |
| JP2012151544A (en) * | 2011-01-17 | 2012-08-09 | Casio Comput Co Ltd | Imaging apparatus and program |
| JP6017854B2 (en) * | 2011-06-24 | 2016-11-02 | 本田技研工業株式会社 | Information processing apparatus, information processing system, information processing method, and information processing program |
| JP6155622B2 (en) * | 2012-12-18 | 2017-07-05 | セイコーエプソン株式会社 | Display device, head-mounted display device, display device control method, and head-mounted display device control method |
-
2013
- 2013-10-04 JP JP2013208872A patent/JP6364735B2/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2015072415A5 (en) | ||
| US9805619B2 (en) | Intelligent glasses for the visually impaired | |
| US10642569B2 (en) | Methods and devices for identifying object in virtual reality communication, and virtual reality equipment | |
| JP2014137396A5 (en) | ||
| WO2014033571A3 (en) | Controlling light source(s) via a portable device | |
| EP3851972A3 (en) | Display apparatus and control methods thereof | |
| WO2015004916A3 (en) | Head mounted display device and control method for head mounted display device | |
| WO2015161240A3 (en) | Speaker verification | |
| WO2017204171A3 (en) | Information processing apparatus, image generation method, control method, and program | |
| MY192514A (en) | Vehicle identification methods and systems | |
| WO2016094109A3 (en) | Natural user interface camera calibration | |
| EP2816559A3 (en) | Translation system comprising display apparatus and server and control method thereof | |
| JP2012094151A (en) | Gesture identification device and identification method | |
| US10497277B2 (en) | Feedback provision method, system, and analysis device | |
| EP3023956A3 (en) | Monitoring camera system | |
| US20180144557A1 (en) | Method and user terminal for providing hologram image-based message service, and hologram image display device | |
| TW201310404A (en) | Sign language translation system, sign language translation apparatus and method thereof | |
| JP2017211864A5 (en) | ||
| JP2016537792A5 (en) | ||
| EP4243378A3 (en) | Method for identifying device, and device | |
| JP2015115849A5 (en) | ||
| CA2970343A1 (en) | Apparatus and method for centrally managing human interface sensors and actuators in interactive machines | |
| JP6364735B2 (en) | Display device, head-mounted display device, display device control method, and head-mounted display device control method | |
| JP2014155083A5 (en) | ||
| WO2018047542A3 (en) | Multi-camera system, camera, camera processing method, confirmation device, and confirmation device processing method |