WO2017113188A1 - 头戴式显示设备及其控制方法 - Google Patents

头戴式显示设备及其控制方法 Download PDF

Info

Publication number
WO2017113188A1
WO2017113188A1 PCT/CN2015/099868 CN2015099868W WO2017113188A1 WO 2017113188 A1 WO2017113188 A1 WO 2017113188A1 CN 2015099868 W CN2015099868 W CN 2015099868W WO 2017113188 A1 WO2017113188 A1 WO 2017113188A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
signal
audio
head
display device
Prior art date
Application number
PCT/CN2015/099868
Other languages
English (en)
French (fr)
Inventor
韩超
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to JP2018530881A priority Critical patent/JP2019506776A/ja
Priority to CN201580076868.2A priority patent/CN107407805A/zh
Priority to EP15911817.3A priority patent/EP3399361A4/en
Priority to US15/751,427 priority patent/US10545345B2/en
Priority to PCT/CN2015/099868 priority patent/WO2017113188A1/zh
Priority to KR1020187016764A priority patent/KR20180084901A/ko
Publication of WO2017113188A1 publication Critical patent/WO2017113188A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/047—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using sets of wires, e.g. crossed wires
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface

Definitions

  • the present invention relates to a display device, and more particularly to a head mounted display device and a control method thereof.
  • the head portion includes a display portion and a headphone portion, the display portion is for providing a display screen, and the earphone portion is for providing sound.
  • the functional device includes a function control module, for example, including a battery, a processor, a storage module, and may also include a wireless module, a communication interface such as HDMI, USB, or the like.
  • the functional device and the headset are connected by a data line, which is mainly used for transmitting audio/video signals, and can also be used for transmitting power signals, control signals, and the like.
  • the head-mounted display device in the prior art is usually equipped with a touch panel as an input device, and the touch panel is generally disposed on the earphone portion or the functional device.
  • the touch panel when the touch panel is disposed on one side of the earphone, for example, the right side, there is inconvenience to the user who is accustomed to using the left hand, and addition of the touch panel on the earphone increases the volume of the earphone and the weight of the head worn end.
  • the touch panel When the touch panel is placed at the end of the box, after the user wears the product, because the line of sight is blocked, it is inconvenient to position the end of the box, and it needs to be held all the time. Since the user has a certain weight at the end of the box, the user always has a certain burden, and in addition, the box end includes In the case of a battery, it will be hot and the hand will not feel good.
  • the embodiment of the invention discloses a head-mounted display device and a control method thereof.
  • the touch panel is arranged on the data line, which facilitates the user to input, and avoids the problem of being disposed on the function device or the head-end device.
  • a head-mounted display device disclosed in an embodiment of the invention includes a head-mounted device and a functional device, and a data line connecting the head-mounted device and the functional device.
  • the headgear device includes a display device for providing a near-eye display for signal transmission with the head-end device through the data line.
  • the head mounted display device also includes a touch pad and a processor.
  • the touch panel is disposed on the data line for generating a touch signal in response to the touch action.
  • the processor is configured to generate a corresponding control signal according to the touch signal.
  • a control method of a head mounted display device comprising a head mounted device and a function device, a data line connecting the headgear device and the function device, and a touch pad disposed on the data line
  • the method includes the steps of: the touch panel generating a touch signal in response to the touch action; the head mounted display device determining a touch action on the touch panel according to the touch signal, and determining according to the touch action and the output state of the current head wear device Corresponding functions; and output control signals corresponding to control functions to control the execution of corresponding functions.
  • the head-mounted display device and the control method of the present invention facilitate the user to input by disposing the touch panel on a data line connected between the function device and the head-end device, thereby avoiding being disposed on the function device or the headset Problems on the device.
  • FIG. 1 is a perspective view of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 2 is a functional block diagram of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 3 is a flow chart of a method of controlling a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 1 is a perspective view of a head mounted display device 100 according to an embodiment of the invention.
  • the head mounted display device 100 includes a headgear device 10, a function device 20, and a number The line 30, the touch panel 40 disposed on the data line 30, and the processor 50.
  • the headgear device 10 and the function device 20 perform signal transmission via the data line 30.
  • the function device 20 can be a box-shaped control device.
  • the touch panel 40 is disposed on the data line 30 for generating a touch signal in response to a touch action.
  • the processor 50 is configured to receive the touch signal and generate a corresponding control signal according to the touch signal to control execution of the corresponding function.
  • the head mounted display device 100 further includes a touch interface unit 60.
  • the touch panel 40 is connected to the processor 50 through the touch interface unit 60, and sends a touch signal to the processing through the touch interface unit 60. 50.
  • the processor 50 and the touch interface unit 60 are disposed on the functional device 20 and are electrically connected to each other.
  • the processor 50 outputs a corresponding control signal through the data line 31 or outputs corresponding data to the head set device 10 according to the control signal, and controls the head wear device 10 to perform a corresponding function.
  • the headgear device 10 includes a display device 11 and an earphone device 12 that are connected to each other, and the display device 11 is for providing a display screen for providing sound.
  • the processor 50 and the touch interface unit 60 are disposed on the earphone device 12 or the display device 11 of the head device 10, and the processor 50 and the touch interface unit 60 are electrically connected to each other.
  • the touch panel 40 is a flexible touch panel that is wrapped around the periphery of the data line 30.
  • the touch interface unit 60 When the touch interface unit 60 is disposed on the function device 20, one end of the touch panel 40 extends to a position close to the function device 20. And connected to the touch interface unit 60 by plugging or the like.
  • the touchpad 40 establishes a data connection with the processor 60 via the touch interface unit 40.
  • the touch interface unit 60 When the touch interface unit 60 is disposed on the earphone device 12 or the display device 11 of the head device 10, one end of the touch panel 40 extends to a position close to the earphone device 12 or the display device 11 of the head device 10, and The touch interface unit 60 is connected by plugging or the like. Thus, the touchpad 40 establishes a data connection with the processor 50 via the touch interface unit 60.
  • the volume and weight of the functional device 20 or the earphone device 12 can be reduced compared to the conventional manner in which the touch panel 40 is disposed on the functional device 20 or the earphone device 12. Further, the touch signal transmission core for transmitting the touch signal from the earphone device 12 to the function device 20 can also be omitted in the data line 30 in the present invention, and the size of the data line 30 is also reduced.
  • the headgear device 10 further includes a first data interface 13 and an audio and video processor 14.
  • the functional device 20 includes a second data interface 21, a power supply unit 22, and a storage unit 23. A plurality of audio and video files are stored in the storage unit 23.
  • the first data interface 13 and the audio and video processor 14 can be disposed on any one of the display device 11 and the earphone device 12.
  • FIG. 1 shows an example in which the first data interface 13 is provided on the earphone device 12.
  • the first data interface 122 of the headgear 10 is coupled to the second data interface 21 of the functional device 20 via the data line 30 to establish a data connection between the headset device 10 and the functional device 20.
  • the power supply unit 22 of the functional device 20 provides an operating voltage to the headgear device 10 via the data line 30.
  • the data line 30 is used for power supply and data transmission, and may include a power supply core for transmitting a power supply voltage, a control signal core for transmitting a sound control signal, and the like.
  • the processor 50 is electrically connected to the touch panel 40 through the touch interface unit 60.
  • the processor 50 is configured to receive a touch signal generated by the touch panel 40, and determine a corresponding function according to the touch signal, and generate Controls the control signals that perform the corresponding functions.
  • the processor 50 when receiving the touch signal, the processor 50 further determines the output state of the current headwear device 10, and determines a corresponding function according to the touch signal and the current output state. Specifically, after receiving the touch signal, the processor 50 determines whether the current output state is an audio and video playback state, and if it is a non-audio video playback state, and when the touch action is a sliding touch action, generating a menu option switching function. Control signal.
  • the processor 50 determines that the current output state is an audio and video playback state, and when the touch action is a click, generates a control signal for controlling to play or pause the currently played audio and video file, or when the touch action is a double click, Controls the control signal of the call menu, or when the touch action is sliding, generates a control signal that controls the adjustment of the playback volume, and the like.
  • the click and double click refer to the touch actions performed by at least two fingers.
  • the processor 50 determines that there are at least two touch points according to the touch signal, determines that at least two finger touches, and determines, according to the received touch signal, that the touch time continues to be less than a first duration (eg, 0.2 seconds), and determines that the click is performed, and When it is determined according to the touch signal that two clicks have occurred within a predetermined time (for example, 1 second), it is determined to be a double tap operation.
  • the processor 50 determines, according to the received touch signal, that the touch time of the at least two touch points continues to be longer than the second time duration (for example, when the time is 1 second), determines whether the coordinates of the touched point change according to the touch signal, and if the change occurs, determines that Slide the operation and sit according to the touch point
  • the direction of the target changes to adjust the volume. For example, when it is determined that the change direction of the touch point coordinates is the first direction, the control increases the volume, and when it is determined that the change direction of the touch point coordinates is the second direction, the control decreases the volume.
  • the processor 50 determines a touch action of whether the touch action is unlocked/locked according to the touch signal, and generates a corresponding unlock/lock control signal.
  • the unlocking/locking touch action is a long press operation
  • the processor 50 determines that the touch time continues to be greater than the second duration and the coordinates of the touch point does not change according to the touch signal, and is determined to be a long press operation.
  • controlling the unlocking or locking state of the touch panel 40 according to the state of the current touch panel 40 that is, generating a control signal for controlling the unlocking or locking state of the switching touch panel 40 to the touch panel 40 to control the unlocking or locking of the touch panel 40.
  • the touch action is a long press operation and the state of the current touch panel 40 is unlocked
  • the touch panel 40 is controlled to be locked
  • the touch panel 40 is controlled to be unlocked.
  • the processor 50 receives the touch signal generated by the touch panel 40 but does not perform processing unless the touch action corresponding to the touch signal is an unlocked/locked touch action. Therefore, when the touch panel 40 is not required, the touch panel 40 can be locked by touch, and erroneous touch to the touch panel 40 is avoided. Obviously, when the touch panel 40 is unlocked, the processor 50 receives the touch signal generated by the touch panel 40 and performs corresponding processing.
  • the processor 50 when determining that the touch action is sliding and the current output state of the display device 10 is the audio and video playback state, the processor 50 further determines a corresponding function according to the direction of the slide and generates a control signal for executing the corresponding function.
  • a control signal for controlling the volume adjustment is generated.
  • the corresponding function is determined to be fast forward or fast backward, and the currently played audio and video is controlled.
  • the up and down sliding refers to sliding along the length direction of the data line 30 disposed on the touch panel 40 along the touch panel 40, and the left and right sliding fingers slide on the touch panel 40 in a direction perpendicular to the data line 30, For example, the user twists the data line after two fingers hold it.
  • the touch action is not limited to the above-described touch action
  • the function is not limited to the above-described function
  • the correspondence relationship between the touch action and the function is not limited to the above relationship.
  • the touch action may also be a circle.
  • the corresponding function is a loop play function. In other embodiments, the double-click corresponding to the unlock/lock function, and the long-press corresponding function to call the menu.
  • the processor 50 determines that the function corresponding to the touch action is to turn on a certain sound.
  • the control converts the corresponding audio and video file in the storage unit 23 to generate a multimedia signal of the mixed audio and video, and transmits it to the audio and video processor 14 of the headset device 10 through the data line 30.
  • the audio and video processor 14 receives the multimedia signal and decodes the multimedia signal into an audio signal and a display signal, which are respectively transmitted to the earphone device 12 for audio output and transmitted to the display device 11 for display output.
  • the processor 50 can be a central processing unit, a microcontroller, a single chip microcomputer, a digital signal processor, or the like.
  • the audio and video processor 14 can be an audio and video decoding chip.
  • the storage unit 23 can be a flash memory card, a magnetic disk, a solid state hard disk, or the like.
  • the earphone device 12 further includes an audio driving unit 121 and an earpiece 122 .
  • the display device 11 includes a display driving unit 111 , a display 112 , and an optical module 113 .
  • the processor 50 decodes the read multimedia signal into an audio signal and a display signal, and transmits the audio signal to the audio driving unit 121, and transmits the display signal to the display driving unit 111 of the display device 11 connected to the earphone device 12.
  • the audio driving unit 121 is configured to drive the handset 122 to output a corresponding sound according to the audio signal. Specifically, the audio driving unit 121 converts an audio signal in the form of a digital signal into an analog signal, and drives the handset 122 to output a corresponding sound through the analog signal.
  • the display driving unit 111 is configured to drive the display 12 to output a corresponding display screen according to the display signal
  • the optical module 13 is configured to project the display screen outputted by the display 12 to the user's eyes according to a preset path.
  • the display screen includes the audio and video playing interface, the menu interface and the like described above.
  • the display 12 is a micro display.
  • the earphone device 12 further includes an endless belt 123 .
  • the number of the earpieces 122 is two, and is disposed at two ends of the endless belt 123 , and is electrically connected through the endless belt 123 .
  • the processor 50 sends the read multimedia signal to the audio and video processor 14, and the audio and video processor 14 decodes the multimedia signal into an audio signal and a display signal, and sends the display signal to the display 12 to output a display screen.
  • the audio signal is then sent to the handset 122 of the headset device 12 to output audio.
  • FIG. 3 is a flowchart of a method for controlling a head mounted display device according to an embodiment of the present invention.
  • the method is for controlling a head mounted display device in any of the above embodiments.
  • the method comprises the following steps:
  • the processor 50 receives the data line 30 disposed for connecting the function device 20 and the head device 10 A touch signal generated by the upper touch panel 40 (S401).
  • the processor 50 determines a corresponding function based on the touch signal and the output state of the current headwear device 10 (S403). Wherein, when the output state of the headwear device 10 is a non-audio video playing state and the touch action is a sliding touch, the processor 50 determines that the corresponding function is a function of switching the menu option. When the output state of the headgear device 10 is an audio and video playback state, and the touch action is a sliding touch, the processor 50 determines that the corresponding function is to adjust the volume, and when the output state is the audio and video playback state and the touch action is a click, the processing is performed. The device 50 determines that the corresponding function is a pause. When the output state is the audio and video playback state and the touch action is a double tap, the processor 50 determines a corresponding function callout menu, such as calling the audio and video file list menu of the play interface.
  • the processor 50 outputs a control signal that controls execution of the corresponding function to control execution of the corresponding function (S405).
  • the method further includes the step of: when the processor 50 determines, according to the touch signal, that the touch action is an unlocked/locked touch action, controlling the unlocking or locking state of the touch panel 40.
  • the unlocking/locking touch action is a long press operation
  • the processor 50 determines that the touch time is long when the touch time is longer than the second time length and the coordinates of the touch point does not change according to the touch signal. Operate and control the unlocking or locking state of the switching touchpad 40.
  • the method further includes the following steps: the processor 50 determines that the function corresponding to the touch action is to open a certain audio and video file, and control to open the audio and video file in the storage unit 23 to generate a multimedia signal of the mixed audio and video. And transmitted to the audio and video processor 14 of the headset device 10 through the data line 30, the audio and video processor 14 receives the multimedia signal and decodes the multimedia signal into an audio signal and a display signal, respectively, and transmits the audio signal to the earphone device 12 for audio output. And transmitted to the display device 11 for display output.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

一种头戴式显示设备（100），包括头戴端装置（10）和功能装置（20）、以及连接头戴端装置（10）和功能装置（20）的数据线（30）。该头戴端装置（10）包括用于提供近眼显示的显示装置（11），该功能装置（20）用于通过所述数据线（30）传送对应的控制信号至所述头戴端装置（10）。该头戴式显示设备（100）还包括触摸板（40）以及处理器（50），该触摸板（40）设置于所述数据线（30）上，用于响应触摸动作而产生触摸信号。该处理器（50）用于根据所述触摸信号产生对应的控制信号。头戴式显示设备（100）及其控制方法，通过将触摸板（40）设置在数据线（30）上，方便用户进行输入。

Description

头戴式显示设备及其控制方法 技术领域
本发明涉及显示设备，尤其涉及一种头戴式的显示设备及其控制方法。
背景技术
目前的头戴式显示设备一般包括头戴部分及功能装置。其中，头戴部分包括显示部及耳机部，显示部用于提供显示画面，耳机部用于提供声音。功能装置包括功能控制模块，例如包括电池、处理器、存储模块，还可以包括无线模块，通信接口，如HDMI、USB等。功能装置与头戴部分通过数据线连接，该数据线主要用于传输音/视频信号，还可以用于传输电源信号、控制信号等。现有技术中的头戴式显示设备通常配备有触摸板作为输入装置，触摸板一般设置于耳机部或功能装置上。然而，当触摸板设置于一侧耳机时，例如右侧，对于习惯使用左手的用户来说则存在不便，此外在耳机上增加触摸板增加了耳机的体积及头戴端的重量。将触摸板设置于盒子端时，用户佩戴产品后，由于视线遮挡，不便定位盒子端的位置，需要一直手持，由于盒子端存在一定重量，用户一直手持，会存在一定负担，此外，在盒子端包括电池的情况下，会发热，手持感不佳。
发明内容
本发明实施例公开一种头戴式显示设备及其控制方法，通过将触摸板设置于数据线上，方便了用户进行输入，避免了设置于功能装置或头戴端装置上的问题。
本发明实施例公开的一种头戴式显示设备，包括头戴端装置和功能装置，以及连接头戴端装置和功能装置的数据线。该头戴端装置包括用于提供近眼显示的显示装置，该功能装置用与所述头戴端装置通过所述数据线进行信号传输。该头戴式显示设备还包括触摸板以及处理器。该触摸板设置于所述数据线上，用于响应触摸动作而产生触摸信号。该处理器用于根据所述触摸信号产生对应的控制信号。
一种头戴式显示设备的控制方法，所述头戴式显示设备包括头戴端装置和功能装置，连接头戴端装置和功能装置的数据线，以及设置于所述数据线上的触摸板，该方法包括步骤：所述触摸板响应触摸动作而产生触摸信号；所述头戴式显示设备根据触摸信号确定触摸板上的触摸动作，并根据触摸动作以及当前头戴端装置的输出状态确定对应的功能；以及输出控制对应功能的控制信号以控制执行对应的功能。
本发明的头戴式显示设备及控制方法，通过将触摸板设置于连接于功能装置和头戴端装置之间的数据线上，方便了用户进行输入，避免了设置于功能装置或头戴端装置上的问题。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的明显变形方式。
图1为本发明一实施例中的头戴式显示设备的立体示意图；
图2为本发明一实施例中的头戴式显示设备的功能模块图；
图3为本发明一实施例中的头戴式显示设备的控制方法的流程图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
请一并参阅图1及图2，图1为本发明一实施例中的头戴式显示设备100的立体示意图。该头戴式显示设备100包括头戴端装置10、功能装置20、数 据线30、设置于数据线30上的触摸板40、以及处理器50。该头戴端装置10与功能装置20通过数据线30进行信号传输。其中，该功能装置20可为一盒状的控制设备。
该触摸板40设置于数据线30上，用于响应触摸动作而产生触摸信号。该处理器50用于接收该触摸信号，并根据触摸信号产生对应的控制信号以控制执行对应的功能。
在一实施例中，该头戴式显示设备100还包括一触摸接口单元60，该触摸板40通过该触摸接口单元60与处理器50连接，并将触摸信号通过该触摸接口单元60发送给处理器50。
在一实施例中，处理器50及触摸接口单元60设置于功能装置20上，且彼此电连接。该处理器50通过该数据线31输出对应的控制信号或根据该控制信号输出对应的数据至所述头戴端装置10，而控制头戴端装置10执行对应的功能。
该头戴端装置10包括相互连接的显示装置11及耳机装置12，该显示装置11用于提供显示画面，该耳机装置12用于提供声音。
在另一实施例中，处理器50及触摸接口单元60设置于头戴端装置10的耳机装置12或显示装置11上，且处理器50及触摸接口单元60彼此电连接。
其中，该触摸板40为柔性触摸板，包覆于所述数据线30的外围，且当触摸接口单元60设置于功能装置20上时，触摸板40的一端延伸至靠近功能装置20的位置，并与该触摸接口单元60通过插接等方式连接。从而，触摸板40通过触摸接口单元40与处理器60建立数据连接。
当触摸接口单元60设置于头戴端装置10的耳机装置12或显示装置11上时，触摸板40的一端延伸至靠近头戴端装置10的耳机装置12或显示装置11的位置，并与该触摸接口单元60通过插接等方式连接。从而，触摸板40通过触摸接口单元60与处理器50建立数据连接。
相比现有的将触摸板40设置于功能装置20或耳机装置12上的方式，可减轻功能装置20或耳机装置12的体积和重量。此外，本发明中的数据线30中还可省略用于将触摸信号从耳机装置12传输至功能装置20的触摸信号传输线芯，也减小了数据线30的尺寸。
请一并参阅图2，为头戴式显示设备100的功能模块图。在一实施例中，该头戴端装置10还包括第一数据接口13以及音视频处理器14。该功能装置20包括第二数据接口21、电源单元22及存储单元23。该存储单元23中存储有若干音视频文件。其中，该第一数据接口13以及音视频处理器14可设置于显示装置11及耳机装置12的任意一个上。图1示出的为第一数据接口13设置于耳机装置12上的例子。
该头戴端装置10的第一数据接口122通过数据线30连接功能装置20的第二数据接口21，从而建立头戴端装置10与功能装置20的数据连接。该功能装置20的电源单元22并通过该数据线30为头戴端装置10提供工作电压。该数据线30用于进行供电以及数据传输，可包括用于传输供电电压的供电线芯、用于传输音控制信号的控制信号线芯等。
在本实施例中，该处理器50通过触摸接口单元60与触摸板40电连接，该处理器50用于接收触摸板40产生的触摸信号，并根据触摸信号确定对应的功能，并产生用于控制执行对应功能的控制信号。
在本实施例中，该处理器50在接收到触摸信号时，还判断当前头戴端装置10的输出状态，并根据该触摸信号以及当前的输出状态确定对应的功能。具体的，处理器50接收到触摸信号后，判断当前的输出状态是否为音视频播放状态，如果为非音视频播放状态，且当触摸动作为滑动触摸动作时，产生用于执行菜单选项切换功能的控制信号。如果该处理器50判断当前的输出状态为音视频播放状态，且当触摸动作为单击时，产生控制播放或暂停当前所播放的音视频文件的控制信号，或当触摸动作为双击时，产生控制唤出菜单的控制信号，或当触摸动作为滑动时，产生控制调节播放音量的控制信号，等等。
在本实施例中，该单击、双击均指的是至少两个手指执行的触摸动作。处理器50根据触摸信号确定有至少两个触摸点时，判断为至少两个手指触摸，并根据接收到的触摸信号确定触摸时间持续小于一第一时长(例如0.2秒)判断为单击，以及根据触摸信号确定在一预定时间内(例如1秒)内发生了两次单击时，确定为双击操作。处理器50并根据接收到的触摸信号确定至少两个触摸点的触摸时间持续大于第二时长(例如1秒时)时，根据触摸信号确定触摸点的坐标是否发生变化，如果发生变化，确定为滑动操作，并根据触摸点坐 标的变化方向对应调节音量。例如，当判断触摸点坐标的变化方向为第一方向时，控制增大音量，当判断触摸点坐标的变化方向为第二方向时，控制减小音量。
在一实施例中，该处理器50并根据触摸信号确定触摸动作是否解锁/锁定的触摸动作，并产生相应的解锁/锁定的控制信号。具体的，在本实施例中，该解锁/锁定的触摸动作为长按操作，该处理器50根据触摸信号确定触摸时间持续大于第二时长且触摸点的坐标未变化时，判断为长按操作，并根据当前触摸板40的状态控制切换触摸板40的解锁或锁定状态，即，产生控制切换触摸板40的解锁或锁定状态的控制信号至触摸板40而控制触摸板40解锁或锁定。例如，当触摸动作为长按操作，且当前触摸板40的状态为解锁时，则控制触摸板40锁定，若当前触摸板40的状态为锁定时，则控制触摸板40解锁。
其中，当触摸板40锁定时，处理器50接收触摸板40产生的触摸信号但不进行处理，除非该触摸信号对应的触摸动作为解锁/锁定的触摸动作。从而，在无需使用触摸板40时，可通过触摸对触摸板40进行锁定，避免了对触摸板40的误触控。显然，当触摸板40解锁时，处理器50接收触摸板40产生的触摸信号并进行相应的处理。
在一实施例中，该处理器50在确定触摸动作为滑动且显示装置10当前输出状态为音视频播放状态时，还进一步根据滑动的方向确定对应的功能并产生执行对应功能的控制信号。其中，当处理器50根据触摸信号判断为上下滑动时，产生控制进行音量调节的控制信号，当判断为左右滑动时，确定对应的功能为快进或快退，并产生控制当前播放的音视频文件快进或快退的控制信号。其中，该上下滑动指在触摸板40上沿着该触摸板40所设置的数据线30的长度方向滑动，该左右滑动指在触摸板40上沿着垂直于所述数据线30的方向滑动，例如用户两个手指捏住数据线后进行扭转。
显然，该触摸动作并不限于上述的触摸动作，功能也并不限于上述的功能，触摸动作与功能的对应关系也不限于上述的关系。例如，该触摸动作还可为圆圈，在当前的界面为音视频播放界面时，对应的功能为循环播放功能。在其他实施方式中，双击对应的为解锁/锁定功能，长按对应的为唤出菜单的功能。
在一些实施例中，该处理器50在确定触摸动作对应的功能为打开某一音 视频文件时，控制打开存储单元23中的对应的音视频文件生成混合音视频的多媒体信号，并通过数据线30传送给头戴端装置10的音视频处理器14。音视频处理器14接收该多媒体信号并将该多媒体信号解码成音频信号和显示信号，分别传送至耳机装置12进行音频输出以及传送给显示装置11进行显示输出。其中，该处理器50可为中央处理器、微控制器、单片机、数字信号处理器等。音视频处理器14可为音视频解码芯片。该存储单元23可为闪存卡、磁盘、固态硬盘等。
如图2所示，该耳机装置12还包括音频驱动单元121以及听筒122，该显示装置11包括显示驱动单元111、显示器112及光学模组113。该处理器50将读取的多媒体信号解码成音频信号以及显示信号，并将音频信号发送给音频驱动单元121，将显示信号发送给与耳机装置12连接的显示装置11的显示驱动单元111。
该音频驱动单元121用于根据该音频信号驱动该听筒122输出相应的声音。具体的，该音频驱动单元121用将数字信号形式的音频信号转化为模拟信号，并通过该模拟信号驱动该听筒122输出相应的声音。
该显示驱动单元111用于根据该显示信号驱动该显示器12输出相应的显示画面，该光学模组13用于将显示器12输出的显示画面按预设路径投射至用户双眼。其中，该显示画面包括上述的音视频播放界面、菜单界面等等。
其中，该显示器12为微型显示器。
其中，如图1所示，该耳机装置12还包括环带123，该听筒122的数量为两个，设置于环带123的两端，并通过环带123进行电连接。
一实施方式下，处理器50将读取的多媒体信号发送至音视频处理器14，音视频处理器14将该多媒体信号解码成音频信号以及显示信号，并将显示信号发送给显示器12输出显示画面，然后将音频信号发送给耳机装置12的听筒122输出音频。
请参阅图3，为本发明一实施例中的头戴式显示设备的控制方法的流程图。该方法用于对上述任一实施方式中的头戴式显示设备进行控制。该方法包括如下步骤：
处理器50接收设置于用于连接功能装置20和头戴端装置10的数据线30 上的触摸板40产生的触摸信号(S401)。
处理器50根据触摸信号以及当前头戴端装置10的输出状态确定对应的功能(S403)。其中，当头戴端装置10的输出状态为非音视频播放状态且触摸动作为滑动触摸时，处理器50确定对应的功能为切换菜单选项的功能。当头戴端装置10的输出状态为音视频播放状态，触摸动作为滑动触摸时，处理器50确定对应的功能为调节音量，当输出状态为音视频播放状态且触摸动作为单击时，处理器50确定对应的功能为暂停，当输出状态为音视频播放状态且触摸动作为双击时，处理器50确定对应的功能唤出菜单，例如唤出播放界面的音视频文件列表菜单。
处理器50输出控制执行对应功能的控制信号，以控制执行对应的功能(S405)。
其中，在一实施例中，该方法还包括步骤：处理器50根据触摸信号确定触摸动作为解锁/锁定的触摸动作时，控制切换触摸板40的解锁或锁定状态。具体的，在本实施例中，该解锁/锁定的触摸动作为长按操作，该处理器50根据根据触摸信号确定触摸时间持续大于第二时长且触摸点的坐标未变化时，判断为长按操作，并控制切换触摸板40的解锁或锁定状态。
其中，在一实施例中，该方法还包括步骤：处理器50确定触摸动作对应的功能为打开某一音视频文件时，控制打开存储单元23中的音视频文件生成混合音视频的多媒体信号，并通过数据线30传送给头戴端装置10的音视频处理器14，音视频处理器14接收该多媒体信号并将该多媒体信号解码成音频信号和显示信号，分别传送至耳机装置12进行音频输出以及传送给显示装置11进行显示输出。
以上所述是本发明的优选实施例，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明原理的前提下，还可以做出若干改进和润饰，这些改进和润饰也视为本发明的保护范围。

Claims (19)

  1. 一种头戴式显示设备，其特征在于，包括头戴端装置和功能装置，以及连接头戴端装置和功能装置的数据线，所述头戴端装置包括用于提供近眼显示的显示装置，所述功能装置与所述头戴端装置通过所述数据线进行信号传输，所述头戴式显示设备还包括：
    触摸板，设置于所述数据线上，用于响应触摸动作而产生触摸信号；
    处理器，用于根据所述触摸信号产生对应的控制信号。
  2. 如权利要求1所述的头戴式显示设备，其特征在于，所述处理器设置于所述功能装置，该处理器通过该数据线输出控制信号至所述头戴端装置至头戴端装置而控制头戴端装置执行对应的功能。
  3. 如权利要求2所述的头戴式显示设备，该功能装置还包括连接于所述处理器与所述触摸板之间的触摸接口单元，该触摸接口单元接收触摸板产生的触摸信号并传送给处理器。
  4. 如权利要求1所述的头戴式显示设备，其特征在于，所述处理器设置于所述显示装置，所述显示装置还包括连接于该处理器与该触摸板之间的触摸接口单元，用于接收所述触摸板产生的触摸信号并传送给处理器。
  5. 如权利要求1所述的头戴式显示设备，其特征在于，所述头戴端装置还包括耳机装置，用于提供音频输出。
  6. 如权利要求5所述的头戴式显示设备，其特征在于，所述处理器设置于所述耳机装置，该耳机装置还包括连接于该处理器与该触摸板之间的触摸接口单元，用于接收所述触摸板产生的触摸信号并传送给处理器。
  7. 如权利要求5所述的头戴式显示设备，其特征在于，所述头戴端装置还包括音视频处理器，用于将音视频信号处理为可供该显示装置显示输出的视频信号以及可供该耳机装置输出的音频信号。
  8. 如权利要求7所述的头戴式显示设备，其特征在于，处理器根据触摸信号确定控制信号为控制打开某一音视频文件的控制信号时，控制开启存储单元中存储的对应的音视频文件，生成混合音视频的多媒体信号并通过数据线传送给音视频处理器，音视频处理器接收该多媒体信号并将该多媒体信号解码成 音频信号和显示信号，分别传送至耳机装置进行音频输出以及传送给显示装置进行显示输出。
  9. 如权利要求1所述的头戴式显示设备，其特征在于，所述触摸板为柔性触摸板，包覆于所述数据线的外围。
  10. 如权利要求1所述的头戴式显示设备，其特征在于，所述处理器根据该触摸板的触摸信号以及当前头戴端装置的输出状态，确定对应的控制信号。
  11. 如权利要求10所述的头戴式显示设备，其特征在于，所述处理器接收到触摸信号后，判断头戴端装置当前的输出状态是否为音视频播放状态，如果为非音视频播放状态，且根据滑动触摸动作对应的触摸信号，产生用于控制执行菜单选项切换功能的控制信号；如果该处理器判断当前的输出状态为音视频播放状态，且根据单击触摸动作对应的触摸信号，产生控制播放或暂停当前所播放的音视频文件的控制信号，或根据双击触摸动作对应的触摸信号，产生控制唤出菜单的控制信号，或根据滑动触摸动作对应的触摸信号，产生控制调节播放的音量的控制信号。
  12. 如权利要求7所述的头戴式显示设备，其特征在于，所述处理器根据滑动触摸动作对应的控制信号，以及头戴端装置当前的输出状态为音视频播放状态时，还进一步根据滑动的方向产生控制对应的功能的控制信号，当处理器判断为上下滑动时，产生控制音量调节的控制信号，以进行音量调节，当判断为左右滑动时，产生控制快进或快退的控制信号，以控制当前播放的音视频文件快进或快退。
  13. 如权利要求7所述的头戴式显示设备，其特征在于，处理器根据触摸信号确定有至少两个触摸点且至少两个触摸点的触摸时间持续小于一第一时长判断为单击，以及根据触摸信号确定在一预定时间内发生了两次单击时，确定为双击操作；处理器并根据接收到的触摸信号确定至少两个触摸点的触摸时间持续大于第二时长时，根据触摸信号确定所述至少两个触摸点的坐标是否发生变化，如果发生变化，确定为滑动操作。
  14. 如权利要求2所述的头戴式显示设备，其特征在于，所述处理器并根据触摸信号确定为解锁/锁定的控制信号时，则控制切换触摸板的解锁或锁定状态。
  15. 如权利要求8所述的头戴式显示设备，其特征在于，所述耳机装置还包括音频驱动单元以及听筒，所述显示装置包括显示驱动单元、显示器及光学模组，所述音视频处理器接收处理器发送的混合音视频的多媒体信号时，将所述多媒体信号解码成音频信号以及显示信号，并将音频信号发送给音频驱动单元，将显示信号发送给与耳机装置连接的显示装置的显示驱动单元；所述音频驱动单元根据该音频信号驱动该听筒输出相应的声音，所述显示驱动单元根据该显示信号驱动该显示器输出相应的显示画面，所述光学模组将显示器输出的显示画面按预设路径投射至用户双眼。
  16. 一种头戴式显示设备的控制方法，其特征在于，所述头戴式显示设备包括头戴端装置和功能装置，连接头戴端装置和功能装置的数据线，以及设置于所述数据线上的触摸板，所述方法包括步骤：
    所述触摸板响应触摸动作而产生触摸信号；
    所述头戴式显示设备根据触摸信号以及当前头戴端装置的输出状态确定对应的功能；以及
    输出控制对应功能的控制信号以控制执行对应的功能。
  17. 如权利要求16所述的控制方法，其特征在于，所述步骤“根据触摸信号以及当前头戴端装置的输出状态确定对应的功能”包括：
    当输出状态为非音视频播放状态且触摸动作为滑动触摸时，输出控制切换菜单选项功能的控制信号；
    当输出状态为音视频播放状态且触摸动作为滑动触摸时，输出控制切换菜单选项功能的控制信号；
    当输出状态为音视频播放状态且触摸动作为单击时，输出控制暂停的控制信号；以及
    当输出状态为音视频播放状态且触摸动作为双击时，输出控制唤出菜单的控制信号。
  18. 如权利要求16所述的控制方法，其特征在于，所述方法还包括步骤：
    根据触摸动作确定为解锁/锁定的触摸信号时，控制切换触摸板的解锁或锁定状态，以使能或禁能所述触摸板。
  19. 如权利要求16所述的控制方法，其特征在于，还包括步骤：
    根据触摸信号确定对应的功能为打开某一音视频文件时，打开音视频文件生成混合音视频的多媒体信号；
    通过数据线将该多媒体信号传输给头戴端装置；以及
    将该多媒体信号解码成音频信号和显示信号，分别传送至耳机装置进行音频输出以及传送给显示装置进行显示输出。
PCT/CN2015/099868 2015-12-30 2015-12-30 头戴式显示设备及其控制方法 WO2017113188A1 (zh)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2018530881A JP2019506776A (ja) 2015-12-30 2015-12-30 ヘッドマウントディスプレイデバイス及びその制御方法
CN201580076868.2A CN107407805A (zh) 2015-12-30 2015-12-30 头戴式显示设备及其控制方法
EP15911817.3A EP3399361A4 (en) 2015-12-30 2015-12-30 VISIOCASQUE, AND METHOD FOR CONTROLLING THE SAME
US15/751,427 US10545345B2 (en) 2015-12-30 2015-12-30 Head-mounted display device with function of touch input and touch control method thereof
PCT/CN2015/099868 WO2017113188A1 (zh) 2015-12-30 2015-12-30 头戴式显示设备及其控制方法
KR1020187016764A KR20180084901A (ko) 2015-12-30 2015-12-30 헤드 장착형 디스플레이 디바이스 및 이의 제어 방법

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/099868 WO2017113188A1 (zh) 2015-12-30 2015-12-30 头戴式显示设备及其控制方法

Publications (1)

Publication Number Publication Date
WO2017113188A1 true WO2017113188A1 (zh) 2017-07-06

Family

ID=59224283

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/099868 WO2017113188A1 (zh) 2015-12-30 2015-12-30 头戴式显示设备及其控制方法

Country Status (6)

Country Link
US (1) US10545345B2 (zh)
EP (1) EP3399361A4 (zh)
JP (1) JP2019506776A (zh)
KR (1) KR20180084901A (zh)
CN (1) CN107407805A (zh)
WO (1) WO2017113188A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200002610A (ko) * 2018-06-29 2020-01-08 캐논 가부시끼가이샤 전자기기, 전자기기의 제어방법, 및 컴퓨터 판독가능한 매체
CN111654777A (zh) * 2020-06-29 2020-09-11 歌尔科技有限公司 头戴显示设备和头戴显示组件
CN114935969A (zh) * 2022-07-21 2022-08-23 杭州灵伴科技有限公司 头戴式显示套件和基于物理连接的断电方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201278050Y (zh) * 2008-09-04 2009-07-22 深圳市力伟数码技术有限公司 一种具有vga接口的电脑立体眼镜显示器
CN103576578A (zh) * 2013-11-05 2014-02-12 小米科技有限责任公司 一种采用耳机线对终端进行控制的方法、装置和设备
CN103901791A (zh) * 2014-04-02 2014-07-02 联想(北京)有限公司 一种响应按键触控操作的方法、装置及电子设备
JP2015087581A (ja) * 2013-10-31 2015-05-07 株式会社東芝 表示装置
JP2015143812A (ja) * 2013-12-24 2015-08-06 セイコーエプソン株式会社 電気光学装置及び電子機器
CN204719350U (zh) * 2015-06-29 2015-10-21 西北农林科技大学 一种穿戴式娱乐型眼镜

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040001106A1 (en) * 2002-06-26 2004-01-01 John Deutscher System and process for creating an interactive presentation employing multi-media components
US20050003851A1 (en) * 2003-06-05 2005-01-06 Visteon Global Technologies, Inc. Radio system with touch pad interface
JP2006189476A (ja) * 2004-12-28 2006-07-20 Konica Minolta Photo Imaging Inc 表示システム
CN1304931C (zh) * 2005-01-27 2007-03-14 北京理工大学 一种头戴式立体视觉手势识别装置
US8769408B2 (en) * 2005-10-07 2014-07-01 Apple Inc. Intelligent media navigation
US8094673B2 (en) * 2006-04-10 2012-01-10 Microsoft Corporation Cable user interface
US8605008B1 (en) * 2007-05-04 2013-12-10 Apple Inc. Head-mounted display
KR101521219B1 (ko) 2008-11-10 2015-05-18 엘지전자 주식회사 플렉서블 디스플레이를 이용하는 휴대 단말기 및 그 제어방법
US8754931B2 (en) * 2010-01-08 2014-06-17 Kopin Corporation Video eyewear for smart phone games
US9047005B2 (en) * 2011-02-03 2015-06-02 Sony Corporation Substituting touch gestures for GUI or hardware keys to control audio video play
JP5810540B2 (ja) 2011-02-04 2015-11-11 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
KR101831644B1 (ko) 2011-03-02 2018-02-23 삼성전자 주식회사 터치 입력부를 구비하는 이어폰 및 이를 이용하는 휴대 단말기
US9042571B2 (en) * 2011-07-19 2015-05-26 Dolby Laboratories Licensing Corporation Method and system for touch gesture detection in response to microphone output
US8217856B1 (en) * 2011-07-27 2012-07-10 Google Inc. Head-mounted display that displays a visual representation of physical interaction with an input interface located outside of the field of view
JP5978592B2 (ja) * 2011-10-26 2016-08-24 ソニー株式会社 ヘッド・マウント・ディスプレイ及び表示制御方法
JP5957875B2 (ja) * 2011-12-26 2016-07-27 ソニー株式会社 ヘッドマウントディスプレイ
US20130207715A1 (en) * 2012-02-13 2013-08-15 Nokia Corporation Method, Apparatus, Computer Program, Cable and System
US9143858B2 (en) * 2012-03-29 2015-09-22 Csr Technology Inc. User designed active noise cancellation (ANC) controller for headphones
KR20140052294A (ko) * 2012-10-24 2014-05-07 삼성전자주식회사 헤드-마운티드 디스플레이 장치에서 가상 이미지를 사용자에게 제공하는 방법, 기계로 읽을 수 있는 저장 매체 및 헤드-마운티드 디스플레이 장치
JP5600360B2 (ja) * 2013-01-25 2014-10-01 ソフトバンクモバイル株式会社 プログラム及び動画再生制御装置
JP6209906B2 (ja) * 2013-09-05 2017-10-11 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置を制御する方法、画像表示システム
JP6144167B2 (ja) * 2013-09-27 2017-06-07 株式会社河合楽器製作所 メトロノームプログラム
JP6264014B2 (ja) * 2013-12-17 2018-01-24 セイコーエプソン株式会社 頭部装着型表示装置
EP3108287A4 (en) * 2014-02-18 2017-11-08 Merge Labs, Inc. Head mounted display goggles for use with mobile computing devices
US9649558B2 (en) * 2014-03-14 2017-05-16 Sony Interactive Entertainment Inc. Gaming device with rotatably placed cameras
WO2015176037A1 (en) * 2014-05-16 2015-11-19 T-Ink, Inc. Devices and techniques relating to a touch sensitive control device
FR3025388B1 (fr) * 2014-09-01 2019-08-23 Lg Electronics Inc. Terminal portable sur soi
US9794684B2 (en) * 2015-02-13 2017-10-17 Seiko Epson Corporation Head-mounted display device, control method for the same, and computer program
US10156721B2 (en) * 2015-03-09 2018-12-18 Microsoft Technology Licensing, Llc User-based context sensitive hologram reaction
US20160378204A1 (en) * 2015-06-24 2016-12-29 Google Inc. System for tracking a handheld device in an augmented and/or virtual reality environment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201278050Y (zh) * 2008-09-04 2009-07-22 深圳市力伟数码技术有限公司 一种具有vga接口的电脑立体眼镜显示器
JP2015087581A (ja) * 2013-10-31 2015-05-07 株式会社東芝 表示装置
CN103576578A (zh) * 2013-11-05 2014-02-12 小米科技有限责任公司 一种采用耳机线对终端进行控制的方法、装置和设备
JP2015143812A (ja) * 2013-12-24 2015-08-06 セイコーエプソン株式会社 電気光学装置及び電子機器
CN103901791A (zh) * 2014-04-02 2014-07-02 联想(北京)有限公司 一种响应按键触控操作的方法、装置及电子设备
CN204719350U (zh) * 2015-06-29 2015-10-21 西北农林科技大学 一种穿戴式娱乐型眼镜

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3399361A4 *

Also Published As

Publication number Publication date
JP2019506776A (ja) 2019-03-07
KR20180084901A (ko) 2018-07-25
CN107407805A (zh) 2017-11-28
US20180239142A1 (en) 2018-08-23
EP3399361A1 (en) 2018-11-07
US10545345B2 (en) 2020-01-28
EP3399361A4 (en) 2019-07-10

Similar Documents

Publication Publication Date Title
EP3048804B1 (en) Headphones with integral image display
JP6255488B2 (ja) コンテンツ共有装置及び方法
CN107407809B (zh) 头戴式设备、耳机装置及头戴式设备分离控制方法
JP2013093663A (ja) ヘッド・マウント・ディスプレイ及びヘッド・マウント・ディスプレイの制御方法
US10846041B2 (en) Audio and video processors
WO2017113188A1 (zh) 头戴式显示设备及其控制方法
US10282979B2 (en) Transmission of infrared signals over a high-definition multimedia interface cable
KR20110075046A (ko) 임의적인 처리 기능을 갖는 중앙 ｄｍａ
JP5990958B2 (ja) 頭部装着型表示装置
JP6563138B2 (ja) ヘッドマウントディスプレイデバイス及びヘッドマウントディスプレイシステム
JP2010081559A (ja) ウェアラブルディスプレイ装置
WO2017166684A1 (zh) 电子设备的音箱控制方法及装置
US8780041B2 (en) Apparatus for displaying information corresponding to connection of controller and method thereof
TW200525371A (en) Using multiple communication links in conjunction with a media adapter
KR101611843B1 (ko) 음성신호 재입력형 스마트기기용 이어폰
JPWO2019053864A1 (ja) 電子機器制御システム、音声出力装置及びそれらの方法
CN103902395B (zh) 信息输入的控制方法及电子终端
KR102342388B1 (ko) 빔 프로젝터 일체형 도킹 스피커
JP6402487B2 (ja) 音声処理装置および音声処理装置の制御方法
WO2014155474A1 (ja) 電子機器、メニュー表示方法、及びメニュー表示プログラム
EP3515089A1 (en) Earphone assembly, and headphone and head-mounted display device with earphone assembly
US20220322007A1 (en) Sound output device, sound output system, and control method
JP2014090265A (ja) 電子機器、制御方法及びプログラム
CN113360126A (zh) 一种电子设备和控制方法
US20150269836A1 (en) Configurable bi-directional remote control based on signal input device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15911817

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15751427

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2018530881

Country of ref document: JP

ENP Entry into the national phase

Ref document number: 20187016764

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1020187016764

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: DE