WO2019041171A1 - 按键操作提示方法及头戴显示设备 - Google Patents

按键操作提示方法及头戴显示设备 Download PDF

Info

Publication number
WO2019041171A1
WO2019041171A1 PCT/CN2017/099683 CN2017099683W WO2019041171A1 WO 2019041171 A1 WO2019041171 A1 WO 2019041171A1 CN 2017099683 W CN2017099683 W CN 2017099683W WO 2019041171 A1 WO2019041171 A1 WO 2019041171A1
Authority
WO
WIPO (PCT)
Prior art keywords
button
user
touch
receives
display device
Prior art date
Application number
PCT/CN2017/099683
Other languages
English (en)
French (fr)
Inventor
王乐
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to CN201780092189.3A priority Critical patent/CN110770677A/zh
Priority to PCT/CN2017/099683 priority patent/WO2019041171A1/zh
Publication of WO2019041171A1 publication Critical patent/WO2019041171A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the invention relates to a key operation prompting technology, in particular to a key operation prompting method and a head mounted display device.
  • the existing HMD Head Mount Display
  • the existing HMD includes a display screen and operation buttons that are user-friendly.
  • the user's eyes can see the display screen, but the user does not see the external operation button.
  • the user needs to process the image or video on the display screen, for example, Moving an image or zooming an image, etc., the user can only operate the operation button by memory or feeling, which may cause an erroneous operation, and is inconvenient for the user to operate the operation button.
  • the technical problem to be solved by the embodiments of the present invention is to provide a button operation prompting method and a head mounted display device. It is convenient for the user to operate the buttons.
  • a first aspect of the present invention provides a key operation prompting method, which is operated on a head mounted display device, the head mounted display device includes a display screen and a plurality of operation buttons, and the button operation prompting method includes :
  • the control When the operation button receives the operation of the user, the control displays a distribution map of the area of the currently operated operation button on the display screen, wherein the distribution map displays a virtual button corresponding to each operation button.
  • An icon, and the arrangement manner of the plurality of virtual button icons is consistent with the actual arrangement manner of the operation button.
  • a second aspect of the present invention provides a head mounted display device including a display screen, a plurality of operation buttons, a memory, a processor, and a connection line, the processor, the memory, the display screen, and the plurality of operation buttons
  • the connection line is electrically connected, wherein the memory stores a set of program codes, and the processor is configured to call the program code stored in the memory to perform the following operations:
  • the control When the operation button receives the operation of the user, the control displays a distribution map of the area of the currently operated operation button on the display screen, wherein the distribution map displays a virtual button corresponding to each operation button.
  • An icon, and the arrangement manner of the plurality of virtual button icons is consistent with the actual arrangement manner of the operation button.
  • the operation button receives the user's operation such as touching or pressing
  • the icon and the arrangement position of all the buttons are displayed on the head-mounted display device, so that the user wearing the head-mounted display device can conveniently view the button. And apply the corresponding operation to the button.
  • FIG. 1 is a flowchart of a method for prompting a key operation in a first embodiment of the present invention
  • 2-1 is a schematic diagram of a head mounted display device in an embodiment of the present invention.
  • FIG. 2-2 is an enlarged schematic view showing an operation button area of the head mounted display device of FIG. 1;
  • FIG. 3 is a schematic diagram showing a distribution map of operation buttons in a display screen according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram showing a distribution map of operation buttons in a display screen according to another embodiment of the present invention.
  • FIG. 5 is a flowchart of a method for prompting a key operation according to a second embodiment of the present invention.
  • FIG. 6 is a flow chart showing a method for prompting a key operation according to a third embodiment of the present invention.
  • FIG. 7 is a flowchart of a method for prompting a key operation according to a fourth embodiment of the present invention.
  • FIG. 8 is a schematic diagram showing the hardware structure of a head mounted display device according to an embodiment of the present invention.
  • 100-head-mounted display device 121-left ear shell button area; 122-right ear shell button area; 130-operation button; 140-display screen; 141-distribution map; 142-virtual button icon; 210-processor; - Memory.
  • the embodiment of the invention provides a button operation prompting method, which is run on the head mounted display device 100.
  • the head mounted display device 100 includes a display end 110 and a head end 120 rotatably coupled to the display end 110.
  • Display terminal 110 includes at least one display 140 (see Figure 3).
  • the head mounted display device 100 also includes a plurality of operation buttons 130.
  • the plurality of operation buttons 130 are disposed outside the head mounted display device 100 to facilitate user operation.
  • the plurality of operation buttons 130 are disposed at positions where the display end 110 is rotatably connected to the head end 120.
  • the plurality of operation buttons 130 are disposed on the earphone casing of the head mounted display device 100. After the user wears the head mounted display device 100, the video or image displayed on the display screen 140 can be viewed through the eyepiece.
  • FIG. 1 a flow chart of steps of a method for prompting a key operation in a first embodiment of the present invention is shown.
  • the method includes the following steps:
  • Step S110 determining whether the operation button receives the operation of the user; if yes, executing step S120. If no, the process ends.
  • the operation button 130 can receive the operation of the user, and the operation of the user The operation can be a pressing operation, a touch operation, or the like.
  • the operation button 130 receives an operation of the user, the head mounted display device 100 receives a corresponding signal.
  • Step S120 Control displaying, on the display screen, a distribution map of an area of the currently operated operation button, wherein the distribution map displays a virtual button icon corresponding to each operation button, and the plurality of virtual button icons
  • the arrangement of the buttons is the same as the actual arrangement of the operation buttons.
  • a plurality of the operation buttons 130 may be collectively disposed in one area, or may be collectively disposed in a plurality of areas.
  • the following is an example in which the operation buttons 130 are distributed in two areas, which are respectively located on the outer casing of the left earphone and the outer earphone of the head mounted display device 100, and the plurality of operation buttons 130 on the left earphone housing are located.
  • the area referred to as the left ear shell button area 121, and the area in which the plurality of operation keys 130 are located on the right headphone case is referred to as the right ear shell key area 122.
  • the head mounted display device 100 When a certain operation button 130 in the left ear shell button area 121 receives an operation of the user, for example, the user touches or presses the operation button 130 by a finger, the head mounted display device 100 receives a signal that the user operates the operation button 130. Correspondingly, the head mounted display device 100 controls, on the display screen 140, the distribution map 141 of the area where the operation button 130 is currently operated, wherein the map 141 is displayed with the currently operated operation button 130.
  • the virtual button icon 142 corresponding to each operation button 130 in the left ear shell button area 121 that is, the virtual button icon 142 on the distribution map 141 and the operation button 130 of the left ear shell button area 121 are in one-to-one correspondence, and multiple virtual A corresponding function prompt is provided on the button icon 142 to prompt the user for the functions corresponding to the virtual button icons 142, such as an upward prompt arrow, a downward prompt arrow, a left prompt arrow, a rightward prompt arrow, and the like, and the plurality of virtual
  • the arrangement of the button icons 142 is consistent with the actual arrangement of the operation buttons 130. Thus, the user can know the function of the other operation buttons 130 in the vicinity of the currently operated operation button 130 through the distribution map 141.
  • the head mounted display device 100 is provided with ten operation buttons 130.
  • the ten operation buttons 130 are evenly distributed in the left ear shell button area 121 and the right ear shell button area 122.
  • four peripheral operation buttons 130 surround a center operation button 130, and the four peripheral operation buttons 130 are respectively an operation button 130 ( ⁇ ) that moves upward, and an operation button 130 ( ⁇ ) that moves downward.
  • the operation button 130 at the center position is the confirmation button 130 (OK).
  • the head mounted display device 100 receives the signal that the user operates the operation button 130 that moves upward.
  • the display screen 140 is controlled to display the map 141.
  • the virtual map icon 142 corresponding to each operation button 130 of the left ear shell button area 121 is displayed on the distribution map 141, that is, five virtual button icons 142 are displayed on the distribution map 141.
  • the four virtual button icons 142 surround a central virtual button icon 142, and the four virtual button icons 142 respectively correspond to the upward movement, the downward movement, the left movement, and the right movement operation of the left ear shell button area 121.
  • the arrangement of the four virtual button icons 142 is consistent with the actual arrangement of the four operation buttons 130, and the central virtual button icon 142 corresponds to the confirmation operation button 130 in the left ear button region 121.
  • the head mounted display device controls the display screen 140.
  • the distribution map 141 is displayed.
  • the distribution map 141 includes a virtual button icon 142 corresponding to each operation button 130 on the head mounted display device 100, that is, the left ear shell button area 121 is displayed on the distribution map 141.
  • the right ear shell button area 122 corresponds to the virtual button icon 142 corresponding to each of the operation buttons 130, and the plurality of the virtual button icons 142 are arranged in the same manner as the actual arrangement of the operation buttons 130.
  • the button operation prompting method determines whether the operation button receives a user's operation.
  • the control displays a distribution map of the area of the currently operated operation button on the display screen, wherein the distribution map displays a virtual button corresponding to each operation button.
  • An icon, and the arrangement manner of the plurality of virtual button icons is consistent with the actual arrangement manner of the operation button. Therefore, when the user wears the head-mounted display device, if the user needs to process the image or video on the display screen, even if the user does not see the operation button, the user only needs to operate any operation button, and the operation will be displayed on the display screen.
  • the distribution map of the button, the virtual button icon on the map corresponds to the actual distribution map of the operation button. In this way, the user can know the arrangement of the operation buttons through the displayed distribution map, which is convenient for the user to operate the operation buttons, thereby effectively avoiding misoperation.
  • the operation button 130 includes a physical button and a touch sensor located on the physical button.
  • the touch sensor is a capacitive touch sensor, a resistive touch sensor, an infrared touch sensor or an ultrasonic touch sensor.
  • the physical button is used
  • An operation command indicated by the input operation button 130 is input, for example, an operation command for moving the picture or video in the display screen 140 up, down, left, and right.
  • the touch sensor is located on a surface on which the physical button is pressed by a user, and the touch sensor senses an operation of the operation button 130 by a user. In this embodiment, the touch sensor senses the user's contact with the operating button.
  • FIG. 5 it is a flow chart of the steps of the button operation prompting method in the second embodiment of the present invention.
  • the method includes the steps of:
  • step S111 Determine whether the touch sensor receives a touch operation of the user; if yes, execute step S121; if not, the process ends.
  • S121 Control, on the display screen, the distribution map of the area where the operation button of the current operation is located.
  • the manner of highlighting the virtual button icon 142 corresponding to the currently operated operation button 130 on the profile 141 may be, for example, highlighting, highlighting by using a specific color, or adding a cursor to identify the current being The virtual button icon 142 corresponding to the operated operation button 130. Therefore, the user can clearly know the operation button 130 currently operated, and can know from the distribution map 141 the operation button 130 of what is currently functioning around the operation button 130 of the current operation, which is convenient for the user's operation.
  • the method further includes: after step S151:
  • step S131 Determine whether the physical button receives a pressing operation of the user; if yes, execute step S141; if not, the process ends.
  • the user presses the physical button to implement the corresponding function. Since the touch sensor is located above the physical button, the user must first touch the touch sensor before pressing the physical button.
  • the head mounted display device 100 receives a signal that the physical button is pressed, thereby determining that the physical button has received a pressing operation of the user.
  • the map may disappear on the display screen 140 or may not disappear.
  • the head mounted display device 100 performs a function corresponding to the physical button. For example, when the physical button is a control command that can input an upward movement, the When the physical button receives the user's pressing operation, the head mounted display device 100 controls the video or image currently displayed on the display screen 140 to move upward.
  • the operation button is a physical button
  • the physical button can receive a first pressing operation and a second pressing operation of the physical button by the user.
  • the head mounted display device 100 controls to display the profile 141 on the display screen 140, when the physical button receives the second pressing operation of the user, The head mounted display device 100 performs a function corresponding to the physical button.
  • the button operation prompting method includes the following steps:
  • step S112. Determine whether the physical button receives the first pressing operation of the user; if yes, execute step S122; if no, the process ends.
  • the physical button is determined to be the first pressing operation or the second pressing operation of the user by pressing the strength of the physical button, and the greater the strength, the greater the height of the physical button sinking. .
  • the height of the physical button sinking by the user's finger is less than the preset height, it is determined that the physical button receives the first pressing operation of the user; when the user presses the physical button, the height of the sinking is greater than or equal to the pre-predetermined
  • the strength of the first pressing operation is smaller than the strength of the second pressing operation.
  • the physical button must receive the first pressing operation before receiving the second pressing operation.
  • the preset height is, for example, 1/4, 1/3, 1/2, etc. of the maximum height at which the physical button can be pressed, and the preset height can be set according to the needs of the user.
  • S122 Control to display the distribution map of the physical button on the display screen.
  • the head mounted display device 100 controls, on the display screen 140, the distribution map 141 of the area where the physical button currently operated is displayed.
  • the virtual button icon 142 corresponding to each physical button is displayed on the distribution map 141, and the arrangement manner of the plurality of virtual button icons 142 and the actual arrangement of the physical buttons Consistent.
  • the manner of highlighting the virtual button icon 142 corresponding to the currently operated operation button 130 on the profile 141 may be, for example, highlighting, highlighting by using a specific color, or adding a cursor to identify the current being The virtual button icon 142 corresponding to the operated operation button 130. Therefore, the user can clearly know the operation button 130 currently operated, and can know from the distribution map 141 the operation button 130 of what is currently functioning around the operation button 130 of the current operation, which is convenient for the user's operation.
  • step S132 Determine whether the physical button receives the second pressing operation of the user; if yes, execute step S142; if not, the process ends.
  • the head mounted display device 100 determines that the physical button receives the user. The second pressing operation.
  • S142 Control the head mounted display device to perform a function corresponding to the physical button.
  • the physical button when the height of the physical button being pressed and lowered reaches a preset height, the physical button receives a second pressing operation of the user, and the head mounted display device 100 controls its execution to correspond to the physical button.
  • the function when the height of the physical button being pressed and lowered reaches a preset height, the physical button receives a second pressing operation of the user, and the head mounted display device 100 controls its execution to correspond to the physical button. The function.
  • the operation button is a touch button.
  • the touch button can receive a first touch operation and a second touch operation of the touch button by the user, and when the touch button receives the first touch operation of the user, the head mounted display device controls display on the display screen The distribution map, when the touch button receives the second touch operation of the user, the head mounted display device performs a function corresponding to the touch button.
  • the operation prompting method of the button includes the following steps:
  • the touch button is determined to be a first touch operation or a second touch operation of the user by the user touching the length of the touch button.
  • the touch button receives the first touch operation of the user; when the user touches the touch button for longer than or equal to the preset duration, the touch is The button receives the second touch operation of the user.
  • the touch duration of the first touch operation is smaller than the touch duration of the second touch operation.
  • the touch button must first receive the first touch operation to receive the second touch operation.
  • the preset duration is, for example, 100 ms, 200 ms, 300 ms, etc., and can be set according to user requirements.
  • S123 Control, on the display screen, the distribution map of the area of the currently operated touch button.
  • the head mounted display device 100 controls to display the distribution map 141 on the display screen 140, and the distribution map 141 displays
  • the virtual button icon 142 corresponding to each touch button in the area where the touch button is operated is arranged, and the arrangement manner of the plurality of virtual button icons 142 is consistent with the actual arrangement manner of the touch button.
  • the manner of highlighting the virtual button icon 142 corresponding to the currently operated operation button 130 on the profile 141 may be, for example, highlighting, highlighting by using a specific color, or adding a cursor to identify the current being The virtual button icon 142 corresponding to the operated operation button 130. Therefore, the user can clearly know the operation button 130 currently operated, and can know from the distribution map 141 the operation button 130 of what is currently functioning around the operation button 130 of the current operation, which is convenient for the user's operation.
  • the touch button when the user keeps touching the touch button and the touch duration reaches a preset duration, the touch button receives the second touch operation of the user, and the head mounted display device 100 determines the The touch button receives a second touch operation of the user.
  • S143 Control the head mounted display device to perform a function corresponding to the touch button.
  • the touch The touch button receives a second touch operation of the user, and the head mounted display device 100 controls it to perform a function corresponding to the touch button.
  • the head mounted display device 100 includes a display screen 140, a plurality of operation buttons 130, a memory 220, a processor 210, and a connection line. .
  • the processor 210, the memory 220, the display screen 140, and the plurality of operation buttons 130 are electrically connected by a connection line, wherein the memory 220 stores one or more sets of program codes, and the processor 210 calls the memory 220.
  • Stored program code do the following:
  • the control When the operation button 130 receives the operation of the user, the control displays the distribution map 141 of the area of the currently operated operation button 130 on the display screen 140, wherein the distribution map 141 displays and the operation button 130 corresponds to the virtual button icon 142, and the arrangement manner of the plurality of virtual button icons 142 is consistent with the actual arrangement manner of the operation button 130.
  • the operation button 130 includes a physical button and a touch sensor located on the physical button, and the touch sensor senses a user's touch operation on the operation button 130.
  • the processor 210 performs an operation of determining whether the operation button 130 receives the user, and is specifically configured to: determine whether the touch sensor receives a touch operation of the user; and the processor 210 executes
  • the control displays the distribution map 141 of the area where the operation button 130 is currently operated on the display screen 140, specifically for: when the touch sensor receives the user's
  • the distribution map 141 of the area where the operation button 130 currently operated is currently displayed is displayed on the display screen 140.
  • the processor 210 further performs the following operations: determining whether the physical button receives the user's pressing operation after knowing the function corresponding to the operation button 130; When the physical button receives the pressing operation of the user, it controls to perform a function corresponding to the physical button.
  • the processor 210 further performs an operation of highlighting the virtual button icon 142 corresponding to the currently operated operation button 130 on the profile 141.
  • highlighting and current operation on the distribution map 141 the virtual button icon 142 corresponding to the operation button 130 may be: the virtual button icon 142 corresponding to the currently operated operation button 130 is identified by highlighting, highlighting with a specific color, or adding a cursor. Therefore, the user can clearly know the operation button 130 of the current operation from the distribution map 141, and can know from the distribution map 141 the operation buttons 130 of what functions around the currently operated operation button 130, which is convenient for the user's operation.
  • the operation button is a physical button; the physical button receives a user first pressing operation and a second pressing operation; and the processor performs to determine whether the operation button receives the user
  • the operation is specifically: determining whether the physical button receives the first pressing operation of the user; and the processor performs the operation of displaying the current operation on the display screen when the operation button receives the operation of the user
  • the distribution map of the area where the button is located is specifically: when the physical button receives the first pressing operation of the user, the control displays the distribution map of the physical button on the display screen.
  • the processor further performs: determining whether the physical button receives a second pressing operation of the user; and when the physical button receives the second pressing operation of the user, controlling the head mounted display device to execute the physical button Corresponding function.
  • the force of the first pressing operation is smaller than the strength of the second pressing operation, so that the height of the physical button sinking when the first pressing operation is performed is smaller than the height of the physical button sinking when the second pressing operation is performed.
  • the head-mounted display device please refer to the description of the second embodiment, and details are not described herein again.
  • the operation button is a touch button
  • the touch button can receive a first touch operation and a second touch operation of the touch button by the user; and determining whether the operation button is received
  • the operation to the user is specifically: determining whether the touch button receives the user's first touch operation; and when the operation button receives the user's operation, controlling to display on the display screen the area of the currently operated operation button
  • the distribution map is specifically configured to: when the touch button receives the first touch operation of the user, control to display an operation button distribution map of the currently operated area of the touch button on the display screen.
  • the processor further performs: determining whether the touch button receives a second touch operation of the user; and when the touch button receives the second touch operation of the user, controlling the head mounted display device to perform the touch The function corresponding to the button.
  • the touch duration of the first touch operation is smaller than the touch duration of the second touch operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种按键操作提示方法，运行于头戴显示设备（100）上。头戴显示设备（100）包括显示屏（140）、多个操作按键（130）。按键操作提示方法包括：判断操作按键（130）是否接收到用户的操作（S110）；当操作按键（130）接收到用户的操作时，控制在显示屏（140）上显示当前操作的操作按键所在区域的分布图（141）（S120），其中分布图（141）上显示有与每一操作按键相对应的虚拟按键图标（142），且虚拟按键图标（142）的排布方式与操作按键（130）的实际排布方式一致。

Description

按键操作提示方法及头戴显示设备 技术领域
本发明涉及按键操作提示技术，尤其涉及一种按键操作提示方法及头戴显示设备。
背景技术
现有的HMD(Head Mount Display，头戴显示设备)，包括显示屏和便于用户操作的操作按键。当用户将头戴显示设备戴到头上后，用户的眼睛可以看到显示屏，但是用户看不到外置的操作按键，此时，如果用户需要对显示屏上的图像或者视频进行处理，例如移动图像或者缩放图像等，用户只能通过记忆或者感觉去操作操作按键，从而可能造成误操作，不方便用户对操作按键的操作。
发明内容
本发明实施例所要解决的技术问题在于，提供一种按键操作提示方法及头戴显示设备。可方便用户对操作按键的操作。
为了解决上述技术问题，本发明第一方面提供了一种按键操作提示方法，运行于头戴显示设备上，所述头戴显示设备包括显示屏、多个操作按键，所述按键操作提示方法包括：
判断所述操作按键是否接收到用户的操作；
当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。
本发明第二方面提供了一种头戴显示设备，包括显示屏、多个操作按键、存储器、处理器和连接线路，所述处理器、存储器、显示屏、多个操作按键通 过连接线路电连接，其中，所述存储器存储一组程序代码，所述处理器用于调用所述存储器中存储的程序代码，执行以下操作：
判断所述操作按键是否接收到用户的操作；
当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。
实施本发明实施例，具有如下有益效果：
只要操作按键接收到用户的操作例如触碰或按压，该头戴显示设备上便会显示所有按键的图标与排布位置，如此，可让佩戴该头戴显示设备的用户非常方便的观看到按键并对按键施加相应的操作。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明第一实施例中的按键操作提示方法的流程图；
图2-1是本发明一实施方式中的头戴显示设备的示意图；
图2-2为图1中的头戴显示设备的操作按键区域放大示意图；
图3是本发明一实施方式中操作按键的分布图在显示屏中显示的示意图；
图4是本发明另一实施方式中操作按键的分布图在显示屏中显示的示意图；
图5是本发明第二实施例按键操作提示方法的流程图；
图6是本发明第三实施例按键操作提示方法的流程图；
图7是本发明第四实施例按键操作提示方法的流程图；
图8是本发明一实施例中的头戴显示设备的硬件结构示意图；
图示标号：
100-头戴显示设备；121-左耳壳按键区；122-右耳壳按键区；130-操作按键；140-显示屏；141-分布图；142-虚拟按键图标；210-处理器；220-存储器。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
本申请说明书、权利要求书和附图中出现的术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。此外，术语“第一”、“第二”和“第三”等是用于区别不同的对象，而并非用于描述特定的顺序。
第一实施例
本发明实施例提供一种按键操作提示方法，运行于头戴显示设备100上。请参见图2-1、图2-2，该头戴显示设备100包括显示端110及与显示端110转动连接的头戴端120。显示端110包括至少一显示屏140(请参见图3)。该头戴显示设备100还包括多个操作按键130。该多个操作按键130设置在头戴显示设备100的外侧便于用户操作。在本实施方式中，该多个操作按键130均设置在显示端110与头戴端120转动连接的位置处，具体的，该多个操作按键130设置在头戴显示设备100的耳机外壳上。用户戴上头戴显示设备100后，透过目镜可以观看到显示屏140显示的视频或者图像。
请参见图1，所示为本发明第一实施方式中的按键操作提示方法的步骤流程图。该方法包括以下步骤：
步骤S110：判断所述操作按键是否接收到用户的操作；若是，则执行步骤S120。若否，则流程结束。
在本发明实施例中，所述操作按键130可以接收到用户的操作，用户的操 作可以为按压操作、触摸操作等。当所述操作按键130有接收到用户的操作时，所述头戴显示设备100接收到相应的信号。
步骤S120：控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。
请一并参见图2和图3，在本发明中，多个所述操作按键130可能集中设置在一个区域，也可能集中设置在多个区域。以下以所述操作按键130分布在2个区域为例进行说明，分别位于所述头戴显示设备100的左耳机的外壳和右耳机的外壳上，位于左耳机外壳上的多个操作按键130所在的区域称为左耳壳按键区121，位于右耳机外壳上的多个操作按键130所在的区域称为右耳壳按键区122。当左耳壳按键区121内的某个操作按键130有接收到用户的操作时，例如用户通过手指触摸或者按压该操作按键130，头戴显示设备100会接收到用户操作操作按键130的信号，相应的，头戴显示设备100控制在所述显示屏140上显示当前操作的该操作按键130所在区域的分布图141，其中，该分布图141上显示有与当前操作的该操作按键130所在的左耳壳按键区121内每一操作按键130相对应的虚拟按键图标142，也即分布图141上的虚拟按键图标142与左耳壳按键区121的操作按键130一一对应，而且多个虚拟按键图标142上设有相应的功能提示符以提示用户该些虚拟按键图标142对应的功能，例如向上提示箭头、向下提示箭头、向左提示箭头、向右提示箭头等，且多个该虚拟按键图标142的排列方式与所述操作按键130的实际排列方式一致。从而，用户可以通过分布图141知道当前操作的操作按键130附近的其他操作按键130的功能。
在本实施方式中，该头戴显示设备100上设置有10个操作按键130。这10个操作按键130平均分布在左耳壳按键区121和右耳壳按键区122。在左耳壳按键区121中4个周边操作按键130围绕一个中心操作按键130，4个周边操作按键130分别为向上移动的操作按键130(▲)、向下移动的操作按键130(▼)、向左移动的操作按键130
Figure PCTCN2017099683-appb-000001
和向右移动的操作按键130
Figure PCTCN2017099683-appb-000002
中心位置处的操作按键130为确认按键130(OK)。当用户操作左耳壳按键区121中的某个操作按键130时，例如用户操作向上移动的操作按键130，此时 所述头戴显示设备100接收到用户操作了向上移动的操作按键130的信号，便控制所述显示屏140显示所述分布图141。请参见图3，所述分布图141上显示有与左耳壳按键区121的每一操作按键130相对应的虚拟按键图标142，也即，分布图141上显示有5个虚拟按键图标142，其中4个虚拟按键图标142围绕一个位于中心的虚拟按键图标142，4个虚拟按键图标142分别对应左耳壳按键区121的向上移动、向下移动、向左移动和向右移动的操作按键130，且该4个虚拟按键图标142的排列方式与4个操作按键130的实际排列方式一致，中心的虚拟按键图标142对应左耳壳按键区121中的确认操作按键130。在另一实施方式中，请参见图4，当用户手指操作任一操作按键130时，此时对应的操作按键130有接收到用户的操作，所述头戴式显示设备控制所述显示屏140显示所述分布图141，所述分布图141上包括有头戴显示设备100上每一操作按键130相对应的虚拟按键图标142，也即所述分布图141上显示左耳壳按键区121和右耳壳按键区122每一操作按键130相对应的虚拟按键图标142，多个所述虚拟按键图标142的排列方式与所述操作按键130的实际排列方式一致。
在本发明中，所述按键操作提示方法通过判断所述操作按键是否接收到用户的操作。当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。从而，当用户戴上头戴显示设备后，如果用户需要对显示屏上的图像或者视频等进行处理，即使用户看不到操作按键，用户只需操作任意一操作按键，显示屏上会显示操作按键的分布图，该分布图上的虚拟按键图标与操作按键的实际分布图相对应。如此，用户通过所显示的分布图便可知操作按键的排布，方便用户对操作按键进行操作，有效避免误操作。
第二实施例
在本实施方式中，所述操作按键130包括物理按键和位于所述物理按键上的触摸感应器。所述触摸感应器为电容式触摸感应器、电阻式触摸感应器、红外线式触摸感应器或者超声波式触摸感应器。在本实施例中，所述物理按键用 于输入操作按键130所表示的操作指令，例如输入使显示屏140中的图片或者视频向上、向下、向左、向右移动的操作指令。所述触摸感应器位于所述物理按键供用户按压的表面上，所述触摸感应器感应用户对该操作按键130的操作。这本实施例中，触摸感应器感应用户与操作按键的接触。
请参见图5，所述为本发明第二实施例中的该按键操作提示方法的步骤流程图。该方法包括步骤：
S111：判断所述触摸感应器是否有接收到用户的触摸操作；若是，则执行步骤S121；若否，则流程结束。
S121：控制在所述显示屏上显示当前操作的该操作按键所在区域的所述分布图。
S151：在该分布图上突出显示与当前操作的操作按键对应的虚拟按键图标。
在本实施例中，在分布图141上突出显示与当前被操作的操作按键130对应的虚拟按键图标142的方式例如可以为：通过高亮、使用特定颜色突出或者增加光标来标识所述当前被操作的操作按键130对应的虚拟按键图标142。从而用户可以很明显的知道目前操作的操作按键130，并可以从分布图141中知道当前操作的操作按键130周围有些什么功能的操作按键130，方便用户的操作。
在知道操作按键130的功能后，为了执行操作按键130对应的功能，在本实施例中，该方法在步骤S151之后还包括：
S131：判断所述物理按键是否接收到用户的按压操作；若是，则执行步骤S141；若否，则流程结束。
在本实施例中，用户通过手指按压物理按键来实现相应的功能，由于所述触摸感应器位于所述物理按键的上方，从而用户按压物理按键之前必然需要先接触触摸感应器。当用户手指按压物理按键时，头戴显示设备100会接收到物理按键被按压的信号，从而判断所述物理按键有接收到用户的按压操作。在执行该操作按键对应的功能时，所述分布图可以在显示屏140上消失，也可以不消失。
S141：控制执行该物理按键对应的功能。
在本实施例中，如果所述物理按键接收到用户的按压操作，则头戴显示设备100执行该物理按键对应的功能，例如，该物理按键为可以输入向上移动的控制命令时，则当该物理按键接收到用户的按压操作时，头戴显示设备100控制显示屏140上当前显示的视频或者图像向上移动。
第三实施例
本实施例与第二实施例的主要区别为所述操作按键为物理按键，所述物理按键可接收用户对该物理按键的第一按压操作及第二按压操作。当所述物理按键接收到用户的第一按压操作时，头戴显示设备100控制在所述显示屏140上显示所述分布图141，当所述物理按键接收到用户的第二按压操作时，所述头戴显示设备100执行该物理按键对应的功能。
请参见图6，在本实施例中，该按键操作提示方法包括步骤：
S112、判断所述物理按键是否接收到用户的第一按压操作；若是，则执行步骤S122；若否，则流程结束。
在本实施例中，通过用户手指按压所述物理按键的力度来判断所述物理按键是接收到用户的第一按压操作或者第二按压操作，力度越大，物理按键下沉的高度也越大。当用户手指按压所述物理按键下沉的高度小于预设高度时，判断此时所述物理按键接收到用户的第一按压操作；当用户手指按压所述物理按键下沉的高度大于或等于预设高度时，判断此时物理按键接收到用户的第二按压操作，在本实施例中，所述第一按压操作的力度小于所述第二按压操作的力度。在此处，物理按键要接收到第二按压操作必定会先接收第一按压操作。在本实施例中，所述预设高度例如为物理按键可以按压下沉的最大高度的1/4、1/3、1/2等，该预设高度可以根据用户的需求进行设定。
S122：控制在所述显示屏上显示该物理按键的所述分布图。
在本实施例中，当所述物理按键接收到用户的第一按压操作时，头戴显示设备100控制在所述显示屏140上显示当前操作的该物理按键所在区域的所述分布图141，所述分布图141上显示有与每一物理按键相对应的虚拟按键图标142，且该多个虚拟按键图标142的排列方式与所述物理按键的实际排列方式 一致。
S151：在该分布图上突出显示与当前操作的操作按键对应的虚拟按键图标。
在本实施例中，在分布图141上突出显示与当前被操作的操作按键130对应的虚拟按键图标142的方式例如可以为：通过高亮、使用特定颜色突出或者增加光标来标识所述当前被操作的操作按键130对应的虚拟按键图标142。从而用户可以很明显的知道目前操作的操作按键130，并可以从分布图141中知道当前操作的操作按键130周围有些什么功能的操作按键130，方便用户的操作。
S132：判断所述物理按键是否接收到用户的第二按压操作；若是，则执行步骤S142；若否，则流程结束。
在本实施例中，当所述用户进一步加大力量按压所述物理按键，物理按键被按压下沉的高度达到了预设高度时，此时头戴显示设备100判断所述物理按键接收到用户的第二按压操作。
S142：控制所述头戴显示设备执行该物理按键对应的功能。
在本实施例中，当所述物理按键被按压下沉的高度达到预设高度时，所述物理按键接收到用户的第二按压操作，头戴显示设备100控制其执行与该物理按键相对应的功能。
第四实施例
本实施例与上述实施例的主要区别为所述操作按键为触摸按键。所述触摸按键可接收用户对该触摸按键的第一触摸操作及第二触摸操作，当所述触摸按键接收到用户的第一触摸操作时，头戴显示设备控制在所述显示屏上显示所述分布图，当所述触摸按键接收到用户的第二触摸操作时，所述头戴显示设备执行该触摸按键对应的功能。
请参见图7，在本实施例中，该按键的操作提示方法包括步骤：
S113：判断所述触摸按键是否接收到用户的第一触摸操作；若是，则执行步骤S123；若否，则流程结束。
在本实施例中，通过用户触摸所述触摸按键的时长来判断所述触摸按键是接收到用户的第一触摸操作或者第二触摸操作。当用户触摸所述触摸按键的时长小于预设时长时，此时所述触摸按键接收到用户的第一触摸操作；当用户触摸所述触摸按键的时长大于或等于预设时长时，此时触摸按键接收到用户的第二触摸操作，在本实施例中，所述第一触摸操作的触摸时长小于所述第二触摸操作的触摸时长。在此处，触摸按键要接收到第二触摸操作必需先接收到第一触摸操作。在本实施例中，所述预设时长例如为100ms、200ms、300ms等，可以根据用户的需求进行设定。
S123:控制在所述显示屏上显示当前操作的该触摸按键所在区域的所述分布图。
在本实施例中，当所述触摸按键接收到用户的第一触摸操作时，头戴显示设备100控制在所述显示屏140上显示所述分布图141，所述分布图141上显示有与操作的该触摸按键所在区域每一触摸按键相对应的虚拟按键图标142，且该多个虚拟按键图标142的排列方式与所述触摸按键的实际排列方式一致。
S151：在该分布图上突出显示与当前操作的操作按键对应的虚拟按键图标。
在本实施例中，在分布图141上突出显示与当前被操作的操作按键130对应的虚拟按键图标142的方式例如可以为：通过高亮、使用特定颜色突出或者增加光标来标识所述当前被操作的操作按键130对应的虚拟按键图标142。从而用户可以很明显的知道目前操作的操作按键130，并可以从分布图141中知道当前操作的操作按键130周围有些什么功能的操作按键130，方便用户的操作。
S133：判断所述触摸按键是否接收到用户的第二触摸操作；若是，则执行步骤S143；若否，则流程结束。
在本实施例中，当所述用户一直触摸所述触摸按键不放，触摸时长达到预设时长时，此时所述触摸按键接收到用户的第二触摸操作，头戴显示设备100判断所述触摸按键接收到用户的第二触摸操作。
S143:控制所述头戴显示设备执行与该触摸按键相对应的功能。
在本实施例中，当所述触摸按键被触摸的时间达到预设时长时，则所述触 摸按键接收到用户的第二触摸操作，头戴显示设备100控制其执行与该触摸按键相对应的功能。
下面将结合附图8对本发明实施例提供的头戴显示设备进行详细介绍。请合并参见图2-1、图2-2、图3和图8，在本实施例中，头戴显示设备100包括显示屏140、多个操作按键130、存储器220、处理器210和连接线路。所述处理器210、存储器220、显示屏140、多个操作按键130通过连接线路电连接，其中，所述存储器220存储一组或多组程序代码，所述处理器210调用所述存储器220中存储的程序代码，执行以下操作：
判断所述操作按键130是否接收到用户的操作；
当所述操作按键130接收到用户的操作时，控制在所述显示屏140上显示当前操作的该操作按键130所在区域的分布图141，其中，该分布图141上显示有与每一操作按键130相对应的虚拟按键图标142，且该多个虚拟按键图标142的排布方式与所述操作按键130的实际排布方式一致。
在本实施例中，所述操作按键130包括物理按键和位于所述物理按键上的触摸感应器，所述触摸感应器感应用户对该操作按键130的触摸操作。在本实施例中，所述处理器210执行判断所述操作按键130是否接收到用户的操作，具体用于：判断所述触摸感应器是否有接收到用户的触摸操作；所述处理器210执行当所述操作按键130接收到用户的操作时，控制在所述显示屏140上显示当前操作的该操作按键130所在区域的分布图141，具体用于：当所述触摸感应器接收到用户的触摸操作时，控制在所述显示屏140上显示当前操作的该操作按键130所在区域的所述分布图141。
在知道相应操作按键130对应的功能后，为了执行操作按键130对应的功能，在本实施例中，所述处理器210还执行以下操作：判断所述物理按键是否接收到用户的按压操作；当所述物理按键接收到用户的按压操作时，控制执行该物理按键对应的功能。
为了方便用户知道当前操作的操作按键130，在本实施例中，所述处理器210还执行以下操作：在该分布图141上突出显示与当前操作的操作按键130对应的虚拟按键图标142。在本实施例中，在分布图141上突出显示与当前操 作的操作按键130对应的虚拟按键图标142的方式例如可以为：通过高亮、使用特定颜色突出或者增加光标来标识所述当前被操作的操作按键130对应的虚拟按键图标142。从而用户可以从分布图141上很明显的知道当前操作的操作按键130，并可以从分布图141中知道当前操作的操作按键130周围有些什么功能的操作按键130，方便用户的操作。另外，本发明实施例头戴显示设备100的具体细节描述请参见第一实施例的描述，在此就不再赘述。
另外，在本发明的其他实施例中，所述操作按键为物理按键；所述物理按键接收用户第一按压操作及第二按压操作；所述处理器执行判断所述操作按键是否接收到用户的操作，具体为：判断所述物理按键是否接收到用户的第一按压操作；所述处理器执行当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，具体为：当所述物理按键接收到用户的第一按压操作时，控制在所述显示屏上显示该物理按键的分布图。所述处理器还执行以下操作：判断所述物理按键是否接收到用户的第二按压操作；当所述物理按键接收到用户的第二按压操作时，控制所述头戴显示设备执行该物理按键对应的功能。在此处，所述第一按压操作的力度小于所述第二按压操作的力度，以实现第一按压操作时物理按键下沉的高度小于第二按压操作时物理按键下沉的高度。另外，此处头戴显示设备的具体细节描述请参见第二实施例的描述，在此就不再赘述。
另外，在本发明的其他实施例中，所述操作按键为触摸按键，所述触摸按键可接收用户对该触摸按键的第一触摸操作及第二触摸操作；所述判断所述操作按键是否接收到用户的操作，具体为：判断所述触摸按键是否接收到用户的第一触摸操作；当操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，具体为：当所述触摸按键接收到用户的第一触摸操作时，控制在所述显示屏上显示当前操作的该触摸按键所在区域的操作按键分布图。所述处理器还执行以下操作：判断所述触摸按键是否接收到用户的第二触摸操作；当所述触摸按键接收到用户的第二触摸操作时，控制所述头戴显示设备执行与该触摸按键相对应的功能。在此处，所述第一触摸操作的触摸时长小于所述第二触摸操作的触摸时长。另外，此处头戴显示设备的具体细节描述请参见第三实施例的描述，在此就不再赘述。
需要说明的是，本说明书中的各个实施例均采用递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同相似的部分互相参见即可。对于装置实施例而言，由于其与方法实施例基本相似，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上所揭露的仅为本发明较佳实施例而已，当然不能以此来限定本发明之权利范围，因此依本发明权利要求所作的等同变化，仍属本发明所涵盖的范围。

Claims (20)

  1. 一种按键操作提示方法，运行于头戴显示设备上，所述头戴显示设备包括显示屏、多个操作按键，其特征在于，所述按键操作提示方法包括：
    判断所述操作按键是否接收到用户的操作；
    当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。
  2. 如权利要求1所述的按键操作提示方法，其特征在于，所述操作按键包括物理按键和位于所述物理按键上的触摸感应器，所述触摸感应器感应用户对该操作按键的触摸操作；
    步骤判断所述操作按键是否接收到用户的操作具体为：判断所述触摸感应器是否有接收到用户的触摸操作；
    步骤当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图具体为：当所述触摸感应器接收到用户的触摸操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的操作按键分布图。
  3. 如权利要求2所述的按键操作提示方法，其特征在于，在控制在所述显示屏上显示当前操作的该操作按键所在区域的所述分布图的步骤之后还包括：
    判断所述物理按键是否接收到用户的按压操作；
    当所述物理按键接收到用户的按压操作时，控制执行该物理按键对应的功能。
  4. 如权利要求1所述的按键操作提示方法，其特征在于，所述操作按键为物理按键；所述物理按键接收用户第一按压操作及第二按压操作；
    步骤判断所述操作按键是否接收到用户的操作具体为：判断所述物理按键是否接收到用户的第一按压操作；
    步骤当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图具体为：当所述物理按键接收到用户的第一按压操作时，控制在所述显示屏上显示该物理按键的实际分布图。
  5. 如权利要求4所述的按键操作提示方法，其特征在于，该方法还包括：
    判断所述物理按键是否接收到用户的第二按压操作；
    当所述物理按键接收到用户的第二按压操作时，控制所述头戴显示设备执行该物理按键对应的功能。
  6. 如权利要求4或5所述的按键操作提示方法，其特征在于，所述第一按压操作的力度小于所述第二按压操作的力度。
  7. 如权利要求1所述的按键操作提示方法，其特征在于，所述操作按键为触摸按键，所述触摸按键可接收用户对该触摸按键的第一触摸操作及第二触摸操作；
    步骤判断所述操作按键是否接收到用户的操作具体为：判断所述触摸按键是否接收到用户的第一触摸操作；
    步骤当操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图具体为：当所述触摸按键接收到用户的第一触摸操作时，控制在所述显示屏上显示当前操作的该触摸按键所在区域的操作按键分布图。
  8. 如权利要求7所述的按键操作提示方法，其特征在于，所述方法还包括：
    判断所述触摸按键是否接收到用户的第二触摸操作；
    当所述触摸按键接收到用户的第二触摸操作时，控制所述头戴显示设备执行与该触摸按键相对应的功能。
  9. 如权利要求7或8所述的按键操作提示方法，其特征在于，所述第一触摸操作的触摸时长小于所述第二触摸操作的触摸时长。
  10. 如权利要求1-5、7、8任一项所述的按键操作提示方法，其特征在于，在控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图的步骤的同时或之后还包括：
    在该分布图上突出显示与当前操作的操作按键对应的虚拟按键图标。
  11. 一种头戴显示设备，其特征在于，包括显示屏、多个操作按键、存储器、处理器和连接线路，所述处理器、存储器、显示屏、多个操作按键通过连接线路电连接，其中，所述存储器存储一组或多组程序代码，所述处理器调用所述存储器中存储的程序代码，执行以下操作：
    判断所述操作按键是否接收到用户的操作；
    当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，其中，该分布图上显示有与每一操作按键相对应的虚拟按键图标，且该多个虚拟按键图标的排布方式与所述操作按键的实际排布方式一致。
  12. 如权利要求11所述的头戴显示设备，其特征在于，所述操作按键包括物理按键和位于所述物理按键上的触摸感应器，所述触摸感应器感应用户对该操作按键的触摸操作；
    所述判断所述操作按键是否接收到用户的操作，具体用于：判断所述触摸感应器是否有接收到用户的触摸操作；
    所述当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，具体为：当所述触摸感应器接收到用户的触摸操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的操作按键分布图。
  13. 如权利要求12所述的头戴显示设备，其特征在于，所述处理器还执行以下操作：
    判断所述物理按键是否接收到用户的按压操作；
    当所述物理按键接收到用户的按压操作时，控制执行该物理按键对应的功能。
  14. 如权利要求11所述的头戴显示设备，其特征在于，所述操作按键为物理按键；所述物理按键接收用户第一按压操作及第二按压操作；
    所述处理器执行判断所述操作按键是否接收到用户的操作，具体为：判断所述物理按键是否接收到用户的第一按压操作；
    所述处理器执行当所述操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该操作按键所在区域的分布图，具体为：当所述物理按键接收到用户的第一按压操作时，控制在所述显示屏上显示该物理按键的分布图。
  15. 如权利要求14所述的头戴显示设备，其特征在于，所述处理器还执行以下操作：
    判断所述物理按键是否接收到用户的第二按压操作；
    当所述物理按键接收到用户的第二按压操作时，控制所述头戴显示设备执行该物理按键对应的功能。
  16. 如权利要求14或15所述的头戴显示设备，其特征在于，所述第一按压操作的力度小于所述第二按压操作的力度。
  17. 如权利要求14所述的头戴显示设备，其特征在于，所述操作按键为触摸按键，所述触摸按键可接收用户对该触摸按键的第一触摸操作及第二触摸操作；
    所述判断所述操作按键是否接收到用户的操作，具体为：判断所述触摸按键是否接收到用户的第一触摸操作；
    当操作按键接收到用户的操作时，控制在所述显示屏上显示当前操作的该 操作按键所在区域的分布图，具体为：当所述触摸按键接收到用户的第一触摸操作时，控制在所述显示屏上显示当前操作的该触摸按键所在区域的操作按键分布图。
  18. 如权利要求17所述的头戴显示设备，其特征在于，所述处理器还执行以下操作：
    判断所述触摸按键是否接收到用户的第二触摸操作；
    当所述触摸按键接收到用户的第二触摸操作时，控制所述头戴显示设备执行与该触摸按键相对应的功能。
  19. 如权利要求17或18所述的头戴显示设备，其特征在于：所述第一触摸操作的触摸时长小于所述第二触摸操作的触摸时长。
  20. 如权利要求11-15、17、18任意一项所述的头戴显示设备，其特征在于，所述处理器还执行以下操作：
    在该分布图上突出显示与当前操作的操作按键对应的虚拟按键图标。
PCT/CN2017/099683 2017-08-30 2017-08-30 按键操作提示方法及头戴显示设备 WO2019041171A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780092189.3A CN110770677A (zh) 2017-08-30 2017-08-30 按键操作提示方法及头戴显示设备
PCT/CN2017/099683 WO2019041171A1 (zh) 2017-08-30 2017-08-30 按键操作提示方法及头戴显示设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/099683 WO2019041171A1 (zh) 2017-08-30 2017-08-30 按键操作提示方法及头戴显示设备

Publications (1)

Publication Number Publication Date
WO2019041171A1 true WO2019041171A1 (zh) 2019-03-07

Family

ID=65524608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/099683 WO2019041171A1 (zh) 2017-08-30 2017-08-30 按键操作提示方法及头戴显示设备

Country Status (2)

Country Link
CN (1) CN110770677A (zh)
WO (1) WO2019041171A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11178384B2 (en) * 2019-07-10 2021-11-16 Nintendo Co., Ltd. Information processing system, storage medium, information processing apparatus and information processing method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104615237A (zh) * 2013-11-05 2015-05-13 精工爱普生株式会社 图像显示系统、控制其的方法及头部佩戴型显示装置
CN105867609A (zh) * 2015-12-28 2016-08-17 乐视移动智能信息技术（北京）有限公司 基于虚拟现实头盔观看视频的方法和装置
CN106873763A (zh) * 2016-12-26 2017-06-20 奇酷互联网络科技（深圳）有限公司 虚拟现实设备及其信息输入方法
WO2017113194A1 (zh) * 2015-12-30 2017-07-06 深圳市柔宇科技有限公司 头戴式显示设备、头戴式显示系统及输入方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104615237A (zh) * 2013-11-05 2015-05-13 精工爱普生株式会社 图像显示系统、控制其的方法及头部佩戴型显示装置
CN105867609A (zh) * 2015-12-28 2016-08-17 乐视移动智能信息技术（北京）有限公司 基于虚拟现实头盔观看视频的方法和装置
WO2017113194A1 (zh) * 2015-12-30 2017-07-06 深圳市柔宇科技有限公司 头戴式显示设备、头戴式显示系统及输入方法
CN106873763A (zh) * 2016-12-26 2017-06-20 奇酷互联网络科技（深圳）有限公司 虚拟现实设备及其信息输入方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11178384B2 (en) * 2019-07-10 2021-11-16 Nintendo Co., Ltd. Information processing system, storage medium, information processing apparatus and information processing method

Also Published As

Publication number Publication date
CN110770677A (zh) 2020-02-07

Similar Documents

Publication Publication Date Title
US11449224B2 (en) Selective rejection of touch contacts in an edge region of a touch surface
US8274484B2 (en) Tracking input in a screen-reflective interface environment
TWI486868B (zh) 具有快捷啟動功能之電子裝置及其控制方法
KR20130052749A (ko) 터치 기반 사용자 인터페이스 장치 및 방법
WO2018103040A1 (zh) 头戴式显示设备及其内容输入方法
JP2011221640A (ja) 情報処理装置、情報処理方法およびプログラム
JP2011077863A (ja) 遠隔操作装置、遠隔操作システム、遠隔操作方法およびプログラム
TW201520882A (zh) 輸入設備及輸入管理系統
JP6017995B2 (ja) 携帯型情報処理装置、その入力方法、およびコンピュータが実行可能なプログラム
JP2015011679A (ja) 操作入力装置及び入力操作処理方法
US9182880B2 (en) Method of displaying images via touching and electronic apparatus thereof
JP2012164047A (ja) 情報処理装置
WO2019041171A1 (zh) 按键操作提示方法及头戴显示设备
TWI439922B (zh) 手持式電子裝置及其控制方法
AU2013205165B2 (en) Interpreting touch contacts on a touch surface
TW201327349A (zh) 以週邊裝置操作螢幕顯示選單的方法
JPH11126132A (ja) 入力装置
AU2015271962B2 (en) Interpreting touch contacts on a touch surface
US20100265107A1 (en) Self-description of an adaptive input device
JP2013246796A (ja) 入力装置、入力支援方法及びプログラム
US9454248B2 (en) Touch input method and electronic apparatus thereof
KR20120070133A (ko) 카메라를 이용한 가상 터치 인터페이스 제공 장치 및 그 방법
US10955962B2 (en) Electronic device and control method thereof that switches a touch panel between an independent mode and a dual input mode
US11314410B2 (en) Mobile device
US20210334117A1 (en) Electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17923217

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17923217

Country of ref document: EP

Kind code of ref document: A1