WO2018103072A1 - 用户界面的调整方法、调整系统及头戴显示设备 - Google Patents

用户界面的调整方法、调整系统及头戴显示设备 Download PDF

Info

Publication number
WO2018103072A1
WO2018103072A1 PCT/CN2016/109228 CN2016109228W WO2018103072A1 WO 2018103072 A1 WO2018103072 A1 WO 2018103072A1 CN 2016109228 W CN2016109228 W CN 2016109228W WO 2018103072 A1 WO2018103072 A1 WO 2018103072A1
Authority
WO
WIPO (PCT)
Prior art keywords
distance
display device
lock screen
display unit
mounted display
Prior art date
Application number
PCT/CN2016/109228
Other languages
English (en)
French (fr)
Inventor
赵聪
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to EP16923431.7A priority Critical patent/EP3553692A1/en
Priority to PCT/CN2016/109228 priority patent/WO2018103072A1/zh
Priority to US16/096,528 priority patent/US20190107885A1/en
Priority to CN201680034127.2A priority patent/CN107820599B/zh
Publication of WO2018103072A1 publication Critical patent/WO2018103072A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0181—Adaptation to the pilot/driver

Definitions

  • the present invention relates to the field of head-mounted display devices, and in particular, to a method and an adjustment system for adjusting a user interface of a head-mounted display device.
  • Head Mounted Device has been recognized by more and more users. Since the display screen is wrapped inside the head-mounted display device, the head-mounted display device needs to be worn on the user's head when in use. Moreover, the user cannot see the real keyboard after wearing the display device. Therefore, the user cannot control the head-mounted display device as when the head-mounted display device is operated by operating the PC with a physical mouse or controlling the mobile phone through the touch screen.
  • the head-mounted display device In order to ensure the security of the information, the head-mounted display device is in a lock screen state when it is not used for a period of time or turned on.
  • the user needs to unlock the screen of the head mounted display device, it is often necessary to remove the head mounted display device from the user's head, then view the screen content from the eyepiece of the head mounted display device, and perform corresponding operations according to the viewed content.
  • the graphical user interface viewed by the user from the eyepiece is smaller than when the head-mounted display device is worn on the head, is not easily seen, and is not convenient for the user to operate.
  • an embodiment of the present invention provides a method for adjusting a user interface, which is suitable for a head mounted display device.
  • a distance sensor and a display unit are mounted on the head mounted display device, the distance sensor is configured to detect a distance of the head mounted display device from a user, and the display unit is configured to display a user interface that interacts with the user.
  • the method includes the steps of: identifying whether the user interface of the head mounted display device is in a lock screen state; when the user interface of the head mounted display device is in a lock screen state, adjusting according to the distance detected by the distance sensor a lock screen interface displayed by the display unit; and controlling the display unit to display the user interface after the adjustment.
  • the adjustment system of the user interface is applicable to a head mounted display device.
  • a distance sensor and a display unit are mounted on the head mounted display device, the distance sensor is configured to detect a distance of the head mounted display device from a user, and the display unit is configured to display a user interface that interacts with the user.
  • the adjustment system includes: an identification module, configured to identify whether the head mounted display device is in a lock screen state; and an adjustment module, configured to detect, according to the distance sensor, when the head mounted display device is in a lock screen state The distance is adjusted to the lock screen interface displayed by the display unit; and the display control module is configured to control the display unit to display the lock screen interface after the adjustment.
  • An embodiment of the present invention further provides a head mounted display device including a distance sensor and a display unit.
  • the distance sensor is configured to detect a distance of the head mounted display device from a user
  • the display unit is configured to display a user interface that interacts with a user.
  • the head mounted display device also includes an adjustment system for the user interface.
  • the adjustment system includes: an identification module, configured to identify whether the head mounted display device is in a lock screen state; and an adjustment module, configured to detect, according to the distance sensor, when the head mounted display device is in a lock screen state The distance is adjusted to the lock screen interface displayed by the display unit; and the display control module is configured to control the display unit to display the lock screen interface after the adjustment.
  • the adjustment method and the adjustment system of the user interface of the head mounted display device provided in the embodiment of the present invention can be separated from the user according to the head mounted display device when the user interface displayed by the head mounted display device is in the lock screen state.
  • the distance adjusts the displayed user interface to facilitate the user to view the corresponding interface and apply corresponding operations to provide user friendliness.
  • FIG. 1 is a schematic diagram of a hardware module of a head mounted display device in an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of functional blocks of an adjustment system of a user interface of the head mounted display device shown in FIG. 1 according to an embodiment of the present invention.
  • FIG. 3 is a flow chart showing the steps of a method for adjusting a user interface of a head mounted display device according to an embodiment of the present invention.
  • the head mounted display device 100 includes a display unit 110, a processing unit 120, a distance sensor 130, and an eyepiece 140.
  • the display unit 110 and the distance sensor 130 are electrically connected to the processing unit 120.
  • the display unit 110 is a flexible display screen.
  • the distance sensor 130 is an infrared sensor disposed on the head mounted display device 100 toward the user's face.
  • the distance sensor 130 is configured to detect a distance of the head mounted display device 100 from a user.
  • the distance sensor 130 is an eye sensor.
  • the distance sensor 130 is disposed at a position of an eyepiece hole (not shown) of the head mounted display device 100 for detecting a distance of the eyepiece 140 of the head mounted display device 100 from a user's eyes.
  • the processing unit 120 is configured to control the adjustment system 200 of the user interface (refer to FIG. 2, hereinafter referred to as the adjustment system 200).
  • the processing unit 120 may be composed of an integrated circuit (IC), for example, may be composed of a single packaged IC, or may be composed of a plurality of packaged ICs having the same function or different functions.
  • the processing unit 120 may include only a central processing unit, or may be a combination of a CPU, a digital signal processor (DSP), a GPU, and various control chips.
  • the CPU may be a single operation core, and may also include multiple operation cores.
  • the head mounted display device 100 further includes a memory 150 and an input unit 160.
  • the memory 150 may be a memory of the head mounted display device 10 itself, or may be an external storage device such as a secure digital card, a smart media card, or a flash memory card, for storing program codes and data of the adjustment system 200.
  • the input unit 160 is configured to receive an input operation of the user and generate a corresponding command in response to the input operation, such as an instruction to perform an unlock operation or a zoom operation on the interface input displayed by the display unit 110.
  • the adjustment system 200 includes an identification module 210, an adjustment module 220, and a display control module 230.
  • the module referred to in the present invention is a subroutine instruction segment that can be executed by the processing unit 120 of the head mounted display device 100 and that can perform a specific function. The specific functions of each functional module will be specifically described below.
  • the identification module 210 identifies the state in which the head mounted display device 100 is currently located.
  • the state in which the head mounted display device 100 is currently located includes a lock screen state or a screen unlock state. In this embodiment, the identification module 210 identifies whether the head mounted display device 100 is currently in a lock screen state.
  • the identification module 210 determines whether the current state of the head mounted display device 100 is a lock by identifying whether the user interface displayed on the display unit 110 includes a lock screen icon or a lock screen text (such as sliding unlock). Screen status or screen unlock status.
  • the identification module 210 determines that the head mounted display device 100 is currently in a lock screen state.
  • the identification module 210 determines that the head mounted display device 100 is currently in the screen unlock state.
  • the display unit 110 displays a lock screen user interface including a lock screen icon or/and a lock screen text.
  • the display unit 110 displays a main interface or an application interface of an application.
  • the adjustment module 220 adjusts the lock screen interface displayed by the display unit 110 according to the distance detected by the distance sensor.
  • the adjustment module 220 determines whether the distance detected by the distance sensor 130 is greater than a first preset value and less than a second preset value.
  • the first preset value is equal to the distance of the eyepiece 140 of the head mounted display device 100 from the user's eyes, for example, 2 cm, when the head mounted display device 100 is worn.
  • the second preset value is the user (or user's eye) distance when the user cannot see the content displayed by the display unit 110, such as the user interface, from the eyepiece 140 after the head mounted display device is removed. The distance from the eyepiece 140 of the head mounted display device 100 or the head mounted display device 100, for example 10 cm.
  • the first preset value may be obtained by measuring the distance of the user from the head mounted display device 100 when the plurality of users wear the head mounted display device 100 a plurality of times.
  • the second preset value can be obtained by measuring the distance when the user cannot see the content displayed by the display unit 110 from the eyepiece 140 when the user removes the head mounted display device 100 a plurality of times.
  • the adjusting module 220 amplifies the lock screen interface displayed by the display unit 110 when the distance detected by the distance sensor 130 is greater than the first preset value and less than the second preset value. In an embodiment, the adjustment module 220 only enlarges the lock screen icon or/and the lock screen text on the lock screen interface displayed by the display unit 110. In other embodiments, the adjusting the display screen of the display unit 110 by the adjustment module 220 includes: calculating a ratio of the distance detected by the distance sensor 130 to the preset value, and according to the The ratio determines the amplification factor of the lock screen interface. Wherein the amplification factor is equal to the ratio.
  • the adjustment module 220 determines whether the distance detected by the distance sensor 130 is equal to the first preset value. When the distance detected by the distance sensor 130 is equal to the first preset value, the adjustment module 220 determines that the head mounted display device 100 has been worn on the user's head and unlocks the display unit 110. The lock screen interface displayed.
  • the display control module 230 controls the display unit 110 to display a lock screen interface after being adjusted by the adjustment module 220.
  • the display control module 230 controls the display unit 110 to display the enlarged lock screen interface. .
  • the display control module 230 controls the display unit 110 to display a screen unlocking interface.
  • FIG. 3 a flow chart of steps of a user interface adjustment method of a head mounted display device in an embodiment of the present invention is shown. The order of the steps in the flowchart may be changed depending on the specific situation, and some steps may be omitted.
  • Step 301 the identification module 210 identifies whether the head mounted display device 100 is currently in a lock screen state. If yes, go to step 302; if no, the process ends.
  • the identification module 210 recognizes that the user interface displayed by the display unit 110 is Whether a lock screen icon or a lock screen text (such as slide unlock) is included to determine whether the state in which the head mounted display device 100 is currently located is a lock screen state or a screen unlock state.
  • a lock screen icon or a lock screen text such as slide unlock
  • the identification module 210 determines that the head mounted display device 100 is currently in a lock screen state.
  • the identification module 210 determines that the head mounted display device 100 is currently in the screen unlock state.
  • the display unit 110 displays a lock screen user interface including a lock screen icon or/and a lock screen text.
  • the display unit 110 displays a main interface or an application interface of an application.
  • Step 302 The distance sensor 210 detects the distance of the head mounted display device 100 from the user.
  • the distance sensor 210 is an eye sensor.
  • the distance sensor 130 is disposed at a position of an eyepiece aperture (not shown) of the head mounted display device 100 for detecting a distance of the eyepiece 140 of the head mounted display device 100 from a user's eyes.
  • Step 303 the adjustment module 220 adjusts the user interface displayed by the display unit 110 according to the distance sensed by the distance sensor 130.
  • the adjusting module 220 determines whether the distance detected by the distance sensor 130 is greater than the first preset value and less than the second preset value, or is equal to or smaller than the first preset. value.
  • the first preset value is equal to the distance of the eyepiece 140 of the head mounted display device 100 from the user's eyes, for example, 2 cm, when the head mounted display device 100 is worn.
  • the second preset value is that the user (or the user's eyes) is away from the head-mounted display device 100 or the head-mounted display when the user cannot see the content displayed by the display unit 110, such as the user interface, from the eyepiece 140 after the head-mounted display device is removed.
  • the distance of the eyepiece 140 of the device 100 is, for example, 10 cm.
  • the adjusting module 220 is configured when the head mounted display device 100 is currently in a lock screen state and the distance detected by the distance sensor 130 is greater than the first preset value and less than the second preset value.
  • the lock screen interface displayed by the display unit 110 is enlarged. In other embodiments, the adjustment module 220 only enlarges the lock screen icon or/and the lock screen text on the lock screen interface displayed by the display unit 110.
  • the adjusting module 220 unlocks the display unit 110 when the head mounted display device 100 is currently in a screen unlocking state and the distance detected by the distance sensor 130 is equal to or smaller than the first preset value.
  • the lock screen interface displayed.
  • the adjustment module 220 enlarges the lock screen displayed by the display unit 110.
  • the interface includes: calculating a ratio of the distance detected by the distance sensor 130 to the preset value, and determining an amplification factor of the lock screen interface according to the ratio.
  • the magnification factor is equal to the ratio.
  • Step 304 The display control module 230 controls the display unit 110 to display the user interface after being adjusted by the adjustment module 220.
  • the display control module 230 controlling the display unit 110 to display the user interface after being adjusted by the adjustment module 220 includes: controlling the display unit 110 to display the enlarged lock screen interface or the user interface after the display screen is unlocked.
  • the method and system for adjusting the user interface of the head mounted display device can adjust the wearing according to the current state of the user interface of the head mounted display device and the distance of the head mounted display device from the user.
  • the adjustment system controls to enlarge the user interface in the lock screen state.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

一种头戴显示设备（100）用的用户界面的调整方法与系统。该头戴显示设备（100）上包括用于侦测所述头戴显示设备（100）距离用户距离的距离感应器（130）及显示用户界面的显示单元（110）。该方法包括步骤：识别所述头戴显示设备（100）是否处于锁屏状态；当所述头戴显示设备（100）处于锁屏状态时，根据所述距离感应器（130）所侦测到的距离调整所述显示单元（110）所显示的锁屏界面；以及控制所述显示单元（110）显示所述调整之后的锁屏界面。如此，用户界面的调整方法可根据用户距离头戴显示设备（100）的距离调整锁屏状态下的用户界面，方便用户使用。

Description

用户界面的调整方法、调整系统及头戴显示设备 技术领域
本发明涉及头戴显示设备技术领域，尤其涉及头戴显示设备的用户界面的调整方法与调整系统。
背景技术
随着头戴显示技术和虚拟显示技术的发展，头戴显示设备(Head Mounted Device，HMD)得到了越来越多用户的认可。由于显示屏被包裹在头戴显示设备内部，故此头戴显示设备在使用时，需要佩戴到用户头部。且，用户佩戴头戴显示设备后无法看到现实中的键盘。因此，用户无法在佩戴头戴显示设备时像通过物理鼠标操作PC机或通过触摸屏控制手机那样控制头戴显示设备。
为了确保信息的安全，头戴显示设备在一段时间未使用或开机时都处于锁屏状态。当用户需要解锁头戴显示设备的屏幕时，往往需要从用户头上摘下头戴显示设备，然后从头戴显示设备的目镜中观看屏幕内容，并根据所观看到的内容进行相应的操作。
然而，头戴显示设备被摘下后，用户从目镜中所观看到的图形用户界面会比头戴显示设备戴在头上时要小，不易被看清楚，也不便于用户操作。
发明内容
有鉴于此，有必要提供一种头戴显示设备的用户界面的调整方法与调整系统，以让头戴显示设备的用户界面可根据用户距离头戴显示设备的距离进行调整，使用户能观看到合适的用户界面，方便施加相应的操作。
为实现上述目的，本发明的实施方式中提供了一种用户界面的调整方法，适用于头戴显示设备。所述头戴显示设备上安装有距离感应器及显示单元，所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面。该方法包括步骤：识别所述头戴显示设备的用户界面是否处于锁屏状态；当所述头戴显示设备的用户界面处于锁屏状态时，根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及控制所述显示单元显示所述调整之后的用户界面。
本发明一实施方式中所提供的用户界面的调整系统，适用于头戴显示设备。所述头戴显示设备上安装有距离感应器及显示单元，所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面。该调整系统包括：识别模块，用于识别所述头戴显示设备是否处于锁屏状态；调整模块，用于当所述头戴显示设备处于锁屏状态时根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及显示控制模块，用于控制所述显示单元显示所述调整之后的锁屏界面。
本发明一实施方式中还提供了一种头戴显示设备，包括距离感应器及显示单元。所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面。该头戴显示设备还包括用户界面的调整系统。该调整系统包括：识别模块，用于识别所述头戴显示设备是否处于锁屏状态；调整模块，用于当所述头戴显示设备处于锁屏状态时根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及显示控制模块，用于控制所述显示单元显示所述调整之后的锁屏界面。
较之现有技术，本发明实施例中所提供的头戴显示设备的用户界面的调整方法与调整系统在头戴显示设备所显示的用户界面处于锁屏状态时可根据头戴显示设备距离用户的距离调整所显示的用户界面，以方便用户观看到相应的界面及施加相应的操作，提供用户使用的友好性。
附图说明
下列附图用于结合具体实施方式详细说明本发明的各个实施方式。应当理解，附图中示意出的各元件并不代表实际的大小及比例关系，仅是为了清楚说明而示意出来的示意图，不应理解成对本发明的限制。
图1本发明一实施方式中的头戴显示设备的硬件模块的示意图。
图2为本发明一实施方式中图1所示的头戴显示设备的用户界面的调整系统的功能模块的示意图。
图3为本发明一实施方式中的头戴显示设备的用户界面调整方法的步骤流程图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合多个实施方式及附图，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施方式仅仅用以解释本发明，并不用于限定本发明。
请参见图1，其示出了本发明一实施方式中的头戴显示设备100的硬件模块的示意图。该头戴显示设备100包括一显示单元110、一处理单元120、一距离感应器130及目镜140。
所述显示单元110及所述距离感应器130与所述处理单元120电连接。在本实施方式中，所述显示单元110为柔性显示屏。所述距离感应器130为红外线感应器，设置在所述头戴显示设备100上朝向用户人脸侧。所述距离感应器130用于侦测所述头戴显示设备100距离用户的距离。在另一实施方式中，所述距离感应器130为一眼球感应器。所述距离感应器130设置在头戴显示设备100的目镜孔(图未示)的位置处，用于侦测所述头戴显示设备100的目镜140距离用户眼睛的距离。所述处理单元120用于控制所述用户界面的调整系统200(请参见图2，以下简称调整系统200)工作。所述处理单元120可以由集成电路(Integrated Circuit，简称IC)组成，例如可以由单颗封装的IC所组成，也可以由连接多颗相同功能或不同功能的封装IC而组成。举例来说，处理单元120可以仅包括中央处理器，也可以是CPU、数字信号处理器(Digital Signal Processor，简称DSP)、GPU及各种控制芯片的组合。在本发明实施方式中，CPU可以是单运算核心，也可以包括多运算核心。
在另一实施方式中，所述头戴显示设备100还包括存储器150及输入单元160。所述存储器150可以是头戴显示设备10本身的内存，也可以是安全数字卡、智能媒体卡、快闪存储卡等外部存储设备，用于存储所述调整系统200的程序代码及数据。所述输入单元160用于接收用户的输入操作并响应该输入操作生成相应的命令，如对显示单元110所显示的界面输入进行解锁操作或缩放操作等指令。
请参见图2，其示出本发明一实施方式中图1所示的用户界面的调整系统200(以下简称调整系统200)的功能模块的示意图。该调整系统200包括一识别模块210、一调整模块220及一显示控制模块230。需要说明的是，本发明所称的模块是一种能被所述头戴显示设备100的处理单元120所执行并且能够完成特定功能的一些子程序指令段。下面将具体描述各功能模块的具体功能。
所述识别模块210识别所述头戴显示设备100当前所处的状态。所述头戴显示设备100当前所处的状态包括锁屏状态或屏幕解锁状态。在本实施方式中，所述识别模块210识别所述头戴显示设备100当前是否处于锁屏状态。
具体的，所述识别模块210通过识别显示单元110所显示的用户界面上是否包含一个锁屏图标或锁屏文字(如滑动解锁)以判断所述头戴显示设备100当前所处的状态是锁屏状态或屏幕解锁状态。当显示单元110所显示的用户界面上包含有锁屏图标或/和锁屏文字时，所述识别模块210判断所述头戴显示设备100当前正处于锁屏状态。相反，当显示单元110所显示的用户界面上不包含锁屏图标或/和锁屏文字时，所述识别模块210判断所述头戴显示设备100当前正处于屏幕解锁状态。
当头戴显示设备100处于锁屏状态时，显示单元110显示一锁屏用户界面，该锁屏用户界面包括有锁屏图标或/和锁屏文字。当头戴显示设备100处于屏幕解锁状态时，显示单元110显示一主界面或一应用程序的应用界面。
当所述头戴显示设备处于锁屏状态时，所述调整模块220根据所述距离感应器所侦测到的距离调整所述显示单元110所显示的锁屏界面。
在一实施方式中，所述调整模块220判断所述距离感应器130所侦测到的距离是否大于第一预设值且小于一第二预设值。其中，该第一预设值等于所述头戴显示设备100被戴上时，所述头戴显示设备100的目镜140距离用户眼睛的距离，例如2cm。该第二预设值为头戴显示设备被摘下后用户从目镜140中无法看清楚显示单元110所显示的内容例如用户界面时用户(或用户眼睛)距 离头戴显示设备100或头戴显示设备100的目镜140的距离，例如10cm。该第一预设值可通过多次测量多个用户在佩戴该头戴显示设备100时用户距离头戴显示设备100的距离而得出。该第二预设值可通过多次测量多个用户在摘下该头戴显示设备100时用户从目镜140中无法看清楚显示单元110所显示的内容时的距离而得出。
当所述距离感应器130所侦测到的距离大于所述第一预设值且小于所述第二预设值时，所述调整模块220放大所述显示单元110所显示的锁屏界面。在一实施方式中，所述调整模块220仅放大显示单元110所显示的锁屏界面上的锁屏图标或/和锁屏文字。在其他实施方式中，所述调整模块220放大所述显示单元110所显示的锁屏界面包括：计算所述距离感应器130所侦测到的距离与所述预设值的比值，并根据所述比值确定所述锁屏界面的放大系数。其中，所述放大系数等于所述比值。即，假设预设的距离为D，锁屏状态下显示单元110所显示的锁屏界面尺寸为S；当距离感应器130所感应到的距离为D1(该D1大于第一预设值小于第二预设值)且D1＞D时，所述调整模块220对锁屏界面进行放大处理，则放到后的锁屏界面的尺寸S1＝D1*S/D。
在另一实施方式中，所述调整模块220判断所述距离感应器130所侦测到的距离是否等于所述第一预设值。当所述距离感应器130所侦测到的距离等于所述第一预设值时，所述调整模块220判断所述头戴显示设备100已佩戴在用户头上并解锁所述显示单元110所显示的锁屏界面。
显示控制模块230控制所述显示单元110显示经所述调整模块220调整之后的锁屏界面。
具体的，当距离感应器130所侦测到的距离大于所述第一预设值及小于所述第二预设值时，显示控制模块230控制所述显示单元110显示放大后的锁屏界面。当距离感应器130所侦测到的距离等于所述第一预设值时，显示控制模块230控制所述显示单元110显示屏幕解锁界面。
请参见图3，其示出了本发明一实施方式中的头戴显示设备的用户界面调整方法的步骤流程图。根据具体的情况，该流程图中步骤的顺序可以改变，某些步骤可以省略。
步骤301，所述识别模块210识别所述头戴显示设备100当前是否处于锁屏状态。若是，则执行步骤302；若否，则流程结束。
具体地，所述识别模块210通过识别显示单元110所显示的用户界面上是 否包含一个锁屏图标或锁屏文字(如滑动解锁)以判断所述头戴显示设备100当前所处的状态是锁屏状态或屏幕解锁状态。当显示单元110所显示的用户界面上包含有锁屏图标或/和锁屏文字时，所述识别模块210判断所述头戴显示设备100当前正处于锁屏状态。相反，当显示单元110所显示的用户界面上不包含锁屏图标或/和锁屏文字时，所述识别模块210判断所述头戴显示设备100当前正处于屏幕解锁状态。
当头戴显示设备100处于锁屏状态时，显示单元110显示一锁屏用户界面，该锁屏用户界面包括有锁屏图标或/和锁屏文字。当头戴显示设备100处于屏幕解锁状态时，显示单元110显示一主界面或一应用程序的应用界面。
步骤302，所述距离感应器210侦测所述头戴显示设备100距离用户的距离。
在本实施方式中，所述距离感应器210为眼球感应器。所述距离感应器130设置在头戴显示设备100的目镜孔(图未示)位置处，用于侦测所述头戴显示设备100的目镜140距离用户的眼睛的距离。
步骤303，所述调整模块220根据所述距离感应器130所感应到的距离调整所述显示单元110所显示的用户界面。
具体的，所述调整模块220判断所述距离感应器130所侦测到的距离是否大于所述第一预设值且小于所述第二预设值，或等于或小于所述第一预设值。其中，该第一预设值等于所述头戴显示设备100被戴上时，所述头戴显示设备100的目镜140距离用户眼睛的距离，例如2cm。该第二预设值为头戴显示设备被摘下后用户从目镜140中无法看清楚显示单元110所显示的内容例如用户界面时用户(或用户眼睛)距离头戴显示设备100或头戴显示设备100的目镜140的距离，例如10cm。
当所述头戴显示设备100当前处于锁屏状态且所述距离感应器130所侦测到的距离大于所述第一预设值及小于所述第二预设值时，所述调整模块220放大所述显示单元110所显示的锁屏界面。在其他实施方式中，所述调整模块220仅放大显示单元110所显示的锁屏界面上的锁屏图标或/和锁屏文字。
当所述头戴显示设备100当前处于屏幕解锁状态且所述距离感应器130所侦测到的距离等于或小于所述第一预设值时，所述调整模块220解锁所述显示单元110所显示的锁屏界面。
在一实施方式中，所述调整模块220放大所述显示单元110所显示的锁屏 界面包括：计算所述距离感应器130所侦测到的距离与所述预设值的比值，并根据所述比值确定所述锁屏界面的放大系数。所述放大系数等于所述比值。即，假设预设的距离为D，锁屏状态下显示单元110所显示的锁屏界面尺寸为S；当距离感应器130所感应到的距离为D1(该D1大于第一预设值小于第二预设值)且D1＞D时，所述调整模块220对锁屏界面进行放大处理，则放到后的锁屏界面的尺寸S1＝D1*S/D。
步骤304，显示控制模块230控制所述显示单元110显示经所述调整模块220调整之后的用户界面。
具体地，显示控制模块230控制所述显示单元110显示经所述调整模块220调整之后的用户界面包括：控制所述显示单元110显示放大后的锁屏界面或显示屏幕解锁后的用户界面。
较之于现有技术，本申请所提供的头戴显示设备的用户界面的调整方法与系统能根据头戴显示设备的用户界面当前所处的状态及头戴显示设备距离用户的距离调整头戴显示设备的用户界面并显示调整后的用户界面。例如，当用户界面处于锁屏状态下，且用户距离头戴显示设备的距离大于第一预设值及小于第二预设时，所述调整系统控制将锁屏状态下的用户界面进行放大处理并显示放大后锁屏状态下的用户界面。如此，使用户可看清楚锁屏状态下的用户界面上的锁屏图标和/或锁屏文字，以便用户施加相应的操作。
以上所述仅为本发明的较佳实施方式而已，并不用以限制本发明，凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本发明的保护范围之内。

Claims (15)

  1. 一种用户界面的调整方法，适用于头戴显示设备，其特征在于，所述头戴显示设备上安装有距离感应器及显示单元，所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面；所述方法包括步骤：
    识别所述头戴显示设备的用户界面是否处于锁屏状态；
    当所述头戴显示设备的用户界面处于锁屏状态时，根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及
    控制所述显示单元显示所述调整之后的用户界面。
  2. 如权利要求1所述的调整方法，其特征在于，所述根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面包括：判断所述距离感应器所侦测到的距离是否大于第一预设值及小于第二预设值；当所述距离大于所述第一预设值及小于所述第二预设值时，放大所述显示单元所显示的锁屏界面；及所述控制所述显示单元显示所述调整之后的用户界面为控制显示放大后的解锁界面。
  3. 如权利要求2所述的调整方法，其特征在于，所述放大所述显示单元所显示的锁屏界面包括：计算所述距离感应器所侦测到的距离与所述预设值的比值；根据所述比值确定所述锁屏界面的放大系数，所述放大系数等于所述比值。
  4. 如权利要求1所述的调整方法，其特征在于，所述根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面包括：判断所述距离感应器所侦测到的距离是否等于或小于所述第一预设值；当所述距离等于或小于所述第一预设值时，解锁所述显示单元所显示的锁屏界面；及所述控制所述显示单元显示所述调整之后的用户界面为控制显示解锁后的用户界面。
  5. 如权利要求1所述的调整方法，其特征在于，所述距离感应器为眼球传感器，用于侦测所述头戴显示设备距离用户眼睛的距离。
  6. 一种用户界面的调整系统，适用于头戴显示设备，其特征在于，所述头戴显示设备上安装有距离感应器及显示单元，所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面；所述调整系统包括：
    识别模块，用于识别所述头戴显示设备所显示的用户界面是否处于锁屏状态；
    调整模块，用于当所述用户界面处于锁屏状态时根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及
    显示控制模块，用于控制所述显示单元显示所述调整之后的用户界面。
  7. 如权利要求6所述的调整系统，其特征在于，所述调整模块根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面包括：所述调整模块判断所述距离感应器所侦测到的距离是否大于第一预设值及小于第二预设值；当所述距离大于所述第一预设值及小于所述第二预设值时，所述调整模块放大所述显示单元所显示的锁屏界面；所述显示控制模块显示放大后的解锁界面。
  8. 如权利要求7所述的调整系统，其特征在于，所述调整模块放大所述显示单元所显示的锁屏界面包括：所述调整模块计算所述距离感应器所侦测到的距离与所述预设值的比值；根据所述比值确定所述锁屏界面的放大系数，所述放大系数等于所述比值。
  9. 如权利要求1所述的调整系统，其特征在于，所述调整模块判断所述距离感应器所侦测到的距离是否等于或小于所述第一预设值；当所述距离等于或小于所述第一预设值时，所述调整模块解锁所述显示单元所显示的锁屏界面；及所述显示单元显示解锁后的用户界面。
  10. 如权利要求1所述的调整系统，其特征在于，所述距离感应器为眼球传感器，用于侦测所述头戴显示设备距离用户眼睛的距离。
  11. 一种头戴显示设备，包括距离感应器及显示单元，所述距离感应器用于侦测所述头戴显示设备距离用户的距离，所述显示单元用于显示与用户进行交互的用户界面；其特征在于，所述头戴显示设备还包括用户界面的调整系统，所述调整系统包括：
    识别模块，用于识别所述头戴显示设备是否处于锁屏状态；
    调整模块，用于当所述头戴显示设备处于锁屏状态时根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面；以及
    显示控制模块，用于控制所述显示单元显示所述调整之后的用户界面。
  12. 如权利要求11所述的头戴显示设备，其特征在于，所述调整模块根据所述距离感应器所侦测到的距离调整所述显示单元所显示的锁屏界面包括：所述调整模块判断所述距离感应器所侦测到的距离是否大于第一预设值及小于第二预设值；当所述距离大于所述第一预设值及小于所述第二预设值时，所述调整模块放大所述显示单元所显示的锁屏界面；所述显示控制模块显示放大后的解锁界面。
  13. 如权利要求12所述的头戴显示设备，其特征在于，所述调整模块计算所述距离感应器所侦测到的距离与所述预设值的比值；根据所述比值确定所述锁屏界面的放大系数，所述放大系数等于所述比值。
  14. 如权利要求11所述的头戴显示设备，其特征在于，所述调整模块判断所述距离感应器所侦测到的距离是否等于或小于所述第一预设值；当所述距离等于或小于所述第一预设值时，所述调整模块解锁所述显示单元所显示的锁屏界面；及所述显示单元显示解锁后的用户界面。
  15. 如权利要求11所述的头戴显示设备，其特征在于，所述距离感应器为眼球传感器，用于侦测所述头戴显示设备距离用户眼睛的距离。
PCT/CN2016/109228 2016-12-09 2016-12-09 用户界面的调整方法、调整系统及头戴显示设备 WO2018103072A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP16923431.7A EP3553692A1 (en) 2016-12-09 2016-12-09 Adjustment method and adjustment system for user interface, and head-mounted display device
PCT/CN2016/109228 WO2018103072A1 (zh) 2016-12-09 2016-12-09 用户界面的调整方法、调整系统及头戴显示设备
US16/096,528 US20190107885A1 (en) 2016-12-09 2016-12-09 Head-mounted display and method and system for adjusting user interface thereof
CN201680034127.2A CN107820599B (zh) 2016-12-09 2016-12-09 用户界面的调整方法、调整系统及头戴显示设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/109228 WO2018103072A1 (zh) 2016-12-09 2016-12-09 用户界面的调整方法、调整系统及头戴显示设备

Publications (1)

Publication Number Publication Date
WO2018103072A1 true WO2018103072A1 (zh) 2018-06-14

Family

ID=61600916

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/109228 WO2018103072A1 (zh) 2016-12-09 2016-12-09 用户界面的调整方法、调整系统及头戴显示设备

Country Status (4)

Country Link
US (1) US20190107885A1 (zh)
EP (1) EP3553692A1 (zh)
CN (1) CN107820599B (zh)
WO (1) WO2018103072A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106569339B (zh) * 2016-11-08 2019-11-15 歌尔科技有限公司 Vr头戴设备以及vr头戴设备的控制方法
WO2021169881A1 (zh) * 2020-02-24 2021-09-02 Oppo广东移动通信有限公司 头戴式设备的显示控制方法、设备及计算机存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020113755A1 (en) * 2001-02-19 2002-08-22 Samsung Electronics Co., Ltd. Wearable display apparatus
CN103927966A (zh) * 2014-04-02 2014-07-16 北京智谷睿拓技术服务有限公司 显示控制方法及显示控制装置
CN103984101A (zh) * 2014-05-30 2014-08-13 华为技术有限公司 显示内容控制方法和装置
CN104067160A (zh) * 2011-11-22 2014-09-24 谷歌公司 使用眼睛跟踪在显示屏中使图像内容居中的方法
CN105531716A (zh) * 2013-07-30 2016-04-27 微软技术许可有限责任公司 显示设备中的近眼光学定位
CN105593785A (zh) * 2013-11-01 2016-05-18 英特尔公司 凝视辅助触摸屏输入

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011097564A1 (en) * 2010-02-05 2011-08-11 Kopin Corporation Touch sensor for controlling eyewear
US9304591B2 (en) * 2010-08-10 2016-04-05 Lenovo (Singapore) Pte. Ltd. Gesture control
US20160025971A1 (en) * 2014-07-25 2016-01-28 William M. Crow Eyelid movement as user input
CN105511846B (zh) * 2014-09-24 2018-12-14 联想(北京)有限公司 电子设备和显示控制方法
TWI571768B (zh) * 2015-04-29 2017-02-21 由田新技股份有限公司 使用者介面同步系統、裝置、方法、電腦可讀取記錄媒體、及電腦程式產品
CN106200884A (zh) * 2015-04-30 2016-12-07 成都理想境界科技有限公司 头戴式显示设备及其控制方法
CN104951070A (zh) * 2015-06-02 2015-09-30 无锡天脉聚源传媒科技有限公司 一种基于眼睛操控设备的方法及装置
KR20170067058A (ko) * 2015-12-07 2017-06-15 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN105847578A (zh) * 2016-04-28 2016-08-10 努比亚技术有限公司 一种显示信息的参数调整方法及头戴式设备
CN106055071B (zh) * 2016-05-27 2018-11-30 维沃移动通信有限公司 一种通知消息的显示控制方法及移动终端

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020113755A1 (en) * 2001-02-19 2002-08-22 Samsung Electronics Co., Ltd. Wearable display apparatus
CN104067160A (zh) * 2011-11-22 2014-09-24 谷歌公司 使用眼睛跟踪在显示屏中使图像内容居中的方法
CN105531716A (zh) * 2013-07-30 2016-04-27 微软技术许可有限责任公司 显示设备中的近眼光学定位
CN105593785A (zh) * 2013-11-01 2016-05-18 英特尔公司 凝视辅助触摸屏输入
CN103927966A (zh) * 2014-04-02 2014-07-16 北京智谷睿拓技术服务有限公司 显示控制方法及显示控制装置
CN103984101A (zh) * 2014-05-30 2014-08-13 华为技术有限公司 显示内容控制方法和装置

Also Published As

Publication number Publication date
US20190107885A1 (en) 2019-04-11
CN107820599A (zh) 2018-03-20
CN107820599B (zh) 2021-03-23
EP3553692A1 (en) 2019-10-16

Similar Documents

Publication Publication Date Title
CN103513921B (zh) 利用压敏触摸的文本选择
CN104298343B (zh) 用于照相机控制和图像处理操作的特定手势
KR102219464B1 (ko) 보안 운용 방법 및 이를 지원하는 전자 장치
KR102187833B1 (ko) 전자 장치의 기능 실행 방법 및 이를 사용하는 전자 장치
KR102229890B1 (ko) 데이터 처리 방법 및 그 전자 장치
US9317713B2 (en) Obstructing user content based on location
KR102138512B1 (ko) 디스플레이 디바이스 및 그의 제어 방법
EP2854013B1 (en) Method for displaying in electronic device and electronic device thereof
EP2708981B1 (en) Gesture recognition apparatus, control method thereof, display instrument, and computer readable medium
US20150186017A1 (en) Unlocking method and device using tension effect
EP2940555A1 (en) Automatic gaze calibration
KR20150081125A (ko) 전자 장치 스크린에서의 입자 효과 디스플레이
KR20150090840A (ko) 디스플레이 화면의 영역을 보호하는 디바이스 및 방법
KR20150146236A (ko) 지문 처리 방법 및 그 전자 장치
EP2889749B1 (en) Electronic device and method for displaying user interface thereof
KR20150108216A (ko) 입력 처리 방법 및 그 전자 장치
KR20150010432A (ko) 디스플레이 디바이스 및 그 제어 방법
KR102544477B1 (ko) 전자 장치, 전자 장치 보호 케이스 및 그 전자 장치의 디스플레이 방법
KR20160027778A (ko) 전자 장치 및 전자 장치의 디스플레이 방법
KR102274944B1 (ko) 오브젝트를 식별하는 전자 장치 및 방법
WO2018103072A1 (zh) 用户界面的调整方法、调整系统及头戴显示设备
KR20150003957A (ko) 전자 장치의 잠금 화면 운용 방법 및 장치
US9380138B2 (en) Electronic device cover
TWI587169B (zh) 電子設備設定密碼、解鎖系統及方法
JP6255731B2 (ja) 表示システム、表示方法および表示端末

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16923431

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016923431

Country of ref document: EP

Effective date: 20190709