WO2024067786A1 - 头戴显示设备的控制方法、装置、电子设备及存储介质 - Google Patents

头戴显示设备的控制方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2024067786A1
WO2024067786A1 PCT/CN2023/122467 CN2023122467W WO2024067786A1 WO 2024067786 A1 WO2024067786 A1 WO 2024067786A1 CN 2023122467 W CN2023122467 W CN 2023122467W WO 2024067786 A1 WO2024067786 A1 WO 2024067786A1
Authority
WO
WIPO (PCT)
Prior art keywords
mounted display
display device
motion state
head
state information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/122467
Other languages
English (en)
French (fr)
Inventor
陈强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Publication of WO2024067786A1 publication Critical patent/WO2024067786A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features

Definitions

  • the present application relates to the technical field of head-mounted display devices, and in particular to a control method, device, electronic device and computer-readable storage medium for a head-mounted display device.
  • head-mounted display devices such as AR (Augmented Reality) and MR (Mix Reality) devices generally add a dark shading sheet in front of the outer display lens; however, when the display content is not needed, the dark shading sheet will affect the user's observation of the real world. With the emergence of color-changing materials, this problem can be well solved.
  • the purpose of the present application is to provide a control method, device, electronic device and computer-readable storage medium for a head-mounted display device, so as to utilize the interaction between devices to trigger the color change of the shading sheet and improve the user experience.
  • the present application provides a control method of a head mounted display device, comprising:
  • the color of the shading sheet of the head mounted display device is controlled and adjusted.
  • detecting the interactive behavior between the head mounted display device and the target device according to the distance information includes:
  • the interactive behavior is detected according to the distance information and the posture data; wherein the posture data includes first motion state information collected by a motion sensor of a head mounted display device and/or second motion state information collected by a motion sensor of a target device.
  • detecting the interactive behavior according to the distance information and the posture data includes:
  • the head mounted display device determines whether the distance information is within a response distance range
  • the interactive behavior is detected according to the change of the distance information within the response distance range, the first motion state information, and the second motion state information.
  • obtaining the distance information between the head mounted display device and the target device includes:
  • the head mounted display device obtains the distance information according to the strength of the wireless signal connected to the target device.
  • controlling and adjusting the color of a shading sheet of the head mounted display device according to the interactive behavior includes:
  • the color of the shading sheet of the head mounted display device is controlled to be lighter, and the screen of the target device is controlled to be brightened.
  • the method before controlling and adjusting the color of the shading sheet of the head mounted display device according to the interactive behavior, the method further includes:
  • the master device is the head mounted display device or the target device
  • the first motion state information is the motion state information collected by the motion sensor of the head mounted display device
  • the second motion state information is the motion state information collected by the motion sensor of the target device
  • controlling and adjusting the color of the shading sheet of the head mounted display device according to the interactive behavior includes:
  • the main device is used to control and adjust the color of the shading sheet of the head mounted display device.
  • determining the master device according to the first motion state information and the second motion state information corresponding to the interactive behavior includes:
  • the head mounted display device determines whether the first motion state information corresponding to the interactive behavior is in a motion state, and the second motion state information corresponding to the interactive behavior is in a stationary state, determining the head mounted display device as the master device;
  • the target device determines whether the first motion state information corresponding to the interactive behavior is in a stationary state, and the second motion state information corresponding to the interactive behavior is in a moving state, determining the target device as the master device;
  • the head-mounted display device is determined as the master device; if the acceleration corresponding to the first motion state information is not greater than the acceleration corresponding to the second motion state information, the target device is determined as the master device.
  • the present application also provides a control device for a head mounted display device, comprising:
  • the acquisition module is used to obtain the distance information between the head mounted display device and the target device; wherein the head mounted display device Wirelessly connect with the target device;
  • a detection module configured to detect an interaction behavior between the head mounted display device and the target device according to the distance information
  • a control module is used to control and adjust the color of the shading sheet of the head mounted display device according to the interactive behavior.
  • the present application also provides an electronic device, including:
  • a processor is used to implement the steps of the control method of the head mounted display device as described above when executing the computer program.
  • the present application also provides a computer-readable storage medium, on which a computer program is stored.
  • a computer program is stored on which a computer program is stored.
  • the steps of the control method of the head-mounted display device as described above are implemented.
  • the present application provides a control method for a head-mounted display device, comprising: obtaining distance information between the head-mounted display device and a target device; wherein the head-mounted display device is wirelessly connected to the target device; detecting an interactive behavior between the head-mounted display device and the target device according to the distance information; and controlling and adjusting the color of a shading sheet of the head-mounted display device according to the interactive behavior;
  • the present application utilizes the distance information between the head-mounted display device and the target device to detect the interactive behavior between the devices, so that the color of the shading sheet of the head-mounted display device can be controlled and adjusted according to the interactive behavior to achieve interactive control of the device status, thereby triggering the automatic color change of the shading sheet of the head-mounted display device through the interaction between the devices, thereby improving the user experience.
  • the present application also provides a control device for a head-mounted display device, an electronic device, and a computer-readable storage medium.
  • FIG1 is a flow chart of a method for controlling a head mounted display device provided in an embodiment of the present application
  • FIG2 is a schematic diagram of device state switching of another method for controlling a head mounted display device provided in an embodiment of the present application
  • FIG3 is a structural block diagram of a control device for a head mounted display device provided in an embodiment of the present application.
  • FIG1 is a flow chart of a method for controlling a head mounted display device provided in an embodiment of the present application.
  • the method includes:
  • Step 101 Obtain distance information between a head mounted display device and a target device; wherein the head mounted display device is wirelessly connected to the target device.
  • the target device in this embodiment can be any electronic device used for interactive control with the head-mounted display device, such as wearable devices (such as smart watches and smart bracelets, etc.) and mobile terminal devices (such as smart phones), etc.; the target device can be connected to the head-mounted display device by wireless communication, such as Bluetooth connection, WiFi connection or infrared connection, etc.
  • wireless communication such as Bluetooth connection, WiFi connection or infrared connection, etc.
  • control method of the head-mounted display device provided in this embodiment can be applied to the head-mounted display device, that is, the processor of the head-mounted display device can execute the steps of the method provided in this embodiment, detect the interactive behavior between the head-mounted display device and the target device, and control and adjust the color of the shading sheet of the head-mounted display device;
  • the control method of the head-mounted display device provided in this embodiment can be applied to the target device or a terminal device (such as a cloud server) connected to the head-mounted display device and the target device, and this embodiment does not impose any restrictions on this.
  • the distance information in this step may be information about the distance between the head-mounted display device and the target device.
  • the specific manner in which the processor obtains the distance information between the head-mounted display device and the target device in this step may be set by the designer according to practical scenarios and user needs.
  • the processor may obtain the distance information according to the strength of the wireless signal connecting the head-mounted display device and the target device; for example, the processor of the head-mounted display device may detect the distance information from the target device using the RSSI (Received Signal Strength Indication) value of the Bluetooth connection with the target device.
  • RSSI Receiveived Signal Strength Indication
  • the processor may also obtain the distance information based on the sensor data of the distance measuring sensors (such as ultrasonic distance measuring sensors or optical distance measuring sensors) in the head-mounted display device and the target device; for example, the head-mounted display device may detect the distance information from the target device using the ultrasonic signal output by the ultrasonic generator in the target device collected by its own ultrasonic receiver (i.e., ultrasonic distance measuring sensor).
  • the processor can obtain the distance information between the head-mounted display device and the target device, this embodiment does not impose any restrictions on this.
  • Step 102 Detecting the interaction behavior between the head mounted display device and the target device according to the distance information.
  • the interactive behavior in this step can be a behavior corresponding to a preset change in the distance between the head mounted display device and the target device.
  • the specific number and type of interactive behaviors in this step can be determined by the designer. Personnel set it up by themselves according to practical scenarios and user needs.
  • the interactive behavior may include an approaching behavior corresponding to a reduction in the distance between the head-mounted display device and the target device; the interactive behavior may also include an approaching behavior corresponding to a reduction in the distance between the head-mounted display device and the target device to contact; the interactive behavior may also include a moving away behavior corresponding to an increase in the distance between the head-mounted display device and the target device.
  • the specific manner in which the processor detects the interactive behavior between the head-mounted display device and the target device according to the distance information in this step can be set by the designer.
  • the processor can detect the interactive behavior between the head-mounted display device and the target device using only the distance information.
  • the processor can detect the interactive behavior between the head-mounted display device and the target device according to the distance information within a response distance range (such as 0 to 60 cm).
  • the processor determines that the interactive behavior is an approaching behavior; if the distance information in the response distance range decreases to a response threshold and the distance information is 0 when the distance change stops, the interactive behavior is determined to be a contact behavior; if the distance information in the response distance range increases to a response threshold, the interactive behavior is determined to be a moving away behavior.
  • a response threshold such as 2 cm
  • the processor can also detect interactive behavior based on the distance information and posture data; wherein the posture data includes the first motion state information collected by the motion sensor (such as an accelerometer) of the head-mounted display device and/or the second motion state information collected by the motion sensor of the target device.
  • the processor can detect the interactive behavior between the head-mounted display device and the target device using the distance information and the posture data corresponding to the posture of the head-mounted display device and/or the target device.
  • the processor can detect the interactive behavior based on the distance information and posture data within the response distance range; for example, the processor of the head-mounted display device determines whether the distance information is within the response distance range; if so, the acquired first motion state information is sent to the target device (that is, the target device can also detect the interactive behavior), and the second motion state information sent by the target device is received; the interactive behavior is detected based on the change of the distance information within the response distance range, the first motion state information, and the second motion state information.
  • the designer can set it by himself.
  • the processor of the head-mounted display device can directly end the process or return to step 101 to continue to obtain the distance information when the distance information is not within the response distance range. This embodiment does not impose any restrictions on this.
  • the specific method of detecting the interactive behavior according to the change of the distance information within the response distance range, the first motion state information, and the second motion state information can be set by the designer according to practical scenarios and user needs.
  • the processor can determine that the interactive behavior is approaching behavior when it is detected that the distance information of the response distance range is reduced, and the first motion state information and the second motion state information are both in a stationary state and the distance information is not 0; when it is detected that the distance information of the response distance range is reduced, and the first motion state information and the second motion state information are both in a stationary state, the distance information is not 0.
  • the interactive behavior is determined to be a contact behavior; when the distance information of the response distance range is detected to increase, and both the first motion state information and the second motion state are in a stationary state or the distance information exceeds the response distance range, the interactive behavior is determined to be a distance behavior.
  • the approach behavior can be divided into the head-mounted display approach behavior of the head-mounted display device actively approaching the target device and the head-mounted display approach behavior of the target device actively approaching the head-mounted display device; for example, when the interactive behavior includes the head-mounted display approach behavior and the head-mounted display approach behavior, when the processor detects that the distance information of the response distance range is reduced and the distance information is not 0 when the distance change stops, if the first motion state information during the distance information reduction process is in a motion state and the second motion state information is in a static state, then the interactive behavior is determined to be the head-mounted display approach behavior; if the first motion state information during the distance information reduction process is in a static state and the second motion state information is in a motion state, then the interactive behavior is determined to be the target approach behavior; if the first motion state information and the second motion state information during the distance information reduction process are both in a motion state, then when the acceleration corresponding to the first motion state information is greater than the acceleration (or speed) corresponding to the second motion state information
  • the specific process of the processor in this embodiment detecting the interactive behavior between the head-mounted display device and the target device based on the distance information can be set by the designer.
  • the processor can detect the interactive behavior between the head-mounted display device and the target device by itself using the distance information; for example, the head-mounted display device can detect the interactive behavior by itself based on the acquired distance information and posture data.
  • the processor can also detect the interactive behavior using other devices by sending the distance information to other devices (such as a cloud server) and receiving the interactive behavior returned by the other devices; for example, the head-mounted display device can send the distance information and posture data to the cloud server and receive the interactive behavior returned by the cloud server to detect the interactive behavior using the cloud server. This embodiment does not impose any restrictions on this.
  • Step 103 Control and adjust the color of the shading sheet of the head mounted display device according to the interactive behavior.
  • the processor can control and adjust the color of the shading sheet of the head-mounted display device according to the detected interactive behavior.
  • the processor can control the head-mounted display device to lighten the color of the shading sheet so that the user of the head-mounted display device can better view the approaching target device (such as a smart watch), thereby realizing automatic color change of the shading sheet of the head-mounted display device.
  • the processor can also control the target device to perform corresponding interactive operations according to the interactive behavior, that is, in this step, the processor can control the color of the shading sheet of the head-mounted display device to be adjusted according to the interactive behavior and control the target device to perform corresponding interactive operations, thereby further improving the interaction effect between the head-mounted display device and the target device and enhancing the user experience; for example, the processor can control the color of the shading sheet of the head-mounted display device to be lightened and control the target device to lighten the screen when the interactive behavior is an approaching behavior.
  • the specific process of the processor controlling the adjustment of the color of the shading sheet of the head-mounted display device according to the interactive behavior in this step can be set by the designer according to the practical scenario and user needs.
  • the processor of the head-mounted display device can directly adjust the color of the shading sheet of the head-mounted display device according to the interactive behavior, or control the adjustment of the color of the shading sheet of the head-mounted display device and control the target device to perform the corresponding interactive operation;
  • the processor of the target device can directly control the head-mounted display device to adjust the color of the shading sheet according to the interactive behavior, or control the head-mounted display device to adjust the color of the shading sheet and control itself to perform the corresponding interactive operation;
  • the processor of the cloud server can directly control the head-mounted display device to adjust the color of the shading sheet according to the interactive behavior, or control the head-mounted display device to
  • the processor of the head-mounted display device when the processor of the head-mounted display device detects that the interactive behavior is a close behavior, it can control the lightening of the color of its own shading sheet and control the target device to perform the corresponding interactive operation (such as lighting the screen).
  • the processor of the head mounted display device can control the color of its own shading sheet to be lighter and control the target device to perform a corresponding interactive operation (such as lighting up the screen) when detecting that the interactive behavior is the head display approach behavior; correspondingly, when detecting that the interactive behavior is the target approach behavior, the color of its own shading sheet is controlled to be lighter according to the color change control instruction sent by the target device.
  • the processor can determine the main device according to the first motion state information and the second motion state information corresponding to the interactive behavior; wherein the main device is a head-mounted display device or a target device, the first motion state information is the motion state information collected by the motion sensor of the head-mounted display device, and the second motion state information is the motion state information collected by the motion sensor of the target device. Accordingly, in this step, the main device can be used to control the head-mounted display device to adjust the color of the shading sheet, or to control the head-mounted display device to adjust the color of the shading sheet and control the target device to perform a corresponding interactive operation.
  • the main device in the head-mounted display device and the target device can be used to control the head-mounted display device to adjust the color of the shading sheet, or to control the head-mounted display device to adjust the color of the shading sheet and control the target device to perform a corresponding interactive operation.
  • the processor of the head-mounted display device determines that the main device is the head-mounted display device, then when the interactive behavior is detected as an approach behavior, the processor can control the color of its own shading sheet to be lighter, and control the target device to perform the corresponding interactive operation; if the main device is determined to be the target device, then when the interactive behavior is detected as an approach behavior, the processor can control the color of its own shading sheet to be lighter according to the color change control instruction sent by the target device; that is, when the target device determines that the main device is itself and the interactive behavior is an approach behavior, the processor can control the color of its shading sheet to be lighter by the head-mounted display device.
  • the specific method of determining the master device according to the first motion state information and the second motion state information corresponding to the interactive behavior can be set by the designer.
  • the processor can turn the head-mounted display on when the first motion state information corresponding to the interactive behavior is in a motion state and the second motion state information corresponding to the interactive behavior is in a stationary state.
  • the device is determined as the main device; when the first motion state information corresponding to the interactive behavior is in a static state and the second motion state information corresponding to the interactive behavior is in a motion state, the target device is determined as the main device; when the first motion state information and the second motion state information corresponding to the interactive behavior are both in a motion state, if the acceleration corresponding to the first motion state information is greater than the acceleration corresponding to the second motion state information, the head-mounted display device is determined as the main device; if the acceleration corresponding to the first motion state information is not greater than the acceleration corresponding to the second motion state information, the target device is determined as the main device.
  • the head-mounted display device and the target device can be quickly connected and exchange data (such as the first motion state information and the second motion state information); if during the approaching behavior, the first motion state information is in a motion state (i.e., the head-mounted display device is moving), and the second motion state information is in a static state (i.e., the target device is static), it can be determined that the head-mounted display device actively approaches the target device, thereby determining that the head-mounted display device is the primary device; if during the approaching behavior, the first motion state information is in a static state, and the second motion state information is in a motion state, it can be determined that the target device actively approaches the head-mounted display device, thereby determining that the target device is the primary device; during the approaching behavior, when both the first motion state information and the second motion state information are in a motion state, if the motion speed or motion acceleration of the head-mounted display device is higher than that of the
  • the waiting connection state can be a state entered after the device system is started and the application is started
  • the waiting trigger state can be a state in which the device establishes a physical connection through WiFi or Bluetooth (i.e., a wireless communication connection between the head-mounted display device and the target device), the application creates a connection link, and messages are sent to each other to maintain smooth communication, and the trigger message is waited for
  • the interactive preparation state can be a state in which the device detects a predetermined trigger state, such as the distance is within the response distance range or the motion state information is in a preset trigger posture (such as a motion state), and sends an interactive preparation message to the other party.
  • the master-slave determination state can be a state in which the master-slave relationship (i.e., the master device and the slave device) is confirmed according to the distance information change and posture data between the devices;
  • the interactive state can be a state in which data is exchanged between devices, such as the transmission of control instructions for interactive operations (such as color change control instructions).
  • the specific settings for the interactive operations performed by the above-mentioned target devices can be set by the designer according to practical scenarios and user needs.
  • the interactive operations can include screen-on and screen-off operations.
  • the head-mounted display device detects that the interactive behavior is approaching behavior, it can lighten the color of the shading sheet and control the target device (such as a wearable device) to turn on the screen; if the head-mounted display device detects that the interactive behavior is not approaching behavior, it can darken the color of the shading sheet and control the target device to turn off the screen.
  • the interactive operation can also include the display operation of the target information.
  • the head-mounted display device when it detects that the interactive behavior is approaching behavior, it can also send target information (such as time information) to the target device and control the target device to turn on the screen.
  • target information such as time information
  • the interactive operation may also include the activation of specific functions of the target device, such as the activation of functions such as heart rate and body temperature monitoring of a smart bracelet.
  • the processor can also control the head-mounted display device to perform other interactive operations besides adjusting the color of the shading sheet according to the interactive behavior, such as the start and stop control operation of music playback; for example, when the interactive behavior is a contact behavior, the processor can control the head-mounted display device to maintain the color of the shading sheet unchanged, and switch the start and stop of music playback or terminate the call.
  • other interactive operations besides adjusting the color of the shading sheet according to the interactive behavior, such as the start and stop control operation of music playback; for example, when the interactive behavior is a contact behavior, the processor can control the head-mounted display device to maintain the color of the shading sheet unchanged, and switch the start and stop of music playback or terminate the call.
  • the interactive operations corresponding to the same interactive behavior when the master device is different can be the same, such as the interactive operations corresponding to the approach behavior of the head-mounted display device actively approaching the target device and the approach behavior of the target device actively approaching the head-mounted display device can be the same, such as both are the light-lightening operation of the head-mounted display device and the screen-lighting operation of the target device;
  • the interactive operations corresponding to the same interactive behavior when the master device is different can also be different, such as when the master device is a head-mounted display device, the interactive operation corresponding to the approach behavior (i.e., the head display approach behavior) can be the light-lightening operation of the head-mounted display device and the screen-lighting operation of the target device, so that when the user lowers his head to view the target device, the light-lightening operation can lighten the screen of the target device at the same time, thereby improving the user experience;
  • the interactive operation corresponding to the approach behavior i.e.
  • the embodiment of the present application utilizes the distance information between the head-mounted display device and the target device to detect the interactive behavior between the devices, so that the color of the shading sheet of the head-mounted display device can be controlled and adjusted according to the interactive behavior to achieve interactive control of the device status, thereby triggering the automatic color change of the shading sheet of the head-mounted display device through the interaction between the devices, thereby improving the user experience.
  • an embodiment of the present application further provides a control device for a head-mounted display device.
  • the control device for a head-mounted display device described below and the control method for a head-mounted display device described above can refer to each other.
  • FIG3 is a structural block diagram of a control device for a head mounted display device provided in an embodiment of the present application.
  • the device may include:
  • the acquisition module 10 is used to acquire the distance information between the head mounted display device and the target device; wherein the head mounted display device is connected to the target device by wireless communication;
  • a detection module 20 configured to detect the interaction between the head mounted display device and the target device according to the distance information
  • the control module 30 is used to control and adjust the color of the shading sheet of the head mounted display device according to the interactive behavior.
  • the detection module 20 may be specifically used to detect interactive behavior based on distance information and posture data; wherein, The gesture data includes first motion state information collected by a motion sensor of the head mounted display device and/or second motion state information collected by a motion sensor of the target device.
  • the detection module 20 may include:
  • a judgment submodule is used to judge whether the distance information is within the response distance range
  • the transceiver submodule is used to send the acquired first motion state information to the target device if it is within the response distance range, and receive the second motion state information sent by the target device;
  • the detection submodule is used to detect the interactive behavior according to the change of the distance information within the response distance range, the first motion state information and the second motion state information.
  • the acquisition module 10 may be specifically used to acquire distance information according to the strength of a wireless signal connected to the target device.
  • control module 30 may include:
  • the approach control submodule is used to control the color of the shading sheet of the head-mounted display device to be lighter and control the screen of the target device to be bright if the interactive behavior is an approach behavior.
  • the device may further include:
  • a master-slave determination module configured to determine a master device according to first motion state information and second motion state information corresponding to the interactive behavior; wherein the master device is a head mounted display device or a target device, the first motion state information is motion state information collected by a motion sensor of the head mounted display device, and the second motion state information is motion state information collected by a motion sensor of the target device;
  • control module 30 can be specifically used to control and adjust the color of the shading sheet of the head mounted display device using the main device.
  • the master-slave determination module may include:
  • a first determination submodule is used to determine the head mounted display device as a main device if the first motion state information corresponding to the interactive behavior is in a motion state and the second motion state information corresponding to the interactive behavior is in a static state;
  • a second determination submodule is used to determine the target device as a main device if the first motion state information corresponding to the interactive behavior is in a stationary state and the second motion state information corresponding to the interactive behavior is in a moving state;
  • the third determination submodule is used to determine the head mounted display device as the main device if the acceleration corresponding to the first motion state information and the second motion state information corresponding to the interactive behavior are both in a motion state; if the acceleration corresponding to the first motion state information is not greater than the acceleration corresponding to the second motion state information, determine the target device as the main device.
  • the present application embodiment uses the distance between the head mounted display device and the target device through the detection module 20 Information is collected and the interactive behavior between devices is detected, so that the color of the shading sheet of the head-mounted display device can be controlled and adjusted according to the interactive behavior through the control module 30 to achieve interactive control of the device status, thereby triggering the automatic color change of the shading sheet of the head-mounted display device through the interaction between devices, thereby improving the user experience.
  • an embodiment of the present application further provides an electronic device.
  • the electronic device described below and the control method of the head-mounted display device described above can refer to each other.
  • An electronic device comprising:
  • the processor is used to implement the steps of the control method of the head mounted display device provided in the above embodiment when executing the computer program.
  • the electronic device provided in this embodiment can be a head-mounted display device, such as AR glasses; it can also be a target device wirelessly connected to the head-mounted display device, such as a wearable device (such as a smart watch and a smart bracelet).
  • a wearable device such as a smart watch and a smart bracelet.
  • an embodiment of the present application further provides a computer-readable storage medium.
  • the computer-readable storage medium described below and the control method of a head-mounted display device described above can refer to each other.
  • a computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the method for controlling a head-mounted display device provided in the above method embodiment.
  • the computer-readable storage medium may specifically be a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种头戴显示设备的控制方法、装置、电子设备及计算机可读存储介质,涉及头戴显示设备技术领域,方法包括:获取头戴显示设备与目标设备的距离信息;其中,头戴显示设备与目标设备无线通信连接(S101);根据距离信息,检测头戴显示设备与目标设备之间的互动行为(S102);根据互动行为,控制调整头戴显示设备的遮光片的颜色(S103);利用头戴显示设备与目标设备之间的距离信息,检测设备之间的互动行为,从而能够根据互动行为,控制调整头戴显示设备的遮光片的颜色,以实现设备状态的交互控制,从而通过设备间的交互触发头戴显示设备的遮光片的自动变色,提升用户体验。

Description

头戴显示设备的控制方法、装置、电子设备及存储介质
本申请要求于2022年9月29日提交中国专利局、申请号202211200124.5、申请名称为“头戴显示设备的控制方法、装置、电子设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及头戴显示设备技术领域,特别涉及一种头戴显示设备的控制方法、装置、电子设备及计算机可读存储介质。
背景技术
目前,如AR(Augmented Reality,增强现实)和MR(Mix Reality,混合现实)设备等头戴显示设备为了提升显示效果,一般会在显示镜片的外部前方添加一个深色遮光片;然而,在不需要显示内容时,深色遮光片会影响用户对真实世界的观察。随着变色材料的出现,能够很好的解决这个问题。
因此,如何能够提供一种遮光片的变色通透策略,实现头戴显示设备中遮光片的自动变色,提升用户体验,是现今急需解决的问题。
发明内容
本申请的目的是提供一种头戴显示设备的控制方法、装置、电子设备及计算机可读存储介质,以利用设备间的交互触发遮光片的变色,提升用户体验。
为解决上述技术问题,本申请提供一种头戴显示设备的控制方法,包括:
获取头戴显示设备与目标设备的距离信息;其中,所述头戴显示设备与所述目标设备无线通信连接;
根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为;
根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色。
可选的,所述根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为,包括:
根据所述距离信息和姿态数据,检测所述互动行为;其中,所述姿态数据包括头戴显示设备的运动传感器采集的第一运动状态信息和/或目标设备的运动传感器采集的第二运动状态信息。
可选的,所述根据所述距离信息和姿态数据,检测所述互动行为,包括:
所述头戴显示设备判断所述距离信息是否处于响应距离范围内;
若是,则将获取的所述第一运动状态信息发送到所述目标设备,并接收所述目标设备发送的所述第二运动状态信息;
根据所述响应距离范围内的所述距离信息的变化、所述第一运动状态信息和所述第二运动状态信息,检测所述互动行为。
可选的,所述获取头戴显示设备与目标设备的距离信息,包括:
所述头戴显示设备根据与所述目标设备连接的无线信号强度,获取所述距离信息。
可选的,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色,包括:
若所述互动行为为靠近行为,则控制调浅所述头戴显示设备的遮光片的颜色,并控制所述目标设备亮屏。
可选的,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色之前,还包括:
根据所述互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备;其中,所述主设备为所述头戴显示设备或所述目标设备,所述第一运动状态信息为所述头戴显示设备的运动传感器采集的运动状态信息,所述第二运动状态信息为所述目标设备的运动传感器采集的运动状态信息;
对应的,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色,包括:
利用所述主设备控制调整所述头戴显示设备的遮光片的颜色。
可选的,所述根据所述互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备,包括:
若所述互动行为对应的第一运动状态信息处于运动状态,所述互动行为对应的第二运动状态信息处于静止状态,则将所述头戴显示设备确定为所述主设备;
若所述互动行为对应的第一运动状态信息处于静止状态,所述互动行为对应的第二运动状态信息处于运动状态,则将所述目标设备确定为所述主设备;
在所述互动行为对应的第一运动状态信息和第二运动状态信息均处于运动状态的情况下,若所述第一运动状态信息对应的加速度大于所述第二运动状态信息对应的加速度,则将所述头戴显示设备确定为所述主设备;若所述第一运动状态信息对应的加速度不大于所述第二运动状态信息对应的加速度,则将所述目标设备确定为所述主设备。
本申请还提供了一种头戴显示设备的控制装置,包括:
获取模块,用于获取头戴显示设备与目标设备的距离信息;其中,所述头戴显示设备 与所述目标设备无线通信连接;
检测模块,用于根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为;
控制模块,用于根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色。
本申请还提供了一种电子设备,包括:
存储器,用于存储计算机程序;
处理器,用于执行所述计算机程序时实现如上述所述的头戴显示设备的控制方法的步骤。
本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如上述所述的头戴显示设备的控制方法的步骤。
本申请所提供的一种头戴显示设备的控制方法,包括:获取头戴显示设备与目标设备的距离信息;其中,头戴显示设备与目标设备无线通信连接;根据距离信息,检测头戴显示设备与目标设备之间的互动行为;根据互动行为,控制调整头戴显示设备的遮光片的颜色;
可见,本申请利用头戴显示设备与目标设备之间的距离信息,检测设备之间的互动行为,从而能够根据互动行为,控制调整头戴显示设备的遮光片的颜色,以实现设备状态的交互控制,从而通过设备间的交互触发头戴显示设备的遮光片的自动变色,提升用户体验。此外,本申请还提供了一种头戴显示设备的控制装置、电子设备及计算机可读存储介质。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据提供的附图获得其他的附图。
图1为本申请实施例所提供的一种头戴显示设备的控制方法的流程图;
图2为本申请实施例所提供的另一种头戴显示设备的控制方法的设备状态切换的示意图;
图3为本申请实施例所提供的一种头戴显示设备的控制装置的结构框图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
请参考图1,图1为本申请实施例所提供的一种头戴显示设备的控制方法的流程图。该方法包括:
步骤101:获取头戴显示设备与目标设备的距离信息;其中,头戴显示设备与目标设备无线通信连接。
可以理解的是,本实施例中的目标设备可以为用于与头戴显示设备进行交互控制的任一电子设备,例如可穿戴设备(如智能手表和智能手环等)和移动终端设备(如智能手机)等;目标设备可以与头戴显示设备无线通信连接,如蓝牙连接、wifi连接或红外连接等。
具体的,本实施例所提供的头戴显示设备的控制方法可以应用于头戴显示设备,即头戴显示设备的处理器可以执行本实施例所提供的方法的步骤,检测头戴显示设备与目标设备之间的互动行为,并控制调整头戴显示设备的遮光片的颜色;本实施例所提供的头戴显示设备的控制方法可以应用于目标设备或与头戴显示设备和目标设备连接的终端设备(如云服务器),本实施例对此不做任何限制。
具体的,本步骤中的距离信息可以为头戴显示设备与目标设备之间距离的信息。对于本步骤中处理器获取头戴显示设备与目标设备的距离信息的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如处理器可以根据头戴显示设备与目标设备连接的无线信号强度,获取距离信息;例如,头戴显示设备的处理器可以利用与目标设备蓝牙连接的RSSI(Received Signal Strength Indication,接收信号强度指示)值,检测与目标设备的距离信息。处理器也可以根据头戴显示设备和目标设备中的测距传感器(如超声测距传感器或光学测距传感器)的传感器数据,获取距离信息;例如,头戴显示设备可以利用自身的超声接收器(即超声测距传感器)采集的目标设备中的超声发生器输出的超声信号,检测与目标设备的距离信息。只要处理器能够获取头戴显示设备与目标设备的距离信息,本实施例对此不做任何限制。
骤102:根据距离信息,检测头戴显示设备与目标设备之间的互动行为。
可以理解的是,本步骤中的互动行为可以为预先设置的头戴显示设备和目标设备之间的距离变化所对应的行为。对于本步骤中的互动行为的具体设置数量和类型,可以由设计 人员根据实用场景和用户需求自行设置,如互动行为可以包括头戴显示设备与目标设备之间距离缩小对应的靠近行为;互动行为也可以包括头戴显示设备与目标设备之间距离缩小至接触对应的接近行为;互动行为还可以包括头戴显示设备与目标设备之间距离增大对应的远离行为。
具体的,对于本步骤中处理器根据距离信息,检测头戴显示设备与目标设备之间的互动行为的具体方式,可以由设计人员自行设置,如处理器可以仅利用距离信息,检测头戴显示设备与目标设备之间的互动行为;举例来说,处理器可以根据响应距离范围(如0至60cm)内的距离信息,检测头戴显示设备与目标设备之间的互动行为;例如,处理器可以在检测到响应距离范围的距离信息发生变化后,若响应距离范围的距离信息减小值达到响应阈值(如2cm)且距离变化停止时距离信息不为0,则确定互动行为为靠近行为;若响应距离范围的距离信息减小值达到响应阈值且距离变化停止时距离信息为0,则确定互动行为为接触行为;若响应距离范围的距离信息增大值达到响应阈值,则确定互动行为为远离行为。
对应的,处理器也可以根据距离信息和姿态数据,检测互动行为;其中,姿态数据包括头戴显示设备的运动传感器(如加速度传感器)采集的第一运动状态信息和/或目标设备的运动传感器采集的第二运动状态信息。也就是说,处理器可以利用距离信息以及头戴显示设备和/或目标设备的姿态对应的姿态数据,检测头戴显示设备与目标设备之间的互动行为。如处理器可以根据响应距离范围内的距离信息和姿态数据,检测互动行为;例如,头戴显示设备的处理器判断距离信息是否处于响应距离范围内;若是,则将获取的第一运动状态信息发送到目标设备(即目标设备也可以检测互动行为),并接收目标设备发送的第二运动状态信息;根据响应距离范围内的距离信息的变化、第一运动状态信息和第二运动状态信息,检测互动行为。
相应的,对于距离信息不处于响应距离范围内的情况,可以由设计人员自行设置,如头戴显示设备的处理器可以在距离信息不处于响应距离范围内时,直接结束本流程或返回步骤101继续获取距离信息,本实施例对此不做任何限制。
需要说明的是,对于上述根据响应距离范围内的距离信息的变化、第一运动状态信息和第二运动状态信息,检测互动行为的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如互动行为包括靠近行为时,处理器可以在检测到响应距离范围的距离信息减小,且第一运动状态信息和第二运动状态均处于静止状态后距离信息不为0时,确定互动行为为靠近行为;在检测到响应距离范围的距离信息减小,且第一运动状态信息和第二 运动状态均处于静止状态后距离信息为0时,确定互动行为为接触行为;在检测到响应距离范围的距离信息增大,且第一运动状态信息和第二运动状态均处于静止状态或距离信息超出响应距离范围时,则确定互动行为为远离行为。
对应的,靠近行为可以划分为头戴显示设备主动靠近目标设备的头显靠近行为和目标设备主动靠近头戴显示设备的头显靠近行为;例如,互动行为包括头显靠近行为和头显靠近行为时,处理器在检测到响应距离范围的距离信息减小,且距离变化停止时距离信息不为0的情况下,若距离信息减小过程中的第一运动状态信息处于运动状态且第二运动状态信息处于静止状态,则确定互动行为为头显靠近行为;若距离信息减小过程中的第一运动状态信息处于静止状态且第二运动状态信息处于运动状态,则确定互动行为为目标靠近行为;若距离信息减小过程中的第一运动状态信息和第二运动状态信息均处于运动状态,则在第一运动状态信息对应的加速度大于第二运动状态信息对应的加速度(或速度)时确定互动行为为头显靠近行为,第一运动状态信息对应的加速度不大于第二运动状态信息对应的加速度时确定互动行为为目标靠近行为。
具体的,对于本实施例中处理器根据距离信息,检测头戴显示设备与目标设备之间的互动行为的具体过程,可以由设计人员自行设置,如处理器可以利用距离信息自行检测头戴显示设备与目标设备之间的互动行为;例如,头戴显示设备可以根据获取的距离信息和姿态数据,自行检测互动行为。处理器也可以通过将距离信息发送到其它设备(如云服务器)并接收其它设备返回的互动行为,以利用其它设备检测互动行为;例如,头戴显示设备可以将距离信息和姿态数据发送到云服务器,并接收云服务器返回的互动行为,以利用云服务器检测互动行为。本实施例对此不做任何限制。
步骤103:根据互动行为,控制调整头戴显示设备的遮光片的颜色。
可以理解的是,本步骤中处理器可以根据检测到的互动行为,控制调整头戴显示设备的遮光片的颜色,如检测到的互动行为为靠近行为时,处理器可以控制头戴显示设备调浅遮光片的颜色,以使头戴显示设备的用户可以更好地查看靠近的目标设备(如智能手表),实现头戴显示设备的遮光片的自动变色。
具体的,本步骤中处理器还可以根据互动行为,控制目标设备执行相应的互动操作,即本步骤中处理器可以互动行为,控制调整头戴显示设备的遮光片的颜色并控制目标设备执行相应的互动操作,从而能够进一步提高头戴显示设备与目标设备的交互效果,提升用户体验;例如处理器可以在互动行为为靠近行为时,控制调浅头戴显示设备的遮光片的颜色,并控制目标设备亮屏。
对应的,对于本步骤中处理器根据互动行为,控制调整头戴显示设备的遮光片的颜色的具体过程,可以由设计人员根据实用场景和用户需求自行设置,如本实施例所提供的方法应用于头戴显示设备时,头戴显示设备的处理器可以直接根据互动行为,调整头戴显示设备的遮光片的颜色,或控制调整头戴显示设备的遮光片的颜色并控制目标设备执行相应的互动操作;本实施例所提供的方法应用于目标设备时,目标设备的处理器可以直接根据互动行为,控制头戴显示设备调整遮光片的颜色,或控制头戴显示设备调整遮光片的颜色并控制自身执行相应的互动操作;本实施例所提供的方法应用于云服务器时,云服务器的处理器可以直接根据互动行为,控制头戴显示设备调整遮光片的颜色,或控制头戴显示设备调整遮光片的颜色并控制目标设备执行相应的互动操作。例如,头戴显示设备的处理器可以在检测到互动行为为靠近行为时,控制调浅自身遮光片的颜色,并控制目标设备执行相应的互动操作(如亮屏)。靠近行为包括头显靠近行为和目标靠近行为的情况下,头戴显示设备的处理器可以在检测到互动行为为头显靠近行为时,控制调浅自身遮光片的颜色,并控制目标设备执行相应的互动操作(如亮屏);相应的,在检测到互动行为为目标靠近行为时,根据目标设备发送的变色控制指令,控制调浅自身遮光片的颜色。
进一步的,本步骤之前处理器可以根据互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备;其中,主设备为头戴显示设备或目标设备,第一运动状态信息为头戴显示设备的运动传感器采集的运动状态信息,第二运动状态信息为目标设备的运动传感器采集的运动状态信息。相应的,本步骤中可以利用主设备控制头戴显示设备调整遮光片的颜色,或控制头戴显示设备调整遮光片的颜色并控制目标设备执行相应的互动操作。也就是说,本实施例中可以利用头戴显示设备和目标设备中的主设备,控制头戴显示设备调整遮光片的颜色,或控制头戴显示设备调整遮光片的颜色并控制目标设备执行相应的互动操作。例如,本实施例所提供的方法应用于头戴显示设备时,头戴显示设备的处理器若确定主设备为头戴显示设备,则可以在检测到互动行为为靠近行为时,控制调浅自身遮光片的颜色,并控制目标设备执行相应的互动操作;若确定主设备为目标设备,则在检测到互动行为为靠近行为时,可以根据目标设备发送的变色控制指令,控制调浅自身遮光片的颜色;即目标设备可以在确定主设备为自身且互动行为为靠近行为时,向头戴显示设备发送变色控制指令,以头戴显示设备控制调浅其遮光片的颜色。
具体的,对于上述根据互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备的具体方式,可以由设计人员自行设置,如处理器可以在互动行为对应的第一运动状态信息处于运动状态,互动行为对应的第二运动状态信息处于静止状态时,将头戴显示 设备确定为主设备;在互动行为对应的第一运动状态信息处于静止状态,互动行为对应的第二运动状态信息处于运动状态时,将目标设备确定为主设备;在互动行为对应的第一运动状态信息和第二运动状态信息均处于运动状态的情况下,若第一运动状态信息对应的加速度大于第二运动状态信息对应的加速度,则将头戴显示设备确定为主设备;若第一运动状态信息对应的加速度不大于第二运动状态信息对应的加速度,则将目标设备确定为主设备。
例如,头戴显示设备与目标设备之间的距离信息进入响应距离范围内后,头戴显示设备与目标设备之间可以迅速连接并交换数据(如第一运动状态信息和第二运动状态信息);若靠近行为进行过程中,第一运动状态信息处于运动状态(即头戴显示设备运动),第二运动状态信息处于静止状态(即目标设备静止),可以确定是头戴显示设备主动靠近目标设备,从而确定头戴显示设备为主设备;若靠近行为进行过程中,第一运动状态信息处于静止状态,第二运动状态信息处于运动状态,可以确定是目标设备主动靠近头戴显示设备,从而确定目标设备为主设备;在靠近行为进行过程中,第一运动状态信息和第二运动状态信息均处于运动状态时,若头戴显示设备的运动速度或运动加速度高于目标设备,则确认头戴显示设备为主设备,反之,确认目标设备为主设备。
相应的,头戴显示设备和/或目标设备的内部状态切换过程可以如图2所示,其中,等待连接状态可以为设备系统启动之后,应用程序启动后进入的状态;等待触发状态可以为设备通过wifi或者蓝牙建立物理连接(即头戴显示设备与目标设备的无线通信连接),应用程序创建连接链路,互发报文保持相互通信畅通,等待触发消息的状态;互动准备状态可以为设备检测到预定的触发状态,如距离处于响应距离范围或运动状态信息处于预设触发姿态(如运动状态),向对方发送互动准备消息的状态,进入互动准备状态后,设备间可以建立数据通道;主从确定状态可以为根据设备间的距离信息变化和姿态数据,确认主从关系(即主设备和从设备)的状态;互动状态可以为设备间进行数据交互的状态,例如互动操作的控制指令(如变色控制指令)的传输。
具体的,对于上述目标设备执行的互动操作的具体设置,可以由设计人员根据实用场景和用户需求自行设置,如互动操作可以包括亮屏操作和熄屏操作,例如本步骤中头戴显示设备若检测到互动行为为靠近行为,则可以调浅遮光片的颜色,并控制目标设备(如可穿戴设备)亮屏;头戴显示设备若检测到互动行为为原理行为,则可以调深遮光片的颜色,并控制目标设备息屏。互动操作也可以包括目标信息的显示操作,如头戴显示设备在检测到互动行为为靠近行为时,还可以向目标设备发送目标信息(如时间信息)并控制目标设 备显示该目标信息。互动操作还可以包括目标设备的特定功能启动操作,如智能手环的心率和体温监测等功能的启动操作。
进一步的,本步骤中处理器还可以根据互动行为,控制头戴显示设备执行调整遮光片的颜色之外的其他互动操作,如音乐播放的启停控制操作;例如,处理器可以在互动行为为接触行为时,控制头戴显示设备维持遮光片颜色不变,并切换音乐播放的启停或中止通话。
对应的,本实施例中主设备不同时同一互动行为对应的互动操作可以相同,如头戴显示设备主动靠近目标设备的靠近行为和目标设备主动靠近头戴显示设备的靠近行为对应的互动操作可以相同,如均为头戴显示设备的遮光片颜色调浅操作和目标设备的亮屏操作;主设备不同时同一互动行为对应的互动操作也可以不同,如主设备为头戴显示设备时,靠近行为(即头显靠近行为)对应的互动操作可以为头戴显示设备的遮光片颜色调浅操作和目标设备的亮屏操作,以使用户低头查看目标设备时,遮光片变浅的同时可以点亮目标设备的屏幕,提升用户体验;主设备为目标设备时,靠近行为(即目标靠近行为)对应的互动操作可以为头戴显示设备的遮光片颜色调浅操作,以使用户可以通过移动目标设备靠近,控制遮光片变浅,方便查看外部环境。本实施例对此不做任何限制。
本实施例中,本申请实施例利用头戴显示设备与目标设备之间的距离信息,检测设备之间的互动行为,从而能够根据互动行为,控制调整头戴显示设备的遮光片的颜色,以实现设备状态的交互控制,从而通过设备间的交互触发头戴显示设备的遮光片的自动变色,提升用户体验。
相应于上面的方法实施例,本申请实施例还提供了一种头戴显示设备的控制装置,下文描述的一种头戴显示设备的控制装置与上文描述的一种头戴显示设备的控制方法可相互对应参照。
请参考图3,图3为本申请实施例所提供的一种头戴显示设备的控制装置的结构框图。该装置可以包括:
获取模块10,用于获取头戴显示设备与目标设备的距离信息;其中,头戴显示设备与目标设备无线通信连接;
检测模块20,用于根据距离信息,检测头戴显示设备与目标设备之间的互动行为;
控制模块30,用于根据互动行为,控制调整头戴显示设备的遮光片的颜色。
可选的,检测模块20可以具体用于根据距离信息和姿态数据,检测互动行为;其中, 姿态数据包括头戴显示设备的运动传感器采集的第一运动状态信息和/或目标设备的运动传感器采集的第二运动状态信息。
可选的,该装置应用于头戴显示设备时,检测模块20可以包括:
判断子模块,用于判断距离信息是否处于响应距离范围内;
收发子模块,用于若处于响应距离范围内,则将获取的第一运动状态信息发送到目标设备,并接收目标设备发送的第二运动状态信息;
检测子模块,用于根据响应距离范围内的距离信息的变化、第一运动状态信息和第二运动状态信息,检测互动行为。
可选的,该装置应用于头戴显示设备时,获取模块10可以具体用于根据与目标设备连接的无线信号强度,获取距离信息。
可选的,控制模块30可以包括:
靠近控制子模块,用于若互动行为为靠近行为,则控制调浅头戴显示设备的遮光片的颜色,并控制目标设备亮屏。
可选的,该装置还可以包括:
主从确定模块,用于根据互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备;其中,主设备为头戴显示设备或目标设备,第一运动状态信息为头戴显示设备的运动传感器采集的运动状态信息,第二运动状态信息为目标设备的运动传感器采集的运动状态信息;
对应的,控制模块30可以具体用于利用主设备控制调整头戴显示设备的遮光片的颜色。
可选的,主从确定模块可以包括:
第一确定子模块,用于若互动行为对应的第一运动状态信息处于运动状态,互动行为对应的第二运动状态信息处于静止状态,则将头戴显示设备确定为主设备;
第二确定子模块,用于若互动行为对应的第一运动状态信息处于静止状态,互动行为对应的第二运动状态信息处于运动状态,则将目标设备确定为主设备;
第三确定子模块,用于在互动行为对应的第一运动状态信息和第二运动状态信息均处于运动状态的情况下,若第一运动状态信息对应的加速度大于第二运动状态信息对应的加速度,则将头戴显示设备确定为主设备;若第一运动状态信息对应的加速度不大于第二运动状态信息对应的加速度,则将目标设备确定为主设备。
本实施例中,本申请实施例通过检测模块20利用头戴显示设备与目标设备之间的距离 信息,检测设备之间的互动行为,从而能够通过控制模块30根据互动行为,控制调整头戴显示设备的遮光片的颜色,以实现设备状态的交互控制,从而通过设备间的交互触发头戴显示设备的遮光片的自动变色,提升用户体验。
相应于上面的方法实施例,本申请实施例还提供了一种电子设备,下文描述的一种电子设备与上文描述的一种头戴显示设备的控制方法可相互对应参照。
一种电子设备,包括:
存储器,用于存储计算机程序;
处理器,用于执行计算机程序时实现如上述实施例所提供的头戴显示设备的控制方法的步骤。
具体的,本实施例并不限定电子设备的具体设备类型,本实施例所提供的电子设备可以为头戴显示设备,例如AR眼镜;也可以为与头戴显示设备无线通信连接的目标设备,例如可穿戴设备(如智能手表和智能手环)。
相应于上面的方法实施例,本申请实施例还提供了一种计算机可读存储介质,下文描述的一种计算机可读存储介质与上文描述的一种头戴显示设备的控制方法可相互对应参照。
一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现上述方法实施例所提供的头戴显示设备的控制方法的步骤。
该计算机可读存储介质具体可以为U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可存储程序代码的介质。
说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的装置、电子设备及计算机可读存储介质而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。
以上对本申请所提供的一种头戴显示设备的控制方法、装置、电子设备及计算机可读存储介质进行了详细介绍。本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想。应当指出,对于本 技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以对本申请进行若干改进和修饰,这些改进和修饰也落入本申请权利要求的保护范围内。

Claims (10)

  1. 一种头戴显示设备的控制方法,其特征在于,包括:
    获取头戴显示设备与目标设备的距离信息;其中,所述头戴显示设备与所述目标设备无线通信连接;
    根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为;
    根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色。
  2. 根据权利要求1所述的头戴显示设备的控制方法,其特征在于,所述根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为,包括:
    根据所述距离信息和姿态数据,检测所述互动行为;其中,所述姿态数据包括头戴显示设备的运动传感器采集的第一运动状态信息和/或目标设备的运动传感器采集的第二运动状态信息。
  3. 根据权利要求2所述的头戴显示设备的控制方法,其特征在于,所述根据所述距离信息和姿态数据,检测所述互动行为,包括:
    所述头戴显示设备判断所述距离信息是否处于响应距离范围内;
    若是,则将获取的所述第一运动状态信息发送到所述目标设备,并接收所述目标设备发送的所述第二运动状态信息;
    根据所述响应距离范围内的所述距离信息的变化、所述第一运动状态信息和所述第二运动状态信息,检测所述互动行为。
  4. 根据权利要求1所述的头戴显示设备的控制方法,其特征在于,所述获取头戴显示设备与目标设备的距离信息,包括:
    所述头戴显示设备根据与所述目标设备连接的无线信号强度,获取所述距离信息。
  5. 根据权利要求1所述的头戴显示设备的控制方法,其特征在于,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色,包括:
    若所述互动行为为靠近行为,则控制调浅所述头戴显示设备的遮光片的颜色,并控制所述目标设备亮屏。
  6. 根据权利要求1至5任一项所述的头戴显示设备的控制方法,其特征在于,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色之前,还包括:
    根据所述互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备;其中,所述主设备为所述头戴显示设备或所述目标设备,所述第一运动状态信息为所述头戴显示设备的运动传感器采集的运动状态信息,所述第二运动状态信息为所述目标设备的运动传 感器采集的运动状态信息;
    对应的,所述根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色,包括:
    利用所述主设备控制调整所述头戴显示设备的遮光片的颜色。
  7. 根据权利要求6所述的头戴显示设备的控制方法,其特征在于,所述根据所述互动行为对应的第一运动状态信息和第二运动状态信息,确定主设备,包括:
    若所述互动行为对应的第一运动状态信息处于运动状态,所述互动行为对应的第二运动状态信息处于静止状态,则将所述头戴显示设备确定为所述主设备;
    若所述互动行为对应的第一运动状态信息处于静止状态,所述互动行为对应的第二运动状态信息处于运动状态,则将所述目标设备确定为所述主设备;
    在所述互动行为对应的第一运动状态信息和第二运动状态信息均处于运动状态的情况下,若所述第一运动状态信息对应的加速度大于所述第二运动状态信息对应的加速度,则将所述头戴显示设备确定为所述主设备;若所述第一运动状态信息对应的加速度不大于所述第二运动状态信息对应的加速度,则将所述目标设备确定为所述主设备。
  8. 一种头戴显示设备的控制装置,其特征在于,包括:
    获取模块,用于获取头戴显示设备与目标设备的距离信息;其中,所述头戴显示设备与所述目标设备无线通信连接;
    检测模块,用于根据所述距离信息,检测所述头戴显示设备与所述目标设备之间的互动行为;
    控制模块,用于根据所述互动行为,控制调整所述头戴显示设备的遮光片的颜色。
  9. 一种电子设备,其特征在于,包括:
    存储器,用于存储计算机程序;
    处理器,用于执行所述计算机程序时实现如权利要求1至7任一项所述的头戴显示设备的控制方法的步骤。
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至7任一项所述的头戴显示设备的控制方法的步骤。
PCT/CN2023/122467 2022-09-29 2023-09-28 头戴显示设备的控制方法、装置、电子设备及存储介质 Ceased WO2024067786A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211200124.5A CN115480645A (zh) 2022-09-29 2022-09-29 头戴显示设备的控制方法、装置、电子设备及存储介质
CN202211200124.5 2022-09-29

Publications (1)

Publication Number Publication Date
WO2024067786A1 true WO2024067786A1 (zh) 2024-04-04

Family

ID=84393608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/122467 Ceased WO2024067786A1 (zh) 2022-09-29 2023-09-28 头戴显示设备的控制方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN115480645A (zh)
WO (1) WO2024067786A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115480645A (zh) * 2022-09-29 2022-12-16 歌尔科技有限公司 头戴显示设备的控制方法、装置、电子设备及存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012026375A1 (ja) * 2010-08-24 2012-03-01 シャープ株式会社 立体表示装置
CN104414747A (zh) * 2013-09-11 2015-03-18 财团法人工业技术研究院 虚像显示装置
JP2017208070A (ja) * 2016-05-11 2017-11-24 株式会社リコー 情報共有システム、情報共有方法、端末装置および情報処理プログラム
US20170343804A1 (en) * 2016-05-27 2017-11-30 Samsung Display Co., Ltd. Display device and display method
US20180318703A1 (en) * 2015-12-02 2018-11-08 Sony Interactive Entertainment Inc. Display control apparatus and display control method
US20190362562A1 (en) * 2018-05-25 2019-11-28 Leap Motion, Inc. Throwable Interface for Augmented Reality and Virtual Reality Environments
CN111077671A (zh) * 2018-10-19 2020-04-28 广东虚拟现实科技有限公司 设备控制方法、装置、显示设备及存储介质
CN114019680A (zh) * 2021-11-05 2022-02-08 苏州伯宇科技有限公司 一种用于ar眼镜的成像优化系统及方法
CN115480645A (zh) * 2022-09-29 2022-12-16 歌尔科技有限公司 头戴显示设备的控制方法、装置、电子设备及存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6355978B2 (ja) * 2014-06-09 2018-07-11 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
CN104905803B (zh) * 2015-07-01 2018-03-27 京东方科技集团股份有限公司 可穿戴电子设备及其情绪监控方法
CN204950975U (zh) * 2015-07-01 2016-01-13 京东方科技集团股份有限公司 可穿戴电子设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012026375A1 (ja) * 2010-08-24 2012-03-01 シャープ株式会社 立体表示装置
CN104414747A (zh) * 2013-09-11 2015-03-18 财团法人工业技术研究院 虚像显示装置
US20180318703A1 (en) * 2015-12-02 2018-11-08 Sony Interactive Entertainment Inc. Display control apparatus and display control method
JP2017208070A (ja) * 2016-05-11 2017-11-24 株式会社リコー 情報共有システム、情報共有方法、端末装置および情報処理プログラム
US20170343804A1 (en) * 2016-05-27 2017-11-30 Samsung Display Co., Ltd. Display device and display method
US20190362562A1 (en) * 2018-05-25 2019-11-28 Leap Motion, Inc. Throwable Interface for Augmented Reality and Virtual Reality Environments
CN111077671A (zh) * 2018-10-19 2020-04-28 广东虚拟现实科技有限公司 设备控制方法、装置、显示设备及存储介质
CN114019680A (zh) * 2021-11-05 2022-02-08 苏州伯宇科技有限公司 一种用于ar眼镜的成像优化系统及方法
CN115480645A (zh) * 2022-09-29 2022-12-16 歌尔科技有限公司 头戴显示设备的控制方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN115480645A (zh) 2022-12-16

Similar Documents

Publication Publication Date Title
KR102606789B1 (ko) 복수의 음성 인식 장치들을 제어하는 방법 및 그 방법을 지원하는 전자 장치
KR102291021B1 (ko) 오디오 출력을 제어하기 위한 전자 장치 및 그의 동작 방법
KR102361885B1 (ko) 전자 장치 및 전자 장치 제어 방법
CN110673783B (zh) 一种触控方法与电子设备
EP3110180B1 (en) Method and device for managing self-balanced vehicle
CN107767839B (zh) 亮度调节方法及相关产品
JP7585006B2 (ja) メガネ型情報機器、その方法及びプログラム
EP2993577A1 (en) Method for providing virtual reality service and apparatus for the same
KR20220158048A (ko) 다수의 사용자들 사이의 시간 제한된 증강 현실 기반 통신을 용이하게 하는 가상 상호작용 세션
US20160165220A1 (en) Display apparatus and method of controlling display apparatus
KR20160026337A (ko) 전자장치의 통지 이벤트 처리 방법 및 그 전자 장치
KR101712762B1 (ko) 테마 어플리케이션을 로딩하기 위한 방법 및 디바이스
WO2015073412A1 (en) Utilizing external devices to offload text entry on a head-mountable device
WO2022037726A1 (zh) 分屏显示方法和电子设备
EP4632416A1 (en) Pogo pin interface connection state detection method, combination apparatus and electronic device
WO2024067786A1 (zh) 头戴显示设备的控制方法、装置、电子设备及存储介质
CN113805825B (zh) 设备之间的数据通信方法、设备及可读存储介质
US10754432B2 (en) Information processing device and information processing method for detecting gesture manipulation
CN112000411A (zh) 移动终端及其录音通道占用信息的显示方法
CN105100674A (zh) 一种基于hud设备的视频通信系统及方法
EP3425511B1 (en) Method and apparatus for monitoring virtual document object model
CN112202957B (zh) 终端控制方法与控制装置
US9600088B2 (en) Method and apparatus for displaying a pointer on an external display
WO2026067720A1 (zh) 通话显示方法、装置、电子设备、存储介质及车辆
CN114849215B (zh) 一种基于智能穿戴设备的跳绳计数的方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23871011

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23871011

Country of ref document: EP

Kind code of ref document: A1