WO2020207380A1 - 头戴电子设备及其控制方法 - Google Patents

头戴电子设备及其控制方法 Download PDF

Info

Publication number
WO2020207380A1
WO2020207380A1 PCT/CN2020/083503 CN2020083503W WO2020207380A1 WO 2020207380 A1 WO2020207380 A1 WO 2020207380A1 CN 2020083503 W CN2020083503 W CN 2020083503W WO 2020207380 A1 WO2020207380 A1 WO 2020207380A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
electronic device
mounted electronic
state
pulse
Prior art date
Application number
PCT/CN2020/083503
Other languages
English (en)
French (fr)
Inventor
周国名
袁其云
陈健
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2020207380A1 publication Critical patent/WO2020207380A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/02Details of power systems and of start or stop of display operation
    • G09G2330/021Power management, e.g. power saving

Definitions

  • This application relates to the technical field of wearable devices, and in particular to a head-mounted electronic device and a control method thereof.
  • augmented reality (augment reality, AR) glasses generally use proximity light sensors to detect the wearing state of the glasses. If the proximity light sensor does not detect an object approaching, it indicates that the wearing state of the glasses at this time is not worn, then shut down or standby; if the proximity light sensor detects an object approaching, it indicates that the wearing state of the glasses at this time is worn, then turn on . As shown in Fig. 1, the proximity light sensor is usually installed on the temple or forehead of the glasses. When users are not using the glasses, they usually bend the left and right temples of the glasses. At this time, the left and right temples and between the temples and the forehead will block each other, which may lead to incorrect judgment of the wearing state of the glasses.
  • the embodiment of the application provides a head-mounted electronic device and a control method thereof, which can accurately determine the wearing state of the head-mounted electronic device, make the head-mounted electronic device respond, reduce the power consumption of the head-mounted electronic device, and improve the head-mounted electronic device.
  • the endurance of the equipment can accurately determine the wearing state of the head-mounted electronic device, make the head-mounted electronic device respond, reduce the power consumption of the head-mounted electronic device, and improve the head-mounted electronic device.
  • an embodiment of the present application provides a head-mounted electronic device, including: a sensor, one or more processors, one or more memories; the aforementioned sensor, the aforementioned one or more memories, and the aforementioned one or more processors
  • the aforementioned sensor is used to detect the pulse of the head of the user wearing the aforementioned head-mounted electronic device, and the aforementioned one or more memories are used to store computer program codes.
  • the aforementioned computer program codes include computer instructions.
  • the head-mounted electronic device executes: acquiring the pulse data of the user's head detected by the sensor; switching the working state of the head-mounted electronic device from the first working state to the pulse data detected by the sensor The second working state.
  • the head-mounted electronic device provided by the embodiment of the present application can use the pulse data detected by the sensor to accurately determine the wearing state of the head-mounted electronic device, so that the head-mounted electronic device can switch the working state from the first working state to the second working state, and the head can be lowered.
  • the power consumption of wearing electronic equipment improves the endurance of head-mounted electronic equipment.
  • the above-mentioned pulse data indicates that there is no pulse
  • the above-mentioned first working state is a power-on state
  • the above-mentioned second working state is any one of a power-off state, a standby state, or a sleep state.
  • the pulse data indicates that there is no pulse, that is, the wearing state of the head-mounted electronic device is not worn, and the working state of the head-mounted electronic device is switched from the on state to the off state, the standby state or the sleep state.
  • the power consumption of the head-mounted electronic device is reduced, and the endurance of the head-mounted electronic device is improved.
  • the pulse data indicates that there is no pulse
  • the first working state is displaying the video being played
  • the second working state is displaying the video that is paused.
  • the device that plays or pauses the video may be a head-mounted electronic device or an external device, which is not limited in the embodiment of the present application.
  • the head-mounted electronic device can be switched from displaying the video being played to displaying the paused video, which can reduce the user's operation and improve the user's use of the head-mounted electronic device.
  • the above-mentioned head-mounted electronic device after the above-mentioned head-mounted electronic device performs the above-mentioned switching of the working state of the above-mentioned head-mounted electronic device from the first working state to the second working state, the above-mentioned head-mounted electronic device further executes: When the working state of the head-mounted electronic device is switched from the first working state to the second working state, and there is no pulse for the first time period, the working state of the head-mounted electronic device is switched from the second working state to the second working state.
  • the foregoing first time length may be, for example, 30 seconds, 1 minute, 5 minutes, and so on.
  • This implementation can further reduce the power consumption of the head-mounted electronic device and improve the endurance of the head-mounted electronic device.
  • the above-mentioned head-mounted electrical device further includes a display screen
  • the above-mentioned pulse data indicates that there is no pulse
  • the above-mentioned first working state is for making the display screen display the first content
  • the above-mentioned second working state is for making the above-mentioned display The screen displays the second content.
  • the display screen when the display screen is lit, it can be regarded as the display screen displaying the first content, and the display screen being turned off can be regarded as the display screen displaying the second content.
  • the second working state can also reduce the brightness of the display screen, or the display screen can display a specific picture.
  • the specific screen may be, for example, a screen used to protect the screen, that is, a screen saver, or a screen used to display time.
  • the content displayed after reducing the brightness of the display screen may be referred to as the second content, and the above-mentioned specific screen may also be referred to as the second content.
  • This implementation can reduce the power consumption of the head-mounted electronic device and improve the endurance of the head-mounted electronic device.
  • the pulse data indicates that there is a pulse
  • the first working state is any one of a shutdown state, a standby state, or a sleep state
  • the second working state is a power-on state.
  • the pulse data indicates that there is a pulse, that is, the wearing state of the head-mounted electronic device is worn, and the working state of the head-mounted electronic device is switched from any one of the off state, the standby state or the hibernation state to the on state, and there is no need
  • the user manually turns on the device, reducing user operations, improving the efficiency of users using head-mounted electronic devices, and improving user experience.
  • the above-mentioned pulse data indicates that there is a pulse
  • the above-mentioned first working state is displaying a paused video
  • the above-mentioned second working state is displaying the above-mentioned video continuously playing.
  • the device that pauses or continues to play the video may be a head-mounted electronic device or an external device, which is not limited in the embodiment of the present application.
  • the head-mounted electronic device can be switched from displaying the video that is paused to displaying the video that continues to be played, which can reduce user operations and improve the user's use of the head-mounted electronic device.
  • Equipment efficiency improves user experience.
  • the above-mentioned head-mounted electrical device further includes a display screen
  • the above-mentioned pulse data indicates that there is a pulse
  • the above-mentioned first working state is for making the display screen display the third content
  • the above-mentioned second working state is for making the above-mentioned display The screen displays the fourth content.
  • the display screen being turned off can be regarded as the display screen displaying the third content
  • the display screen being lit can be regarded as the display screen displaying the fourth content.
  • the content displayed on the display screen at the first display brightness may be referred to as the third content
  • the content displayed on the display screen at the second display brightness may be referred to as the fourth content.
  • the first display brightness is lower than the second display brightness.
  • the head-mounted electronic device before the head-mounted electronic device executes acquiring the pulse data detected by the sensor, the head-mounted electronic device further executes: triggering the sensor to detect the pulse if the trigger condition is met.
  • the user's intention of use can be preliminarily judged according to the triggering condition, and then the sensor can be triggered to detect the pulse.
  • the trigger condition includes at least one of the following: the motion trajectory of the head-mounted electronic device conforms to a preset motion trajectory, the bending state of the head-mounted electronic device changes, and the head-mounted electronic device The connection with the external device has changed; wherein the bending state of the above-mentioned head-mounted electronic device includes an unfolded state and a folded state, and the connection between the above-mentioned head-mounted electronic device and the external device includes connected and unconnected.
  • the aforementioned head-mounted electronic device further includes a temple, the sensor is located on the temple, and the sensor is a capacitive sensor.
  • the aforementioned head-mounted electronic device further includes a nose pad, the aforementioned sensor is located at the aforementioned nose pad, and the aforementioned sensor is a photoelectric sensor.
  • an embodiment of the present application provides a method for controlling a head-mounted electronic device.
  • the head-mounted electronic device includes a sensor for detecting the pulse of the head of a user wearing the head-mounted electronic device.
  • the method includes: acquiring the sensor The detected data of the user's head; according to the pulse data detected by the sensor, the working state of the head-mounted electronic device is switched from the first working state to the second working state.
  • the above-mentioned pulse data indicates that there is no pulse
  • the above-mentioned first working state is a power-on state
  • the above-mentioned second working state is any one of a power-off state, a standby state, or a sleep state.
  • the pulse data indicates that there is no pulse
  • the first working state is displaying the video being played
  • the second working state is displaying the video that is paused.
  • the above-mentioned method further includes: From the moment when the working state is switched to the second working state, and there is no pulse for the first time period, the working state of the head-mounted electronic device is switched from the second working state to the third working state; wherein, the third working state is The working state is any one of sleep state, standby state or shutdown state.
  • the above-mentioned head-mounted electrical device further includes a display screen
  • the above-mentioned pulse data indicates that there is no pulse
  • the above-mentioned first working state is for making the display screen display the first content
  • the above-mentioned second working state is for making the above-mentioned display The screen displays the second content.
  • the pulse data indicates that there is a pulse
  • the first working state is any one of a shutdown state, a standby state, or a sleep state
  • the second working state is a power-on state.
  • the above-mentioned pulse data indicates that there is a pulse
  • the above-mentioned first working state is displaying a paused video
  • the above-mentioned second working state is displaying the above-mentioned video continuously playing.
  • the above-mentioned head-mounted electrical device further includes a display screen
  • the above-mentioned pulse data indicates that there is a pulse
  • the above-mentioned first working state is for making the display screen display the third content
  • the above-mentioned second working state is for making the above-mentioned display The screen displays the fourth content.
  • the method before acquiring the pulse data detected by the sensor, the method further includes: triggering the sensor to detect the pulse when the trigger condition is met.
  • the trigger condition includes at least one of the following: the motion trajectory of the head-mounted electronic device conforms to a preset motion trajectory, the bending state of the head-mounted electronic device changes, and the head-mounted electronic device The connection with the external device has changed; wherein the bending state of the above-mentioned head-mounted electronic device includes an unfolded state and a folded state, and the connection between the above-mentioned head-mounted electronic device and the external device includes connected and unconnected.
  • the aforementioned head-mounted electronic device further includes a temple, the sensor is located on the temple, and the sensor is a capacitive sensor.
  • the aforementioned head-mounted electronic device further includes a nose pad, the aforementioned sensor is located at the aforementioned nose pad, and the aforementioned sensor is a photoelectric sensor.
  • the method described in the second aspect provided above is applicable to the head-mounted electronic device provided in the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding head-mounted electronic device, which will not be repeated here.
  • the embodiments of the present application provide a computer storage medium, including computer instructions, when the computer instructions run on the electronic device, the electronic device is caused to execute the method provided in the second aspect or any one of the second aspects. Control method of head-mounted electronic equipment.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the control of the head-mounted electronic device as provided in the second aspect or any one of the second aspects. method.
  • the computer storage medium described in the third aspect or the computer program product described in the fourth aspect are both used to execute the method for controlling a head-mounted electronic device provided in the second aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.
  • FIG. 1 is a schematic diagram of the structure of AR glasses in the prior art
  • FIG. 2 is a schematic structural diagram of a head-mounted electronic device provided by an embodiment of the application
  • Figure 3 shows the distribution of blood vessels around the right ear of the human head
  • Figure 4 shows the distribution of blood vessels in the human face
  • Figure 5 is a schematic diagram of the structure of a photoelectric sensor
  • FIG. 6 is a schematic diagram of a method for controlling a head-mounted electronic device according to an embodiment of the application.
  • FIG. 7 is a schematic diagram of a first movement track provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of a second movement track provided by an embodiment of the application.
  • FIG. 9 is a schematic diagram of a bent state of a head-mounted electronic device provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram of the position of the Hall sensor in an embodiment of the application.
  • FIG. 11 is a schematic diagram of the connection between a head-mounted electronic device and an external device provided by an embodiment of the application;
  • FIG. 12 is a schematic flowchart of a method for controlling a head-mounted electronic device according to an embodiment of the application.
  • the electronic equipment involved in the embodiments of the present application is introduced.
  • the electronic device may be a head-mounted electronic device. Users can wear head-mounted electronic devices to achieve different effects such as virtual reality (VR), AR, and mixed reality (MR).
  • VR virtual reality
  • AR AR
  • MR mixed reality
  • the user 200 can see the image presented by the display screen 1100 of the head-mounted electronic device 100.
  • the display screen 1100 is transparent, the eyes of the user 200 can see the physical object through the display screen 1100, or the eyes of the user 200 can see the image displayed by another display device through the display screen 1100.
  • the embodiment of the present application takes the electronic device as a head-mounted electronic device as an example for introduction, but the embodiment of the present application is not limited to the head-mounted electronic device, and the electronic device may also be other devices.
  • a head-mounted electronic device provided by an embodiment of the present application is introduced.
  • b in FIG. 2 is a schematic diagram of the positions of various components in the head-mounted electronic device
  • c in FIG. 2 is a schematic structural diagram of the head-mounted electronic device.
  • the head-mounted electronic device 100 may include a processor 110, a memory 120, a sensor module 130, a microphone 140, a button 150, an input/output interface 160, a communication module 170, a camera 180, a battery 190, and a display screen. 1100 and so on.
  • the sensor module 130 may include a pulse sensor 131, a proximity light sensor 132, a gyroscope sensor 133, and the like.
  • the sensor module 130 may also include other sensors, such as a sound detector, an ambient light sensor, an acceleration sensor, a temperature sensor, a magnetic sensor, and so on.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the head-mounted electronic device 100.
  • the head-mounted electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), video processing unit (VPU), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural network Processor (neural-network processing unit, NPU), etc.
  • AP application processor
  • ISP image signal processor
  • VPU video processing unit
  • DSP digital signal processor
  • NPU neural network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the head-mounted electronic device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • Interfaces may include integrated circuit (I2C) interface, universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general input and output (general -purpose input/output, GPIO) interface, subscriber identity module (SIM) interface, and/or universal serial bus (universal serial bus, USB) interface, serial peripheral interface (serial peripheral interface, SPI) Interface etc.
  • I2C integrated circuit
  • UART universal asynchronous receiver/transmitter
  • MIPI mobile industry processor interface
  • SIM subscriber identity module
  • USB universal serial bus
  • serial peripheral interface serial peripheral interface
  • the I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may include multiple sets of I2C buses.
  • the processor 110 may be respectively coupled to the pulse sensor 131, the battery 190, the camera 180, etc. through different I2C bus interfaces.
  • the processor 110 may couple the pulse sensor 131 through an I2C interface, so that the processor 110 and the pulse sensor 131 communicate through the I2C bus interface to obtain the pulse detection result.
  • the SPI interface can be used for the connection between the processor and the sensor.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is generally used to connect the processor 110 and the communication module 170.
  • the processor 110 communicates with the Bluetooth module in the communication module 170 through the UART interface to implement the Bluetooth function.
  • the MIPI interface can be used to connect the processor 110 with the display screen 1100, the camera 180 and other peripheral devices.
  • the MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 110 and the camera 180 communicate through a CSI interface to realize the shooting function of the head-mounted electronic device 100.
  • the processor 110 and the display screen 1100 communicate through a DSI interface to realize the display function of the head-mounted electronic device 100.
  • the GPIO interface can be configured through software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface can be used to connect the processor 110 with the camera 180, the display screen 1100, the communication module 170, the sensor module 130, the microphone 140, and so on.
  • GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.
  • the USB interface is an interface that complies with the USB standard specifications, and can be a Mini USB interface, a Micro USB interface, and a USB Type C interface.
  • the USB interface can be used to connect a charger to charge the head-mounted electronic device 100, and can also be used to transfer data between the head-mounted electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through the headphones. This interface can also be used to connect other electronic devices, such as mobile phones.
  • the USB interface can be USB3.0, which is compatible with high-speed display port (DP) signal transmission, and can transmit high-speed video and audio data.
  • DP display port
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is merely illustrative, and does not constitute a structural limitation of the head-mounted electronic device 100.
  • the head-mounted electronic device 100 may also adopt different interface connection modes in the above-mentioned embodiments, or a combination of multiple interface connection modes.
  • the head-mounted electronic device 100 may include a wireless communication function.
  • the communication module 170 may include a wireless communication module and a mobile communication module.
  • the wireless communication function can be realized by an antenna (not shown), a mobile communication module (not shown), a modem processor (not shown), a baseband processor (not shown), and the like.
  • the antenna is used to transmit and receive electromagnetic wave signals.
  • the head-mounted electronic device 100 may include multiple antennas, and each antenna may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the head-mounted electronic device 100.
  • the mobile communication module may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module can receive electromagnetic waves by the antenna, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation by the antenna.
  • at least part of the functional modules of the mobile communication module may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is processed by the baseband processor and then passed to the application processor.
  • the application processor outputs sound signals through audio equipment (not limited to speakers, etc.), or displays images or videos through the display screen 1100.
  • the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module or other functional modules.
  • the wireless communication module can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (bluetooth, BT), and global navigation that are used on the head-mounted electronic device 100.
  • WLAN wireless local area networks
  • WiFi wireless fidelity
  • BT Bluetooth
  • global navigation that are used on the head-mounted electronic device 100.
  • Satellite system global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module may be one or more devices integrating at least one communication processing module.
  • the wireless communication module receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module may also receive the signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna.
  • the antenna of the head mounted electronic device 100 is coupled with the mobile communication module, so that the head mounted electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the head-mounted electronic device 100 implements a display function through a GPU, a display screen 1100, and an application processor.
  • the GPU is a microprocessor for image processing, connected to the display screen 1100 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the number of display screens 1100 in the head-mounted electronic device 100 may be two, corresponding to the two eyeballs of the user 200 respectively.
  • the content displayed on the two displays can be displayed independently. Different images can be displayed on the two displays to improve the three-dimensional sense of the image.
  • the number of the display screen 1100 in the head-mounted electronic device 100 may also be one to correspond to the two eyeballs of the user 200.
  • the head-mounted electronic device 100 can implement a shooting function through an ISP, a camera 180, a video codec, a GPU, a display screen 1100, and an application processor.
  • the ISP is used to process the data fed back by the camera 180. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 180.
  • the camera 180 is used to capture still images or videos.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats.
  • the head-mounted electronic device 100 may include one or N cameras 180, and N is a positive integer greater than one.
  • the camera 180 can be installed on the side of the head-mounted electronic device 100, and can also be installed at a position between two display screens on the head-mounted electronic device 100.
  • the camera 180 is used to capture images and videos within the viewing angle of the user 200 in real time.
  • the head-mounted electronic device 100 generates a virtual image according to the captured real-time image and video, and displays the virtual image on the display screen 1100.
  • the processor 110 may determine the virtual image displayed on the display screen 1100 according to the still image or video image captured by the camera 180, combined with the data (such as brightness, sound, etc.) acquired by the sensor module 130, to achieve superimposition on real world objects Attach a virtual image.
  • the digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals.
  • the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the head mounted electronic device 100 may support one or more video codecs.
  • the head-mounted electronic device 100 can play or record videos in a variety of encoding formats, for example: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • MPEG moving picture experts group
  • NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • applications such as intelligent cognition of the head-mounted electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
  • the memory 120 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the head-mounted electronic device 100 by running instructions stored in the memory 120.
  • the memory 120 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the head-mounted electronic device 100.
  • the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • UFS universal flash storage
  • the head-mounted electronic device 100 can implement audio functions through an audio module, a speaker, a microphone 140, a headphone interface, and an application processor. For example, music playback, recording, etc.
  • the audio module is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal.
  • the audio module can also be used to encode and decode audio signals.
  • the audio module may be provided in the processor 110, or some functional modules of the audio module may be provided in the processor 110.
  • Loudspeakers also called “horns" are used to convert audio electrical signals into sound signals.
  • the head-mounted electronic device 100 can listen to music through a speaker, or listen to a hands-free call.
  • the microphone 140 also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the head-mounted electronic device 100 may be provided with at least one microphone 140. In some other embodiments, the head-mounted electronic device 100 may be provided with two microphones 140, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the head-mounted electronic device 100 may also be provided with three, four or more microphones 140 to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions.
  • the head-mounted electronic device 100 may include a sound detector, which can detect and process a voice signal used to control the head-mounted electronic device 100.
  • the sound detector may include a microphone 140. It is convenient for the head-mounted electronic device 100 to use the microphone 140 to convert sound into electrical signals. The sound detector can then process the electrical signal and recognize the signal as a command of the head-mounted electronic device 100.
  • the processor 110 may be configured to receive a voice signal from the microphone 140. After receiving the voice signal, the processor 110 may run a sound detector to recognize the voice command. For example, when a voice command is received, the head-mounted electronic device 110 can obtain a contact on the stored user contact list, so that the head-mounted electronic device 100 can automatically dial the phone number of the contact.
  • the headphone jack is used to connect wired headphones.
  • the headphone interface can be a USB interface, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA, CTIA
  • the head-mounted electronic device 100 may include one or more buttons 150, which can control the head-mounted electronic device 100 and provide the user with access to functions on the head-mounted electronic device 100.
  • the key 150 may be in the form of a button, a switch, a dial, and a touch or proximity sensing device (such as a touch sensor).
  • the user 200 can turn on the display screen 1100 of the head-mounted electronic device 100 by pressing a button.
  • the button 150 includes a power button, a volume button and so on.
  • the button 150 may be a mechanical button. It can also be a touch button.
  • the head-mounted electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the head-mounted electronic device 100.
  • the head-mounted electronic device 100 may include an input-output interface 160, and the input-output interface 160 may connect other devices to the head-mounted electronic device 100 through appropriate components.
  • Components may include audio/video jacks, data connectors, etc., for example.
  • the mobile phone can be connected to the head-mounted electronic device 100 through the input/output interface 160 to realize data transmission between the mobile phone and the head-mounted electronic device 100. At the same time, the mobile phone can provide power for the head-mounted electronic device 100.
  • the pulse sensor 131 may be used to detect the pulse, and determine the wearing state of the head-mounted electronic device 100 according to the pulse. Among them, the wearing state of the head-mounted electronic device 100 includes worn and unworn. If the pulse sensor 131 detects the pulse, it is determined that the wearing state of the head-mounted electronic device 100 is worn; if the pulse sensor 131 does not detect the pulse, it is determined that the wearing state of the head-mounted electronic device 100 is not worn.
  • the curve of human pulse can refer to d in Fig. 2. The horizontal axis in the curve represents time and the vertical axis represents voltage.
  • the pulse sensor may detect the pulse data of the head of the user wearing the head-mounted electronic device 100.
  • the pulse data may include at least the frequency of pulse beats.
  • the pulse data whose pulse rate is within the preset range may indicate that there is a pulse, and further indicate that the wearing state of the head-mounted electronic device 100 is worn.
  • the pulse data whose pulse rate is not within the preset range may indicate that there is no pulse, and further indicate that the wearing state of the head-mounted electronic device 100 is not being worn.
  • the aforementioned preset range may be the range of the pulse of the human body, for example, it may be 60-100 beats per minute.
  • the pulse sensor can detect the pulse data of the head of the user wearing the head-mounted electronic device 100.
  • the head-mounted electronic device can match the pulse data detected by the pulse sensor 131 with the pre-stored pulse data. If the matching degree between the two exceeds a certain threshold, such as but not limited to 80%, the pulse data detected by the pulse sensor indicates that there is a pulse. Otherwise, the above pulse data indicates that there is no pulse.
  • the pre-stored pulse data can be obtained by collecting a large amount of pulse data on the heads of multiple users wearing headsets.
  • Figure 3 shows the distribution of blood vessels around the right ear of the head. It can be seen from the figure that there is an up-down artery near the ear. If the wearing state of the head-mounted electronic device 100 is worn, the temple will cross the artery. The distribution of blood vessels around the left ear of the head is similar to the distribution of blood vessels around the right ear. Therefore, the pulse sensor 131 may be arranged on at least one temple of the head-mounted electronic device 100, and specifically may be arranged on the inner side of the temple (the dashed frame in b in FIG. 2 indicates that the pulse sensor 131 is located on the inner side of the temple). B in FIG. 2 exemplarily shows two pulse sensors 131 on the temples.
  • the words "arms" in brackets marked 131 in b in Fig. 2 indicate that the pulse sensor 131 is a pulse sensor arranged on the temples.
  • the pulse sensor 131 provided on the temple can be a non-contact sensor, that is, a sensor that can detect pulse without contacting the skin, such as a capacitive sensor.
  • the head-mounted electronic device 100 may also have no folded temples, or no temples.
  • Figure 4 shows the distribution of blood vessels in the human face. It can be seen from the figure that there are arteries at the Jingming point of the human eye. If the wearing state of the head-mounted electronic device 100 is worn, the nose pad will contact the artery. Therefore, the pulse sensor 131 may be located at the nose pad of the head-mounted electronic device 100.
  • B in FIG. 2 exemplarily shows two pulse sensors 131 located at the nose pads. It can be known that the text "nose pad" in brackets marked 131 in b in FIG. 2 indicates that the pulse sensor 131 is a pulse sensor set at the nose pad.
  • the pulse sensor 131 provided at the nose pad may be a contact sensor, that is, a sensor that detects the pulse when in contact with the skin, such as a photoelectric sensor.
  • the nose pad is a component used to fix the head-mounted electronic device 100 on the bridge of the nose.
  • B in FIG. 2 exemplarily shows the position of the nose pad in the head-mounted electronic device 100.
  • the nose pad may be a protruding component, which is not limited in the embodiment of the present application.
  • the aforementioned pulse sensor 131 may be a flexible material.
  • the length of the pulse sensor 131 provided on the temple can be up to 20 mm to ensure that the pulse sensor 131 can cross the artery and detect the pulse when the wearing state of the head-mounted electronic device 100 is worn.
  • the head-mounted electronic device 100 shown in b in FIG. 2 includes four pulse sensors 131.
  • the head-mounted electronic device 100 may only include any one or more pulse sensors 131 shown in b in FIG.
  • the application embodiment does not limit this.
  • the above-mentioned length of the pulse sensor 131 provided on the temple is only an exemplary illustration, and in specific implementation, the length may also be other values, which is not limited in the embodiment of the present application.
  • the sensors provided on the temples may also be piezoresistive sensors or piezoelectric sensors, which are not limited in the embodiments of the present application.
  • the proximity light sensor 132 may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
  • the light emitting diode may be an infrared light emitting diode.
  • the head mounted electronic device 100 emits infrared light to the outside through the light emitting diode.
  • the head mounted electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the head mounted electronic device 100. When insufficient reflected light is detected, the head mounted electronic device 100 can determine that there is no object near the head mounted electronic device 100.
  • the head-mounted electronic device 100 may use the proximity light sensor 132 to detect a gesture operation at a specific position of the head-mounted electronic device 100 to achieve the purpose of associating the gesture operation with an operation command.
  • the gyroscope sensor 133 may be used to determine the movement posture of the head-mounted electronic device 100. In some embodiments, the angular velocity of the head-mounted electronic device 100 around three axes (ie, x, y, and z axes) can be determined by the gyroscope sensor 133. The gyroscope sensor 133 can also be used for navigation and somatosensory game scenes.
  • the ambient light sensor is used to sense the brightness of the ambient light.
  • the head mounted electronic device 100 can adaptively adjust the brightness of the display screen 1100 according to the perceived brightness of the ambient light.
  • the ambient light sensor can also be used to automatically adjust the white balance when taking pictures.
  • the acceleration sensor can detect the magnitude of acceleration of the head-mounted electronic device 100 in various directions (generally three-axis). When the head-mounted electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to recognize the posture of head-mounted electronic devices and applied to applications such as pedometers.
  • the temperature sensor is used to detect temperature.
  • the head-mounted electronic device 100 uses the temperature detected by the temperature sensor to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor exceeds the threshold, the head-mounted electronic device 100 reduces the performance of the processor located near the temperature sensor, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the head-mounted electronic device 100 heats the battery 190 to prevent the head-mounted electronic device 100 from shutting down abnormally due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the head mounted electronic device 100 boosts the output voltage of the battery 190 to avoid abnormal shutdown caused by low temperature.
  • the magnetic sensor includes a Hall sensor.
  • the head-mounted electronic device 100 may use a magnetic sensor to detect the bending state of the head-mounted electronic device 100. Furthermore, the pulse sensor 131 is triggered to detect the pulse according to the change in the bending state of the head mounted electronic device 100.
  • the following describes several working states of the head-mounted electronic device 100 and the operating conditions of the head-mounted electronic device 100 in each working state.
  • Shutdown state close all running programs and stop supplying power to various components.
  • Power-on state Provide power for each component, and the processor 110 can execute commands in time.
  • Standby state a state in which the head mounted electronic device 100 is operating in a low power mode, the processor 110 stops executing commands, and the data in the memory remains in the memory as it is.
  • Hibernation state The data left in the memory in the standby state is written to the hard disk as it is, and the system itself enters a zero power consumption state after the hibernation is completed.
  • a capacitive sensor is a sensor that converts the measured value into a change in capacitance.
  • the measured change can be converted into a capacitance change.
  • a capacitor composed of two parallel plates, its capacitance is:
  • the temples of the head-mounted electronic device 100 will cross the artery beside the ear shown in FIG. 3.
  • the user's skin and the sensor pad of the capacitive sensor can form a capacitor, and A and ⁇ will not change.
  • the distance between the skin and the sensor pad also changes.
  • both A and ⁇ are constant, the change of the capacitance value will change with the change of the distance between the skin and the sensor pad. Therefore, the heart rate can be calculated by the frequency of changes in the capacitance value over a period of time.
  • the photoelectric sensor may include a transmitter, a receiver, and the like.
  • the transmitter may be a light emitting diode, an infrared emitting diode, etc.
  • the receiver may include a phototransistor and the like.
  • the change of pulse blood flow can be obtained by the change of light.
  • the photoelectric sensor is used to detect the difference in the intensity of the reflected light after absorption by human blood and tissues, and the change of blood flow within the heartbeat cycle can be obtained, and the heart rate can be calculated from the obtained pulse waveform.
  • an embodiment of the present application provides a method for detecting the wearing state of the head-mounted electronic device 100.
  • Several examples provided by the embodiments of this application are described below.
  • FIG. 6 is a schematic diagram of an embodiment provided by an embodiment of the present application.
  • the head-mounted electronic device 100 is in the off state at time t1, and the wearing state of the head-mounted electronic device 100 is not being worn.
  • the pulse sensor 131 detects the pulse at time t2, determines that the wearing state of the head-mounted electronic device 100 is worn, and the head-mounted electronic device 100 is turned on. After powering on, the user can operate the head-mounted electronic device 100, for example, to play a video through the display screen 1100.
  • the display screen 1100 playing videos means that the display screen 1100 refreshes and displays different images sequentially in time.
  • the pulse sensor 131 does not detect the pulse at time t3, it is determined that the wearing state of the head-mounted electronic device 100 is not worn, and the video playback is paused. While pausing the video, you can also pause the audio corresponding to the video. Wherein, the video is paused, that is, the image displayed on the display screen 1100 does not change with time, and the subsequent image displayed on the display screen 1100 is the image displayed when it is paused. Further, the head-mounted electronic device 100 can also turn off the display screen 1100.
  • the pulse sensor 131 does not detect the pulse at time t4, and it is determined that the wearing state of the head-mounted electronic device 100 is not worn, and the head-mounted electronic device 100 can enter the standby state, the sleep state, or the shutdown state, to Increase the endurance of the head-mounted electronic device 100.
  • the pulse sensor 131 has not detected a pulse from time t3 to time t4.
  • the time interval between time t3 and time t4 is greater than or equal to the first threshold, and the first threshold may be, for example, 1 minute, 5 minutes, 10 minutes, and so on.
  • t1 is earlier than t2
  • t2 is earlier than t3
  • t3 is earlier than t4.
  • the head-mounted electronic device 100 may enter the standby state, the sleep state, or the shutdown state to increase The endurance of the head-mounted electronic device 100.
  • the pulse sensor 131 is always in a state of detecting the pulse.
  • the pulse sensor 131 detects at least two pulse beats, for example 3-5 pulses, and determines whether the pulse beat frequency is within a preset range based on the time taken to detect the at least two pulse beats, and the preset range is the human body
  • the range of pulse beating can be 60-100 beats/min, for example. If it is determined that the pulse beat frequency is within the above preset range, it is determined that the pulse detected by the pulse sensor 131 is the pulse of the human body, and the wearing state of the head-mounted electronic device 100 is determined to be worn.
  • the pulse sensor 131 does not detect the pulse, or the frequency of the detected pulse beat is not within the preset range, it is determined that the wearing state of the head-mounted electronic device 100 is not worn.
  • the pulse sensor 131 detects the pulse when the trigger condition is met.
  • the aforementioned trigger condition may be preliminary detection of a change in the wearing state of the head-mounted electronic device 100.
  • the manners for preliminary detection of changes in the wearing state of the head-mounted electronic device 100 may include the following:
  • the gyroscope sensor 133 can detect the movement trajectory of the head-mounted electronic device 100 to determine whether the movement trajectory conforms to the preset movement trajectory. If so, it is preliminarily detected that the wearing state of the head-mounted electronic device 100 has changed.
  • the above-mentioned preset movement track may include a preset first movement track and a preset second movement track.
  • the aforementioned first movement track may be, for example, an arc from bottom to top as shown in FIG. 7.
  • the above-mentioned second motion track may be, for example, an arc from top to bottom as shown in FIG. 8.
  • the pulse sensor 131 is triggered to detect whether there is a pulse. If there is a pulse, it is determined that the wearing state of the head-mounted electronic device 100 is worn. If there is no pulse, it is determined that the wearing state of the head-mounted electronic device 100 is not being worn.
  • the pulse sensor 131 detects whether there is a pulse result
  • the pulse sensor can be turned off until it detects that the motion trajectory of the head-mounted electronic device 100 meets the preset motion trajectory, so as to reduce the power consumption of the pulse sensor and enhance the head-mounted electronic device.
  • the endurance of the device 100 is not limited.
  • the first motion trajectory may also be other.
  • the motion trajectory of the head-mounted electronic device 100 can be determined by collecting the motion trajectory of the head-mounted electronic device 100 when multiple users are wearing the head-mounted electronic device 100.
  • the second movement track may be determined by collecting the movement tracks of the head-mounted electronic device 100 of multiple users during the process of removing the head-mounted electronic device 100.
  • an acceleration sensor may also be used to detect the posture of the head-mounted electronic device 100 to detect whether the wearing state of the head-mounted electronic device 100 has changed.
  • Manner 2 It can be preliminarily detected whether the wearing state of the head-mounted electronic device 100 has changed according to the change of the bending state of the head-mounted electronic device 100. If so, it is preliminarily detected that the wearing state of the head-mounted electronic device 100 has changed.
  • the bent state of the head mounted electronic device 100 may include a folded state and an unfolded state as shown in FIG. 9.
  • the change of the above-mentioned bending state may include changing from the folded state to the unfolded state, and from the unfolded state to the folded state.
  • the pulse sensor 131 is triggered to detect whether there is a pulse. If there is a pulse, it is determined that the wearing state of the head-mounted electronic device 100 is worn. If there is no pulse, it is determined that the wearing state of the head-mounted electronic device 100 is not being worn.
  • the change in the bending state of the aforementioned head-mounted electronic device 100 may be detected by a magnetic sensor.
  • the magnetic sensor may be a Hall sensor, for example.
  • the Hall sensor may include an output terminal, which outputs an electrical signal in the form of voltage or current. When the output electrical signal jumps (from a high level to a low level or from a low level to a high level), it can be determined that the bending state of the head mounted electronic device 100 has changed.
  • the position of the Hall sensor in the head-mounted electronic device is shown in Figure 10.
  • the Hall sensor may be arranged at A1 of the right temple, and the magnet may be arranged at A2 of the mirror frame.
  • A1 is when the head-mounted electronic device 100 is in a folded state, where the right temple and the frame overlap, and the corresponding position on the right temple;
  • A2 is when the head-mounted electronic device 100 is in a folded state , The corresponding position on the mirror frame where the right temple and the mirror frame coincide, specifically can be seen in the position shown in the dashed box on the left of b in FIG. 10.
  • the Hall sensor may be arranged at B1 of the left temple, and the magnet may be arranged at B2 of the mirror frame.
  • B1 is when the head-mounted electronic device 100 is in a folded state, where the left temple and the mirror frame overlap, and the corresponding position on the left temple;
  • B2 is when the head-mounted electronic device 100 is in a folded state , The corresponding position on the mirror frame where the left temple and the mirror frame overlap, specifically can be seen in the position shown in the dashed box on the right of b in FIG. 10.
  • the Hall sensor can be arranged at A1 and B1, and the magnet can be arranged at A2 and B2 of the mirror frame.
  • the positions of the above-mentioned Hall sensor and the magnet can be exchanged with each other, which will not be repeated.
  • the change in the bending state of the aforementioned head-mounted electronic device 100 may be detected by two gyroscope sensors 133.
  • the two gyroscope sensors 133 can be respectively arranged on the two temples of the head-mounted electronic device 100. Specifically, when the values of the angular velocities output by the gyro sensors 133 on the two temples are opposite to each other, it can be determined that the bending state of the head-mounted electronic device 100 has changed.
  • the pulse sensor 131 detects whether there is a pulse result, the pulse sensor can be turned off, and the pulse sensor 131 can be turned off until it detects that the bending state of the head mounted electronic device 100 changes again, so as to reduce the power consumption of the pulse sensor 131 , Enhance the endurance of the head-mounted electronic device 100.
  • the magnetic sensor provided at the temple or the frame of the lens can be replaced with a compass, and the head can be determined by the change of magnetic force detected by the compass. Changes in the bending state of the worn electronic device 100. If the magnetic force detected by the compass becomes larger or smaller, it can be determined that the bending state of the head mounted electronic device 100 has changed.
  • Manner 3 It can be preliminarily detected whether the wearing state of the head-mounted electronic device 100 has changed through the change of the connection state of the head-mounted electronic device 100 and the external device. If so, it is preliminarily detected that the wearing state of the head-mounted electronic device 100 has changed.
  • connection state of the headset 100 and the external device may include connected and disconnected.
  • the above-mentioned change in connection status may include changing from disconnected to connected, and from connected to disconnected.
  • the pulse sensor 131 is triggered to detect whether there is a pulse. If there is a pulse, it is determined that the wearing state of the head-mounted electronic device 100 is worn. If there is no pulse, it is determined that the wearing state of the head-mounted electronic device 100 is not being worn.
  • the external device may be a mobile phone 300, and the head-mounted electronic device 100 may be connected to the external device 300 through a connection line 400.
  • connection line 400 can be connected to the external device 300 through a USB Type C interface or a Mini USB interface, and the connection line 400 can be connected to the head mounted electronic device 100 through a USB interface.
  • the USB interface may be USB3.0, which is compatible with high-speed display port (DP) signal transmission, and can transmit high-speed video and audio data.
  • the external device 300 can send the screen displayed by the external device 300 to the head-mounted electronic device 100 through the connection line 400, so that the user can view the screen displayed by the external device 300 through the head-mounted electronic device 100.
  • the external device 300 can display the screen of the game application, and send the screen to the head-mounted electronic device 100 through the connection line 400, so that the user can use the head-mounted electronic device 100 View the screen of the game application.
  • the external device 300 may not display the screen, and directly display the screen through the head-mounted electronic device 100.
  • the pulse sensor 131 can be turned off until it detects that the connection state between the head mounted electronic device 100 and the external device changes again, so as to reduce the power consumption of the pulse sensor 131 and enhance the head The endurance of wearing electronic equipment 100.
  • a user operation detected by the external device 300 can cause the head-mounted electronic device 100 to respond.
  • the external device 300 can trigger the head mounted electronic device 100 to turn on the pulse sensor 133 to detect the pulse after detecting the user's operation of lighting the screen.
  • the external device 300 detecting an unlocking user operation may trigger the head-mounted electronic device 100 to display an unlocked screen, or may trigger the head-mounted electronic device 100 to turn on the pulse sensor 133 to detect the pulse.
  • the head-mounted electronic device 100 is in the off state, and after the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is worn, the pulse detection result is transmitted to the processor 110, and the processor 110 will The working state of the electronic device 100 is switched to the on state.
  • the shutdown state may be called the first working state
  • the power-on state may be called the second working state.
  • the head-mounted electronic device 100 is in a dormant state, and after the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is worn, it transmits the pulse detection result to the processor 110, and the processor 110 makes the head Wear the electronic device 100 out of the sleep state.
  • the dormant state may be referred to as the first working state
  • the state after exiting the dormant state may be referred to as the second working state.
  • the head-mounted electronic device 100 is in a standby state, and after the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is worn, it transmits the result of the pulse detection to the processor 110, and the processor 110 makes the head The electronic device 100 exits the standby state.
  • the standby state may be referred to as the first working state
  • the state after exiting the standby state may be referred to as the second working state.
  • the head-mounted electronic device 100 is in a state of displaying a paused video, and after the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is worn, it transmits the result of the pulse detection to the processor 110, The processor 110 causes the head-mounted electronic device 100 to display the video that continues to be played.
  • the device for pausing and continuing to play the video may be the head-mounted electronic device 100 or the external device 300, which is not limited in the embodiment of the present application.
  • displaying the paused video can be called the first working state
  • displaying the resumed video can be called the second working state.
  • the display screen 1100 of the head-mounted electronic device 100 is in a extinguished state, and after the pulse sensor 133 determines that the wearing state of the head-mounted electronic device 100 is worn, it transmits the result of the pulse detection to the processor 110 , The processor 110 lights up the display screen 1100.
  • the display screen 1100 being turned off can be regarded as the display screen 1100 displaying the third content
  • the display screen 1100 being lit can be regarded as the display screen 1100 displaying the fourth content.
  • the display screen 1100 of the head-mounted electronic device 100 is displayed at the first display brightness, and the pulse sensor 133 determines that the wearing state of the head-mounted electronic device 100 is worn, and then transmits the result of the pulse detection to the processor.
  • the processor 110 causes the display screen 1100 to display at the second display brightness.
  • the first display brightness is lower than the second display brightness.
  • the content displayed on the display screen 1100 at the first display brightness may be referred to as third content
  • the content displayed on the display screen 1100 at the second display brightness may be referred to as fourth content.
  • the working state of the head-mounted electronic device is switched from the first working state to the second working state, which can reduce user operations and improve the use of the head-mounted electronic device.
  • Equipment efficiency improves user experience.
  • the head-mounted electronic device 100 is in a power-on state and displays a video being played.
  • the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is not worn, it transmits the result of the pulse detection to the processor 110 ,
  • the processor 110 causes the head-mounted electronic device 100 to display the paused video.
  • the device for playing and pausing the video may be the head-mounted electronic device 100 or the external device 300, which is not limited in the embodiment of the present application.
  • the displayed video can be referred to as the first working state
  • the displayed paused video can be referred to as the second working state.
  • the processor 110 may turn off the display screen 193 until the wearing state of the head-mounted electronic device 100 changes (that is, becomes worn), then turn on the display screen and continue to play the video.
  • the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is not worn, and then transmits the result of the pulse detection to The processor 110, the processor 110 may turn off the display screen 1100, and turn on the display screen until the wearing state of the head-mounted electronic device 100 changes (that is, becomes worn).
  • the processor 110 switches the working state of the head-mounted electronic device 100 to a sleep state, a standby state, or a shutdown state.
  • the sleep state, standby state, or shutdown state may be referred to as the third working state.
  • the working state of the head-mounted electronic device 100 is changed to a standby state or a sleep state; wherein, the first time period may be 30 seconds, for example. It is not limited to 30 seconds.
  • the above-mentioned first duration may also be other values, which is not limited in the embodiment of the present application.
  • the working state of the head-mounted electronic device 100 is changed to the off state.
  • the second duration may be greater than the first duration, and the second duration may be, for example, 5 minutes. It is not limited to 5 minutes. In specific implementation, the above-mentioned second duration may also be other values, which is not limited in the embodiment of the present application.
  • the display screen 1100 of the head-mounted electronic device 100 is in a lighted state, and the pulse sensor 131 determines that the wearing state of the head-mounted electronic device 100 is not worn, and transmits the result of the pulse detection to the processor 110.
  • the processor 110 turns off the display screen 1100.
  • the display screen 1100 being lit can be regarded as the display screen 1100 displaying the first content
  • the display screen 1100 being turned off can be regarded as the display screen 1100 displaying the second content.
  • the display screen 1100 may be an LCD display screen.
  • the LCD display screen includes a backlight, a display panel (panel), a backlight drive circuit (integrated circuit, IC), and a screen drive IC.
  • the processor 110 turning off the display screen 1100 may include any of the following situations: (1) Turn off the backlight power supply of the display screen 1100. 2Turn off the backlight power supply of the display 1100 and the power supply of the display panel. 3Turn off the backlight power supply of the display 1100, the display panel, the screen driver IC and the backlight driver IC.
  • the display screen 1100 may be an OLED display screen.
  • the OLED display screen includes an OLED display panel (panel) and a screen driver IC.
  • the processor 110 turning off the display screen 1100 may include any of the following situations: (1) Turn off the power supply of the OLED display panel. 2Turn off the power supply of the OLED display panel and the screen driver IC.
  • the brightness displayed on the display screen 1100 may also be reduced, or the display screen 1100 may display a specific screen, which is not limited in the embodiment of the present application.
  • the specific screen may be, for example, a screen used to protect the screen, that is, a screen saver, or a screen used to display time.
  • the content displayed after reducing the brightness of the display screen 1100 may be referred to as the second content, and the above-mentioned specific screen may also be referred to as the second content.
  • displaying the paused video can also reduce user operations, improve the efficiency of users using head-mounted electronic devices, and improve user experience.
  • the user can turn on the head-mounted electronic device 100 by clicking the button 159 to access the functions on the head-mounted electronic device 100.
  • the pulse sensor 131 can detect whether there is a pulse, and send the pulse detection result to the processor 110, and the processor 110 can determine the wearing state of the head-mounted electronic device 100 according to the pulse detection result.
  • the user can turn on the head-mounted electronic device 100 by clicking the button 159 to access the functions on the head-mounted electronic device 100.
  • the pulse sensor 131 can be triggered to detect whether there is a pulse.
  • the trigger condition may be a preliminary detection of a change in the wearing state of the head-mounted electronic device 100. The manner of preliminarily detecting whether the wearing state of the head-mounted electronic device 100 has changed can be seen in the description of the foregoing embodiment, and will not be repeated here.
  • the user can also make the head-mounted electronic device 100 exit the sleep state or standby state by clicking the button 159, or make the head-mounted electronic device 100 light up the display screen 1100.
  • This application The embodiment does not limit this.
  • the processor 110 may light up the display screen 1100, and the pulse sensor 131 may detect whether there is a pulse. If there is no pulse, the processor 110 can turn off the display screen 1100 and change the working state of the head-mounted electronic device 100 to a sleep state, a standby state or a shutdown state. Implementing this embodiment can prevent the power consumption caused by the user accidentally touching the button 159.
  • the pulse sensor 131 can detect whether there is a pulse. If there is no pulse, the display screen 1100 is always in the off state, and the working state of the head-mounted electronic device 100 is changed to a sleep state, a standby state or a shutdown state. Implementing this embodiment can prevent the power consumption caused by the user accidentally touching the button 159.
  • the pulse sensor 131 may be used to detect the heart rate, and send the detected heart rate result to the processor 110.
  • the processor 110 may determine the user's sleep state according to the result of the heart rate detection, and then change the working state of the head-mounted electronic device 100 according to the user's sleep state.
  • the processor 110 may change the working state of the head-mounted electronic device 100 to a sleep state, a standby state, or a shutdown state.
  • the heart rate of the user before falling asleep may belong to the first range
  • the heart rate of the user after falling asleep may belong to the second range.
  • the first range may be 61-90 times/min
  • the second range may be 45-60 times/min, for example.
  • the embodiment of the application can determine whether the user is asleep according to the heart rate result. If it is determined that the user has fallen asleep, the working state of the head-mounted electronic device can be changed to save power consumption, and prevent the head-mounted electronic device from continuing to work after the user falls asleep, resulting in wasting power consumption. It can improve the endurance of head-mounted electronic devices.
  • the processor 110 may determine the user's health status according to the heart rate detection result.
  • the heart rate detection result can be, but is not limited to, used for heart rate detection, stress management, heart rate abnormality reminder, heart-related disease warning, etc.
  • abnormal reminders or early warning methods include but are not limited to sound, vibration, images, text, etc.
  • the user can preset emergency contacts.
  • the head-mounted electronic device 100 may send prompt information to preset emergency contacts through the mobile communication module. Ensure that users can receive timely assistance when their health conditions are abnormal, ensure user safety, and improve user experience.
  • an acceleration sensor can also be used to detect the pulse in specific implementation, which is not limited in the embodiment of the present application.
  • FIG. 12 shows a method for controlling the head-mounted electronic device described in the foregoing embodiment provided by an embodiment of the present application. As shown in Fig. 12, the control method of the head-mounted electronic device may at least include the following steps:
  • S101 Acquire pulse data of the user's head detected by the sensor.
  • S102 Switch the working state of the head-mounted electronic device from the first working state to the second working state according to the pulse data detected by the sensor.
  • the aforementioned sensor may be the pulse sensor 133 mentioned in the foregoing embodiment, or may be an acceleration sensor.
  • the aforementioned sensor is used to detect the pulse of the head of the user wearing the head-mounted electronic device 100.
  • the aforementioned head-mounted electronic device 100 includes a temple, and the aforementioned sensor may be a capacitive sensor.
  • the detection principle of the capacitive sensor can be seen in the relevant description of the foregoing embodiment, which will not be repeated here.
  • the aforementioned head-mounted electronic device 100 includes a nose pad, and the aforementioned sensor may be a photoelectric sensor.
  • the detection principle of the photoelectric sensor can be seen in the related description of the embodiment in FIG. 5, which will not be repeated here.
  • the pulse data indicates that there is no pulse, the first working state is the on state, and the second working state is any one of the off state, the standby state, or the sleep state.
  • the pulse data indicates that there is no pulse
  • the first working state is displaying the video being played
  • the second working state is displaying the video that is paused.
  • the device for playing or pausing the video can be the head-mounted electronic device 100 or the external device 300, which is not limited in the embodiment of the present application.
  • the head-mounted electronic device after determining that the wearing state of the head-mounted electronic device is not worn, the head-mounted electronic device can be switched from displaying the video being played to displaying the paused video, which can reduce the user's operation and improve the user's use of the head-mounted electronic device.
  • the working state of the head-mounted electronic device 100 is switched from the first working state to the second working state and there is no pulse for the first time period, the working state of the head-mounted electronic device 100 is changed from the first working state to the second working state.
  • the second working state is switched to the third working state.
  • the third working state may be any one of a sleep state, a standby state, or a shutdown state.
  • the power consumption of the head-mounted electronic device can be further reduced, and the endurance of the head-mounted electronic device can be improved.
  • the above-mentioned pulse data indicates that there is no pulse
  • the above-mentioned first working state is to cause the display screen 1100 to display the first content
  • the above-mentioned second working state is to cause the display screen 1100 to display the second content.
  • the display screen 1100 being lit can be regarded as the display screen 1100 displaying the first content
  • the display screen 1100 being turned off can be regarded as the display screen 1100 displaying the second content.
  • the second working state can also reduce the brightness displayed on the display screen 1100, or the display screen 1100 displays a specific screen, which is not limited in the embodiment of the present application.
  • the specific screen may be, for example, a screen used to protect the screen, that is, a screen saver, or a screen used to display time.
  • the content displayed after reducing the brightness of the display screen 1100 may be referred to as the second content, and the above-mentioned specific screen may also be referred to as the second content.
  • the pulse data indicates that there is a pulse
  • the first working state is any one of a shutdown state, a standby state, or a sleep state
  • the second working state is a power-on state.
  • the pulse data indicates that there is a pulse
  • the first working state is displaying a paused video
  • the second working state is displaying a video that continues to play.
  • the device that pauses or continues to play the video may be the head-mounted electronic device 100 or the external device 300, which is not limited in the embodiment of the present application.
  • the above-mentioned pulse data indicates that there is a pulse
  • the above-mentioned first working state is to cause the display screen 1100 to display the third content
  • the above-mentioned second working state is to cause the display screen 1100 to display the fourth content.
  • the display screen 1100 being turned off may be regarded as the display screen 1100 displaying the third content
  • the display screen 1100 being lit may be regarded as the display screen 1100 displaying the fourth content.
  • the content displayed on the display screen 1100 at the first display brightness may be referred to as third content
  • the content displayed on the display screen 1100 at the second display brightness may be referred to as fourth content.
  • the first display brightness is lower than the second display brightness.
  • the method before the head mounted electronic device 100 acquires the pulse data detected by the sensor, the method further includes: triggering the sensor to detect the pulse when the trigger condition is satisfied.
  • the aforementioned trigger condition may include at least one of the following: the motion trajectory of the head-mounted electronic device 100 conforms to a preset motion trajectory, the bending state of the head-mounted electronic device 100 changes, and the difference between the head-mounted electronic device 100 and the external device 300 The connection situation has changed.
  • the aforementioned preset movement track may be the first movement track shown in FIG. 7 or the second movement track shown in FIG. 8.
  • the bending state of the head-mounted electronic device 100 may include an unfolded state and a folded state, as shown in FIG. 9 for details.
  • the method for detecting the bending state of the head-mounted electronic device 100 can be found in the relevant description of the foregoing embodiment, and will not be repeated here.
  • connection between the headset 100 and the external device includes connected and unconnected. For details, see the related description of the embodiment in FIG. 11, which is not repeated here.
  • the method for controlling the head-mounted electronic device can detect whether there is a pulse through a pulse sensor, and then make the head-mounted electronic device respond accordingly according to whether there is a pulse. For example, after detecting that there is no pulse, reducing the display brightness of the display screen or sleeping, standby, shutting down, etc., can reduce the power consumption of the head-mounted electronic device and improve the endurance of the head-mounted electronic device without affecting the use of the user. For another example, after detecting that there is no pulse, pause the display of the video being played, and automatically power on after detecting the pulse, which can reduce the user's operation, improve the user's efficiency in using the head-mounted electronic device, and enhance the user experience.
  • triggering the sensor to detect the pulse by triggering conditions can preliminarily determine the user's intention based on the triggering conditions, and then trigger the sensor to detect the pulse, which can reduce the work of the sensor, reduce the power consumption caused by the sensor, and further improve the endurance of the head-mounted electronic device ability.
  • the embodiment of the present application also provides a computer-readable storage medium that stores instructions in the computer-readable storage medium, and when it runs on a computer or a processor, the computer or the processor executes any of the above methods. Or multiple steps. If each component module of the above-mentioned signal processing device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in the computer readable storage medium.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium.
  • the computer instructions can be sent from one website site, computer, server, or data center to another website site via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) , Computer, server or data center for transmission.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)), etc.
  • the process can be completed by a computer program instructing relevant hardware.
  • the program can be stored in a computer readable storage medium. , May include the processes of the foregoing method embodiments.
  • the aforementioned storage media include: ROM or random storage RAM, magnetic disks or optical discs and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种头戴电子设备(100),可以包括用于检测佩戴头戴电子设备(100)的用户头部的脉搏。该头戴电子设备(100)可以获取传感器(131)检测的脉搏数据;根据传感器(131)检测到的脉搏数据,将头戴电子设备(100)的工作状态从第一工作状态切换至第二工作状态。可以降低头戴电子设备(100)的功耗,提升头戴电子设备(100)的续航能力,还可以减少用户操作,提升用户使用头戴电子设备(100)的效率,提升用户体验。

Description

头戴电子设备及其控制方法
本申请要求在2019年4月12日提交中国国家知识产权局、申请号为201910296129.4、发明名称为“头戴电子设备及其控制方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及可穿戴设备技术领域,尤其涉及一种头戴电子设备及其控制方法。
背景技术
目前,增强现实(augment reality,AR)眼镜普遍采用接近光传感器来检测眼镜的佩戴状态。若接近光传感器没有检测到有物体靠近,表明眼镜此时的佩戴状态为未佩戴,则关机或者待机;若接近光传感器检测到有物体靠近,表明眼镜此时的佩戴状态为已佩戴,则开机。如图1所示,接近光传感器通常被设置在眼镜的镜腿或者前额板上。用户在未使用眼镜时,通常会将眼镜的左右镜腿弯折。此时,左右镜腿之间、镜腿与前额板之间会互相遮挡,从而可能导致错误判断眼镜的佩戴状态。
发明内容
本申请实施例提供了一种头戴电子设备及其控制方法,可以准确判断头戴电子设备的佩戴状态,使头戴电子设备做出响应,降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
第一方面,本申请实施例提供了一种头戴电子设备,包括:传感器、一个或多个处理器、一个或多个存储器;上述传感器、上述一个或多个存储器与上述一个或多个处理器耦合,上述传感器用于检测佩戴上述头戴电子设备的用户头部的脉搏,上述一个或多个存储器用于存储计算机程序代码,上述计算机程序代码包括计算机指令,当上述一个或多个处理器执行上述计算机指令时,上述头戴电子设备执行:获取上述传感器检测的上述用户头部的脉搏数据;根据上述传感器检测的脉搏数据,将上述头戴电子设备的工作状态从第一工作状态切换至第二工作状态。
本申请实施例提供的头戴电子设备可以采用传感器检测的脉搏数据准确判断头戴电子设备的佩戴状态,使头戴电子设备将工作状态从第一工作状态切换至第二工作状态,可以降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述脉搏数据表明没有脉搏,上述第一工作状态为开机状态,上述第二工作状态为关机状态、待机状态或休眠状态中的任意一种。
具体地,脉搏数据表明没有脉搏,即头戴电子设备的佩戴状态为未佩戴,将头戴电子设备的工作状态从开机状态切换至关机状态、待机状态或休眠状态中的任意一种,可以在不影响用户使用的前提下,降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述脉搏数据表明没有脉搏,上述第一工作状态为显示正在 播放的视频,上述第二工作状态为显示暂停播放的上述视频。
其中,播放或暂停播放视频的设备可以是头戴电子设备,也可以是外接设备,本申请实施例对此不做限定。
该实现方式,在确定头戴电子设备的佩戴状态为未佩戴后,可使头戴电子设备从显示正在播放的视频切换至显示暂停播放的视频,可以减少用户的操作,提升用户使用头戴电子设备的效率,并减少头戴电子设备的功耗,提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述头戴电子设备执行上述将上述头戴电子设备的工作状态从第一工作状态切换至第二工作状态后,上述头戴电子设备还执行:若从将上述头戴电子设备的工作状态从第一工作状态切换至第二工作状态的时刻起,在第一时长内一直没有脉搏,则将上述头戴电子设备的工作状态从上述第二工作状态切换至第三工作状态;其中,上述第三工作状态为休眠状态、待机状态或者关机状态中的任意一种。
具体地,上述第一时长为例如可以是30秒、1分钟、5分钟等。
该实现方式可以进一步降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述头戴电设备还包括显示屏,上述脉搏数据表明没有脉搏,上述第一工作状态为使上述显示屏显示第一内容,上述第二工作状态为使上述显示屏显示第二内容。
可能地,显示屏被点亮可以看作是显示屏显示第一内容,显示屏被熄灭可看作是显示屏显示第二内容。
不限于熄灭显示屏,第二工作状态还可以降低显示屏显示的亮度,或者是显示屏显示特定的画面。其中,特定的画面例如可以是用于保护屏幕的画面,即屏保,还可以是用于显示时间的画面等。此时,降低显示屏显示的亮度后显示的内容可被称为第二内容,上述特定的画面也可被称为第二内容。
该实现方式可降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述脉搏数据表明有脉搏,上述第一工作状态为关机状态、待机状态或者休眠状态中的任意一种,上述第二工作状态为开机状态。
具体地,脉搏数据表明有脉搏,即头戴电子设备的佩戴状态为已佩戴,将头戴电子设备的工作状态从关机状态、待机状态或休眠状态中的任意一种切换至开机状态,无需要用户手动开机,减少用户操作,提升用户使用头戴电子设备的效率,提升用户体验。
在一种可能的实现方式中,上述脉搏数据表明有脉搏,上述第一工作状态为显示暂停播放的视频,上述第二工作状态为显示继续播放的上述视频。
其中,暂停播放或继续播放视频的设备可以是头戴电子设备,也可以是外接设备,本申请实施例对此不做限定。
该实现方式,在确定头戴电子设备的佩戴状态为已佩戴后,可使头戴电子设备从显示暂停播放的视频切换至显示继续播放的视频,可以减少用户的操作,提升用户使用头戴电子设备的效率,提升用户体验。
在一种可能的实现方式中,上述头戴电设备还包括显示屏,上述脉搏数据表明有脉搏,上述第一工作状态为使上述显示屏显示第三内容,上述第二工作状态为使上述显示屏显示第四内容。
可能地,显示屏被熄灭可看作是显示屏显示第三内容,显示屏被点亮可看作是显示屏显示第四内容。
可能地,显示屏以第一显示亮度显示的内容可被称为第三内容,显示屏以第二显示亮度显示的内容可被称为第四内容。其中,第一显示亮度低于第二显示亮度。
在一种可能的实现方式中,上述头戴电子设备执行获取上述传感器检测的脉搏数据之前,上述头戴电子设备还执行:在满足触发条件的情况下,触发上述传感器检测脉搏。
通过触发条件触发传感器检测脉搏,可以根据触发条件初步判断用户的使用意图,再触发传感器检测脉搏,可以减少传感器的工作,降低由传感器造成的功耗,进一步提升头戴电子设备的续航能力。
在一种可能的实现方式中,上述触发条件包括以下至少一项:上述头戴电子设备的运动轨迹符合预设的运动轨迹、上述头戴电子设备的弯折状态发生变化、上述头戴电子设备与外接设备的连接情况发生变化;其中,上述头戴电子设备的弯折状态包括展开状态及折叠状态,上述头戴电子设备与外接设备的连接情况包括已连接和未连接。
在一种可能的实现方式中,上述头戴电子设备还包括镜腿,上述传感器位于上述镜腿上,上述传感器为电容式传感器。
在一种可能的实现方式中,上述头戴电子设备还包括鼻托,上述传感器位于上述鼻托处,上述传感器为光电式传感器。
第二方面,本申请实施例提供了一种头戴电子设备的控制方法,该头戴电子设备包括传感器,用于检测佩戴该头戴电子设备的用户头部的脉搏,该方法包括:获取传感器检测的用户头部的数据;根据上述传感器检测的脉搏数据,将所述头戴电子设备的工作状态从第一工作状态切换至第二工作状态。
在一种可能的实现方式中,上述脉搏数据表明没有脉搏,上述第一工作状态为开机状态,上述第二工作状态为关机状态、待机状态或休眠状态中的任意一种。
在一种可能的实现方式中,上述脉搏数据表明没有脉搏,上述第一工作状态为显示正在播放的视频,上述第二工作状态为显示暂停播放的上述视频。
在一种可能的实现方式中,上述将上述头戴电子设备的工作状态从第一工作状态切换至第二工作状态后,上述方法还包括:若从将上述头戴电子设备的工作状态从第一工作状态切换至第二工作状态的时刻起,在第一时长内一直没有脉搏,则将上述头戴电子设备的工作状态从上述第二工作状态切换至第三工作状态;其中,上述第三工作状态为休眠状态、待机状态或者关机状态中的任意一种。
在一种可能的实现方式中,上述头戴电设备还包括显示屏,上述脉搏数据表明没有脉搏,上述第一工作状态为使上述显示屏显示第一内容,上述第二工作状态为使上述显示屏显示第二内容。
在一种可能的实现方式中,上述脉搏数据表明有脉搏,上述第一工作状态为关机状态、待机状态或者休眠状态中的任意一种,上述第二工作状态为开机状态。
在一种可能的实现方式中,上述脉搏数据表明有脉搏,上述第一工作状态为显示暂停播放的视频,上述第二工作状态为显示继续播放的上述视频。
在一种可能的实现方式中,上述头戴电设备还包括显示屏,上述脉搏数据表明有脉搏,上述第一工作状态为使上述显示屏显示第三内容,上述第二工作状态为使上述显示屏显示第四内容。
在一种可能的实现方式中,获取上述传感器检测的脉搏数据之前,该方法还包括:在满足触发条件的情况下,触发上述传感器检测脉搏。
在一种可能的实现方式中,上述触发条件包括以下至少一项:上述头戴电子设备的运动轨迹符合预设的运动轨迹、上述头戴电子设备的弯折状态发生变化、上述头戴电子设备与外接设备的连接情况发生变化;其中,上述头戴电子设备的弯折状态包括展开状态及折叠状态,上述头戴电子设备与外接设备的连接情况包括已连接和未连接。
在一种可能的实现方式中,上述头戴电子设备还包括镜腿,上述传感器位于上述镜腿上,上述传感器为电容式传感器。
在一种可能的实现方式中,上述头戴电子设备还包括鼻托,上述传感器位于上述鼻托处,上述传感器为光电式传感器。
可以理解,上述提供的第二方面所述的方法,可适用于第一方面提供的头戴电子设备。因此,其所能达到的有益效果可参考对应头戴电子设备中的有益效果,此处不再赘述。
第三方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得电子设备执行如第二方面或第二方面的任意一种实现方式提供的头戴电子设备的控制方法。
第四方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第二方面或第二方面的任意一种实现方式提供的头戴电子设备的控制方法。
可以理解地,上述第三方面所述的计算机存储介质或者第四方面所述的计算机程序产品均用于执行第二方面所提供的头戴电子设备的控制方法。因此,其所能达到的有益效果可参考对应方法中的有益效果,此处不再赘述。
附图说明
图1为现有技术中AR眼镜的结构示意图;
图2为本申请实施例提供的头戴电子设备的结构示意图;
图3为人体头部右耳周边血管分布图;
图4为人体面部血管分布图;
图5为光电式传感器的结构示意图;
图6为本申请实施例提供的头戴电子设备的控制方法示意图;
图7为本申请实施例提供的第一运动轨迹示意图;
图8为本申请实施例提供的第二运动轨迹示意图;
图9为本申请实施例提供的头戴电子设备的弯折状态示意图;
图10为本申请实施例中霍尔传感器的位置示意图;
图11为本申请实施例提供的头戴电子设备与外接设备连接示意图;
图12为本申请实施例提供的头戴电子设备的控制方法流程示意图。
具体实施方式
下面结合本申请实施例中的附图对本申请实施例进行描述。本申请实施例的实施方式部分使用的术语仅用于对本申请的具体实施例进行解释,而非旨在限定本申请。
对本申请实施例涉及的电子设备进行介绍。电子设备可以是头戴电子设备。用户可以佩戴头戴电子设备实现虚拟现实(virtual reality,VR)、AR、混合现实(mixed reality,MR)等不同效果。
如图2中的a所示,当头戴电子设备100安装在用户200头上时,用户200眼睛可以看到头戴电子设备100显示屏1100呈现的图像。当显示屏1100是透明的情况下,用户200眼睛可以透过显示屏1100看到实体对象,或者用户200眼睛可以透过显示屏1100看到另外的显示装置显示的图像。
可以理解的,本申请实施例以电子设备为头戴电子设备为例进行介绍,但是本申请实施例不限于头戴电子设备,电子设备还可以是其他设备。
接下来结合图2中的b和c,介绍本申请实施例提供的一种头戴电子设备。其中,图2中的b为头戴电子设备中各个部件的位置示意图,图2中的c为头戴电子设备的结构示意图。
如图2中的c所示,头戴电子设备100可以包括处理器110,存储器120,传感器模块130,麦克风140,按键150,输入输出接口160,通信模块170,摄像头180,电池190以及显示屏1100等。传感器模块130可以包括脉搏传感器131、接近光传感器132、陀螺仪传感器133等。传感器模块130还可以包含其他传感器,例如声音探测器,环境光传感器,加速度传感器、温度传感器、磁传感器等。
可以理解的是,本申请实施例示意的结构并不构成对头戴电子设备100的具体限定。在本申请另一些实施例中,头戴电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),视频处理单元(video processing unit,VPU),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是头戴电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口,串行外设接口(serial peripheral interface,SPI)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合脉搏传感器131,电池190,摄像头180等。例如:处理器110可以通过I2C接口耦合脉搏传感器131,使处理器110与脉搏传感器131通过I2C总线接口通信,来获取脉搏检测的结果。SPI接口可以用于处理器与传感器之间的 连接。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与通信模块170。例如:处理器110通过UART接口与通信模块170中的蓝牙模块通信,实现蓝牙功能。
MIPI接口可以被用于连接处理器110与显示屏1100,摄像头180等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头180通过CSI接口通信,实现头戴电子设备100的拍摄功能。处理器110和显示屏1100通过DSI接口通信,实现头戴电子设备100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头180,显示屏1100,通信模块170,传感器模块130,麦克风140等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。
USB接口是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口可以用于连接充电器为头戴电子设备100充电,也可以用于头戴电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如手机等。USB接口可以是USB3.0,用于兼容高速显示接口(display port,DP)信号传输,可以传输视音频高速数据。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对头戴电子设备100的结构限定。在本申请另一些实施例中,头戴电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
另外,头戴电子设备100可以包含无线通信功能。通信模块170可以包含无线通信模块和移动通信模块。无线通信功能可以通过天线(未示出)、移动通信模块(未示出),调制解调处理器(未示出)以及基带处理器(未示出)等实现。
天线用于发射和接收电磁波信号。头戴电子设备100中可以包含多个天线,每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块可以提供应用在头戴电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块可以由天线接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块还可以对经调制解调处理器调制后的信号放大,经天线转为电磁波辐射出去。在一些实施例中,移动通信模块的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递 给应用处理器。应用处理器通过音频设备(不限于扬声器等)输出声音信号,或通过显示屏1100显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块或其他功能模块设置在同一个器件中。
无线通信模块可以提供应用在头戴电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块经由天线接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线转为电磁波辐射出去。
在一些实施例中,头戴电子设备100的天线和移动通信模块耦合,使得头戴电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
头戴电子设备100通过GPU,显示屏1100,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏1100和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
头戴电子设备100中显示屏1100的数量可以是两个,分别对应用户200的两个眼球。这两个显示屏上显示的内容可以独立显示。可以在这两个显示屏上显示不同的图像来提高图像的立体感。在一些可能的实施例中,头戴电子设备100中显示屏1100的数量也可以是一个,来对应用户200的两个眼球。
头戴电子设备100可以通过ISP,摄像头180,视频编解码器,GPU,显示屏1100以及应用处理器等实现拍摄功能。
ISP用于处理摄像头180反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头180中。
摄像头180用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例 中,头戴电子设备100可以包括1个或N个摄像头180,N为大于1的正整数。
如图2中的a所示,摄像头180可以安装在头戴电子设备100的侧面,还可以安装在头戴电子设备100上两个显示屏之间的位置。摄像头180用于实时捕捉用户200视角内的图像和视频。头戴电子设备100根据捕获的实时的图像和视频生成虚拟图像,并将虚拟图像通过显示屏1100进行显示。
处理器110可以根据摄像头180捕获的静态图像或视频图像,结合传感器模块130获取的数据(例如亮度、声音等数据),来确定显示屏1100上显示的虚拟图像,来实现在现实世界物体上叠加上虚拟图像。
其中,数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当头戴电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。头戴电子设备100可以支持一种或多种视频编解码器。这样,头戴电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现头戴电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
存储器120可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在存储器120的指令,从而执行头戴电子设备100的各种功能应用以及数据处理。存储器120可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储头戴电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,存储器120可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
头戴电子设备100可以通过音频模块,扬声器,麦克风140,耳机接口,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块还可以用于对音频信号编码和解码。在一些实施例中,音频模块可以设置于处理器110中,或将音频模块的部分功能模块设置于处理器110中。
扬声器,也称“喇叭”,用于将音频电信号转换为声音信号。头戴电子设备100可以通过扬声器收听音乐,或收听免提通话。
麦克风140,也称“话筒”,“传声器”,用于将声音信号转换为电信号。头戴电子设备100可以设置至少一个麦克风140。在另一些实施例中,头戴电子设备100可以设置两个麦克风140,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,头戴电子设备100还可以设置三个,四个或更多麦克风140,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
在一些实施例中,头戴电子设备100可以包括声音探测器,该声音探测器可以检测和处理用于控制头戴电子设备100的语音信号。例如,声音探测器可以包含麦克风140。便于头戴电子设备100可以使用麦克风140将声音转换为电信号。声音探测器随后可以处理电信号, 并将信号识别为头戴电子设备100的命令。处理器110可以被配置为从麦克风140接收语音信号。在接收到语音信号后,处理器110可以运行声音探测器来识别语音命令。例如,当接收到语音指令时,头戴电子设备110可以获取存储的用户联系人列表上的联系人,便于头戴电子设备100可以自动拨打该联系人电话号码。
耳机接口用于连接有线耳机。耳机接口可以是USB接口,也可以是3.5mm的开放移动头戴电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
在一些实施例中,头戴电子设备100可以包括一个或多个按键150,这些按键可以控制头戴电子设备100,为用户提供访问头戴电子设备100上的功能。按键150的形式可以是按钮、开关、刻度盘和触摸或近触摸传感设备(如触摸传感器)。具体的,例如,用户200可以通过按下按钮来打开头戴电子设备100的显示屏1100。按键150包括开机键,音量键等。按键150可以是机械按键。也可以是触摸式按键。头戴电子设备100可以接收按键输入,产生与头戴电子设备100的用户设置以及功能控制有关的键信号输入。
在一些实施例中,头戴电子设备100可以包括输入输出接口160,输入输出接口160可以通过合适的组件将其他装置连接到头戴电子设备100。组件例如可以包括音频/视频插孔,数据连接器等。具体地,例如,可以通过输入输出接口160将手机与头戴电子设备100连接,实现手机与头戴电子设备100之间的数据传输。同时,手机可以为头戴电子设备100提供电源。
脉搏传感器131可以用于检测脉搏,根据脉搏确定头戴电子设备100的佩戴状态。其中,头戴电子设备100的佩戴状态包括已佩戴和未佩戴。若脉搏传感器131检测到脉搏,则确定头戴电子设备100的佩戴状态为已佩戴;若脉搏传感器131未检测到脉搏,则确定头戴电子设备100的佩戴状态为未佩戴。人体脉搏的曲线可参见图2中的d,曲线中横轴表示时间,纵轴表示电压。
在一些实施例中,脉搏传感器可检测佩戴头戴电子设备100的用户头部的脉搏数据。脉搏数据至少可包含脉搏跳动的频率。脉搏跳动的频率在预设范围内的脉搏数据可表明有脉搏,进而表明头戴电子设备100的佩戴状态为已佩戴。脉搏跳动的频率不在预设范围内的脉搏数据可表明没有脉搏,进而表明头戴电子设备100的佩戴状态为未佩戴。其中,上述预设范围可以是人体脉搏跳动的范围,例如可以是60-100次/分。
在另外一些实施例中,脉搏传感器可检测佩戴头戴电子设备100的用户头部的脉搏数据。头戴电子设备可将脉搏传感器131检测的脉搏数据与预存的脉搏数据匹配,若两者的匹配度超过一定阈值,例如但不限于80%,则脉搏传感器检测到的脉搏数据表明有脉搏。否则,上述脉搏数据表明没有脉搏。其中,预存的脉搏数据可以通过大量采集多个佩戴头戴设备的用户头部的脉搏数据得出。
图3示出了头部右耳周边血管分布图,从图中可以看出靠近耳朵附近有一条上下方向的动脉。若头戴电子设备100的佩戴状态为已佩戴,则镜腿会跨过该动脉。头部左耳周边的血管分布与右耳周边的血管分布类似。因此,脉搏传感器131可以设置于头戴电子设备100的至少一个镜腿上,具体可设置在镜腿的内侧(图2中的b中虚线框表明该脉搏传感器131位于镜腿的内侧)。图2中的b示例性示出了位于镜腿上的两个脉搏传感器131。可以知道,图2中的b中标号131的括号内的文字“镜腿”表明该脉搏传感器131为设置于镜腿上的脉搏传感 器。设置于镜腿上的脉搏传感器131可以是非接触式的传感器,即,不与皮肤接触即可检测脉搏的传感器,例如电容式传感器。在一些实施例中,头戴电子设备100也可以没有折叠的镜腿,或者没有镜腿。
图4示出了人体面部血管分布图,从图中可以看出人眼的睛明穴位置有动脉。若头戴电子设备100的佩戴状态为已佩戴,则鼻托会与该动脉接触。因此,脉搏传感器131可以位于头戴电子设备100的鼻托处。图2中的b示例性示出了位于鼻托处的两个脉搏传感器131。可以知道,图2中的b中标号131的括号内的文字“鼻托”表明该脉搏传感器131为设置于鼻托处的脉搏传感器。设置于鼻托处的脉搏传感器131可以是接触式的传感器,即,在与皮肤接触的情况下检测脉搏的传感器,例如光电式传感器。其中,鼻托为用于固定头戴电子设备100于鼻梁上的部件。图2中的b示例性示出了鼻托在头戴电子设备100中的位置,在具体实现中鼻托可以是突出的部件,本申请实施例对此不作限定。
具体地,上述脉搏传感器131可以是柔性材料。设置于镜腿上的脉搏传感器131的长度可以达20毫米,以保证在头戴电子设备100的佩戴状态为已佩戴的情况下,该脉搏传感器131可以跨过动脉,检测到脉搏。图2中的b示出的头戴电子设备100包括四个脉搏传感器131,在具体实现中头戴电子设备100可以仅包含图2中的b示出的任意一个或多个脉搏传感器131,本申请实施例对此不作限定。上述设置于镜腿上的脉搏传感器131的长度仅为示例性说明,在具体实现中该长度还可以是其他数值,本申请实施例对此不做限定。
不限于上述列举的电容式传感器,在具体实现中设置在镜腿上的传感器还可以是压阻式传感器或压电式传感器等,本申请实施例对此不作限定。
接近光传感器132可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。头戴电子设备100通过发光二极管向外发射红外光。头戴电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定头戴电子设备100附近有物体。当检测到不充分的反射光时,头戴电子设备100可以确定头戴电子设备100附近没有物体。头戴电子设备100可以利用接近光传感器132检测头戴电子设备100特定位置的手势操作,以实现手势操作与操作命令相关联的目的。
陀螺仪传感器133可以用于确定头戴电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器133确定头戴电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器133还可以用于导航,体感游戏场景。
环境光传感器用于感知环境光亮度。头戴电子设备100可以根据感知的环境光亮度自适应调节显示屏1100亮度。环境光传感器也可用于拍照时自动调节白平衡。
加速度传感器可检测头戴电子设备100在各个方向上(一般为三轴)加速度的大小。当头戴电子设备100静止时可检测出重力的大小及方向。还可以用于识别头戴电子设备姿态,应用于计步器等应用。
温度传感器用于检测温度。在一些实施例中,头戴电子设备100利用温度传感器检测的温度,执行温度处理策略。例如,当温度传感器上报的温度超过阈值,头戴电子设备100执行降低位于温度传感器附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,头戴电子设备100对电池190加热,以避免低温导致头戴电子设备100异常关机。在其他一些实施例中,当温度低于又一阈值时,头戴电子设备100对电池190的输出电压执行升压,以避免低温导致的异常关机。
磁传感器包括霍尔传感器。头戴电子设备100可以利用磁传感器检测头戴电子设备100 的弯折状态。进而根据头戴电子设备100弯折状态的变化触发脉搏传感器131检测脉搏。
为了便于理解,接下来介绍头戴电子设备100的几个工作状态以及各个工作状态下头戴电子设备100的运行情况。
关机状态:关闭所有运行中的程序,停止对各个部件供电。
开机状态:为各个部件提供电源,处理器110可及时执行命令。
待机状态:头戴电子设备100在低电量模式下运行的状态,处理器110停止执行命令,内存中的数据原样保留在内存中。
休眠状态:待机状态下留在内存中的数据被原样写入硬盘,休眠完成后系统自身进入零耗电状态。
下面介绍电容式传感器检测脉搏的原理。
电容式传感器是把被测量转换成电容量变化的一种传感器。可将被测量的变化转换成电容量变化。
两平行极板组成的电容器,它的电容量为:
Figure PCTCN2020083503-appb-000001
其中,ε 0为真空介电常数,ε 0=8.854×10 -12F/m;A为极板的遮盖面积;ε为极板间介质的相对介电系数,在空气中,ε=1;d为两平行极板间的距离。
当d、A或ε发生变化时,都会引起电容C的变化。
在头戴电子设备100已被佩戴后,头戴电子设备100的镜腿会横跨图3示出的耳朵旁边的动脉。此时,用户的皮肤可与电容式传感器的传感器垫片构成电容器,且A和ε不会发生变化。随着脉搏的跳动,皮肤与传感器垫片之间的距离也会发生变化。在A和ε均不变的情况下,电容值的变化会随着皮肤与传感器垫片之间距离的变化而变化。因此,通过一段时间内电容值的变化频率可计算出心率。
下面结合图5介绍光电式传感器检测脉搏的原理。
如图5所示的光电式传感器的结构,光电式传感器可以包括发射器、接收器等。其中,发射器可以是发光二极管、红外发射二极管等,接收器可以包括光电晶体管等。当发射器发出的光照透过皮肤组织然后再反射到接收器时光照存在一定程度的衰减。通过光照的变化即可获得脉搏血流的变化。利用光电式传感器检测经过人体血液和组织吸收后的反射光强度的不同,可以获得血液流量在心跳周期内的变化,从获得的脉搏波形中计算出心率。
为了提高检测头戴电子设备佩戴状态的准确率,本申请实施例提供一种头戴电子设备100的佩戴状态检测方法。下面介绍本申请实施例提供的几个示例。
下面介绍一种场景:头戴电子设备100处于关机状态,头戴电子设备100的佩戴状态为未佩戴。请参阅图6,图6是本申请实施例提供的一个实施例的示意图。
如图6中的a所示,在t1时刻头戴电子设备100处于关机状态,头戴电子设备100的佩戴状态为未佩戴。
如图6中的b所示,t2时刻脉搏传感器131检测到脉搏,确定头戴电子设备100的佩戴状态为已佩戴,头戴电子设备100开机。开机后,用户可以操作头戴电子设备100,例如通 过显示屏1100播放视频等。其中,显示屏1100播放视频是指,显示屏1100在时间上按序刷新显示不同的图像。
如图6中的c所示,t3时刻脉搏传感器131未检测到脉搏,确定头戴电子设备100的佩戴状态为未佩戴,暂停播放视频。在暂停播放视频的同时,还可以暂停播放该视频对应的音频。其中,暂停播放视频即显示屏1100上显示的图像不随时间变化,显示屏1100上后续显示的图像是被暂停时显示的图像。进一步地,头戴电子设备100还可以关闭显示屏1100。
如图6中的d所示,t4时刻脉搏传感器131未检测到脉搏,确定头戴电子设备100的佩戴状态为未佩戴,头戴电子设备100可以进入待机状态、休眠状态、或者关机状态,以增加头戴电子设备100的续航能力。其中,t3时刻至t4时刻之间,脉搏传感器131一直未检测到脉搏。
其中,t3时刻和t4时刻之间的时间间隔大于或者等于第一阈值,第一阈值例如可以是1分钟、5分钟、10分钟等。
上述t1时刻早于t2时刻、t2时刻早于t3时刻、t3时刻早于t4时刻。
若用户取下头戴电子设备100的时长在一定时长范围内,可暂停当前播放的视频及该视频对应的音频。若检测到用户再次佩戴了该头戴电子设备100后,可继续播放当前视频及该视频对应的音频,无需用户手动暂停或者播放视频,减少用户操作。进一步地,若用户取下头戴电子设备100后,头戴电子设备100处于未佩戴状态的时长超过上述时长范围后,头戴电子设备100可进入待机状态、休眠状态、或者关机状态,以增加头戴电子设备100的续航能力。
接下来介绍上述确定头戴电子设备100的佩戴状态为已佩戴及未佩戴的过程。
在一些实施例中,脉搏传感器131一直处于检测脉搏的状态。
具体地,脉搏传感器131检测到至少两次,例如3-5次脉搏跳动,根据检测到该至少两次脉搏跳动耗费的时间确定脉搏跳动的频率是否在预设范围内,该预设范围为人体脉搏跳动的范围,例如可以是60-100次/分。若确定脉搏跳动的频率在上述预设范围内,则确定脉搏传感器131检测到的脉搏为人体的脉搏,确定头戴电子设备100的佩戴状态为已佩戴。
若脉搏传感器131未检测到脉搏,或者检测到的脉搏跳动的频率不在上述预设范围内,则确定头戴电子设备100的佩戴状态为未佩戴。
在另一些实施例中,在满足触发条件的情况下,脉搏传感器131检测脉搏。
具体地,上述触发条件可以是初步检测出头戴电子设备100的佩戴状态发生变化。
其中,初步检测头戴电子设备100的佩戴状态发生变化的方式可以包括以下几种:
方式一:可以通过陀螺仪传感器133检测头戴电子设备100的运动轨迹,判断运动轨迹是否符合预设的运动轨迹。若是,则初步检测出头戴电子设备100的佩戴状态发生变化。
上述预设的运动轨迹可以包括预设的第一运动轨迹、预设的第二运动轨迹。
具体地,上述第一运动轨迹例如可以是如图7所示的从下至上的弧线。上述第二运动轨迹例如可以是如图8所示的从上至下的弧线。
若检测出头戴电子设备100的运动轨迹符合上述预设的运动轨迹,则触发脉搏传感器131检测是否存在脉搏。若存在脉搏,则确定头戴电子设备100的佩戴状态为已佩戴。若不存在脉搏,则确定头戴电子设备100的佩戴状态为未佩戴。
进一步地,脉搏传感器131检测出是否存在脉搏结果后,可关闭脉搏传感器,直至检测出头戴电子设备100的运动轨迹符合预设的运动轨迹,以降低脉搏传感器产生的功耗,增强头戴电子设备100的续航能力。
不限于上述列举的弧线,在具体实现中上述第一运动轨迹还可以是其他,具体可通过采集多名用户在佩戴头戴电子设备100的过程中头戴电子设备100的运动轨迹来确定上述预设的第一运动轨迹。同样地,第二运动轨迹可以通过采集多名用户在取下头戴电子设备100的过程中头戴电子设备的运动轨迹来确定。
不限于上述列举的陀螺仪传感器133,在具体实现中还可以采用加速度传感器检测头戴电子设备100的姿态,来检测出头戴电子设备100的佩戴状态是否发生变化。
方式二:可以根据头戴电子设备100的弯折状态的变化初步检测出头戴电子设备100的佩戴状态是否发生变化。若是,则初步检测出头戴电子设备100的佩戴状态发生变化。
头戴电子设备100的弯折状态可以包括如图9所示的折叠状态和展开状态。上述弯折状态的变化可以包括从折叠状态变成展开状态,以及从展开状态变成折叠状态。
具体地,若头戴电子设备100的弯折状态发生变化,则触发脉搏传感器131检测是否存在脉搏。若存在脉搏,则确定头戴电子设备100的佩戴状态为已佩戴。若不存在脉搏,则确定头戴电子设备100的佩戴状态为未佩戴。
在一种可能的实现方式中,上述头戴电子设备100的弯折状态的变化可通过磁传感器检测。其中,磁传感器例如可以是霍尔传感器。霍尔传感器可包含输出端,输出端以电压或者电流的方式输出电信号。当输出的电信号发生跳变(从高电平变成低电平或者从低电平变成高电平)时,可确定头戴电子设备100的弯折状态发生变化。霍尔传感器在头戴电子设备中的位置如图10所示。
如图10中的a所示,在一种实现方式中,霍尔传感器可以设置在右镜腿的A1处,磁铁可以设置在镜框的A2处。其中,A1为头戴电子设备100的弯折状态为折叠状态时,右镜腿与镜框的重合处,右镜腿上的相应位置;A2为头戴电子设备100的弯折状态为折叠状态时,右镜腿与镜框的重合处镜框上的相应位置,具体可见图10中的b左边虚线框中示出的位置。
在另外一种实现方式中,霍尔传感器可以设置在左镜腿的B1处,磁铁可以设置在镜框的B2处。其中,B1为头戴电子设备100的弯折状态为折叠状态时,左镜腿与镜框的重合处,左镜腿上的相应位置;B2为头戴电子设备100的弯折状态为折叠状态时,左镜腿与镜框的重合处镜框上的相应位置,具体可见图10中的b右边虚线框中示出的位置。
在另外一种实现方式中,霍尔传感器可设置在A1和B1处,磁铁可设置在镜框的A2和B2处。
不限于此,上述霍尔传感器和磁铁的位置可相互调换,不再赘述。
在另外一种可能的实现方式中,上述头戴电子设备100的弯折状态的变化可通过两个陀螺仪传感器133检测。其中,两个陀螺仪传感器133可分别设置于头戴电子设备100的两个镜腿上。具体地,当两个镜腿上的陀螺仪传感器133输出的角速度的值互为相反数时,可确定头戴电子设备100的弯折状态发生了变化。
进一步地,脉搏传感器131检测出是否存在脉搏结果后,可关闭脉搏传感器,可关闭脉搏传感器131,直至检测到头戴电子设备100的弯折状态再次发生变化,以降低脉搏传感器131产生的功耗,增强头戴电子设备100的续航能力。
不限于通过磁传感器检测头戴电子设备100的弯折状态的变化,在具体实现中还可以将上述设置在镜腿或者镜框处的磁传感器替换成指南针,通过指南针检测到的磁力的变化确定头戴电子设备100的弯折状态的变化。若指南针检测到的磁力变大或者变小,可确定头戴电子设备100的弯折状态发生变化。
方式三:可以通过头戴电子设备100与外接设备的连接状态的变化初步检测出头戴电子设备100的佩戴状态是否发生变化。若是,则初步检测出头戴电子设备100的佩戴状态发生变化。
头戴电子设备100与外接设备的连接状态可包括连接和断开。上述连接状态的变化可以包括从断开变成连接,以及从连接变成断开。
具体地,若头戴电子设备100与外接设备的连接状态发生变化,则触发脉搏传感器131检测是否存在脉搏。若存在脉搏,则确定头戴电子设备100的佩戴状态为已佩戴。若不存在脉搏,则确定头戴电子设备100的佩戴状态为未佩戴。
具体地,如图11所示,外接设备可以是手机300,头戴电子设备100可以通过连接线400与外接设备300连接。
其中,连接线400可以通过USB Type C接口或Mini USB接口与外接设备300连接,连接线400可以通过USB接口与头戴电子设备100连接。该USB接口可以是USB3.0,用于兼容高速显示接口(display port,DP)信号传输,可以传输视音频高速数据。
此外,外接设备300可通过连接线400将外接设备300显示的画面发送至头戴电子设备100,以使用户通过头戴电子设备100查看外接设备300显示的画面。例如,外接设备300在接收用户输入的开启某游戏应用的指令后,可显示该游戏应用的画面,并通过连接线400将该画面发送至头戴电子设备100,以使用户通过头戴电子设备100查看该游戏应用的画面。可能地,外接设备300可以不显示画面,直接通过头戴电子设备100显示画面。
进一步的,脉搏传感器131检测出是否存在脉搏结果后,可关闭脉搏传感器131,直至检测到头戴电子设备100与外接设备的连接状态再次发生变化,以降低脉搏传感器131产生的功耗,增强头戴电子设备100的续航能力。
在一些实施例中,在头戴电子设备100与外接设备300连接的情况下,外接设备300检测到的用户操作可使头戴电子设备100做出响应。例如,外接设备300检测到点亮屏幕的用户操作后可触发头戴电子设备100开启脉搏传感器133检测脉搏。又例如,外接设备300检测到解锁的用户操作可触发头戴电子设备100显示解锁的画面,或可触发头戴电子设备100开启脉搏传感器133检测脉搏等。
接下来介绍不同的使用场景中,在确定头戴电子设备100的佩戴状态为已佩戴后,头戴电子设备100做了什么。
在一种使用场景中,头戴电子设备100处于关机状态,脉搏传感器131确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110将头戴电子设备100的工作状态切换为开机状态。在该使用场景中,关机状态可被称为第一工作状态,开机状态可被称为第二工作状态。
在另外一种使用场景中,头戴电子设备100处于休眠状态,脉搏传感器131确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110使头 戴电子设备100退出休眠状态。在该使用场景中,休眠状态可被称为第一工作状态,退出休眠状态后的状态可被称为第二工作状态。
在另外一种使用场景中,头戴电子设备100处于待机状态,脉搏传感器131确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110使头戴电子设备100退出待机状态。在该使用场景中,待机状态可被称为第一工作状态,退出待机状态后的状态可被称为第二工作状态。
在另外一种使用场景中,头戴电子设备100处于显示暂停播放的视频的状态,脉搏传感器131确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110使头戴电子设备100显示继续播放的视频。其中,暂停播放视频和继续播放视频的设备可以是头戴电子设备100,也可以是外接设备300,本申请实施例对此不做限定。在该使用场景中,显示暂停播放的视频可被称为第一工作状态,显示继续播放的视频可被称为第二工作状态。
在另外一种使用场景中,头戴电子设备100的显示屏1100处于被熄灭的状态,脉搏传感器133确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110点亮显示屏1100。在该使用场景中,显示屏1100被熄灭可看作是显示屏1100显示第三内容,显示屏1100被点亮可看作是显示屏1100显示第四内容。
在另外一种使用场景中,头戴电子设备100的显示屏1100以第一显示亮度显示,脉搏传感器133确定确定头戴电子设备100的佩戴状态为已佩戴后,将脉搏检测的结果传递给处理器110,处理器110使显示屏1100以第二显示亮度显示。其中,第一显示亮度低于第二显示亮度。在该使用场景中,显示屏1100以第一显示亮度显示的内容可被称为第三内容,显示屏1100以第二显示亮度显示的内容可被称为第四内容。
本申请实施例中,确定头戴电子设备的佩戴状态为已佩戴后,将头戴电子设备的工作状态从第一工作状态切换为第二工作状态,可以减少用户操作,提升用户使用头戴电子设备的效率,提升用户体验。
接下来介绍在确定头戴电子设备100的佩戴状态为未佩戴后,头戴电子设备100做了什么。
在一种使用场景中,头戴电子设备100处于开机状态,且显示正在播放的视频,脉搏传感器131确定头戴电子设备100的佩戴状态为未佩戴后,将脉搏检测的结果传递给处理器110,处理器110使头戴电子设备100显示暂停播放的视频。其中,播放视频和暂停播放视频的设备可以是头戴电子设备100,也可以是外接设备300,本申请实施例对此不做限定。在该使用场景中,显示播放的视频可被称为第一工作状态,显示暂停播放的视频可被称为第二工作状态。
进一步地,处理器110可以关闭显示屏193,直至头戴电子设备100的佩戴状态发生变化(即变为已佩戴),则开启显示屏,并继续播放视频。
在其他场景,例如但不限于浏览网页的场景、浏览图片的场景、或者阅读电子书的场景中,脉搏传感器131确定头戴电子设备100的佩戴状态为未佩戴后,将脉搏检测的结果传递给处理器110,处理器110可以关闭显示屏1100,直至头戴电子设备100的佩戴状态发生变化(即变为已佩戴),则开启显示屏。
进一步地,若在一段时间内头戴电子设备100一直处于未佩戴状态,处理器110将头戴 电子设备100的工作状态切换为休眠状态、待机状态或者关机状态。此时,休眠状态、待机状态或者关机状态可被称为第三工作状态。
具体地,若在第一时长内头戴电子设备100一直处于未佩戴状态,则更改头戴电子设备100的工作状态为待机状态或者休眠状态;其中,该第一时长例如可以是30秒。不限于30秒,在具体实现中上述第一时长还可以是其它数值,本申请实施例对此不做限定。
若在第二时长内头戴电子设备100一直处于未佩戴状态,则更改头戴电子设备100工作状态为关机状态。其中,第二时长可以大于第一时长,该第二时长例如可以是5分钟。不限于5分钟,在具体实现中上述第二时长还可以是其它数值,本申请实施例对此不做限定。
在另外一种使用场景中,头戴电子设备100的显示屏1100处于被点亮的状态,脉搏传感器131确定头戴电子设备100的佩戴状态为未佩戴后,将脉搏检测的结果传递给处理器110,处理器110熄灭显示屏1100。在该使用场景中,显示屏1100被点亮可看作是显示屏1100显示第一内容,显示屏1100被熄灭可看作是显示屏1100显示第二内容。
可能地,显示屏1100可以是LCD显示屏。LCD显示屏包含背光、显示面板(panel)、背光驱动电路(integrated circuit,IC)、和屏驱动IC。处理器110熄灭显示屏1100可以包含以下任一种情况:①关闭显示屏1100的背光供电。②关闭显示屏1100的背光供电和显示面板供电。③关闭显示屏1100背光供电、显示面板、屏驱动IC和背光驱动IC。
可能地,显示屏1100可以是OLED显示屏。OLED显示屏包含OLED显示面板(panel)和屏驱动IC。处理器110熄灭显示屏1100可以包含以下任一种情况:①关闭OLED显示面板供电。②关闭OLED显示面板供电和屏驱动IC供电。
不限于熄灭显示屏1100,在具体实现中,还可以降低显示屏1100显示的亮度,或者是显示屏1100显示特定的画面,本申请实施例对此不做限定。其中,特定的画面例如可以是用于保护屏幕的画面,即屏保,还可以是用于显示时间的画面等。此时,降低显示屏1100显示的亮度后显示的内容可被称为第二内容,上述特定的画面也可被称为第二内容。
本申请实施例中,确定头戴电子设备的佩戴状态为未佩戴后,显示暂停播放的视频,或者将头戴电子设备待机、休眠或关机,或者熄灭显示屏,或者降低显示屏的显示亮度,或者使显示屏显示特定的画面等,都可以在不影响用户使用的前提下,降低头戴电子设备的功耗,提升头戴电子设备的续航能力。此外,显示暂停播放的视频还可以减少用户操作,提升用户使用头戴电子设备的效率,提升用户体验。
在一些实施例中,用户可以通过点击按键159使头戴电子设备100开机,访问头戴电子设备100上的功能。开机后,脉搏传感器131可检测是否存在脉搏,并将脉搏检测结果发送至处理器110,处理器110可以根据脉搏检测结果确定头戴电子设备100的佩戴状态。
在另一些实施例中,用户可以通过点击按键159使头戴电子设备100开机,访问头戴电子设备100上的功能。开机后,在满足触发条件的情况下,可触发脉搏传感器131检测否存在脉搏。其中,触发条件可以是初步检测出头戴电子设备100的佩戴状态发生变化。初步检测头戴电子设备100的佩戴状态是否发生变化的方式可见前述实施例的描述,此处不赘述。
不限于使头戴电子设备100开机,在具体实现中,用户通过点击按键159还可以使头戴电子设备100退出休眠状态或者待机状态,或者使头戴电子设备100点亮显示屏1100,本申请实施例对此不做限定。
在一种可能的实施例中,用户点击按键159后,处理器110可将显示屏1100点亮,脉搏传感器131可检测是否存在脉搏。若不存在脉搏,则处理器110可使显示屏1100熄灭,更改 头戴电子设备100的工作状态为休眠状态、待机状态或者关机状态。实施该实施例可防止用户误触按键159导致的功耗。
在另外一种可能的实施例中,用户点击按键159后,脉搏传感器131可检测是否存在脉搏。若不存在脉搏,则显示屏1100一直处于熄灭的状态,更改头戴电子设备100的工作状态为休眠状态、待机状态或者关机状态。实施该实施例可防止用户误触按键159导致的功耗。
在一些实施例中,脉搏传感器131可用于检测心率,将检测的心率结果发送至处理器110。处理器110可根据心率检测的结果确定用户入睡情况,进而根据用户的入睡情况更改头戴电子设备100的工作状态。
具体地,若根据心率检测结果确定用户已入睡,则处理器110可更改头戴电子设备100的工作状态为休眠状态、待机状态或者关机状态。其中,用户入睡前的心率可以属于第一范围,用户入睡后的心率可以属于第二范围。上述第一范围例如可以是61-90次/分,上述第二范围例如可以是45-60次/分。
本申请实施例可根据心率结果判断用户是否入睡,若判断出用户已入睡,可更改头戴电子设备的工作状态以节省功耗,防止头戴电子设备在用户入睡后继续工作导致浪费功耗,可提升头戴电子设备的续航能力。
在另一些实施例中,处理器110可根据心率检测结果确定用户的健康状况。心率检测结果可以但不限于用于心率检测、压力管理、心率异常提醒、心脏相关疾病预警等。其中,异常提醒或者预警的方式包括但不限于声音、震动、图像、文字等。
进一步地,用户可预先设置紧急联系人。在根据心率检测结果确定用户的健康状况异常的情况下,头戴电子设备100可通过移动通信模块向预先设置的紧急联系人发送提示信息。保证在用户的健康状况出现异常时能够得到及时的救助,保障用户安全,提升用户体验。
不限于脉搏传感器,在具体实现中还可以采用加速度传感器检测脉搏,本申请实施例对此不做限定。
图12示出了本申请实施例提供的适用于前述实施例描述的头戴电子设备的控制方法。如图12所示,头戴电子设备的控制方法至少可以包括以下几个步骤:
S101:获取传感器检测的用户头部的脉搏数据。
S102:根据传感器检测的脉搏数据,将头戴电子设备的工作状态从第一工作状态切换至第二工作状态。
具体地,上述传感器可以是前述实施例中提到的脉搏传感器133,也可以是加速度传感器。上述传感器用于检测佩戴头戴电子设备100的用户头部的脉搏。
在一种可能的实现方式中,上述头戴电子设备100包括镜腿,上述传感器可以是电容式传感器。电容式传感器的检测原理可见前述实施例的相关描述,此处不赘述。
在另外一种可能的实现方式中,上述头戴电子设备100包括鼻托,上述传感器可以是光电式传感器。光电式传感器的检测原理可见图5实施例的相关描述,此处不赘述。
在一些实施例中,上述脉搏数据表明没有脉搏,上述第一工作状态为开机状态,上述第二工作状态为关机状态、待机状态或休眠状态中的任意一种。
在另外一些实施例中,上述脉搏数据表明没有脉搏,上述第一工作状态为显示正在播放的视频,上述第二工作状态为显示暂停播放的所述视频。
其中,播放或暂停播放视频的设备可以是头戴电子设备100,也可以是外接设备300,本申请实施例对此不做限定。
本申请实施例在确定头戴电子设备的佩戴状态为未佩戴后,可使头戴电子设备从显示正在播放的视频切换至显示暂停播放的视频,可以减少用户的操作,提升用户使用头戴电子设备的效率,并减少头戴电子设备的功耗,提升头戴电子设备的续航能力。
进一步地,若从将头戴电子设备100的工作状态从第一工作状态切换至第二工作状态的时刻起,在第一时长内一直没有脉搏,则将头戴电子设备100的工作状态从第二工作状态切换至第三工作状态。其中,上述第三工作状态可以是休眠状态、待机状态或者关机状态中的任意一种。可以进一步降低头戴电子设备的功耗,提升头戴电子设备的续航能力。
在另外一些实施例中,上述脉搏数据表明没有脉搏,上述第一工作状态为使显示屏1100显示第一内容,上述第二工作状态为使显示屏1100显示第二内容。
可能地,显示屏1100被点亮可以看作是显示屏1100显示第一内容,显示屏1100被熄灭可看作是显示屏1100显示第二内容。
不限于熄灭显示屏1100,在具体实现中,第二工作状态还可以降低显示屏1100显示的亮度,或者是显示屏1100显示特定的画面,本申请实施例对此不做限定。其中,特定的画面例如可以是用于保护屏幕的画面,即屏保,还可以是用于显示时间的画面等。此时,降低显示屏1100显示的亮度后显示的内容可被称为第二内容,上述特定的画面也可被称为第二内容。
在一些实施例中,上述脉搏数据表明有脉搏,上述第一工作状态为关机状态、待机状态或者休眠状态中的任意一种,上述第二工作状态为开机状态。
在另外一些实施例中,上述脉搏数据表明有脉搏,上述第一工作状态为显示暂停播放的视频,上述第二工作状态为显示继续播放的视频。
其中,暂停播放或继续播放视频的设备可以是头戴电子设备100,也可以是外接设备300,本申请实施例对此不做限定。
在另外一些实施例中,上述脉搏数据表明有脉搏,上述第一工作状态为使显示屏1100显示第三内容,上述第二工作状态为使显示屏1100显示第四内容。
可能地,显示屏1100被熄灭可看作是显示屏1100显示第三内容,显示屏1100被点亮可看作是显示屏1100显示第四内容。
可能地,显示屏1100以第一显示亮度显示的内容可被称为第三内容,显示屏1100以第二显示亮度显示的内容可被称为第四内容。其中,第一显示亮度低于第二显示亮度。
在一些实施例中,头戴电子设备100在获取传感器检测的脉搏数据之前,该方法还包括:在满足触发条件的情况下,触发传感器检测脉搏。
具体地,上述触发条件可以包括以下至少一项:头戴电子设备100的运动轨迹符合预设的运动轨迹、头戴电子设备100的弯折状态发生变化、头戴电子设备100与外接设备300的连接情况发生变化。
其中,上述预设的运动轨迹可以是图7示出的第一运动轨迹,还可以是图8示出的第二运动轨迹。
头戴电子设备100的弯折状态可包括展开状态及折叠状态,具体可见图9。头戴电子设备恩100的弯折状态的检测方法可见前述实施例的相关描述,此处不赘述。
头戴电子设备100与外接设备的连接情况包括已连接和未连接。具体可见图11实施例的相关描述,此处不赘述。
本申请实施例提供的头戴电子设备的控制方法可以通过脉搏传感器检测是否有脉搏,进而根据是否有脉搏使头戴电子设备做出相应的响应。例如,检测到没有脉搏后,降低显示屏的显示亮度或者休眠、待机、关机等,可以在不影响用户使用的前提下,降低头戴电子设备的功耗,提升头戴电子设备的续航能力。又例如,检测到没有脉搏后,暂停显示正在播放的视频,以及检测到有脉搏后自动开机等,可以减少用户的操作,提升用户使用头戴电子设备的效率,提升用户体验。进一步地,通过触发条件触发传感器检测脉搏,可以根据触发条件初步判断用户的使用意图,再触发传感器检测脉搏,可以减少传感器的工作,降低由传感器造成的功耗,进一步提升头戴电子设备的续航能力。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有指令,当其在计算机或处理器上运行时,使得计算机或处理器执行上述任一个方法中的一个或多个步骤。上述信号处理装置的各组成模块如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在所述计算机可读取存储介质中。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者通过所述计算机可读存储介质进行传输。所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。

Claims (12)

  1. 一种头戴电子设备,其特征在于,包括:传感器、一个或多个处理器、一个或多个存储器;
    所述传感器、所述一个或多个存储器与所述一个或多个处理器耦合,所述传感器用于检测佩戴所述头戴电子设备的用户头部的脉搏,所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述一个或多个处理器执行所述计算机指令时,所述头戴电子设备执行:
    获取所述传感器检测的所述用户头部的脉搏数据;
    根据所述传感器检测的脉搏数据,将所述头戴电子设备的工作状态从第一工作状态切换至第二工作状态。
  2. 如权利要求1所述的头戴电子设备,其特征在于,所述脉搏数据表明没有脉搏,所述第一工作状态为开机状态,所述第二工作状态为关机状态、待机状态或休眠状态中的任意一种。
  3. 如权利要求1所述的头戴电子设备,其特征在于,所述脉搏数据表明没有脉搏,所述第一工作状态为显示正在播放的视频,所述第二工作状态为显示暂停播放的所述视频。
  4. 如权利要求3所述的头戴电子设备,其特征在于,所述头戴电子设备执行所述将所述头戴电子设备的工作状态从第一工作状态切换至第二工作状态后,所述头戴电子设备还执行:
    若从将所述头戴电子设备的工作状态从第一工作状态切换至第二工作状态的时刻起,在第一时长内一直没有脉搏,则将所述头戴电子设备的工作状态从所述第二工作状态切换至第三工作状态;
    其中,所述第三工作状态为休眠状态、待机状态或者关机状态中的任意一种。
  5. 如权利要求1所述的头戴电子设备,其特征在于,所述头戴电设备还包括显示屏,所述脉搏数据表明没有脉搏,所述第一工作状态为使所述显示屏显示第一内容,所述第二工作状态为使所述显示屏显示第二内容。
  6. 如权利要求1所述的头戴电子设备,其特征在于,所述脉搏数据表明有脉搏,所述第一工作状态为关机状态、待机状态或者休眠状态中的任意一种,所述第二工作状态为开机状态。
  7. 如权利要求1所述的头戴电子设备,其特征在于,所述脉搏数据表明有脉搏,所述第一工作状态为显示暂停播放的视频,所述第二工作状态为显示继续播放的所述视频。
  8. 如权利要求1所述的头戴电子设备,其特征在于,所述头戴电设备还包括显示屏,所述脉搏数据表明有脉搏,所述第一工作状态为使所述显示屏显示第三内容,所述第二工作状态为使所述显示屏显示第四内容。
  9. 如权利要求1-8任一项所述的头戴电子设备,其特征在于,所述头戴电子设备执行获取所述传感器检测的脉搏数据之前,所述头戴电子设备还执行:
    在满足触发条件的情况下,触发所述传感器检测脉搏。
  10. 如权利要求9所述的头戴电子设备,其特征在于,所述触发条件包括以下至少一项:所述头戴电子设备的运动轨迹符合预设的运动轨迹、所述头戴电子设备的弯折状态发生变化、所述头戴电子设备与外接设备的连接情况发生变化;
    其中,所述头戴电子设备的弯折状态包括展开状态及折叠状态,所述头戴电子设备与外 接设备的连接情况包括已连接和未连接。
  11. 如权利要求1-10任一项所述的头戴电子设备,其特征在于,所述头戴电子设备还包括镜腿,所述传感器位于所述镜腿上,所述传感器为电容式传感器。
  12. 如权利要求1-10任一项所述的头戴电子设备,其特征在于,所述头戴电子设备还包括鼻托,所述传感器位于所述鼻托处,所述传感器为光电式传感器。
PCT/CN2020/083503 2019-04-12 2020-04-07 头戴电子设备及其控制方法 WO2020207380A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910296129.4A CN110070812A (zh) 2019-04-12 2019-04-12 头戴电子设备及其控制方法
CN201910296129.4 2019-04-12

Publications (1)

Publication Number Publication Date
WO2020207380A1 true WO2020207380A1 (zh) 2020-10-15

Family

ID=67367720

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/083503 WO2020207380A1 (zh) 2019-04-12 2020-04-07 头戴电子设备及其控制方法

Country Status (2)

Country Link
CN (1) CN110070812A (zh)
WO (1) WO2020207380A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112988106A (zh) * 2021-04-14 2021-06-18 歌尔股份有限公司 音量指示方法、头戴设备及计算机可读存储介质

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110070812A (zh) * 2019-04-12 2019-07-30 华为技术有限公司 头戴电子设备及其控制方法
CN110780769A (zh) * 2019-09-24 2020-02-11 维沃移动通信有限公司 一种控制方法、装置、可穿戴设备及介质
CN113157077B (zh) * 2020-01-23 2024-08-23 Oppo广东移动通信有限公司 模式控制方法及相关产品
CN111291338B (zh) * 2020-02-17 2023-11-28 Oppo广东移动通信有限公司 用户识别方法、用户识别装置、存储介质与头戴式设备
CN111259895B (zh) * 2020-02-21 2022-08-30 天津工业大学 一种基于面部血流分布的情感分类方法及系统
CN111741511B (zh) * 2020-05-29 2022-05-10 华为技术有限公司 快速匹配方法及头戴电子设备
CN111930221A (zh) * 2020-07-14 2020-11-13 苏州宣佑科技有限公司 一种智能设备低功耗模式判断切换的方法
CN115209178A (zh) * 2021-04-14 2022-10-18 华为技术有限公司 一种信息处理方法、装置及系统
CN113010025B (zh) * 2021-04-25 2023-06-09 歌尔股份有限公司 亮屏时长控制方法、设备、介质及计算机程序产品
CN114237386A (zh) * 2021-11-29 2022-03-25 歌尔光学科技有限公司 虚拟现实设备的控制方法、虚拟现实设备以及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009171505A (ja) * 2008-01-21 2009-07-30 Nikon Corp ヘッドマウントディスプレイ
CN104731331A (zh) * 2015-03-24 2015-06-24 联想(北京)有限公司 控制开启方法及电子设备
CN104905780A (zh) * 2015-06-17 2015-09-16 华南理工大学 一种通过太阳穴位置检测心率的眼镜
CN106200889A (zh) * 2015-05-05 2016-12-07 联想(北京)有限公司 控制方法及穿戴式设备
CN108095720A (zh) * 2017-12-14 2018-06-01 广州德科投资咨询有限公司 一种基于智能眼镜的酒驾预警方法及智能眼镜
CN110070812A (zh) * 2019-04-12 2019-07-30 华为技术有限公司 头戴电子设备及其控制方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202281870U (zh) * 2011-10-13 2012-06-20 歌尔声学股份有限公司 3d眼镜
CN104808776A (zh) * 2014-01-24 2015-07-29 北京奇虎科技有限公司 检测头戴式智能设备持续附着在人体上的装置和方法
US20160131904A1 (en) * 2014-11-07 2016-05-12 Osterhout Group, Inc. Power management for head worn computing
CN105652473A (zh) * 2016-04-14 2016-06-08 上海理工大学 智能镜架
CN108769387A (zh) * 2018-05-03 2018-11-06 Oppo广东移动通信有限公司 应用控制方法及相关设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009171505A (ja) * 2008-01-21 2009-07-30 Nikon Corp ヘッドマウントディスプレイ
CN104731331A (zh) * 2015-03-24 2015-06-24 联想(北京)有限公司 控制开启方法及电子设备
CN106200889A (zh) * 2015-05-05 2016-12-07 联想(北京)有限公司 控制方法及穿戴式设备
CN104905780A (zh) * 2015-06-17 2015-09-16 华南理工大学 一种通过太阳穴位置检测心率的眼镜
CN108095720A (zh) * 2017-12-14 2018-06-01 广州德科投资咨询有限公司 一种基于智能眼镜的酒驾预警方法及智能眼镜
CN110070812A (zh) * 2019-04-12 2019-07-30 华为技术有限公司 头戴电子设备及其控制方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112988106A (zh) * 2021-04-14 2021-06-18 歌尔股份有限公司 音量指示方法、头戴设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN110070812A (zh) 2019-07-30

Similar Documents

Publication Publication Date Title
WO2020207380A1 (zh) 头戴电子设备及其控制方法
EP3862845B1 (en) Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
WO2021008534A1 (zh) 一种语音唤醒的方法和电子设备
US20220342074A1 (en) Electronic Device and Sensor Control Method
US20240073305A1 (en) Touchscreen, Electronic Device, and Display Control Method
WO2021063311A1 (zh) 具有折叠屏的电子设备的显示控制方法及电子设备
CN110012154A (zh) 一种具有折叠屏的电子设备的控制方法及电子设备
CN113552937B (zh) 显示控制方法和可穿戴设备
CN113395382B (zh) 一种设备间数据交互的方法及相关设备
CN110012130A (zh) 一种具有折叠屏的电子设备的控制方法及电子设备
KR20210030437A (ko) 색소 검출 방법 및 전자 장치
CN111526407B (zh) 屏幕内容的显示方法及装置
CN114451874B (zh) 智能眼罩、终端设备、健康管理方法与系统
WO2020237617A1 (zh) 控屏方法、装置、设备及存储介质
CN115696522A (zh) 数据传输方法及可穿戴设备
CN113964900A (zh) 动态调节电源适配器的供电电压的方法及电子设备
CN114257920B (zh) 一种音频播放方法、系统和电子设备
WO2022206825A1 (zh) 一种调节音量的方法、系统及电子设备
WO2021244186A1 (zh) 用户健康管控方法和电子设备
CN115665632B (zh) 音频电路、相关装置和控制方法
WO2022083363A1 (zh) 周期性测量血氧的方法及电子设备
WO2022089625A1 (zh) 一种增强现实功能控制方法和电子设备
WO2021204036A1 (zh) 睡眠风险监测方法、电子设备及存储介质
CN114375027A (zh) 降低功耗的方法和装置
CN113918003A (zh) 检测皮肤接触屏幕时长的方法、装置及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20786856

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20786856

Country of ref document: EP

Kind code of ref document: A1