CN109582141A - According to the method for eyeball focal point control display screen and wear electronic equipment - Google Patents

According to the method for eyeball focal point control display screen and wear electronic equipment Download PDF

Info

Publication number
CN109582141A
CN109582141A CN201811407510.5A CN201811407510A CN109582141A CN 109582141 A CN109582141 A CN 109582141A CN 201811407510 A CN201811407510 A CN 201811407510A CN 109582141 A CN109582141 A CN 109582141A
Authority
CN
China
Prior art keywords
display screen
display
electronic equipment
user
focus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811407510.5A
Other languages
Chinese (zh)
Other versions
CN109582141B (en
Inventor
周国名
陈健
臧旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201811407510.5A priority Critical patent/CN109582141B/en
Priority to CN202210492188.0A priority patent/CN114879840A/en
Publication of CN109582141A publication Critical patent/CN109582141A/en
Priority to EP19886694.9A priority patent/EP3862845B1/en
Priority to FIEP19886694.9T priority patent/FI3862845T3/en
Priority to PCT/CN2019/118623 priority patent/WO2020103763A1/en
Priority to US17/295,699 priority patent/US20220019282A1/en
Application granted granted Critical
Publication of CN109582141B publication Critical patent/CN109582141B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231Monitoring the presence, absence or movement of users
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038Indexing scheme relating to G06F3/038
    • G06F2203/0381Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A kind of method according to eyeball focal point control display screen is applied to wear electronic equipment with electronic equipment, this method is worn, and wearing electronic equipment includes display screen, and display screen is transparent when closing display;Method includes: to show image on a display screen, and the focusing focus of user eyeball is within the scope of first distance;When detecting that duration of the user eyeball focusing focus not within the scope of first distance is greater than or equal to the first duration, display screen is closed.Implement the embodiment of the present application, power consumption can be saved, and reduces influence of the image to viewing real world.

Description

According to the method for eyeball focal point control display screen and wear electronic equipment
Technical field
This application involves field of communication technology more particularly to a kind of method according to eyeball focal point control display screen and wear Electronic equipment.
Background technique
It wears in electronic equipment, augmented reality (augmented reality, AR) device can watch real generation in user While boundary's scene, virtual image is displayed for a user.User can also interact to realize augmented reality with virtual image Effect.
Currently, power consumption and heat dissipation problem are to wear one of technical bottleneck of electronic equipment.And wear the display of electronic equipment The power consumption and heat dissipation problem of screen occupy major part.In addition, wanting viewing real world when wearing the user for wearing electronic equipment When, wearing the image that the display screen of electronic equipment is shown and will affect user to watch real world, especially image background color is light tone When system's such as white, user is difficult to see the subsequent real world of image clearly.
Therefore, the problem of how reducing and wear powder consumption of electronic equipment, reducing heat dissipation, and allow users to more clearly see Real world is a problem to be solved.
Summary of the invention
This application provides a kind of method according to eyeball focal point control display screen and wear electronic equipment.Power consumption is saved, And reduce influence of the image to viewing real world.
In a first aspect, this application provides a kind of methods according to eyeball focal point control display screen, which is characterized in that described Method is applied to wear electronic equipment, and the electronic equipment of wearing includes display screen, and the display screen is when closing display Bright;The described method includes: showing image on the display screen, the focusing focus of the user eyeball is in first distance range It is interior;Detecting that the duration within the scope of the first distance is not greater than or equal to the first duration to user eyeball focusing focus When, close the display screen.
Implement the above-mentioned method according to eyeball focal point control display screen, when the focus that user eyeball focuses is not in display screen Fixed-focus focus in when, i.e., closing display screen.User can watch entity object by transparent display screen.Display can be reduced Image watches user the influence of real world.In addition the power consumption of display screen can be reduced.
Optionally, display screen is just closed when one of the following or multiple conditions occur: a. processor calls focal length inspection It surveys sensor and detects that the focus of the ocular focusing of user is fallen in the fixed-focus focus of display screen lower than first threshold, first threshold Such as it can be 1 second.B. processor calls focal length detection sensor to detect that the focus of the ocular focusing of user exceeds display screen Fixed-focus focus frequency be more than second threshold, second threshold for example can be per minute twice.C. processor calls focal length inspection Surveying sensor and detecting that the focus of the ocular focusing of user removes the time from the fixed-focus focus of display screen is more than the first duration, and first Duration for example can be 1 minute.
In some embodiments, described to close after the display screen, the method also includes: detecting the user When ocular focusing focus falls in the duration within the scope of the first distance more than or equal to the second duration, the display is opened Screen.
When the focus that user eyeball focuses is in the fixed-focus focus of display screen, that is, open display screen.It can be improved and wear The operation ease of electronic equipment.
Optionally, display screen is just opened when one of the following or multiple conditions occur: a. processor calls focal length inspection Survey sensor and detect that the focus of the ocular focusing of user is fallen in the fixed-focus focus of display screen more than the second duration, this second when Length for example can be 1 second;B. processor calls focal length detection sensor to detect that the focus of the ocular focusing of user falls in display The frequency of the fixed-focus focus of screen be more than per minute twice;C. processor calling focal length detection sensor detects the eye of user 200 It is more than 1 second that the focus that ball focuses, which falls in the fixed-focus near focal point of display screen,;D. processor calls focal length detection sensor to detect The focus of the ocular focusing of user fell in the duration other than the fixed-focus focus of display screen less than 1 second.
In some embodiments, the display screen is liquid crystal display, when playing video on the display screen, the pass Close the display screen, comprising: close the backlight of the display screen.
When watching video, user needs to see that entity object then suspends video playing and closes the display of display screen, can be with It reduces power consumption and improves the convenience that user watches video.In addition, being simply turned off display panel without closing screen driving IC, restoring IC is driven without initial configuration screen when playing video, so as to improve the response speed for restoring to play.
Wherein, video is played on display screen to refer to, sequentially refresh in time on display screen and show different images.Pause Playing video is to show that the image of screen display does not change over time, and the image of subsequent display is display when being suspended on display screen Image.
Optionally, display screen is closed, can refer to the first area closed on display screen.Opening display screen, which can refer to, to be beaten Open the first area of display screen.
In the embodiment of the present application, after the pause of the video image that plays on display screen, first area is closed display, and removes the The image that display area other than one region is shown no longer changes, until display screen is resumed broadcasting video.
Electronic equipment can also detect the depth of focus of user eyeball.Electronic equipment can also detect user eyeball focusing Visual angle, the i.e. direction of gaze of eyeball.The first area that display is closed on display screen can be eyeball view directions and fall in display screen On region.The first area that display is closed on display screen can also be the region of vertical projection on a display screen.
In some embodiments, when detecting lasting not within the scope of the first distance of user eyeball focusing focus It is long when being greater than or equal to the first duration, wear electronic equipment can execute it is any one of following: reduce the brightness of first area; Close the display of display screen;The region of image is shown on moving display screen;Move and reduce the region of display screen display image.
In some embodiments, the display screen is liquid crystal display, when showing navigation information on the display screen, institute It states and closes the display screen, comprising: close the backlight of the display screen and following one or more: display panel, the backlight Driving circuit and the display screen driving circuit.
Under navigation scenarios, the backlight of display screen, display panel and driving IC can be turned off, further to save function Consumption.
In some embodiments, the display screen is organic light-emitting diode (OLED) display screen, plays view on the display screen It is described to close the display screen, comprising: to close the display panel of the display screen when frequency.
When watching video, user needs to see that entity object then suspends video playing and closes the display of display screen, can be with It reduces power consumption and improves the convenience that user watches video.In addition, being simply turned off display panel without closing screen driving IC, restoring IC is driven without initial configuration screen when playing video, so as to improve the response speed for restoring to play.
In some embodiments, the display screen is organic light-emitting diode (OLED) display screen, and display is led on the display screen It is described to close the display screen, comprising: to close the driving circuit of the display screen and the display surface of the display screen when information of navigating Plate.
Under navigation scenarios, display panel and driving IC can be turned off, further to save power consumption.
In some embodiments, the method also includes: when detecting any one of following or multinomial, close the display Screen: detect user eyeball focusing focus not the duration within the scope of the first distance be greater than or equal to described first when It is long;Detect the pushing operation of the first key;Detect first gesture;Detect the first voice signal.
The first gesture for example can be one or more of following gesture: scissors hand, fist fire finger, than OK hand Gesture etc..
Wherein, the corresponding relationship of the instruction of the first key and closing display screen can be systemic presupposition, be also possible to ring It should be in the operation setting of user.The corresponding relationship of the instruction of first gesture and closing display screen is also possible to systemic presupposition, It is also possible to the operation setting in response to user.First voice signal and the corresponding relationship for the instruction for closing display screen can be Systemic presupposition, it is also possible to the operation setting in response to user.
In some embodiments, the method also includes: when detecting any one of following or multinomial, open the display Screen:
The duration for detecting that the user eyeball focusing focus is fallen within the scope of the first distance is greater than or equal to Second duration;Detect the pushing operation of the second key;Detect second gesture;Detect the second voice signal.
Wherein, the corresponding relationship of the instruction of the second key and opening display screen can be systemic presupposition, be also possible to ring It should be in the operation setting of user.The corresponding relationship of the instruction of second gesture and opening display screen is also possible to systemic presupposition, It is also possible to the operation setting in response to user.Second voice signal and the corresponding relationship for the instruction for opening display screen can be Systemic presupposition, it is also possible to the operation setting in response to user.
The second gesture for example can be one or more of following gesture: scissors hand, fist fire finger, than OK hand Gesture etc..
User's operation can also be display screen touch control operation and eeg signal.Camera shooting can also be passed through by wearing electronic equipment Head in the case where detecting eyeball particular state, such as eyeball turn over, under turn over or rapid eye movements, then wearing electronic equipment can will show Display screen closes display or opens display.
Optionally, when display screen shows navigation information, wearing electronic equipment can also be detected by velocity sensor Movement speed is more than threshold speed, closes display screen and shows, the navigation information for showing screen display can also be moved to display The side of screen.When detecting that the movement speed for wearing electronic equipment is excessively high, display screen is closed.It can reduce under navigation scenarios The case where too fast display screen of user moving speed shows image contributions user security, provides convenience for user.
Optionally, when display screen shows navigation information, wearing electronic equipment can also determine according to equipment position location Without without crossing, then wearing electronics in crossing, such as 1 km within the scope of distance threshold in the direction of motion of current track route Equipment can close display screen and show.Under navigation scenarios, not when the close crossing for needing user to pay attention to, display screen is closed It has been shown that, can save and wear powder consumption of electronic equipment, and reduces display screen and show that image blocks user's sight, provide for user Convenience.
Optionally, it is closed open number repeatedly to reduce display screen, electronic equipment can detect continuous N number of reality The image of body object on a display screen not by ocular focusing when, close display panel and driving IC.Later detect it is following Display screen and driving IC are just opened when one or more, to show the image of entity object in electronic equipment current visual angle: a. The focal point of ball is in display screen fixed-focus focus.B. in response to a certain user's operation.C. detect that successive M is (whole greater than 1 Number) a entity object enters in electronic equipment visual angle.
Optionally, user can also be obtained to the corresponding figure of different entities object by machine learning by wearing electronic equipment The number or probability focused as history.Wearing electronic equipment can be true according to the history of every class entity object focusing number or probability Surely the trigger condition of display screen is closed.History focuses number or probability is bigger, and the looser pass of such entity object can be set Close the trigger condition of display screen.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Above-mentioned method determines that the display screen of user preference shows content using machine learning, then according to user preference Display screen show curriculum offering close display screen condition.While saving power consumption, more accurately whether user can be determined It needs to close display screen.
Optionally, user can be obtained and be gone through to image corresponding under different scenes by machine learning by wearing electronic equipment The times or frequency that history focuses.Times or frequency can be focused according to the history of entity object under each scene by wearing electronic equipment Determine the trigger condition for closing display screen.History focusing times or frequency is bigger, and closing looser under the scene can be set The trigger condition of display screen.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Above-mentioned method determines that the display screen of user preference shows scene using machine learning, then according to user preference Display screen show scene setting close display screen condition.While saving power consumption, more accurately whether user can be determined It needs to close display screen.
Second aspect, this application provides another kinds according to the method for eyeball focal point control display screen, the method application In wearing electronic equipment, the electronic equipment of wearing includes display screen, and the display screen is transparent when closing display;It is described Method includes: to play video on the display screen, and the focusing focus of the user eyeball is within the scope of first distance;It is detecting When the duration within the scope of the first distance is not greater than or equal to the first duration to user eyeball focusing focus, institute is closed It states user eyeball and focuses on visual angle that corresponding display area, pause play the video on the display screen on the display panel.
Implement the above-mentioned method according to eyeball focal point control display screen, when the focus that user eyeball focuses is not in display screen Fixed-focus focus in when, i.e., user eyeball focuses on visual angle corresponding display area on the display panel, described in pause plays Video on display screen.User can watch entity object by transparent closing display area.Display image pair can be reduced The influence of user's viewing real world.In addition the power consumption of display screen can be reduced.
In some embodiments, described to close corresponding display on the display panel on user eyeball focusing visual angle After region, the method also includes: detecting that the user eyeball focusing focus falls within the scope of the first distance When duration is greater than or equal to the second duration, the user eyeball is focused into corresponding display on the display panel on visual angle Region is opened, and starts to play the video on the display screen.
The third aspect, this application provides one kind to wear electronic equipment, comprising: one or more processors, one or more A memory;One or more of memories are coupled with one or more of processors, one or more of memories For storing computer program code, the computer program code includes computer instruction, when one or more of processing When device executes the computer instruction, the terminal executes such as first aspect, second aspect, any possible reality of first aspect Apply the method according to eyeball focal point control display screen that mode or any possible embodiment of second aspect provide.
Fourth aspect, this application provides a kind of computer storage mediums, including computer instruction, when the computer refers to When order is run at the terminal, so that the terminal executes such as first aspect, second aspect, any possible implementation of first aspect The method according to eyeball focal point control display screen that mode or any possible embodiment of second aspect provide.
Implement the embodiment of the present application, when the focus that user eyeball focuses is not in the fixed-focus focus of display screen, that is, closes Display screen.User can watch entity object by transparent display screen.Display image can be reduced, real generation is watched to user The influence on boundary.In addition the power consumption of display screen can be reduced.
Detailed description of the invention
The attached drawing that the embodiment of the present application is used is introduced below.
Fig. 1 is a kind of structural schematic diagram for wearing electronic equipment provided by the embodiments of the present application;
Fig. 2 is the schematic illustration of eyeball focometry in a kind of electronic equipment provided by the embodiments of the present application;
Fig. 3 is the schematic diagram of some human-computer interactions under navigation scenarios provided by the embodiments of the present application;
Fig. 4 a- Fig. 4 k is the schematic diagram of the embodiment of some human-computer interactions provided by the embodiments of the present application;
Fig. 5 is the schematic diagram of some human-computer interactions under navigation scenarios provided by the embodiments of the present application;
Fig. 6 is the schematic diagram of other human-computer interactions under navigation scenarios provided by the embodiments of the present application;
Fig. 7 is the schematic diagram of human-computer interaction provided by the embodiments of the present application;
Fig. 8 is a kind of schematic diagram of human-computer interaction provided by the embodiments of the present application;
Fig. 9 a and Fig. 9 b are a kind of structural schematic diagram of display screen provided by the embodiments of the present application respectively;
Figure 10 is the flow diagram of the method provided in an embodiment of the present invention according to eyeball focal point control display screen.
Specific embodiment
The embodiment of the present application is described below with reference to the attached drawing in the embodiment of the present application.The implementation of the embodiment of the present application The term that mode part uses is only used for explaining the specific embodiment of the application, and is not intended to limit the application.
To the invention relates to electronic equipment be introduced.Electronic equipment, which can be, wears electronic equipment.User It can wear and wear electronic equipment realization virtual reality (virtual reality, VR), AR, mixed reality (mixed Reality, MR) etc. different-effects.For example, wearing electronic equipment can be glasses, wears electronic equipment, goggles etc..Electronics Equipment can also be other equipment comprising display screen, such as the automatic driving vehicle comprising display screen etc..
Referring to Fig. 1, Fig. 1 is a kind of structural schematic diagram for wearing electronic equipment provided by the embodiments of the present application.When wearing When electronic equipment is mounted on in account, eyes of user can see the image for wearing electronic equipment display screen presentation.Work as display In the case that screen is transparent, eyes of user can see that entity object or eyes of user can be through displays through display screen Screen sees the image that other display device is shown.
It should be understood that the embodiment of the present application is introduced so that electronic equipment is to wear electronic equipment as an example, but this Shen Please embodiment be not limited to wear electronic equipment, electronic equipment can also be other equipment.
As shown in Figure 1, wearing electronic equipment 100 may include processor 110, memory 120, sensor module 130, wheat Gram wind 140, key 150, input/output interface 160, communication module 170, camera 180, battery 190 and display screen 1100 Deng.Wherein sensor module 130 may include focal length detection optical sensor 181, and focal length detection optical sensor 181 is for examining Survey the focal length of the eyeball of user 200.Sensor module 130 can also include other sensors, such as sound-detection gear, close to light Sensor, range sensor, gyro sensor, ambient light sensor, acceleration transducer and temperature sensor etc..
It is understood that the structure of the embodiment of the present application signal does not constitute the specific limit of correct wearing electronic equipment 100 It is fixed.In other embodiments of the application, wearing electronic equipment 100 may include components more more or fewer than diagram, or Certain components are combined, certain components or different component layouts are perhaps split.The component of diagram can with hardware, software or The combination of software and hardware is realized.
Processor 110 may include one or more processing units, such as: processor 110 may include application processor (application processor, AP), modem processor, graphics processor (graphics processing Unit, GPU), image-signal processor (image signal processor, ISP), video processing unit (video Processing unit, VPU) controller, memory, Video Codec, digital signal processor (digital signal Processor, DSP), baseband processor and/or neural network processor (neural-network processing unit, NPU) etc..Wherein, different processing units can be independent device, also can integrate in one or more processors.
Wherein, controller can be the nerve center for wearing electronic equipment 100 and command centre.Controller can be according to finger Operation code and clock signal are enabled, operating control signal is generated, the control completing instruction fetch and executing instruction.
Memory can also be set in processor 110, for storing instruction and data.In some embodiments, processor Memory in 110 is cache memory.The memory can save the instruction that processor 110 is just used or is recycled Or data.If processor 110 needs to reuse the instruction or data, can be called directly from the memory.It avoids Repeated access, reduces the waiting time of processor 110, thus improves the efficiency of system.
In some embodiments, processor 110 may include one or more interfaces.Interface may include integrated circuit (inter-integrated circuit, I2C) interface, universal asynchronous receiving-transmitting transmitter (universal asynchronous Receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor Interface, MIPI), universal input exports (general-purpose input/output, GPIO) interface, user identifier Module (subscriber identity module, SIM) interface and/or universal serial bus (universal serial Bus, USB) interface, Serial Peripheral Interface (SPI) (serial peripheral interface, SPI) interface etc..
I2C interface is a kind of bi-directional synchronization universal serial bus, including serial data line (serial data line, SDA) He Yigen serial time clock line (derail clock line, SCL).In some embodiments, processor 110 may include Multiple groups I2C bus.Processor 110 can couple focal length detection optical sensor 131 respectively by different I2C bus interface, Battery 190, camera 180 etc..Such as: processor 110 can couple focal length by I2C interface and detect optical sensor 131, make Processor 110 is communicated with focal length detection optical sensor 131 by I2C bus interface, to obtain the eyeball focal length of user.SPI Interface can be used for the connection between processor and sensor.
UART interface is a kind of Universal Serial Bus, is used for asynchronous communication.The bus can be bidirectional communications bus. The data that it will be transmitted are converted between serial communication and parallel communications.In some embodiments, UART interface usually by with In connection processor 110 and communication module 170.Such as: processor 110 passes through the bluetooth in UART interface and communication module 170 Module communication, realizes Bluetooth function.
MIPI interface can be used to connect the peripheral components such as processor 110 and display screen 1100, camera 180.MIPI Interface includes camera serial line interface (camera serial interface, CSI), display screen serial line interface (display Serial interface, DSI) etc..In some embodiments, processor 110 and camera 180 are communicated by CSI interface, real Now wear the shooting function of electronic equipment 100.By DSI interface communication, electronics is worn in realization for processor 110 and display screen 1100 The display function of equipment 100.
GPIO interface can pass through software configuration.GPIO interface can be configured as control signal, may be alternatively configured as counting It is believed that number.In some embodiments, GPIO interface can be used for connecting processor 110 and camera 180, and display screen 1100 leads to Believe module 170, sensor module 130, microphone 140 etc..GPIO interface can be additionally configured to I2C interface, I2S interface, UART interface, MIPI interface etc..
Usb 1 30 is the interface for meeting USB standard specification, specifically can be Mini USB interface, and Micro USB connects Mouthful, USB Type C interface etc..It is to wear the charging of electronic equipment 100 that usb 1 30, which can be used for connecting charger, can also be with Data are transmitted between electronic equipment 100 and peripheral equipment for wearing.It can be used for connection earphone, sound played by earphone Frequently.The interface can be also used for connecting other electronic equipments, such as mobile phone etc..USB interface can be USB3.0, for compatible high Fast display interface (display port, DP) signal transmission, can transmit video and audio high-speed data.
It is understood that the interface connection relationship of each intermodule of the embodiment of the present application signal, only schematically illustrates, The structure qualification of correct wearing electronic equipment 100 is not constituted.In other embodiments of the application, electronic equipment 100 is worn It can be using the combination of interface connection type or multiple interfaces connection type different in above-described embodiment.
In addition, wearing electronic equipment 100 may include wireless communication function.Communication module 170 may include wireless communication Module and mobile communication module.Wireless communication function can be modulated by antenna (not shown), mobile communication module (not shown) Demodulation processor (not shown) and baseband processor (not shown) etc. are realized.
Antenna electromagnetic wave signal for transmitting and receiving.It wears and may include mutiple antennas, Mei Getian in electronic equipment 100 Line can be used for covering single or multiple communication bands.Different antennas can also be multiplexed, to improve the utilization rate of antenna.Such as: Antenna 1 can be multiplexed with to the diversity antenna of WLAN.In other embodiments, antenna can be with tuning switch knot It closes and uses.
Mobile communication module, which can provide to apply, is wearing the channel radios such as including 2G/3G/4G/5G on electronic equipment 100 The solution of letter.Mobile communication module may include at least one filter, switch, power amplifier, low-noise amplifier (low noise amplifier, LNA) etc..Mobile communication module can be received electromagnetic wave by antenna, and to received electromagnetic wave It is filtered, the processing such as amplification is sent to modem processor and is demodulated.Mobile communication module can also be to modulated solution The modulated signal amplification of processor is adjusted, switchs to electromagenetic wave radiation through antenna and goes out.In some embodiments, mobile communication module At least partly functional module can be arranged in processor 110.In some embodiments, at least portion of mobile communication module Point functional module can be arranged in the same device at least partly module of processor 110.
Modem processor may include modulator and demodulator.Wherein, modulator is used for low frequency base to be sent Band signal is modulated into high frequency signal.Demodulator is used to received electromagnetic wave signal being demodulated into low frequency baseband signal.Then solution Adjust device that the low frequency baseband signal that demodulation obtains is sent to baseband processor.Low frequency baseband signal is through baseband processor Afterwards, it is delivered to application processor.Application processor exports voice signal by audio frequency apparatus (being not limited to loudspeaker etc.), or logical It crosses display screen 1100 and shows image or video.In some embodiments, modem processor can be independent device.Another In some embodiments, modem processor can be set independently of processor 110 with mobile communication module or other function module It sets in the same device.
It includes WLAN (wireless that wireless communication module, which can be provided and be applied wearing on electronic equipment 100, Local area networks, WLAN) (such as Wireless Fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), Global Navigation Satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), the short distance wireless communication technology (near field communication, NFC) are red The solution of the wireless communications such as outer technology (infrared, IR).Wireless communication module can be integrated into a few mailing address Manage one or more devices of module.Wireless communication module receives electromagnetic wave via antenna, by electromagnetic wave signal frequency modulation and filter Wave processing, by treated, signal is sent to processor 110.Wireless communication module can also receive to be sent from processor 110 Signal, frequency modulation is carried out to it, amplify, switch to electromagenetic wave radiation through antenna and go out.
In some embodiments, antenna and the mobile communication module coupling for wearing electronic equipment 100, set so that wearing electronics Standby 100 technology can communicate with network and other equipment by wireless communication.The wireless communication technique may include the whole world Mobile communcations system (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), CDMA access (code division multiple Access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), the time-division CDMA (time-division code division multiple access, TD-SCDMA), long term evolution (long Term evolution, LTE), BT, GNSS, WLAN, NFC, FM and/or IR technology etc..The GNSS may include that the whole world is defended Star positioning system (global positioning system, GPS), Global Navigation Satellite System (global navigation Satellite system, GLONASS), Beidou satellite navigation system (beidou navigation satellite System, BDS), quasi- zenith satellite system (quasi-zenith satellite system, QZSS) and/or star base enhancing system It unites (satellite based augmentation systems, SBAS).
Electronic equipment 100 is worn by GPU, display screen 1100 and application processor etc. realize display function.GPU is The microprocessor of image procossing connects display screen 1100 and application processor.GPU is calculated for executing mathematics and geometry, is used for Figure rendering.Processor 110 may include one or more GPU, execute program instructions to generate or change display information.
The quantity for wearing display screen 1100 in electronic equipment 100 can be two, respectively correspond two eyes of user 200 Ball.The content of the two display screen displays can independently be shown.It can come in the different image of the two display screen displays Improve the three-dimensional sense of image.In some possible embodiments, the quantity for wearing display screen 1100 in electronic equipment 100 can also be with It is one, to correspond to two eyeballs of user 200.
Wearing electronic equipment 100 can be by ISP, camera 180, Video Codec, GPU, display screen 1100 and Application processor etc. realizes shooting function.
ISP is used to handle the data of the feedback of camera 180.For example, opening shutter when taking pictures, light is passed by camera lens It is delivered on camera photosensitive element, optical signal is converted to electric signal, and camera photosensitive element passes to the electric signal at ISP Reason, is converted into macroscopic image.ISP can also be to the noise of image, brightness, colour of skin progress algorithm optimization.ISP can be with Exposure to photographed scene, the parameter optimizations such as colour temperature.In some embodiments, ISP can be set in camera 180.
Camera 180 is for capturing still image or video.Object generates optical imagery by camera lens and projects photosensitive member Part.Photosensitive element can be charge-coupled device (charge coupled device, CCD) or complementary metal oxide is partly led Body (complementary metal-oxide-semiconductor, CMOS) phototransistor.Photosensitive element turns optical signal It changes electric signal into, electric signal is passed into ISP later and is converted into data image signal.Data image signal is output to DSP by ISP Working process.Data image signal is converted into the RGB of standard, the picture signal of the formats such as YUV by DSP.In some embodiments, Wearing electronic equipment 100 may include 1 or N number of camera 180, and N is the positive integer greater than 1.
As shown in Figure 1, camera 180 may be mounted at the side for wearing electronic equipment 100, it can also be mounted on and wear electricity Position in sub- equipment 100 between two display screens.Camera 180 is for the image and view in 200 visual angle of real-time capture user Frequently.It wears electronic equipment 100 and virtual image is generated according to the real-time image and video of capture, and virtual image is passed through into display Screen 1100 is shown.
The still image or video image that processor 110 can be captured according to camera 180, in conjunction with sensor module 130 The data (such as the data such as brightness, sound) of acquisition, to determine the virtual image shown on display screen 1100, Lai Shixian is in reality Virtual image is superimposed on world object.
Wherein, digital signal processor, in addition to can handle data image signal, can also be located for handling digital signal Manage other digital signals.For example, digital signal processor is used for frequency point energy when wearing electronic equipment 100 in frequency point selection Amount carries out Fourier transformation etc..
Video Codec is used for compression of digital video or decompression.Wear electronic equipment 100 can support it is a kind of or Various video codec.In this way, the video of a variety of coded formats can be played or record by wearing electronic equipment 100, and such as: it is dynamic State motion picture expert group version (moving picture experts group, MPEG) 1, MPEG2, mpeg 3, MPEG4 etc..
NPU is neural network (neural-network, NN) computation processor, by using for reference biological neural network structure, Such as transfer mode between human brain neuron is used for reference, it, can also continuous self study to input information fast processing.Pass through NPU It may be implemented to wear the application such as intelligent cognition of electronic equipment 100, such as: image recognition, recognition of face, speech recognition, text Understand etc..
Memory 120 can be used for storing computer executable program code, and the executable program code includes instruction. Processor 110 is stored in the instruction of memory 120 by operation, thereby executing the various function application for wearing electronic equipment 100 And data processing.Memory 120 may include storing program area and storage data area.Wherein, storing program area can store behaviour Make system, application program needed at least one function (such as sound-playing function, image player function etc.) etc..Storing data Area can store the data (such as audio data, phone directory etc.) etc. worn and created in 100 use process of electronic equipment.In addition, Memory 120 may include high-speed random access memory, can also include nonvolatile memory, for example, at least a disk Memory device, flush memory device, generic flash memory (universal flash storage, UFS) etc..
Wearing electronic equipment 100 can be by audio-frequency module, loudspeaker, microphone 140, at earphone interface, and application It manages device etc. and realizes audio-frequency function.Such as music, recording etc..
Audio-frequency module is used to for digitized audio message to be converted into analog audio signal output, is also used for analog audio input Be converted to digital audio and video signals.Audio-frequency module can be also used for audio-frequency signal coding and decoding.In some embodiments, audio Module can be set in processor 110, or the partial function module of audio-frequency module is set in processor 110.
Loudspeaker, also referred to as " loudspeaker ", for audio electrical signal to be converted to voice signal.Wearing electronic equipment 100 can be with Music is listened to by loudspeaker, or listens to hand-free call.
Microphone 140, also referred to as " microphone ", " microphone ", for voice signal to be converted to electric signal.Wear electronic equipment 100 can be set at least one microphone 140.In further embodiments, wearing electronic equipment 100 can be set two Mikes Wind 140 can also realize decrease of noise functions in addition to collected sound signal.In further embodiments, electronic equipment 100 is worn also It can be set three, four or more microphone 140 realizes that collected sound signal, noise reduction can also identify sound source, real Existing directional recording function etc..
In some embodiments, wearing electronic equipment 100 may include sound-detection gear 132, which can To detect and handle the voice signal for controlling mancarried electronic aid.For example, sound-detection gear may include microphone 140. Just it wears electronic equipment 100 microphone 140 can be used and convert sound into electric signal.Sound-detection gear 132 can then be located Electric signal is managed, and is the order of wear-type display system 1300 by signal identification.Processor 110 can be configured as from microphone 140 receive voice signal.After receiving voice signal, processor 110 can run sound-detection gear 132 to identify that voice is ordered It enables.For example, wearing the connection in the user contact lists of the available storage of electronic equipment 110 when receiving phonetic order It is people, just wearing electronic equipment 100 can be with the automatic dialing contact phone number.
Earphone interface is for connecting wired earphone.Earphone interface can be USB interface, is also possible to the open of 3.5mm and moves It is dynamic to wear electronic equipment platform (open mobile terminal platform, OMTP) standard interface, American cellular telecommunications work Industry association (cellular telecommunications industry association of the USA, CTIA) standard Interface.
In some embodiments, wearing electronic equipment 100 may include one or more keys 150, these keys can be with Electronic equipment is worn in control, provides the function in access head wearing electronic equipment 100 for user.The form of key 150 can be by Button, switch, dial and touch or nearly touch sensing device (such as touch sensor).Specifically, for example, user 20 can pass through The display screen 1100 for wearing electronic equipment 100 is opened by lower button.Key 190 includes power button, volume key etc..Key 190 It can be mechanical key.It is also possible to touch-key.Wearing electronic equipment 100 can receive key-press input, generates and wears The related key signals input of the user setting and function control of electronic equipment 100.
In some embodiments, wearing electronic equipment 100 may include input/output interface 160, input/output interface 160 Other devices can be connected to by suitable component and wear electronic equipment 100.Component for example may include that audio/video is inserted Hole, data connector etc..
Sound-detection gear can detecte and handle the voice signal for controlling mancarried electronic aid.
In some embodiments, wearing electronic equipment 100 may be implemented eyeball tracking (eye tracking).Specifically, Infrared equipment (such as infrared transmitter) and image capture device (such as camera) be can use to detect eyeball fixes direction.
It may include such as light emitting diode (LED) and photodetector, such as photodiode close to optical sensor.It shines Diode can be infrared light-emitting diode.It wears electronic equipment 100 and infrared light is launched outward by light emitting diode.Wear electricity Sub- equipment 100 detects the infrared external reflection light from neighbouring object using photodiode.It, can when detecting sufficient reflected light To determine that wearing electronic equipment 100 nearby has object.When detecting insufficient reflected light, wearing electronic equipment 100 can be with It determines and wears electronic equipment 100 nearby without object.Wear electronic equipment 100 can use close to optical sensor detection wear electricity The gesture operation of sub- 100 specific position of equipment, to realize gesture operation purpose associated with operational order.
Range sensor, for measuring distance.Wearing electronic equipment 100 can be by infrared or laser distance measuring.? In some embodiments, wearing electronic equipment 100 can use range sensor ranging to realize rapid focus.
Gyro sensor is determined for wearing the athletic posture of electronic equipment 100.It in some embodiments, can be with The angular speed worn electronic equipment 100 and surround three axis (that is, x, y and z-axis) is determined by gyro sensor.Gyro sensors Device can be also used for navigating, somatic sensation television game scene.
Ambient light sensor is for perceiving environmental light brightness.Wearing electronic equipment 100 can be according to the environment bright of perception Spend 1100 brightness of automatic adjusument display screen.Automatic white balance adjustment when ambient light sensor can also be used for taking pictures.
Acceleration transducer is detectable to wear the big of (the generally three axis) acceleration in all directions of electronic equipment 100 It is small.When wear electronic equipment 100 it is static when can detect that size and the direction of gravity.It can be also used for identification and wear electronic equipment Posture is applied to the application such as pedometer.
Temperature sensor is for detecting temperature.In some embodiments, electronic equipment 100 is worn to examine using temperature sensor The temperature of survey executes Temperature Treatment strategy.For example, wearing electronic equipment 100 when the temperature that temperature sensor reports is more than threshold value The performance for reducing the processor being located near temperature sensor is executed, implements Thermal protection to reduce power consumption.In other implementations In example, when temperature is lower than another threshold value, wears electronic equipment 100 and battery 190 is heated, cause to wear electronics to avoid low temperature The abnormal shutdown of equipment 100.In some other embodiment, when temperature is lower than another threshold value, electronic equipment 100 is worn to battery 190 output voltage executes boosting, to avoid shutting down extremely caused by low temperature.
Focal length detection optical sensor 131 is used to detect the focal length of the eyeball of user 200.In some embodiments, such as Fig. 1 Shown, wearing electronic equipment 100 can also include infrared light sources 1200.Focal length detection optical sensor 131 can be with it is red The focal length of the eyeball of the outer cooperation of linear light source 1200 detection user 200.
As shown in Figure 1, focal length detection optical sensor 131 and infrared light sources 1200 can be set in display screen close to eye The side of ball.The quantity that focal length detects optical sensor 131 and infrared light sources 1200 can be two, and each eyeball can be with Corresponding focal length detection optical sensor 131 and infrared light sources 1200, for detecting the focal length of ocular focusing.
It should be understood that the detection of focal length shown in Fig. 1 optical sensor 131, infrared light sources 1200 and camera 180 Wearing position on electronic equipment 100 and quantity is only used for explaining the embodiment of the present application, restriction should not be constituted.Focal length detection The quantity of optical sensor 131 and infrared light sources 1200 can also be one.One focal length detects optical sensor 131 and one The quantity of a infrared light sources 1200 can be used for detecting the focal length of an ocular focusing, or detect two ocular focusings simultaneously Focal length.
Below with reference to the concrete principle of Fig. 2 introduction measurement user eyeball focal length.Referring to Fig. 2, Fig. 2 is the embodiment of the present application A kind of schematic illustration for wearing eyeball focometry in electronic equipment of offer.As shown in Fig. 2, infrared light sources 1200, eye Ball and focal length detection optical sensor 131 form an optical system.Wherein, focal length detection optical sensor 131 may include Slit diaphragm Z and imaging sensor (such as CCD or CMOS).As shown in Fig. 2, infrared light sources 1200 can periodically be sent out Penetrate infrared light.Infrared light projects eyeball, and eyeball reflects infrared light.Eye refraction state is different, reflection light warp It crosses diaphragm Z and forms eyeball image of different shapes on imaging plane.Eyeball image can be comprising bright, dark two-part circle Hot spot.The focal length or diopter (diopter=1/ focal length) of eyeball and the bright dark range of eyeball image have corresponding relationship.Eyeball Diopter it is bigger, the ratio between the bright part and dark-part of eyeball image is bigger.According to above-mentioned principle, focal length detects optics Sensor 131 can detecte eyeball image clear zone size, and then according to the clear zone, size calculates the diopter and focal length of eyeball. Relationship between clear zone size and focal length can be determined by following data in optical system: eyes principal plane to focal length detects optics The distance A of 131 principal plane of sensor, the radius of eyes, infrared light sources center to diaphragm knife-edge eccentricity E.
As shown in Figure 1, focal length detection optical sensor 131 can be located at the edge for wearing electronic equipment 100.I.e. focal length is examined The optical axis and the optical axis where eyeball of photometry sensor 131 are not overlapped, then can detect 131 He of optical sensor according to focal length The position of eyeball compensates the relationship between clear zone size and focal length.
It should be understood that the above-mentioned principles and methods to eyeball focometry are only used for explaining the embodiment of the present application, structure is not answered At restriction.Eyeball focometry can also utilize other methods in the embodiment of the present application.
Display screen 1100 is for showing image, video etc..Display screen 1100 includes display panel.Display panel can use Liquid crystal display (liquid crystal display, LCD), Organic Light Emitting Diode (organic light-emitting Diode, OLED), active matrix organic light-emitting diode or active-matrix organic light emitting diode (active-matrix Organic light emitting diode's, AMOLED), Flexible light-emitting diodes (flex light-emitting Diode, FLED), Miniled, MicroLed, Micro-oLed, light emitting diode with quantum dots (quantum dot light Emitting diodes, QLED) etc..
To reduce the power consumption of electronic equipment and reducing the influence that image that display screen show watches user real world, Apply for that embodiment provides the display methods of a kind of electronic equipment and electronic equipment.It is described below provided by the embodiments of the present application several Example.
A kind of scene is described below: user 200 wears AR glasses, and watches the virtual graph that display screen is shown on AR glasses Picture, such as user 200 are watching video using AR glasses.Referring to Fig. 3, Fig. 3 is provided by the embodiments of the present application some man-machine The schematic diagram of interactive embodiment.
As shown in the 3a in Fig. 3, electronic equipment 100 can be arranged on video play mode.Under video play mode, Video clip is shown on the display screen 1100 of electronic equipment 100.User 200 can focus eyeball focus and determine to display screen 1100 Clearly image is seen in focus.The fixed-focus focus for example can be 2 meters in front of 200 eyeball of user of position.It should Fixed-focus focus is also possible in a distance range in front of 200 eyeball of user, such as can be apart from 200 eyeball of user The position that 2~4 meters of front.The distance range is first distance range.
User 200, which will appear, needs to watch the scene that display screen 1100 shows offscreen entity object.For example, as schemed Shown in 3b in 3, when user 200 needs to observe entity object 300, it can focus in eyeball focus to entity object 300.
As shown in the 3b in Fig. 3, when 100 mid-focal length detection sensor of electronic equipment detects the ocular focusing of user 200 Focus when exceeding the fixed-focus focus of display screen 1100, for example, detect the focal point of the ocular focusing of user 200 to away from Position at from 0.5 meter in front of 200 eyeball of user where entity object 300.Electronic equipment 100 can will be on display screen 1100 Display is closed in first area 1101.It is transparent for closing the first area 1101 of display.User 200 can pass through firstth area Entity object 300 is watched in domain 1101.
Optionally, when the processor in electronic equipment 100 detects that the eyeball of user 200 is poly- by focal length detection sensor Burnt focus is when exceeding the fixed-focus focus of display screen 1100, video figure that electronic equipment 100 can also will play on display screen As pause.Electronic equipment 100 by the video image played on display screen suspend it is also possible to suspend play the video it is corresponding Audio.
Wherein, video is played on display screen to refer to, sequentially refresh in time on display screen and show different images.Pause Playing video is to show that the image of screen display does not change over time, and the image of subsequent display is display when being suspended on display screen Image.In the embodiment of the present application, after the video image pause played on display screen, first area 1101 is closed display, and The image that display area in addition to first area 1101 is shown no longer changes, until display screen is resumed broadcasting video.
Wherein, when display screen 1100 is OLED display screen, the display for closing first area 1101 can pass through processor control Pixel power supply in OLED display panel processed in first area is closed to realize.Powering pent description about pixel can be with The specific descriptions of embodiment are shown with reference to subsequent figure 8, which is not described herein again.
In addition, the processor in electronic equipment 100 determines the focus of the ocular focusing of user 200 beyond display screen 1100 Fixed-focus focus, can pass through one of the following or multiple conditions and determine: a. processor calls the detection of focal length detection sensor Focus to the ocular focusing of user 200 is fallen in lower than first threshold in the fixed-focus focus of display screen 1100, and first threshold is for example It can be 1 second.B. processor calls focal length detection sensor to detect that the focus of the ocular focusing of user 200 exceeds display screen The frequency of 1100 fixed-focus focus is more than second threshold, and second threshold for example can be per minute twice.C. processor calls burnt Detecting that the focus of the ocular focusing of user 200 removes the time from the fixed-focus focus of display screen 1100 away from detection sensor is more than the One duration, the first duration for example can be 1 minute.
As shown in the 3c in Fig. 3, the first area 1101 on display screen 1100 is closed in the processor of electronic equipment 100 After display, when the processor in electronic equipment 100 detects that the focus of the ocular focusing of user 200 returns to display screen 1100 When fixed-focus focus, the first area 1101 that display is closed on display screen 1100 can be restored display by electronic equipment 100.Display screen 1100 when being OLED display screen, and restoring the first area 1101 on display display screen 1100, can to control OLED by processor aobvious Show the pixel service restoration on panel in first area to realize.Description can be shown with reference to Fig. 8 as described in pixel service restoration The specific descriptions of embodiment, which is not described herein again.
In the embodiment of the present application, the image that first area 1101 restores to show after display on display screen 1100 can be with figure It is identical that the image shown in first area 1101 is closed in 3c in 3.
Optionally, the place after electronic equipment 10 suspends the video image played on display screen, in electronic equipment 100 When reason device determines that the focus of the ocular focusing of user 200 is returned in the fixed-focus focus of display screen 1100, electronic equipment 100 can be extensive Video image is put in replay.
Wherein, the processor in electronic equipment 100 determines that the focus of the ocular focusing of user 200 returns to display screen 1100 In fixed-focus focus, can be determined by one of the following or multiple conditions: a. processor calls the detection of focal length detection sensor Focus to the ocular focusing of user 200 is fallen in the fixed-focus focus of display screen 1100 more than the second duration, the second duration example It such as can be 1 second;B. processor calls focal length detection sensor to detect that the focus of the ocular focusing of user 200 falls in display screen The frequency of 1100 fixed-focus focus be more than per minute twice;C. processor calls focal length detection sensor to detect user's 200 The fixed-focus near focal point that the focus of ocular focusing falls in display screen 1100 is more than 1 second;D. processor calls focal length detection sensor Detect that the focus of the ocular focusing of user 200 fell in duration other than the fixed-focus focus of display screen 1100 less than 1 second.
About above-mentioned condition c, for example, when the fixed-focus focus of display screen 1100 is 2~4 meters in front of 200 eyeball of user Position when, fixed-focus near focal point can be apart from 1~5 meter in front of user 200 eyeball.
Wherein, the second duration and the first duration can be equal, can not also wait.
In the embodiment of the present application, in the schematic diagram of the human-computer interaction shown in Fig. 3, in addition to the coke of the ocular focusing of detection user Other than point, electronic equipment 100 can also detect the depth of focus of user eyeball.Electronic equipment 100 can also detect user eyeball The visual angle of focusing, the i.e. direction of gaze of eyeball.The first area 1101 that display is closed on display screen 1100 can be eyeball visual angle Direction falls in the region on display screen 1100.The first area 1101 that display is closed on display screen 1100 can also be vertical It is incident upon the region on display screen 1100.
In the display methods of above-mentioned electronic equipment, when showing screen display image, the eye of user 200 is detected in processor When the focus that ball focuses is not in the fixed-focus focus of display screen 1100, i.e. the display of the first area of closing display screen.User can To watch entity object by transparent first area.The influence that display image watches user real world can be reduced.? When watching video, user needs to see that entity object then suspends video playing and closes the display of display screen first area, can drop Low-power consumption simultaneously improves the convenience that user watches video.In addition, being simply turned off display panel without closing screen driving IC, restoring to broadcast IC is driven without initial configuration screen when putting video, so as to improve the response speed for restoring to play.
Optionally, when 100 mid-focal length detection sensor of electronic equipment detects the focus of the ocular focusing of user 200 super Out when the fixed-focus focus of display screen 1100, the processor of electronic equipment 100 can reduce the brightness of first area or close aobvious The display of display screen.The processor of electronic equipment 100 can also move or reduce region for displaying images on display screen.Please It is the schematic diagram of the embodiment of some human-computer interactions provided by the embodiments of the present application refering to Fig. 4 a- Fig. 4 d, Fig. 4 a- Fig. 4 d.
(1) brightness of first area is reduced
As shown in fig. 4 a, when 100 mid-focal length detection sensor of electronic equipment detects the focus of the ocular focusing of user 200 When exceeding the fixed-focus focus of display screen 1100, the processor of electronic equipment 100 can reduce the brightness of first area 1101.With Family 200 can watch entity object 300 by transparent first area 1101, it is possible to reduce display image watches reality to user The influence in the world.In addition, only reducing the brightness of first area 1101, without closing screen driving IC and display panel, restoring to broadcast Without initial configuration screen driving IC and display panel when putting video, so as to improve the response speed for restoring to play.
(2) display of display screen is closed
As shown in figure Fig. 4 b, when 100 mid-focal length detection sensor of electronic equipment detects the coke of the ocular focusing of user 200 For point when exceeding the fixed-focus focus of display screen 1100, the processor of electronic equipment 100 can close the display of display screen.The display Screen can be LCD display, be also possible to OLED display screen.Display screen is transparent after closing display, and user 200 can pass through Transparent display screen watches entity object 300, it is possible to reduce display image watches user the influence of entity object 300.It will be whole A display screen closes, and can further save power consumption.
(3) region of image is shown on moving display screen
As illustrated in fig. 4 c, processor can call the part display area 1102 on display screen 1100 to be shown, display Display is closed in region other than the region 1102 of screen display image, is pellucidity.It is passed when 100 mid-focal length of electronic equipment detects Sensor detect the focus of the ocular focusing of user 200 when exceeding the fixed-focus focus of display screen 1100, the place of electronic equipment 100 The region for showing image can be switched to region 1103 from region 1102 by reason device.As illustrated in fig. 4 c, image can will be shown The region that ocular focusing visual angle projects on a display screen is avoided in region 1103, is allow other than region of the eyeball by showing image Display screen area watch entity object 300.Optionally, processor can switch the region of display image into deviation display screen Transparent region is reserved for user eyeball to watch entity object 300 in the position of the heart.
Detect that the focus of the ocular focusing of user 200 returns to determining for display screen 1100 in the processor of electronic equipment 100 When focus, the region for showing image can be switched to the central area of display screen by the processor of electronic equipment 100, or be made Image is shown with entire display screen area.
The region for showing screen display image is moved to other than the region that ocular focusing visual angle projects on a display screen Region, it is possible to reduce display image watches user the influence of entity object 300, and improves response when display screen restores display Speed.
(4) region that is mobile and reducing display screen display image
As shown in figure 4d, when 100 mid-focal length detection sensor of electronic equipment detects the focus of the ocular focusing of user 200 When exceeding the fixed-focus focus of display screen 1100, the processor of electronic equipment 100 can will show the region of image from region 1104 are switched to region 1105.And the pixel quantity for switching rear region 1105 is less than region 1104, it is reserved more for user eyeball Big display screen transparent region.As shown in figure 4d, ocular focusing visual angle can be avoided on a display screen in the region for showing image The region of projection allows the display screen area other than region 1105 of the eyeball by showing image to watch entity object 300.
Detect that the focus of the ocular focusing of user 200 returns to determining for display screen 1100 in the processor of electronic equipment 100 When focus, the region for showing image can be switched to the central area of display screen by the processor of electronic equipment 100, and be expanded It shows the region of image, or shows image using entire display screen area.
In the embodiment of the present application, the direction for showing that the region of screen display image is mobile or reducing can be according to eyeball tracking Obtained visual angle determines.After the region of display screen display image is moved or reduced, eyeball can be by showing screen display Display screen area other than the region of image watches entity object 300.
It is the region for showing screen display image is mobile and narrow down to the region that ocular focusing visual angle projects on a display screen Region in addition, it is possible to reduce display image watches user the influence of entity object 300, since display screen is not closed, Response speed when display screen restores display can be improved.
Optionally, electronic equipment 100 can restore display screen display image in response to the operation of user.The operation of user It can be button operation, gesture operation, voice signal, can also be other operations.Please refer to Fig. 4 e and Fig. 4 f, Fig. 4 e and Fig. 4 f It is a kind of schematic diagram of the embodiment of human-computer interaction respectively.
As shown in fig 4e, first area 1101 closes display or reduces brightness on display screen 1100, or closes display In the case where 1100 display of screen, electronic equipment 100 detects that the pushing operation of the second key can then restore first area 1101 Or display screen display image.
Optionally, as shown in fig 4e, first area 1101 closes display or reduces brightness, Huo Zheguan on display screen 1100 In the case where closing the display of display screen 1100, processor can also be that the detection of transfer environment optical sensor is in one's hands in electronic equipment 100 The light reflected when referring to close can then restore first area 1101 or display screen display image.
Optionally, as shown in fig 4e, first area 1101 closes display or reduces brightness, Huo Zheguan on display screen 1100 Processor, which can also be, in the case where closing the display of display screen 1100, in electronic equipment 100 calls camera detection to specific hand Gesture, i.e. second gesture can then restore first area 1101 or display screen display image.Processor can call image to know The certain gestures (second gesture) of other algorithm identification camera acquisition.The second gesture for example can be one in following gesture Or multiple: scissors hand, fist fire finger, than OK gesture etc..
Optionally, first area 1101 closes display or reduces brightness on display screen 1100, or closes display screen Processor, which can be, in the case where 1100 displays, in electronic equipment 100 restores the firstth area when detecting following one or more Domain 1101 or display screen display image: a detects user's operation;B detects that the focus of the ocular focusing of user is being shown In the fixed-focus focus of screen 1100.
As shown in fig. 4f, first area 1101 closes display or reduces brightness on display screen 1100, or closes display Screen 1100 display in the case where, when electronic equipment 100 detects the second voice signal, then can restore first area 1101 or Show screen display image.When processor in electronic equipment 100 gets the second voice signal by sound-detection gear, then locate Reason device can restore first area 1101 or display screen display image.It can store the second voice letter in electronic equipment 100 Number execute restore display instruction between mapping relations.
It should be understood that being not limited to the operation of key, gesture and voice, electronic equipment can also detect other signals, example Such as display screen touch control operation and eeg signal, Lai Huifu display screen is shown.
Optionally, it closes after display screen show, in the focus for detecting user eyeball focusing (example within a certain period of time In 1 minute) frequently variation, such as focal length variations frequency, greater than 1 minute 5 times, wearing electronic equipment can restore to show screen display Show, and is shown with low-light level.Such as it can be to close 30% display for showing preceding brightness.The image that low-light level is shown can be for Family ocular focusing.It, can be by the bright of display screen when detecting that user eyeball focusing focus returns in the fixed-focus focus of display screen Degree is transferred to normal brightness, such as is transferred to the brightness before closing display.In the certain time that display screen is shown with low-light level, such as 20 Second, user eyeball focusing focus is detected not in the fixed-focus focus of display screen, is closed display screen and is shown.Or display screen with The certain time that low-light level is shown, such as 20 seconds, it detects that user eyeball focusing focus change frequency is still larger, closes display Screen display.
Optionally, it closes after display screen show, wearing electronic equipment can be at regular intervals, such as 2 minutes, weighs New display screen of opening focuses again for user eyeball.If display screen is still not detected in 5 seconds after opening display screen to be focused, Then close display screen.When reopening display screen, the brightness of display screen can be low-light level and show, such as preceding bright to close display 30% display of degree.When detecting that user eyeball focusing focus returns in the fixed-focus focus of display screen, just by display screen Normal brightness is transferred in brightness, such as is transferred to the brightness before closing display.
Optionally, the display screen that can close in response to the operation of user of electronic equipment 100 shows or moves, reduces Show the region of screen display image.The operation of user is also possible to button operation, gesture operation, voice signal, can also be Other operations.Please refer to the schematic diagram that Fig. 4 g and Fig. 4 h, Fig. 4 g and Fig. 4 h are a kind of embodiment of human-computer interaction respectively.
As shown in figure 4g, in the case where showing image on display screen 1100, electronic equipment 100 detects the first key Pushing operation can then execute any one of following: closing display screen 1100 and show;First area is aobvious on closing display screen Show;The region of image is shown on moving display screen;Move and reduce the region of display screen display image.
Optionally, as shown in figure 4g, in the case where showing image on display screen 1100, processor in electronic equipment 100 Transfer environment optical sensor detect finger close to when the light that reflects, then processor can execute any one of following: close Close the display of display screen 1100;Close the display of first area on display screen;The region of image is shown on moving display screen;Movement is simultaneously Reduce the region of display screen display image.
Optionally, as shown in figure 4g, in the case where showing image on display screen 1100, processor in electronic equipment 100 When may call upon the specific gesture of camera detection, such as first gesture, then processor can execute any one of following: Display screen 1100 is closed to show;Close the display of first area on display screen;The region of image is shown on moving display screen;It is mobile And reduce the region of display screen display image.The first gesture for example can be one or more of following gesture: scissors Hand, fist fire finger, than OK gesture etc..
Optionally, as shown in figure 4g, in the case where showing image on display screen 1100, processor in electronic equipment 100 Can be i.e. closing display screen when detecting following one or more to show: a detects user's operation;B detects the eye of user The focus that ball focuses is other than the fixed-focus focus of display screen 1100.
As shown in figure 4h, in the case where showing image on display screen 1100, electronic equipment 100 detects that the first voice is believed Number when, then can execute any one of following: close display screen 1100 show;Close the display of first area on display screen; The region of image is shown on moving display screen;Move and reduce the region of display screen display image.Place in electronic equipment 100 Reason device, which can be, detects the first voice signal by sound-detection gear.First voice signal can be the special sound of systemic presupposition Signal.It can store the first voice signal in electronic equipment 100 and execute the mapping closed between the instruction that display screen is shown and close System.
Restored using the operation of user display screen show image, closed using the operation of user display screen show or Region that is mobile, reducing display screen display image, it is possible to reduce the case where maloperation, improve control display screen and show image Accuracy.
In the embodiment of the present application, it can store the mapping relations of user's operation and instruction in electronic equipment 100.Instruction can be with It include: to restore display screen to show image;Display screen is closed to show;Close the display of first area on display screen;Moving display screen The region of upper display image;Move and reduce the region of display screen display image.The mapping relations can be systemic presupposition, It is also possible in response to the customized setting of user's operation.A kind of customized setting user's operation of user and instruction is given below The example of mapping relations.
Fig. 4 i is please referred to, Fig. 4 i is a kind of schematic diagram of the embodiment of human-computer interaction.As shown in figure 4i, user can be in head The option that " the first key associated display screen " is opened in the set interface of display equipment is worn, then wearing display equipment can be in response to The opening operation, establish first by key pressing and display switch mapping relations.At opening " the first key associated display screen " Option after, electronic equipment can respond the pushing operation of the first key, close the display screen 1100 lighted or either on or off Display screen 1100.Similar, as shown in figure 4i, user can open " OK gesture in the set interface for wearing display equipment Be associated with display screen " option, then OK gesture and display switch can be established in response to the opening operation by wearing display equipment Mapping relations.After the option of opening " OK gesture be associated with display screen ", OK hand that the camera detection that electronic equipment can respond arrives Gesture closes the display screen 1100 of the display screen 1100 lighted or either on or off.
Wherein, electronic equipment detects that user opens the option of " the first key associated display screen ", can be electronic equipment Processor turns on the switch place using the option that camera detection to finger is placed on " the first key associated display screen ".
It should be understood that the example of the mapping relations of customized setting user's operation and instruction shown in Fig. 4 i is only used for solving The embodiment of the present application is released, restriction should not be constituted.Set interface can also include other user-defined user operations pass corresponding with instruction It is option, the embodiment of the present application is not construed as limiting this.
Optionally, as shown in figure 4j, it after display screen 1100 closes display, can still be shown on display screen 1100 Label 1106.The label 1106 for example can be round bright spot.The label 1106 may be displayed on the edge of display screen 1100, example Such as the upper left corner or the upper right corner." it can see with display reminding information on display screen 1100 and restore display here ".As shown in figure 4j, work as eye When ball is focused on the label 1106, display screen 1100 can be reopened by wearing electronic equipment.
Optionally, Fig. 4 k is please referred to, Fig. 4 k is the schematic diagram of the embodiment of a human-computer interaction provided by the embodiments of the present application. As shown in fig. 4k, after display screen 1100 closes display, label 1106 can be still shown on display screen 1100.The label 1106 for example can be triangle bright spot.The label 1106 may be displayed on the edge of display screen 1100, such as the upper left corner or the right side Upper angle." it can see with display reminding information on display screen 1100 and restore display here ".As shown in fig. 4k, when ocular focusing is in the mark When in note 1106, the prompt page can be opened by wearing electronic equipment.It can prompt the user whether to open display screen on the prompt page. When wearing on the position that electronic equipment is placed on "Yes" to finger by camera detection, i.e., restore the display of display screen again.
Optionally, in the embodiment of the present application, eyeball particular state can detected by camera by wearing electronic equipment Under, for example, eyeball turn over, under turn over or rapid eye movements, then display can be closed display screen or open aobvious by wearing electronic equipment Show.
Under different scenes, the response speed that user restores display screen or closes requires difference.For example, in viewing video screen module Under formula, user is to the more demanding of response speed.And under the scene navigated using AR glasses, user is without moment concern display The requirement of the navigation information of screen display, the response speed that user restores display screen or closes is lower, can close display screen Backlight, display panel and driving IC, further to save power consumption.In the embodiment of the present application, electronic equipment 100 can be according to not The requirement for the response speed restored to display screen or closed under same scene, is arranged the scheme that different closing display screens is shown. User to the backlight that display screen under the more demanding scene (such as viewing video scene) of response speed, can be simply turned off or Person's display panel.It, can be by the back of display screen under the lower scene of requirement of the user to response speed (such as navigation scenarios) Light, display panel and driving IC are turned off, further to save power consumption.About backlight, display panel and the drive for closing display screen Specifically describing for dynamic IC can be with reference to the example shown in Fig. 9 a and Fig. 9 b, and which is not described herein again.
About navigation scenarios, referring to Fig. 5, Fig. 5 is some human-computer interactions under navigation scenarios provided by the embodiments of the present application Schematic diagram.As shown in the 5a in Fig. 5, navigation information can be shown on display screen 1100, arrived when user 200 focuses eyeball focus When fixed-focus focus (such as in front of eyeball at 2 meters) of display screen, it is clear that the navigation information that display screen is shown.When with Navigation information is finished watching at family, when needing to see real world, as shown in the 5b in Fig. 5, wears the focal length detection optics in display equipment Sensor can detecte in front of position of the focal length of eyeball other than display screen fixed-focus focus, such as eyeball at 10 meters.It wears Show that display screen 1100 can be closed display by processor in equipment.Specifically, can be by the backlight of display screen 1100, display surface Plate and driving IC are turned off.Display screen 1100 after closing be it is transparent, user 200 can watch reality by display screen 1100 Body object.When user 200 needs to watch the navigation information of display screen again, as shown in the 5c in Fig. 5, electronic equipment can be rung Image should be shown to restore display screen in the gesture of user.The description of gesture about user can retouching with reference to Fig. 4 e and Fig. 4 g It states, which is not described herein again.As shown in the 5d in Fig. 5, electronic equipment is in the gesture for detecting user, it can restarting is aobvious Display screen shows navigation information.
It should be understood that processor can be i.e. recovery display when detecting following one or more in electronic equipment 100 Screen display image: a detects user gesture;B detects that the focus of the ocular focusing of user is burnt in the fixed-focus of display screen 1100 Point on.
Optionally, wearing may include velocity sensor in electronic equipment, carry out the movement speed of detection device.Wearing electricity Sub- equipment detects that movement speed is more than threshold speed by velocity sensor, such as more than 50,000 ms/h, then wears electronics Equipment can close display screen and show, the navigation information for showing screen display can also be moved to the side of display screen, such as scheme Shown in 4c, it can also move and reduce display screen display picture position, as shown in figure 4d.Detecting the shifting for wearing electronic equipment When dynamic speed is excessively high, display screen is closed.The too fast display screen of user moving speed under navigation scenarios can be reduced and show image shadow The case where ringing user security, provides convenience for user.
Optionally, under navigation scenarios, current track route is determined according to equipment position location if wearing electronic equipment The direction of motion within the scope of distance threshold that without crossing, then wearing electronic equipment can not close in crossing, such as 1 km Display screen is shown.Referring to Fig. 6, Fig. 6 is the schematic diagram of other human-computer interactions under navigation scenarios provided by the embodiments of the present application. As shown in the 6a in Fig. 6, detect that just having crossing on current moving direction after 5 kilometers occurs when wearing electronic equipment, It then determines in the direction of motion of current track route in 1 km without crossing, then as shown in the 6b in Fig. 6, wears electronic equipment The display of display screen 1100 can be closed.After display screen 1100 is closed, navigation and positioning system still work.When wearing electronic equipment Determine that as shown in the 6c in Fig. 6, then wearing electronic equipment can be again when there is crossing in 1 km according to equipment position location Display screen 1100 is opened, to show navigation information.Under navigation scenarios, not when the close crossing for needing user to pay attention to, close It closes display screen to show, can save and wear powder consumption of electronic equipment, and reduce display screen and show that image blocks user's sight, be User provides convenience.
The relevant image of entity object in electronic equipment visual angle can be shown on the display screen of electronic equipment.Wherein, electronics Entity object can use camera collection image and determine in equipment visual angle.For example, camera collects the image of certain part clothes, Then processor determines that picture material is " clothes " using image recognition in electronic equipment, and determine the brand of the clothes, price, The information such as Shopping directery, and these information are shown on a display screen.
The image shown on a display screen is electronics when being directed to the multiple entity objects for successively entering electronic equipment visual angle Equipment can count to obtain the state that user eyeball in certain time period continuously watches the image of display screen attentively, true according to statistical result It is fixed whether to close display screen.Electronic equipment is closed when detecting the image of entity object 1 on a display screen not by ocular focusing Display screen is shown.When there is entity object 2 in electronic equipment visual angle later, need to reopen display screen to show entity object 2 image on a display screen.If detect the image of entity object 2 on a display screen not by ocular focusing, it is again switched off aobvious Display screen is shown.
It is closed open number repeatedly to reduce display screen, electronic equipment can detect that continuous N is (whole greater than 1 Number) image of a entity object on a display screen not by ocular focusing when, close display panel and driving IC.It is detecting later To it is following one or more when just open display screen and driving IC, to show the figure of entity object in electronic equipment current visual angle Picture: the focal point of a. eyeball is in display screen fixed-focus focus.B. in response to a certain user's operation.C. detect that successive M (is greater than 1 integer) a entity object enters in electronic equipment visual angle.
Electronic equipment can detect the image quilt of continuous S (greater than 1 integer) a entity object on a display screen When ocular focusing, relax the condition that display screen is shown of closing.Specifically, can reduce first threshold value in condition, increase the The value of two threshold values and the first duration.It is closed open number repeatedly so as to reduce display screen, extends the display screen service life And it reduces display screen and is closed the stimulation opened to eyeball repeatedly.
For example, detecting animal 1 in the visual angle of AR glasses in the case where wearing the scene of the user of AR glasses at the zoo Image when, AR glasses determined using image recognition picture material be " animal 1 ".AR glasses can be determined according to " animal 1 " Display screen shows that content is the associated image of animal 1.The display screen display of the AR glasses associated image of animal 1, such as can With the web page interlinkage comprising animal 1, distribution ground, protection level, related animation video etc..Animal 1 is closed on detecting display screen The image of connection by after ocular focusing, does not close display screen.When then detecting the image of animal 2 in the visual angle of AR glasses, AR Mirror opens display screen and shows the associated image of animal 2, and the associated image of animal 2 is not yet by eyeball on detecting display screen After focusing, display screen is closed.Similar, the associated image of animal 3 by after ocular focusing, does not close display screen yet.Then AR glasses It can just open display screen with continuously off display screen until detecting eyeball focal point in display screen fixed-focus focus and show Image.Or image is shown until detecting that user's operation just opens display screen.Or until detecting successive 4 entity objects Display screen is just opened in into electronic equipment visual angle shows image.
For another example display screen shows navigation information under navigation scenarios.When AR Glasses detection does not exist to ocular focusing focus When in display screen fixed-focus focus, the backlight of LCD display can be closed.When AR Glasses detection is to continuing five minutes, eyeball is poly- Focus can then close the display panel of LCD display still without returning in display screen fixed-focus focus.When AR Glasses detection To continuing ten minutes, ocular focusing focus, then can be by LCD display again without returning in LCD display fixed-focus focus Driving IC is also switched off.
Wearing electronic equipment it is poly- to the corresponding image history of different entities object can also to obtain user by machine learning Burnt number or probability.Wearing electronic equipment can be aobvious according to the history of every class entity object focusing number or determine the probability closing The trigger condition of display screen.History focuses number or probability is bigger, and the looser closing display screen of such entity object can be set Trigger condition.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Different entity objects for example may include: people, automobile, animal, building etc..
For example, wearing electronic equipment by machine learning, obtain following result: occurring people in camera visual angle, passes through When display is people's associated image on image recognition display screen, image on display screen is 85% by the probability of ocular focusing.And There is automobile in camera visual angle, when by being shown as the associated image of automobile on image recognition display screen, on display screen Image is 50% by the probability of ocular focusing.It is built in camera visual angle, by being shown as on image recognition display screen When building associated image, image on display screen is 10% by the probability of ocular focusing.It can then go out in camera visual angle When existing people, the fixed-focus focus of display screen is less than 1 second by ocular focusing, and electronic equipment determines that the image on display screen is not gathered by eyeball It is burnt.When there is automobile in camera visual angle, the fixed-focus focus of display screen is less than 2 seconds by ocular focusing, and electronic equipment determines aobvious Image in display screen is not by ocular focusing.When building in camera visual angle, the fixed-focus focus of display screen is by ocular focusing Less than 3 seconds, electronic equipment just determined the image on display screen not by ocular focusing.
Above-mentioned method determines that the display screen of user preference shows content using machine learning, then according to user preference Display screen show curriculum offering close display screen condition.While saving power consumption, more accurately whether user can be determined It needs to close display screen.
Wearing electronic equipment can obtain what user focused image history corresponding under different scenes by machine learning Times or frequency.The determining closing of times or frequency can be focused according to the history of entity object under each scene by wearing electronic equipment The trigger condition of display screen.History focusing times or frequency is bigger, and closing display screen looser under the scene can be set Trigger condition.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Different scenes for example may include: virtual fitting scene, scenic spots and historical sites scene, navigation scenarios etc..
For example, electronic equipment passes through machine learning, following result is obtained: the figure under virtual fitting scene, on display screen As the probability being focused is 95%.And under navigation scenarios, the probability that the image on display screen is focused is 48%.In name Shenggu Under mark scene, the probability that the image on display screen is focused is 5%.Then electronics processors, which detect in camera visual angle, is Virtual fitting scene, the fixed-focus focus of display screen were focused less than 1 second, and electronic equipment determines that the image on display screen is not gathered It is burnt.When being navigation scenarios in camera visual angle, the fixed-focus focus of display screen was focused less than 2 seconds, and electronic equipment determines display Image on screen is not focused.When being scenic spots and historical sites scene in camera visual angle, the fixed-focus focus of display screen is focused less than 3 Second, electronic equipment just determines that the image on display screen is not focused.
In the embodiment of the present application, for the user of farsightedness or myopia, wearing can be corrected on electronic equipment Eyeball degree.Specifically, the slot of additional eyeglass can be set between display screen and eyeball, which can be fixed for correcting The concave lens or hyperopic lens of eyesight.
In the embodiment of the present application, image is shown except through display screen, to wear electronic equipment may include projection system, The projection system can replace display screen, and clearly image is directly generated in the user visual field.The projection system for example can be Holographical wave guide display instrument projects visible hologram to eyeball using holographic technique.
Under the scene for projecting image to user eyeball using projection system, in the embodiment of the present application, display screen display is closed The closing projection system can be referred to by showing.After the projection system is closed, user eyeball can not see the figure of projection system projection Picture, it can be seen that the entity object of real world.The first area for closing display screen, can refer to optical projection system in user eyeball In position corresponding with first area do not project image.Brightness of display screen is reduced, can refer to that optical projection system is reduced in user's eye The brightness of image is projected in ball.The region of image is shown in moving display screen, and the image of mobile projection can be referred in user's eye Position in ball.The region for showing image in display screen is reduced, can refer to that the image for reducing projection occupies in user eyeball Region.
In the embodiment of the present application, electronic equipment may include both of which: under the first mode, electronic equipment can basis Ocular focusing focus closes or opens display screen, specifically the interactive mode as shown in Fig. 3, Fig. 4 a- Fig. 4 k, Fig. 5 and Fig. 6.Second Under kind mode, the display screen of electronic equipment is not by the control of ocular focusing focus.Electronic equipment can be in response to the operation of user Determine one mode.Specifically, referring to Fig. 7, Fig. 7 is the schematic diagram of human-computer interaction provided by the embodiments of the present application.Such as Fig. 7 institute Show, user can open the option of " the bright screen of eye tracking go out screen " in the set interface for wearing display equipment, then wear display Equipment can be in response to the opening operation, in the first mode by electronic equipment setting.In opening, " the bright screen of eye tracking goes out After the option of screen ", electronic equipment can close or open display screen according to ocular focusing focus and show, specifically execute Fig. 3, figure The mode for opening or closing display screen shown in 4a- Fig. 4 k, Fig. 5 and Fig. 6.
Referring to Fig. 8, Fig. 8 is a kind of schematic diagram of human-computer interaction provided by the embodiments of the present application.As shown in figure 8, wearing Electronic equipment 100 can establish connection with other electronic equipments 400, such as mobile phone, plate etc..The connection can be bluetooth company Connect, WiFi connection or other wireless connection.The connection can also be that wired connection, the embodiment of the present application are not construed as limiting this.
The connection interaction data established can be passed through with electronic equipment 400 by wearing electronic equipment 100.Electronic equipment 400 is also It can receive user's operation, such as touch operation, and generate to be arranged to instruct to be sent to and wear electronic equipment 100.Specifically, as schemed Shown in 8, after wearing electronic equipment 100 and establishing connection with electronic equipment 400, electronic equipment 400 can receive the touch of user Operation, and function will be used to open: it is sent to according to the instruction of eyeball focal point control display screen and wears electronic equipment 100.It wears Electronic equipment 100, which executes, opens the function: according to eyeball focal point control display screen.
It should be understood that the citing that interacts worn between electronic equipment 100 and electronic equipment 400 shown in Fig. 8 is only used for It explains the embodiment of the present application, restriction should not be constituted.Other can also be arranged using electronic equipment 400 by wearing electronic equipment 100 Parameter, or other interactive data, such as the set interface in Fig. 4 i.
In the embodiment of the present application, display screen 1100 can be LCD display, be also possible to OLED display screen.Fig. 9 a and figure 9b is a kind of structural schematic diagram of display screen provided by the embodiments of the present application respectively.Fig. 9 a is the structural schematic diagram of LCD, and Fig. 9 b is The structural schematic diagram of OLED.
As illustrated in fig. 9, LCD display includes backlight, display panel (panel), backlight drive circuit (integrated Circuit, IC), and screen driving IC.Wherein, display panel is for providing the rotation direction of different liquid crystal molecules, to reach Achieve the purpose that whether show whether each pixel polarised light is emitted.
Display panel includes liquid crystal cell, polarizer etc..It include liquid crystal molecule, the different steering pair of liquid crystal molecule in liquid crystal cell The polarization of light is different, to realize the light and shade state of pixel.The corresponding liquid crystal cell of each pixel of display panel drives IC in screen Control under realize that different liquid crystal turns to, so that light be made to penetrate or be not through display panel.Polarizer is for providing one Fixed polarization direction only passes through for the light of polarization direction in the specified direction.The upper and lower surface of liquid crystal cell can be respectively set Polarizer, to realize that the light of polarization direction in particular directions passes through display panel.The upper and lower surface of liquid crystal cell may include Close to backlight and close to eyeball while.
Since liquid crystal will not shine in display panel, backlight is needed to provide light source for display screen.Backlight can be luminous two Pole pipe (light emitting diode, LED) is realized.For the color effect for realizing display screen, backlight can be with red green and blue (red green blue, RGB) three colors.Specifically, each pixel may include the corresponding LED of three colors.Pixel it is red Turquoise three color can also be realized by colored filter and white light LEDs.
Backlight drive IC and backlight constitute circuit, and backlight drive IC provides light source for controlling backlight for display screen.Backlight Driving IC can be connect with processor interface, be controlled by processor to adjust the size of the electric current of backlight, to realize different Backlight illumination.The size of current that processor control backlight drive IC inputs to backlight, which can be, corresponds to backlight control skill using content Art (content adaptive brightness control, CABC) or environment light detect corresponding backlight control techniques (light adaptive brightness control, LABC).
Screen driving IC can receive the display data of processor interface transmission, to drive display panel and backlight.These are aobvious Registration is according to brightness data and color data comprising each pixel of display panel.Screen driving IC passes through display number using brightness data There is provided each pixel corresponding brightness according to transmission channel driving display panel.Screen driving IC can also be connect by RGB backlight control Mouth is connect with backlight drive IC.Screen driving IC passes through RGB backlight control interface driver backlight drive IC and back using color data Light provides each pixel corresponding color.
As illustrated in fig. 9, LCD display can also include load switch 1.The load switch 1 can be in the control of processor One or more operations below lower execution: control backlight drive IC closes or restores backlight power supply, control is closed or restores display Backlight drive IC power supply is closed or is restored in screen power supply, control, control is closed or restores screen driving IC power supply.
As shown in figure 9b, OLED display screen includes OLED display panel (panel) and screen driving IC.Wherein, OLED is shown Panel includes the display unit of multiple array arrangements.Each display unit can shine under the driving of screen driving IC.Processor The size of the electric current of OLED display panel can be conveyed to by Interface Controller, to realize different backlight illuminations.Processor The size of current that control inputs to OLED display panel, which can be, utilizes CABC or LABC.
Screen driving IC can receive the display data of processor interface transmission, to drive OLED display panel.These displays Data include the brightness data and color data of each pixel of OLED display panel.Screen driving IC utilizes brightness data and number of colors The corresponding brightness of each pixel and color are provided according to driving OLED display panel.
As shown in figure 9b, OLED display screen can also include load switch 2.The load switch 2 can be in the control of processor System is lower to execute following one or more operations: OLED display panel power supply is closed or restored in control, control is closed or restores screen drives Dynamic IC power supply.
In the embodiment of the present application, processor can be the processor 110 in electronic equipment 100 described by Fig. 1.It is above-mentioned right LCD display and the structure example of OLED display screen are only used for explaining the embodiment of the present application, should not constitute restriction.LCD display It may include more or fewer parts with OLED display screen, also may include different part arrangements.
Display screen is described below and closes the implementation of display and the realization of display screen fixed-focus.
(1) display screen is closed to show
In the embodiment of the present application, for LCD display, closing display screen, which is shown, may include following any feelings Condition: the backlight power supply of display screen is 1. closed.2. closing backlight power supply and the display panel power supply of display screen.3. closing display screen back Optical functions, display panel, screen driving IC and backlight drive IC.
When controlling backlight drive IC and closing backlight power supply, processor still passes through screen driving IC and backlight drive IC to aobvious Show that panel sends display data, but since backlight is closed, display screen can not show image.Since display data are sent always To display panel, it is fast to restore backlight power supply resume speed again.
When control close display panel power supply when, display panel can not receiving screen driving IC send display data, display Panel initial-configuration data is lost.Again restore to need to carry out each pixel initial configuration (such as one when display screen power supply A little initial potential assignment etc.).Therefore it is slower to restore the speed that display screen is shown, display panel power consumption can be saved.Right In the case that the response speed of display screen recovery display is of less demanding, power consumption can be further saved into display panel closing.
After backlight drive IC is closed in control, backlight drive IC can not receive the backlight data of processor transmission.Backlight is driven Dynamic IC also can not receiving screen driving IC send color data.It is similar when restoring backlight drive IC power supply again to need to backlight IC is driven to carry out initial configuration.After screen driving IC is closed in control, screen driving IC can not receive the display number of processor transmission According to, also can not to backlight drive IC send color data.Again similar when recovery screen driving IC power supply to be also required to screen driving IC carries out initial configuration.Therefore it is slow to restore the speed that display screen is shown again.
In the embodiment of the present application, for OLED display screen, closing display screen, which is shown, may include following any feelings Condition: OLED display panel power supply is 1. closed.2. closing OLED display panel power supply and screen driving IC power supply.
Wherein, when processor, which controls, closes OLED display panel power supply, processor still sends display to screen driving IC Data, but since OLED display panel power supply is closed, OLED display screen can not show image.When restoring display screen power supply again It needs to carry out initial configuration (such as some initial potential assignment etc.) to each pixel.Since display data are sent to always It is fast to restore OLED display panel service restoration speed again for OLED display panel.
After screen driving IC is closed in control, screen driving IC can not receive the display data of processor transmission, also without normal direction OLED display panel sends display data.Again restore to shield similar when driving IC power supply be also required to screen driving IC progress initially Change configuration.Again it is slower to restore screen driving IC service restoration speed.
It is closed in addition, processor can control the power supply of the pixel in OLED display panel partial region.The then part area Image can not be shown in domain.It may be implemented to close the subregional display in display screen top.
(2) display screen fixed-focus
Show that the image of screen display can be in user eyeball at virtual image.The optics to display screen can be passed through Design by the setting of the virtual image corresponding focus in front of user eyeball in certain distance, such as 2 meters or 4 meters.It should Distance can also be one apart from section, such as 2-4 meters.User eyeball is apparently imaged in the image then shown on a display screen In front of the user eyeball in fixed-focus focus.
Based on some embodiments shown in earlier figures 1- Fig. 3, Fig. 4 a- Fig. 4 k, figure 5-8, Fig. 9 a and Fig. 9 b, it is described below Method provided by the present application according to eyeball focal point control display screen.
Show referring to the process that Figure 10, Figure 10 are the methods provided in an embodiment of the present invention according to eyeball focal point control display screen It is intended to.As shown in Figure 10, this method is applied to wear electronic equipment, and it includes display screen that this, which wears electronic equipment, and display screen is closing It is transparent when closing display.This, which is worn electronic equipment and can be, shown in fig. 1 wears electronic equipment.This method comprises:
S101, image is shown on a display screen.
Wherein, the focusing focus of user eyeball is within the scope of first distance.First distance range can be with reference to the 3a in Fig. 3 Shown in fixed-focus focus associated description, can be in a distance range in front of 200 eyeball of user, such as can be 2~4 meters of the position in front of 200 eyeball of user.
In the embodiment of the present application, display screen can be substituted with the projection system in head of a quilt wearing electronic equipment, the shape in eyeball At image.
S102, detecting that duration of the user eyeball focusing focus not within the scope of first distance be greater than or equal to the When one duration, display screen is closed.
Wherein, the first duration can be the associated description for exceeding fixed-focus focus with reference to shown in the 3b in Fig. 3, such as can be with It is 1 minute.
In some possible embodiments, after step S102, detect user eyeball focusing focus fall in first away from When being greater than or equal to the second duration from the duration in range, display screen is opened.
Wherein, the second duration can be the associated description that fixed-focus focus is returned to reference to shown in the 3c in Fig. 3, such as can be with It is 1 second.
In some possible embodiments, display screen is liquid crystal display, when playing video on a display screen, closes display Screen, comprising: close the backlight of display screen.
In other possible embodiments, display screen is liquid crystal display, when showing navigation information on a display screen, is closed Close the display screen, comprising: close the backlight of the display screen and following one or more: the driving electricity of display panel, backlight The driving circuit on road and the display screen.
The description of driving circuit about liquid crystal display, display panel, the driving circuit of backlight and the display screen can With the specific descriptions of the LCD display with reference to shown in Fig. 9 a, which is not described herein again.
In some possible embodiments, the display screen is organic light-emitting diode (OLED) display screen, is played on a display screen When video, the display screen is closed, comprising: close the display panel of display screen.
In other possible embodiments, display screen is organic light-emitting diode (OLED) display screen, and display is led on a display screen When information of navigating, display screen is closed, comprising: close the driving circuit of display screen and the display panel of display screen.
Description can be shown with reference to OLED shown in Fig. 9 b as described in OLED display screen, OLED display panel and driving circuit The specific descriptions of screen, which is not described herein again.
In some possible embodiments, when detecting any one of following or multinomial, closes display screen: detecting user Duration of the ocular focusing focus not within the scope of first distance is greater than or equal to the first duration.Detect the first key by Lower operation.Detect first gesture.Detect the first voice signal.
Wherein, the first key can be with reference to the associated description of the first key in Fig. 4 g.First gesture can refer to Fig. 4 g In first gesture associated description, first gesture for example can be one or more of following gesture: scissors hand, fist, Fire finger, than OK gesture etc..First voice signal can be with reference to the associated description of the first voice signal in Fig. 4 h.
Further, it the first key and closes the corresponding relationship of instruction of display screen and can be systemic presupposition, it can also be with It is in response to the operation setting in user.With specific reference to Fig. 4 i associated description.Set interface shown in Fig. 4 i be also possible to It wears and shows on the electronic equipments such as mobile phone of electronic equipment connection.
In some possible embodiments, when detecting any one of following or multinomial, opens display screen: detecting user Ocular focusing focus falls in the duration within the scope of first distance more than or equal to the second duration.Detect the second key by Lower operation.Detect second gesture.Detect the second voice signal.
Wherein, the second key can be with reference to the associated description of the second key in Fig. 4 g.First key and the second key can With identical, can also be different.Second gesture can be with reference to the associated description of the second gesture in Fig. 4 e.First gesture and second-hand Gesture may be the same or different.
Further, it the second key and opens the corresponding relationship of instruction of display screen and can be systemic presupposition, it can also be with It is in response to the operation setting in user.Fig. 4 i associated description can specifically be referred to.Set interface shown in Fig. 4 i is also possible to It is showing on the electronic equipments such as mobile phone that electronic equipment is connect with wearing.
In above-mentioned steps S101-S102, when the focus that user eyeball focuses is not in the fixed-focus focus of display screen, i.e., Close display screen.User can watch entity object by transparent display screen.Display image can be reduced to watch now user The influence in the real world.In addition the power consumption of display screen can be reduced.When the focus that user eyeball focuses is in the fixed-focus focus of display screen When interior, that is, open display screen.The operation ease for wearing electronic equipment can be improved.
When watching video, user needs to see that entity object then suspends video playing and closes the aobvious of display screen first area Show, power consumption can be reduced and improves the convenience that user watches video.In addition, being simply turned off display panel without closing screen driving IC drives IC without initial configuration screen when restoring to play video, so as to improve the response speed for restoring to play.
User's operation can also be display screen touch control operation and eeg signal.Camera shooting can also be passed through by wearing electronic equipment Head in the case where detecting eyeball particular state, such as eyeball turn over, under turn over or rapid eye movements, then wearing electronic equipment can will show Display screen closes display or opens display.
Optionally, when display screen shows navigation information, wearing electronic equipment can also be detected by velocity sensor Movement speed is more than threshold speed, closes display screen and shows, the navigation information for showing screen display can also be moved to display The side of screen.When detecting that the movement speed for wearing electronic equipment is excessively high, display screen is closed.It can reduce under navigation scenarios The case where too fast display screen of user moving speed shows image contributions user security, provides convenience for user.
Optionally, when display screen shows navigation information, wearing electronic equipment can also determine according to equipment position location Without without crossing, then wearing electronics in crossing, such as 1 km within the scope of distance threshold in the direction of motion of current track route Equipment can close display screen and show.Under navigation scenarios, not when the close crossing for needing user to pay attention to, display screen is closed It has been shown that, can save and wear powder consumption of electronic equipment, and reduces display screen and show that image blocks user's sight, provide for user Convenience.
Optionally, it is closed open number repeatedly to reduce display screen, electronic equipment can detect continuous N number of reality The image of body object on a display screen not by ocular focusing when, close display panel and driving IC.Later detect it is following Display screen and driving IC are just opened when one or more, to show the image of entity object in electronic equipment current visual angle: a. The focal point of ball is in display screen fixed-focus focus.B. in response to a certain user's operation.C. detect that successive M is (whole greater than 1 Number) a entity object enters in electronic equipment visual angle.
Under navigation scenarios, the backlight of display screen, display panel and driving IC can be turned off, further to save function Consumption.
Optionally, user can also be obtained to the corresponding figure of different entities object by machine learning by wearing electronic equipment The number or probability focused as history.Wearing electronic equipment can be true according to the history of every class entity object focusing number or probability Surely the trigger condition of display screen is closed.History focuses number or probability is bigger, and the looser pass of such entity object can be set Close the trigger condition of display screen.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Above-mentioned method determines that the display screen of user preference shows content using machine learning, then according to user preference Display screen show curriculum offering close display screen condition.While saving power consumption, more accurately whether user can be determined It needs to close display screen.
Optionally, user can be obtained and be gone through to image corresponding under different scenes by machine learning by wearing electronic equipment The times or frequency that history focuses.Times or frequency can be focused according to the history of entity object under each scene by wearing electronic equipment Determine the trigger condition for closing display screen.History focusing times or frequency is bigger, and closing looser under the scene can be set The trigger condition of display screen.Such as smaller first threshold value, the value of bigger second threshold and the first duration.
Above-mentioned method determines that the display screen of user preference shows scene using machine learning, then according to user preference Display screen show scene setting close display screen condition.While saving power consumption, more accurately whether user can be determined It needs to close display screen.
It should be understood that the specific implementation of each step about Figure 10 the method, can refer to earlier figures 1- figure 3, Fig. 4 a- Fig. 4 k, figure 5-8, Fig. 9 a and Fig. 9 b embodiment, do not repeat here.
Each embodiment of the application can be arbitrarily combined, to realize different technical effects.
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof real It is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer program Product includes one or more computer instructions.When loading on computers and executing the computer program instructions, all or It partly generates according to process described herein or function.The computer can be general purpose computer, special purpose computer, meter Calculation machine network or other programmable devices.The computer instruction may be stored in a computer readable storage medium, or It is transmitted from a computer readable storage medium to another computer readable storage medium, for example, the computer instruction can To pass through wired (such as coaxial cable, optical fiber, digital subscriber from a web-site, computer, server or data center Line) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server or data center into Row transmission.The computer readable storage medium can be any usable medium or include one that computer can access Or the data storage devices such as integrated server, data center of multiple usable mediums.The usable medium can be magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard disk Solid State Disk) etc..
In short, being not intended to limit protection of the invention the foregoing is merely the embodiment of technical solution of the present invention Range.All exposure according to the present invention, any modification, equivalent replacement, improvement and so on should be included in protection of the invention Within the scope of.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims (10)

1. a kind of method according to eyeball focal point control display screen, which is characterized in that the method is applied to wear electronic equipment, The electronic equipment of wearing includes display screen, and the display screen is transparent when closing display;The described method includes:
Image is shown on the display screen, and the focusing focus of the user eyeball is within the scope of first distance;
Detect user eyeball focusing focus not the duration within the scope of the first distance be greater than or equal to first when When long, the display screen is closed.
2. the method as described in claim 1, which is characterized in that it is described to close after the display screen, the method also includes:
Detecting that the user eyeball focusing focus falls in the duration within the scope of the first distance and be greater than or equal to the When two durations, the display screen is opened.
3. method according to claim 1 or 2, which is characterized in that the display screen is liquid crystal display, in the display screen It is described to close the display screen when upper broadcasting video, comprising:
Close the backlight of the display screen.
4. method according to claim 1 or 2, which is characterized in that the display screen is liquid crystal display, in the display screen It is described to close the display screen when upper display navigation information, comprising:
Close the backlight of the display screen and following one or more: display panel, the driving circuit of the backlight and described aobvious The driving circuit of display screen.
5. method according to claim 1 or 2, which is characterized in that the display screen is organic light-emitting diode (OLED) display screen, It is described to close the display screen when playing video on the display screen, comprising:
Close the display panel of the display screen.
6. method according to claim 1 or 2, which is characterized in that the display screen is organic light-emitting diode (OLED) display screen, It is described to close the display screen when display screen display navigation information, comprising:
Close the driving circuit of the display screen and the display panel of the display screen.
7. such as method as claimed in any one of claims 1 to 6, which is characterized in that the method also includes:
When detecting any one of following or multinomial, the display screen is closed:
Detect that the duration within the scope of the first distance is not greater than or equal to described first to user eyeball focusing focus Duration;
Detect the pushing operation of the first key;
Detect first gesture;
Detect the first voice signal.
8. method as described in any one of claim 1 to 7, which is characterized in that the method also includes:
When detecting any one of following or multinomial, the display screen is opened:
Detect that the user eyeball focusing focus falls in the duration within the scope of the first distance more than or equal to described Second duration;
Detect the pushing operation of the second key;
Detect second gesture;
Detect the second voice signal.
9. one kind wears electronic equipment characterized by comprising one or more processors, one or more memories;
One or more of memories are coupled with one or more of processors, and one or more of memories are for depositing Computer program code is stored up, the computer program code includes computer instruction, when one or more of processors execute When the computer instruction, the terminal is executed as claim 1-8 is described in any item according to eyeball focal point control display screen Method.
10. a kind of computer storage medium, which is characterized in that including computer instruction, when the computer instruction at the terminal When operation, so that the terminal executes such as the described in any item methods according to eyeball focal point control display screen of claim 1-8.
CN201811407510.5A 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment Active CN109582141B (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN201811407510.5A CN109582141B (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
CN202210492188.0A CN114879840A (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
EP19886694.9A EP3862845B1 (en) 2018-11-23 2019-11-15 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
FIEP19886694.9T FI3862845T3 (en) 2018-11-23 2019-11-15 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
PCT/CN2019/118623 WO2020103763A1 (en) 2018-11-23 2019-11-15 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
US17/295,699 US20220019282A1 (en) 2018-11-23 2019-11-15 Method for controlling display screen according to eye focus and head-mounted electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811407510.5A CN109582141B (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202210492188.0A Division CN114879840A (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment

Publications (2)

Publication Number Publication Date
CN109582141A true CN109582141A (en) 2019-04-05
CN109582141B CN109582141B (en) 2022-05-10

Family

ID=65924258

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202210492188.0A Pending CN114879840A (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
CN201811407510.5A Active CN109582141B (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202210492188.0A Pending CN114879840A (en) 2018-11-23 2018-11-23 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment

Country Status (5)

Country Link
US (1) US20220019282A1 (en)
EP (1) EP3862845B1 (en)
CN (2) CN114879840A (en)
FI (1) FI3862845T3 (en)
WO (1) WO2020103763A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110332944A (en) * 2019-07-18 2019-10-15 百度国际科技(深圳)有限公司 Navigation equipment control method, device, equipment and storage medium
CN111077989A (en) * 2019-05-27 2020-04-28 广东小天才科技有限公司 Screen control method based on electronic equipment and electronic equipment
WO2020103763A1 (en) * 2018-11-23 2020-05-28 华为技术有限公司 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
CN111710284A (en) * 2020-07-17 2020-09-25 Oppo广东移动通信有限公司 Intelligent glasses control method, intelligent glasses control device and intelligent glasses
CN111741511A (en) * 2020-05-29 2020-10-02 华为技术有限公司 Quick matching method and head-mounted electronic equipment
CN111824043A (en) * 2019-04-16 2020-10-27 上汽通用汽车有限公司 Automobile display screen control system and method and vehicle comprising same
CN113359270A (en) * 2021-05-25 2021-09-07 歌尔股份有限公司 Diopter adjusting method and diopter adjusting system of head-mounted equipment
CN113672085A (en) * 2021-08-04 2021-11-19 Oppo广东移动通信有限公司 Parameter control method and device, head-mounted display equipment and storage medium
CN113703572A (en) * 2021-08-25 2021-11-26 京东方科技集团股份有限公司 Electronic device, control method, control apparatus, and storage medium
CN113900253A (en) * 2021-10-18 2022-01-07 杨敬尧 Mini functional lens module
CN114615488A (en) * 2022-03-14 2022-06-10 北京行者无疆科技有限公司 Control method for display mode of AR glasses
CN117056749A (en) * 2023-10-12 2023-11-14 深圳市信润富联数字科技有限公司 Point cloud data processing method and device, electronic equipment and readable storage medium
EP4095648A4 (en) * 2020-01-23 2024-04-03 Xiaosong Xiao Glasses waistband-type computer device
WO2024140676A1 (en) * 2022-12-30 2024-07-04 维沃移动通信有限公司 Display control method and apparatus, augmented reality device, and medium

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022212072A1 (en) * 2021-03-31 2022-10-06 Snap Inc. Eyewear projector brightness control
CN117321537A (en) * 2021-05-17 2023-12-29 斯纳普公司 Dynamic power configuration for eyewear devices
CN113485546A (en) * 2021-06-29 2021-10-08 歌尔股份有限公司 Control method of wearable device, wearable device and readable storage medium
US20230050526A1 (en) * 2021-08-10 2023-02-16 International Business Machines Corporation Internet of things configuration using eye-based controls
CN113504833B (en) * 2021-09-10 2021-12-24 世纳微电子科技(成都)有限公司 Digital optical color temperature sensor, eyeball tracking device and human-computer interaction system
CN114779916B (en) * 2022-03-29 2024-06-11 杭州海康威视数字技术股份有限公司 Electronic equipment screen awakening method, access control management method and device
CN116880702B (en) * 2023-09-08 2024-01-05 深圳市江元科技(集团)有限公司 Control method, system and storage medium of induction type vehicle-mounted medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103620527A (en) * 2011-05-10 2014-03-05 寇平公司 Headset computer that uses motion and voice commands to control information display and remote devices
CN104850317A (en) * 2014-12-31 2015-08-19 华为终端(东莞)有限公司 Display method of screen of wearable device, and wearable device
US20170329398A1 (en) * 2016-05-13 2017-11-16 Google Inc. Eye tracking systems and methods for virtual reality environments
CN108595009A (en) * 2012-02-29 2018-09-28 联想(北京)有限公司 A kind of man-machine interaction control method and electric terminal

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9081416B2 (en) * 2011-03-24 2015-07-14 Seiko Epson Corporation Device, head mounted display, control method of device and control method of head mounted display
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
CN202602831U (en) * 2012-05-11 2012-12-12 山东沃飞电子科技有限公司 Display control device
US9310611B2 (en) * 2012-09-18 2016-04-12 Qualcomm Incorporated Methods and systems for making the use of head-mounted displays less obvious to non-users
KR102333704B1 (en) * 2013-09-30 2021-12-01 삼성전자주식회사 Method for processing contents based on biosignals, and thereof device
US9836122B2 (en) * 2014-01-21 2017-12-05 Osterhout Group, Inc. Eye glint imaging in see-through computer display systems
US20150288788A1 (en) * 2014-04-08 2015-10-08 Stephen Y Liu Mobile Device Management
US20160025971A1 (en) * 2014-07-25 2016-01-28 William M. Crow Eyelid movement as user input
WO2016138178A1 (en) * 2015-02-25 2016-09-01 Brian Mullins Visual gestures for a head mounted device
CN105204651A (en) * 2015-11-12 2015-12-30 上海卓易科技股份有限公司 Control method and device
US10345988B2 (en) * 2016-03-16 2019-07-09 International Business Machines Corporation Cursor and cursor-hover based on user state or sentiment analysis
US10372205B2 (en) * 2016-03-31 2019-08-06 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
CN107424584A (en) * 2016-05-24 2017-12-01 富泰华工业(深圳)有限公司 Eyes protecting system and method
US10552183B2 (en) * 2016-05-27 2020-02-04 Microsoft Technology Licensing, Llc Tailoring user interface presentations based on user state
KR102577634B1 (en) * 2016-07-25 2023-09-11 매직 립, 인코포레이티드 Imaging modification, display and visualization using augmented and virtual reality eyewear
TWI610059B (en) * 2016-08-04 2018-01-01 緯創資通股份有限公司 Three-dimensional measurement method and three-dimensional measurement device using the same
KR20180028796A (en) * 2016-09-09 2018-03-19 삼성전자주식회사 Method, storage medium and electronic device for displaying images
WO2018080431A1 (en) * 2016-10-24 2018-05-03 Hewlett-Packard Development Company, L.P. Awakening electronic devices in selected modes of operation
US20180314066A1 (en) * 2017-04-28 2018-11-01 Microsoft Technology Licensing, Llc Generating dimming masks to enhance contrast between computer-generated images and a real-world view
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
CN207651151U (en) * 2017-12-27 2018-07-24 北京枭龙防务科技有限公司 A kind of adjust automatically shows the nearly eye display device of Clairvoyant type of content
US10922862B2 (en) * 2018-04-05 2021-02-16 Lenovo (Singapore) Pte. Ltd. Presentation of content on headset display based on one or more condition(s)
CN114879840A (en) * 2018-11-23 2022-08-09 华为技术有限公司 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103620527A (en) * 2011-05-10 2014-03-05 寇平公司 Headset computer that uses motion and voice commands to control information display and remote devices
CN108595009A (en) * 2012-02-29 2018-09-28 联想(北京)有限公司 A kind of man-machine interaction control method and electric terminal
CN104850317A (en) * 2014-12-31 2015-08-19 华为终端(东莞)有限公司 Display method of screen of wearable device, and wearable device
US20170329398A1 (en) * 2016-05-13 2017-11-16 Google Inc. Eye tracking systems and methods for virtual reality environments

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020103763A1 (en) * 2018-11-23 2020-05-28 华为技术有限公司 Method for controlling display screen according to eyeball focus and head-mounted electronic equipment
CN111824043A (en) * 2019-04-16 2020-10-27 上汽通用汽车有限公司 Automobile display screen control system and method and vehicle comprising same
CN111077989A (en) * 2019-05-27 2020-04-28 广东小天才科技有限公司 Screen control method based on electronic equipment and electronic equipment
CN111077989B (en) * 2019-05-27 2023-11-24 广东小天才科技有限公司 Screen control method based on electronic equipment and electronic equipment
CN110332944A (en) * 2019-07-18 2019-10-15 百度国际科技(深圳)有限公司 Navigation equipment control method, device, equipment and storage medium
EP4095648A4 (en) * 2020-01-23 2024-04-03 Xiaosong Xiao Glasses waistband-type computer device
CN111741511A (en) * 2020-05-29 2020-10-02 华为技术有限公司 Quick matching method and head-mounted electronic equipment
CN111710284A (en) * 2020-07-17 2020-09-25 Oppo广东移动通信有限公司 Intelligent glasses control method, intelligent glasses control device and intelligent glasses
CN113359270A (en) * 2021-05-25 2021-09-07 歌尔股份有限公司 Diopter adjusting method and diopter adjusting system of head-mounted equipment
CN113359270B (en) * 2021-05-25 2023-06-09 歌尔股份有限公司 Diopter adjustment method and diopter adjustment system of head-mounted equipment
WO2023011103A1 (en) * 2021-08-04 2023-02-09 Oppo广东移动通信有限公司 Parameter control method and apparatus, head-mounted display device, and storage medium
CN113672085A (en) * 2021-08-04 2021-11-19 Oppo广东移动通信有限公司 Parameter control method and device, head-mounted display equipment and storage medium
CN113703572A (en) * 2021-08-25 2021-11-26 京东方科技集团股份有限公司 Electronic device, control method, control apparatus, and storage medium
CN113703572B (en) * 2021-08-25 2024-02-09 京东方科技集团股份有限公司 Electronic device, control method, control apparatus, and storage medium
CN113900253A (en) * 2021-10-18 2022-01-07 杨敬尧 Mini functional lens module
CN114615488B (en) * 2022-03-14 2022-12-27 北京行者无疆科技有限公司 Control method for display mode of AR glasses
CN114615488A (en) * 2022-03-14 2022-06-10 北京行者无疆科技有限公司 Control method for display mode of AR glasses
WO2024140676A1 (en) * 2022-12-30 2024-07-04 维沃移动通信有限公司 Display control method and apparatus, augmented reality device, and medium
CN117056749A (en) * 2023-10-12 2023-11-14 深圳市信润富联数字科技有限公司 Point cloud data processing method and device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
EP3862845A1 (en) 2021-08-11
CN109582141B (en) 2022-05-10
EP3862845B1 (en) 2024-01-10
WO2020103763A1 (en) 2020-05-28
FI3862845T3 (en) 2024-04-17
CN114879840A (en) 2022-08-09
US20220019282A1 (en) 2022-01-20
EP3862845A4 (en) 2021-12-29

Similar Documents

Publication Publication Date Title
CN109582141A (en) According to the method for eyeball focal point control display screen and wear electronic equipment
CN110221432B (en) Image display method and device of head-mounted display
US9619943B2 (en) Event augmentation with real-time information
CN104076512B (en) The control method of head-mount type display unit and head-mount type display unit
US9245389B2 (en) Information processing apparatus and recording medium
CN110070812A (en) Wear electronic equipment and its control method
CN108535868B (en) Head-mounted display device and control method thereof
CN109766066A (en) A kind of method of Message Processing, relevant apparatus and system
CN108421252B (en) Game realization method based on AR equipment and AR equipment
CN105759422A (en) Display System And Control Method For Display Device
CN114730100A (en) NFC communication and QI wireless charging of eye-worn device
US11575877B2 (en) Utilizing dual cameras for continuous camera capture
CN110069236A (en) One kind wearing electronic equipment and its audio output control method
US11216066B2 (en) Display device, learning device, and control method of display device
CN109712588B (en) Gray scale adjusting method and device and display device
US12002392B2 (en) Eyewear projector brightness control
CN115202042A (en) Control method of wearable device and electronic device
WO2023185698A1 (en) Wearing detection method, and related apparatus
WO2023040562A1 (en) Information display method, near-eye display device, and electronic device
CN112558847B (en) Method for controlling interface display and head-mounted display
US11527895B1 (en) Eyewear bidirectional communication using time gating power transfer
WO2024099121A1 (en) Risk detection method for vestibular function and electronic device
US20240276377A1 (en) Eyewear having current consumption optimization of wireless system interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant