CN112799625A - Display control method, apparatus and storage medium - Google Patents
Display control method, apparatus and storage medium Download PDFInfo
- Publication number
- CN112799625A CN112799625A CN202110168554.2A CN202110168554A CN112799625A CN 112799625 A CN112799625 A CN 112799625A CN 202110168554 A CN202110168554 A CN 202110168554A CN 112799625 A CN112799625 A CN 112799625A
- Authority
- CN
- China
- Prior art keywords
- display
- display screen
- refresh rate
- attention
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004458 analytical method Methods 0.000 claims abstract description 36
- 210000004556 brain Anatomy 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 5
- 230000003247 decreasing effect Effects 0.000 claims description 4
- 230000000193 eyeblink Effects 0.000 claims 1
- 230000015654 memory Effects 0.000 description 22
- 230000000007 visual effect Effects 0.000 description 12
- 230000008859 change Effects 0.000 description 11
- 230000010355 oscillation Effects 0.000 description 11
- 230000004438 eyesight Effects 0.000 description 9
- 230000001360 synchronised effect Effects 0.000 description 6
- 230000004397 blinking Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000004424 eye movement Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001154 acute effect Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application discloses a display control method, a device and a computer storage medium, wherein the method comprises the following steps: detecting a first parameter, wherein the first parameter is a parameter capable of representing the attention of a user to a display screen; determining a display mode of the display screen based on an analysis result obtained by analyzing the first parameter; controlling the display screen to display according to the determined display mode; the display modes comprise a first display mode and a second display mode, and the display refresh rate of the display screen in the first display mode is higher than that in the second display mode.
Description
Technical Field
The present application relates to display control technologies, and in particular, to a display control method, device, and computer storage medium.
Background
The higher the display refresh rate of the display screen is, the less flickering the picture is, and the better the visual experience brought to the user is. However, the high refresh rate of the display screen also brings more power consumption, and how to bring good visual experience to the user and save power consumption becomes a technical problem to be solved urgently.
Disclosure of Invention
In order to solve the existing technical problem, embodiments of the present application provide a display control method, a device, and a computer storage medium.
The technical scheme of the embodiment of the application is realized as follows:
an embodiment of the present application provides a display control method, including:
detecting a first parameter, wherein the first parameter is a parameter capable of representing the attention of a user to a display screen;
determining a display mode of the display screen based on an analysis result obtained by analyzing the first parameter;
controlling the display screen to display according to the determined display mode;
the display modes comprise a first display mode and a second display mode, and the display refresh rate of the display screen in the first display mode is higher than that in the second display mode.
In the foregoing solution, the display mode of the display screen is determined to be the first display mode under the condition that the analysis result represents that the user pays attention to the display screen; and determining the display mode to be a second display mode under the condition that the analysis result represents that the user has no attention to the display screen.
In the foregoing scheme, under the condition that the analysis result indicates that the user pays attention to the display screen, the display refresh rate of the display screen when the display screen is paid attention strongly is higher than the display refresh rate of the display screen when the display screen is paid attention weakly.
In the foregoing solution, when the analysis result represents that the user has an attention to the display screen, the display screen includes a strongly-attended region and a weakly-attended region, and a display refresh rate of the strongly-attended region of the display screen is higher than a display refresh rate of the weakly-attended region.
In the foregoing solution, the display refresh rate of the strong attention area is increased, and/or the display refresh rate of the weak attention area is decreased so that the display refresh rate of the strong attention area is higher than the display refresh rate of the weak attention area.
In the foregoing aspect, the display refresh rate of the region of strong interest may be changed based on the level of interest of the region of strong interest; and/or the display refresh rate of the weak attention area may be varied based on the attention level of the weak attention area.
In the foregoing solution, the method further includes:
the display screen consumes different power in the case of a high display refresh rate than in the case of a low display refresh rate.
In the foregoing embodiment, the first parameter is at least one of an eye sight line, a blink frequency and a brain wave signal of the user.
An embodiment of the present application provides a display control apparatus, including:
the detection unit is used for detecting a first parameter, wherein the first parameter can represent the attention of a user to the display screen;
the analysis unit is used for analyzing the first parameter to obtain an analysis result;
the determining unit is used for determining the display mode of the display screen according to the analysis result;
and the control display unit is used for controlling the display screen to display in the determined display mode.
An embodiment of the present application provides a computer storage medium storing a computer program, which when executed performs the steps of implementing the aforementioned display control method.
The embodiment of the application provides a display control method, a device and a computer storage medium, wherein the method comprises the following steps: detecting a first parameter, wherein the first parameter is a parameter capable of representing the attention of a user to a display screen; determining a display mode of the display screen based on an analysis result obtained by analyzing the first parameter; controlling the display screen to display according to the determined display mode; the display modes comprise a first display mode and a second display mode, and the display refresh rate of the display screen in the first display mode is higher than that in the second display mode.
The embodiment of the application is a scheme for adaptively changing the refresh rate of a display screen according to the actual attention condition of a user to the display screen. Therefore, good visual experience can be brought to a user, the problem that the electric quantity is increased due to the fact that the display screen always adopts a high refresh rate can be avoided, and the electric quantity is saved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first schematic flow chart illustrating an implementation of a display control method according to an embodiment of the present application;
fig. 2 is a schematic flow chart illustrating an implementation process of a display control method according to an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating region division of a display screen according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a display control apparatus according to an embodiment of the present application;
fig. 5 is a schematic diagram of a hardware structure of a display control device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. In the present application, the embodiments and features of the embodiments may be arbitrarily combined with each other without conflict. The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
The display control method in the embodiment of the application can be applied to electronic equipment, and the electronic equipment is any reasonable equipment with a display screen. Such as mobile phones, notebook computers, tablet computers, desktop computers, all-in-one machines and the like; but also wearable devices such as smart glasses, smart bracelets, etc.; or a home appliance such as a television, a home theater, or the like. Preferably, the electronic device is a mobile phone, a notebook computer, a desktop computer, or the like.
Fig. 1 is a first schematic flow chart illustrating an implementation of a display control method according to an embodiment of the present application. As shown in fig. 1, the method includes:
s101: detecting a first parameter, wherein the first parameter is a parameter capable of representing the attention of a user to a display screen;
in practical applications, the display screen of the electronic device is turned on when being used by a user and turned off when not being used by the user. In the embodiment of the application, the first parameter can be detected and analyzed under the condition that the display screen of the electronic equipment is lightened, so that the attention degree of a user to the display screen is obtained, for example, the user is in a state of attention concentration or a state of non-concentration to the display screen. The first parameter may be at least one of eye sight, eye blinking frequency, and brain wave signal of the user. The longer the eye line of sight of the user stays on the display screen, the lower the blinking frequency, which indicates that the user is more attentive to the display screen.
First, how to detect the attention of the user to the display screen by the eye sight and/or the blink frequency of the user is shown. The electronic device may be provided with an image capturing device, such as a camera, for capturing images of the user viewing the display screen, preferably for capturing multiple frames of images. And identifying the eye region of the user in the image, and calculating the proportion of the eye region in each frame of image in the image. If the proportion of the eye region in each frame image to the corresponding frame image is found to have small change in the calculation of the continuous multi-frame images, such as the change is within a tolerable value range, the eye sight line of the user stays on the display screen for a long time. The first parameter can be obtained by utilizing the change of the proportion of the eye region in each frame of image in the collected multi-frame image. In addition, in practical applications, if the user blinks frequently while viewing the display screen, the eye area in the captured blink image is small, and the occupied proportion of the entire image is naturally small. If in the scheme of calculating the change of the proportion of the eye region in each frame image in the plurality of frame images, the proportion calculated for one frame is suddenly reduced relative to the proportion of two adjacent frames, the frame image is the blink image of the user. If the number of blinking images in the collected multi-frame images is larger than the tolerable number, the user can be considered to have frequent blinking behaviors in watching the display screen, which indicates that the attention of the user to the display screen is not too concentrated. If the number of blinked images is small, this may indicate that the user is attentive to the display. In addition to the parameters capable of representing the attention of the user to the display screen obtained by analyzing the acquired images, the eye sight can be tracked by using an eye sight tracking technology. The main principle is as follows: the eye can reflect infrared rays, the infrared rays reflected by the eye can be measured by using an optical sensor, and the eye movement information is extracted from the change of the facula of the infrared rays. Determining the attention (attention) of the user to the display screen according to the frequency of the eye movement, wherein if the eye movement is not frequent, the attention is concentrated; if the eye movement is too frequent this may indicate inattention.
Then, how to detect the attention of the user to the display screen through the computer wave signal of the user is shown. Generally, brain electrical brain signals, such as alpha signals and beta signals, exist in the brain of a user. Wherein if the alpha signal in the brain is dominant, it indicates that the user is in a state of more concentration at this time. If the beta signal in the brain is dominant, it indicates that the user is in mental stress at the moment and hardly focuses on the display screen. Based on this, it is sufficient to detect whether or not the α signal of the user is dominant in the computer wave signal by the brain wave sensor. The vibration frequency of the alpha signal is 8Hz (Hertz) to 14Hz, and the larger the vibration frequency is, the more concentrated the attention is. The electronic equipment can be internally provided with a brain wave sensor, the brain wave sensor is utilized to detect the brain wave signal generated by the current user and judge whether the alpha signal is the maximum, if so, the alpha signal is considered to be dominant in the computer wave signal, and the attention of the user to the display screen is in a concentrated state. If the alpha signal is not the maximum signal in the computer wave signal, the attention of the user to the display screen is not focused enough.
Furthermore, the first parameter may also be detected by a sensor. In consideration of the practical application that a user needs to hold the electronic equipment when using the electronic equipment, the angle of the electronic equipment relative to the ground is different from the angle of the electronic equipment relative to the ground when not being used. The sensor, specifically, the gyroscope detects the angle of the electronic equipment relative to the ground, and when the angle is an acute angle within a predetermined range, the electronic equipment is considered to be held, the held time length is calculated, and the display screen is more focused when the held time length is larger.
Considering that the attention of the user to the display screen may change during the use of the display screen, it is preferable to detect the first parameter in real time or every certain period, for example, every 0.5 s. If the oscillation frequency of the alpha signal in the first period is 8 Hz-10 Hz; the oscillation frequency of the alpha signal in the second period is 13Hz to 14 Hz; the oscillation frequency of the alpha signal in the third period is 10 Hz-13 Hz. The refresh rate of the display screen can be adjusted in time under the condition that the attention condition of the user to the display screen changes. Therefore, the good visual experience of the user is met, and the power consumption is prevented from being wasted without reasons.
The above are several schemes for detecting the parameters of interest. The above embodiments are specific examples, and any other reasonable embodiments are covered in the protection scope of the embodiments of the present application.
S102: determining a display mode of the display screen based on an analysis result obtained by analyzing the first parameter;
it will be appreciated that the analysis of the first parameter is intended to derive whether the user is attentive to the display screen. The specific analysis process can be seen from the related content in the foregoing S101. In practical applications, the analysis result obtained by analyzing the first parameter generally includes the following two cases:
the first case is whether the user has focus on the display screen. If the change of the proportion of the eye region in each frame image in the corresponding frame image is small and the change is within a tolerable value range, the eye sight line of the user stays on the display screen for a long time, and the stay time on the display screen is long, so that the user pays attention to the eye sight line. If the dwell time is short, such as 0.5 seconds, then it may be considered that there is no concern. In practical applications, this situation may occur when the user only wants to see the scene, such as the date and time displayed on the screen, which is a situation when the user does not want to know the date and time only by using the electronic device, and the user may not pay attention to the display screen. In the view of brain wave signals, a larger frequency of vibration of an α signal indicates more concentration of attention, and a smaller frequency indicates less concentration of attention.
For the first case, determining that the display mode of the display screen is a mode with a high refresh rate (first display mode) when the analysis result represents that the user pays attention to the display screen; and determining the display mode to be a mode (a second display mode) with a low refresh rate under the condition that the analysis result represents that the user does not pay attention to the display screen. Therefore, the high refresh rate of the display screen is realized under the condition that the user pays attention to the display screen; a low refresh rate of the display screen without the user being concerned about the display screen. The refresh rate of the display screen is flexibly determined according to the actual use condition of the display screen, so that the electric quantity can be saved, and the visual experience of a user can be met.
The second case is a degree of attention of the user to the display screen, such as strong attention or weak attention, in a case where the user has attention to the display screen. In colloquial, strong attention and weak attention are relative, and in the case where strong attention is focused on a display screen to a high degree, weak attention can be understood as not being focused to a high degree. The user's attention to the display screen can be divided into other grades such as strong, medium and weak, besides the two grades of strong and weak, and the divided grades can be flexibly set according to the actual use condition. No matter what kind of grading mode is adopted, the requirement that the refresh rate of the display screen is higher under the condition of large attention degree than under the condition of small attention degree is met.
For the second case, when the analysis result indicates that the user has attention to the display screen, it is further required to determine whether the user has strong attention or weak attention to the display screen according to the size of the first parameter, and if the user has strong attention, the display mode of the display screen is determined to be the first display mode; and if the focus is weak, determining that the display mode of the display screen is the second display mode. Namely, the display refresh rate of the display screen when the display screen is focused strongly is higher than the display refresh rate of the display screen when the display screen is focused weakly. Taking the first parameter as the α signal as an example, when the oscillation frequency of the α signal of the user detected when the user views the display screen is greater than a first threshold, for example, 10Hz (hertz), the user may be considered to be in a strong attention state with respect to the display screen. If the oscillation frequency is less than the second threshold value, for example, 8.5Hz, the user may be considered to be in a weak focus state on the display screen.
S103: controlling the display screen to display according to the determined display mode; the display modes comprise a first display mode and a second display mode, and the display refresh rate of the display screen in the first display mode is higher than that in the second display mode.
It will be appreciated that the display comprises two display modes (first and second display modes) in which the refresh rate of the display is different. The refresh rate of the display screen in the first display mode is high, and the refresh rate of the display screen in the second display mode is low. In other words, the variable refresh rate design of the display screen is realized in the embodiment of the application, and the problem caused by the fact that the display screen adopts a fixed refresh rate, such as the problem of poor user experience caused by flicker of a display picture caused by adopting a low refresh rate, and the problem of increased electric quantity consumption caused by adopting a high refresh rate, can be avoided.
In S101 to S103, the display mode of the display screen may be determined according to the analysis result of the attention of the user to the display screen. It is equivalent to determine whether to use the high refresh rate mode (the first display mode) or the low refresh rate mode (the second display mode) of the display screen according to the actual attention of the user to the display screen. The method is a scheme for changing the refresh rate of the display screen, and is a scheme for adaptively changing the refresh rate of the display screen according to the actual attention situation of a user to the display screen. Therefore, good visual experience can be brought to a user, the problem that the electric quantity is increased due to the fact that the display screen always adopts a high refresh rate can be avoided, and the electric quantity is saved.
It should be appreciated that the display consumes different power at high refresh rates than at low refresh rates. In particular, the power consumed at low refresh rates is lower than the power consumed at high refresh rates. The embodiment of the application considers the problems of visual experience and power consumption of a user, and compared with a scheme that screen refreshing is always performed by adopting a high refresh rate or a low refresh rate in the related art, the method can determine whether to use the high refresh rate or the low refresh rate based on the attention condition of the user to the display screen, such as concentration or non-concentration, and is a scheme that the screen refresh rate can be changed based on the attention condition of the user to the display screen. The scheme is easy to realize in engineering and high in feasibility.
In an optional scheme, as shown in fig. 2, after the foregoing S101, the method further includes:
s201: determining a region to be focused on the display screen under the condition that the analysis result represents that the user focuses on the display screen;
s202: dividing a strong attention area and a weak attention area of the display screen according to the position of the area on the display screen;
s203: determining a display refresh rate for the strong attention area and a display refresh rate for the weak attention area;
s204: controlling the strong attention area and the weak attention area to display at respective display refresh rates; wherein a display refresh rate of the region of strong interest of the display screen is higher than a display refresh rate of the region of weak interest.
The scheme of S201-S204 realizes that the refreshing rate of the screen is performed by adopting different display refreshing rates in the areas with different attention degrees or grades on the display screen.
In practical applications, when a user pays attention to a display screen, it may happen that the user pays more attention to a certain area on the display screen, and pays less attention to other areas, such as more attention to the middle position of the display screen, and less attention to the upper and lower edge positions of the display screen. On the technical level, the method can determine which area on the display screen is the strong attention area and which area is the weak attention area according to the tracking result of the sight of the user. According to the scheme, the watching position of the sight of the user on the display screen can be regarded as a strong attention area; other locations on the display screen than the gaze location of the user's line of sight may be considered weak areas of interest. For a scheme for determining the gaze location of the user's gaze on the display screen based on tracking the user's gaze, please refer to the related description, which is not repeated herein. Based on this, the visual display screen is divided into two regions: a region of strong interest and a region of weak interest. Different display refresh rates are given for different regions. For example, in order to make the user experience a screen that flickers infrequently and feel a good experience when focusing attention on a strong attention area, it is possible to determine that the display mode of the strong attention area of the display screen is a high refresh rate mode. To achieve power savings, the display mode of the weak region of interest of the display screen may be determined to be a low refresh rate mode. That is, in the embodiment of the present application, in the case where the display screen includes the strong attention area and the weak attention area, the display refresh rate of the strong attention area of the display screen needs to be higher than the display refresh rate of the weak attention area. According to the scheme, the regions of the display screen can be refreshed and displayed by adopting the refresh rate adaptive to the regions with different attention levels due to different attention levels (strong attention and weak attention). The user can experience good user experience and save the electric quantity.
In practical applications, a default value may be set for the display refresh rate of the display screen, and the display screen is refreshed in the default value when not being used (focused). If the display screen is concerned and a strong concerned area and a weak concerned area exist, the display refresh rate of the strong concerned area can be increased to a certain extent on the basis of a default value, and the weak concerned area only needs to adopt a default refresh rate value. Or, the display refresh rate of the strong attention area can be increased to a certain extent on the basis of a default value; for weak interest areas, a certain reduction may be made on the basis of default values. The strong attention area may maintain a default refresh rate, and the weak attention area may be reduced to some extent based on the default value. Namely, the scheme that the display refresh rate of the strong attention area is higher than that of the weak attention area is realized by increasing the display refresh rate of the strong attention area and/or reducing the display refresh rate of the weak attention area.
As shown in the foregoing, in the embodiment of the present application, attention may be classified into a grade, such as strong attention and weak attention, and further, such as strong attention, medium attention, and weak attention. In each level, a (fine) division of the level may be performed, and if the strong attention includes the 1 st level, the 2 nd level, and the 3 rd level, the refresh rate of the strong attention area may be set in advance to be larger as the level of the strong attention is higher. The weak attention includes a 1 st level, a 2 nd level, and a 3 rd level, and the refresh rate of the strong attention region may be set in advance to be smaller as the level of the weak attention is higher. The display refresh rate of the region of strong interest may vary based on the level of interest of the region of strong interest. The display refresh rate of the weak attention area may vary based on the attention level of the weak attention area. In short, in the embodiment of the present application, the display refresh rate of a certain area of the display screen may be changed based on the change of the attention degree of the user to the area. Illustratively, the middle area of the display screen is a strong attention area, and the user pays more and more attention to the strong attention area, and if the attention area is changed from the 1 st level to the 3 rd level, the refresh rate of the area can be changed from the refresh rate value corresponding to the 1 st level of the strong attention to the refresh rate value corresponding to the 2 nd level of the strong attention. That is, in the embodiment of the present application, each region in the display screen may change with the change of the attention degree of the user to each region. The display refresh rate of each area is flexibly realized according to the actual use condition of each area of the display screen by a user, so that good visual experience is brought to the user, and the consumption of electric quantity is avoided.
The following further describes the embodiments of the present application with reference to several application scenarios.
In the following application scenarios, the display screen includes at least two refresh rates of 30Hz, 60Hz, and 120Hz as an example.
The application scene one:
under the condition that the brain wave alpha signals of the user are detected, analyzed and found that the attention of the user to the display screen is in a concentrated state, the refresh rate of the display screen can be determined to be 120Hz, and the display screen is controlled to refresh at 120 Hz. The display screen can ensure that a display picture does not flicker under high refreshing, and can bring good visual experience to users.
If the user's attention to the display screen is found to be in a non-focused state through analysis, the refresh rate of the display screen can be determined to be a low refresh rate of 30Hz, and the display screen is controlled to refresh at 30 Hz. The inattention of the user to the display screen can be regarded as the state that the user does not want to watch the display screen or does not watch the display screen, and the screen is refreshed by using the low refresh rate under the condition, so that the consumption of power can be avoided, and the consumption of the battery power of the electronic equipment can be reduced.
Application scenario two:
when the brain wave alpha signal of the user is detected and analyzed to find that the attention of the user to the display screen is changed from being in a concentrated state to a medium concentrated state (relative to an inattentive state) when the alpha signal oscillation frequency is reduced from a high frequency to a medium frequency, the refresh rate of the display screen can be adjusted from a high refresh rate of 120Hz to a medium refresh rate of 60Hz, and the display screen is controlled to refresh at 60 Hz. Or, if the attention of the user to the display screen is changed from the middle concentration state to the attention-distracted state, the refresh rate of the display screen is adjusted from 60Hz to the low refresh rate of 30 Hz. The display refresh rate of the display screen is flexibly adjusted according to the actual attention condition of the user to the display screen, so that the user experience is met, and unnecessary waste of power consumption is avoided.
Application scenario three:
the display screen is originally refreshed at a default refresh rate, such as 60 Hz. In the process of watching the display screen by a user, the user is found to pay more attention to a certain area of the display screen through tracking the sight of the user, as shown in fig. 3, if the user pays more attention to a display area 1 on the display screen, the display area 1 is regarded as a strong attention area, and other areas except the display area 1 on the display screen are weak attention areas (display areas 2), the refresh rate of the display area 1 on the display screen can be determined to be 120Hz at a high refresh rate, the refresh rate of the display area 2 can be 30Hz or 60Hz at a low refresh rate, and the display area 1 and the display area 2 are controlled to be refreshed at respective refresh rates. The regions with different attention levels on the same display screen are refreshed at respective refresh rates, so that a user paying attention to the display region 1 can watch a non-flickering picture displayed in the display region 1, and good visual experience of the user is guaranteed. It is also ensured that display areas 2 which are not expected to be concerned are displayed at a low refresh rate, avoiding power consumption.
It is assumed that the display screen is originally refreshed at a default refresh rate, such as 60 Hz. If the initial focus of the user on the display area 1 of the display screen is a strong focus of level 1 (the oscillation frequency of the α signal is a low oscillation frequency), it may be determined that the initial refresh rate of the display area 1 may be increased to some extent at the default refresh rate, for example, from 60Hz to 80 Hz. The display area 1 is controlled to refresh at a refresh rate of 80 Hz. As the oscillation frequency of the α signal changes from a low oscillation frequency to a medium oscillation frequency, the refresh rate of the display area 1 may be increased from 80Hz to 100Hz (at 20Hz intervals). The display area 1 is controlled to be refreshed at a refresh rate of 100 Hz. During this time the display area 2 may be displayed at a default value of 60Hz and the screen may also be refreshed at a low refresh rate of 30 Hz. Further, the display region 2 may be refreshed at 60Hz first and then 30Hz as the weak attention level of the weak attention region of the display region 2 increases, for example, from the 1 st level to the 3 rd level of the weak attention.
The above is a scheme of the embodiment of the present application in several typical application scenarios. Any reasonable alternative is covered by the scope of the embodiments of the present application. In summary, the refresh rate of the display screen can be determined according to the actual attention situation of the user to the display screen. Further, the refresh rate of each area is determined according to the actual attention situation of the user to the area of the display screen. Colloquially, when the user focuses on the display screen of the electronic equipment, the refreshing rate can be increased or improved by using the scheme. The adjustment of the refresh rate may be made according to the level of concentration of attention. In the event that the user is less or not focused, the refresh rate may be reduced or decreased. The adjustment of the refresh rate may also be made according to a level of inattention. Furthermore, the regions can be divided into regions of interest of different degrees according to the region of interest of the user on the display screen, and the regions of different interest degrees can adopt the refresh rate adapted to the regions of different interest degrees. The same area can flexibly adjust its refresh rate with the deepening or declining of the user's attention. By adopting the scheme, better visual experience can be provided for users, and effective control on power consumption/heating is also achieved.
An embodiment of the present application provides a display control apparatus, as shown in fig. 4, including: a detection unit 501, an analysis unit 502, a determination unit 503, and a control display unit 504; wherein the content of the first and second substances,
the detection unit 501 is configured to detect a first parameter, where the first parameter is a parameter that can represent a user's attention to a display screen;
an analyzing unit 502, configured to analyze the first parameter to obtain an analysis result;
a determining unit 503, configured to determine a display mode of the display screen according to the analysis result;
and a control display unit 504, configured to control the display screen to display in the determined display mode.
In an optional scheme, the determining unit 503 determines that the display mode of the display screen is the first display mode when the analysis result indicates that the user has attention to the display screen; the determination unit 503 determines the display mode to be the second display mode if the analysis result indicates that the user has no attention to the display screen.
In an optional scheme, in a case that the analysis result represents that the user has an attention to the display screen, the display refresh rate of the display screen when the display screen is intensively attended is higher than the display refresh rate of the display screen when the display screen is weakly attended.
In an optional scheme, in a case that the analysis result represents that the user has an attention to the display screen, the display screen includes a region of strong attention and a region of weak attention, and a display refresh rate of the region of strong attention of the display screen is higher than a display refresh rate of the region of weak attention.
In an optional scheme, the display refresh rate of the strong attention area is increased, and/or the display refresh rate of the weak attention area is decreased so that the display refresh rate of the strong attention area is higher than that of the weak attention area.
In an alternative, the display refresh rate of the region of strong interest may be varied based on the level of interest of the region of strong interest; and/or the display refresh rate of the weak attention area may be varied based on the attention level of the weak attention area.
In an alternative arrangement, the display screen consumes different power in the case of a high display refresh rate than in the case of a low display refresh rate.
In an alternative, the first parameter is at least one of eye sight, eye blinking frequency, and brain wave signal of the user.
It is understood that the detection Unit 501, the analysis Unit 502, the determination Unit 503, and the control display Unit 504 in the apparatus can be implemented by a Central Processing Unit (CPU), a Digital Signal Processor (DSP), a Micro Control Unit (MCU) or a Programmable Gate Array (FPGA) in practical applications.
It should be noted that, in the display control device according to the embodiment of the present application, because the principle of solving the problem of the device is similar to that of the display control method, the implementation process and the implementation principle of the display control device can be described by referring to the implementation process and the implementation principle of the method, and repeated details are not repeated.
An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is configured to, when executed by a processor, perform at least the steps of the method shown in any one of fig. 1 to 2. The computer readable storage medium may be embodied as a memory, such as memory 62 shown in FIG. 5.
Fig. 5 is a schematic diagram of a hardware structure of a display control device according to an embodiment of the present application, and as shown in fig. 5, the display control device includes: a communication component 63 for data transmission, at least one processor 61 and a memory 62 for storing computer programs capable of running on the processor 61. The various components in the terminal are coupled together by a bus system 64. It will be appreciated that the bus system 64 is used to enable communications among the components. The bus system 64 includes a power bus, a control bus, and a status signal bus in addition to the data bus. For clarity of illustration, however, the various buses are labeled as bus system 64 in fig. 5.
Wherein the processor 61 executes the computer program to perform at least the steps of the method of any of fig. 1 to 2.
It will be appreciated that the memory 62 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memories described in the embodiments of the present application are intended to comprise, without being limited to, these and any other suitable types of memory.
In an exemplary embodiment, the display control apparatus may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), FPGAs, general purpose processors, controllers, MCUs, microprocessors (microprocessors), or other electronic components for performing the aforementioned display control method.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated units described above in the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof contributing to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.
Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.
The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A display control method comprising:
detecting a first parameter, wherein the first parameter is a parameter capable of representing the attention of a user to a display screen;
determining a display mode of the display screen based on an analysis result obtained by analyzing the first parameter;
controlling the display screen to display according to the determined display mode;
the display modes comprise a first display mode and a second display mode, and the display refresh rate of the display screen in the first display mode is higher than that in the second display mode.
2. The method of claim 1, determining a display mode of a display screen to be a first display mode if the analysis results indicate that a user has focus on the display screen; and determining the display mode to be a second display mode under the condition that the analysis result represents that the user has no attention to the display screen.
3. The method of claim 1, wherein the display refresh rate of the display screen when the display screen is strongly focused is higher than the display refresh rate of the display screen when the display screen is weakly focused, in case the analysis result indicates that the user focuses on the display screen.
4. The method of claim 1, wherein the display screen comprises a region of strong interest and a region of weak interest in the case that the analysis result indicates that the user has an interest in the display screen, and a display refresh rate of the region of strong interest of the display screen is higher than a display refresh rate of the region of weak interest.
5. The method according to claim 4, wherein the display refresh rate of the region of strong interest is increased and/or the display refresh rate of the region of weak interest is decreased such that the display refresh rate of the region of strong interest is higher than the display refresh rate of the region of weak interest.
6. The method of claim 5, the display refresh rate of the region of strong interest being variable based on the level of interest of the region of strong interest; and/or the display refresh rate of the weak attention area may be varied based on the attention level of the weak attention area.
7. The method of any of claims 1 to 6, further comprising:
the display screen consumes different power in the case of a high display refresh rate than in the case of a low display refresh rate.
8. The method of claim 7, wherein the first parameter is at least one of eye gaze, eye blink frequency, brain wave signal of the user.
9. A display control apparatus comprising:
the detection unit is used for detecting a first parameter, wherein the first parameter can represent the attention of a user to the display screen;
the analysis unit is used for analyzing the first parameter to obtain an analysis result;
the determining unit is used for determining the display mode of the display screen according to the analysis result;
and the control display unit is used for controlling the display screen to display in the determined display mode.
10. A computer storage medium storing a computer program which, when executed, performs steps implementing the method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110168554.2A CN112799625A (en) | 2021-02-07 | 2021-02-07 | Display control method, apparatus and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110168554.2A CN112799625A (en) | 2021-02-07 | 2021-02-07 | Display control method, apparatus and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112799625A true CN112799625A (en) | 2021-05-14 |
Family
ID=75814651
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110168554.2A Pending CN112799625A (en) | 2021-02-07 | 2021-02-07 | Display control method, apparatus and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112799625A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160180762A1 (en) * | 2014-12-22 | 2016-06-23 | Elwha Llc | Systems, methods, and devices for controlling screen refresh rates |
| CN106919402A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of control method of mobile terminal, device and mobile terminal |
| CN108694033A (en) * | 2017-04-01 | 2018-10-23 | 英特尔公司 | Multiple refresh rates are supported in the different zones of panel display |
-
2021
- 2021-02-07 CN CN202110168554.2A patent/CN112799625A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160180762A1 (en) * | 2014-12-22 | 2016-06-23 | Elwha Llc | Systems, methods, and devices for controlling screen refresh rates |
| CN106919402A (en) * | 2017-03-10 | 2017-07-04 | 广东欧珀移动通信有限公司 | A kind of control method of mobile terminal, device and mobile terminal |
| CN108694033A (en) * | 2017-04-01 | 2018-10-23 | 英特尔公司 | Multiple refresh rates are supported in the different zones of panel display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Valliappan et al. | Accelerating eye movement research via accurate and affordable smartphone eye tracking | |
| US9626741B2 (en) | Systems and methods for configuring the display magnification of an electronic device based on distance and user presbyopia | |
| JP6096276B2 (en) | Selective backlight of display based on eye tracking | |
| US20140118240A1 (en) | Systems and Methods for Configuring the Display Resolution of an Electronic Device Based on Distance | |
| US10085635B2 (en) | Information processing method and wearable electronic device | |
| CN111867447B (en) | Electronic device for monitoring eye health of user and operation method thereof | |
| CN113012263A (en) | Configuration method of layer composition mode and electronic equipment | |
| CN112214112A (en) | Parameter adjusting method and device | |
| US20220130350A1 (en) | Recovery from eye-tracking loss in foveated displays | |
| US11800975B2 (en) | Eye fatigue prediction based on calculated blood vessel density score | |
| CN112799625A (en) | Display control method, apparatus and storage medium | |
| CN109426342B (en) | Document reading method and device based on augmented reality | |
| CN113495616A (en) | Terminal display control method, terminal, and computer-readable storage medium | |
| EP3440532B1 (en) | Improving readability of content displayed on a screen | |
| CN112799624A (en) | Control display method, apparatus and storage medium | |
| US20190366031A1 (en) | Visual disorder treatment | |
| CN117351866A (en) | Refresh rate regulating method, device, storage medium and electronic equipment | |
| Jalaliniya et al. | Symbiotic attention management in the context of internet of things | |
| CN106921890A (en) | A kind of method and apparatus of the Video Rendering in the equipment for promotion | |
| CN117877406A (en) | Control method, device and storage medium | |
| CN105812645B (en) | Information processing method and electronic equipment | |
| Wu et al. | Concentration Reminder: Distraction and Drowsiness Detection for Computer Users | |
| CN117872561A (en) | Focal length adjustment method, focal length adjustment device, VR device and readable storage medium | |
| CN116560837A (en) | Cache resource adjustment method and device, electronic equipment and readable storage medium | |
| CN116679822A (en) | Focusing control method of head-mounted equipment and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210514 |