CN116820246A - Screen adjustment control method and device with self-adaptive visual angle - Google Patents
Screen adjustment control method and device with self-adaptive visual angle Download PDFInfo
- Publication number
- CN116820246A CN116820246A CN202310822577.XA CN202310822577A CN116820246A CN 116820246 A CN116820246 A CN 116820246A CN 202310822577 A CN202310822577 A CN 202310822577A CN 116820246 A CN116820246 A CN 116820246A
- Authority
- CN
- China
- Prior art keywords
- electronic screen
- user
- screen
- sight
- sight line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 66
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000012544 monitoring process Methods 0.000 claims abstract description 58
- 238000005516 engineering process Methods 0.000 claims abstract description 35
- 238000004458 analytical method Methods 0.000 claims abstract description 26
- 230000004424 eye movement Effects 0.000 claims abstract description 24
- 210000003128 head Anatomy 0.000 claims description 92
- 210000001747 pupil Anatomy 0.000 claims description 20
- 230000003044 adaptive effect Effects 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 claims description 11
- 210000000744 eyelid Anatomy 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 11
- 238000012937 correction Methods 0.000 claims description 9
- 238000009826 distribution Methods 0.000 claims description 9
- 230000007306 turnover Effects 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 4
- 230000003203 everyday effect Effects 0.000 claims description 3
- 230000006978 adaptation Effects 0.000 claims 1
- 230000006870 function Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000012806 monitoring device Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000000265 homogenisation Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
Abstract
The invention discloses a screen adjustment control method and device with self-adaptive visual angles. The screen adjustment control method with the self-adaptive visual angle comprises the following steps: the electronic screen is communicated with the monitoring equipment, and monitoring data of the head of the user are obtained through the monitoring equipment; the electronic screen obtains the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzes and counts the monitoring data by combining the visual angle information and the sight line position of the user; generating a corresponding target adjustment scheme according to the visual angle information of the user, the sight line position and the analysis and statistics result; the electronic screen is turned over according to the target adjustment scheme. The invention distinguishes the identified head characteristics of the users, and generates the corresponding adjustment scheme according to the use index and different head characteristics, thereby achieving the purpose that the electronic screen can be adjusted in time and individuated according to the habit of the users, and solving the problem that the adjusting function of the electronic screen according to the relevant information of the sight of the users is not individuated.
Description
Technical Field
The invention relates to the technical field of screen adjustment, in particular to a screen adjustment control method and device with self-adaptive visual angles.
Background
Viewing angle self-adaptation means that parameters of a screen are automatically adjusted according to the sight line position and environmental conditions of a user so as to obtain a better display effect. The screen adjustment control is used for adjusting parameters such as brightness, contrast, color and the like of the display screen. In modern life, various electronic devices such as smartphones, tablet computers, televisions, and the like are widely used by people. However, the lighting conditions and viewing angle requirements vary from environment to environment and from scene to scene of use. In order to enhance the user experience, researchers have focused on developing a screen adjustment control technique with self-adaptive viewing angles to achieve automatic brightness and viewing angle adjustment of the screen in different environments, thereby providing more comfortable and optimized visual effects.
There are currently some existing implementations available for viewing angle adaptive screen adjustment control. The ambient light sensing technology can automatically adjust the screen brightness by sensing the ambient illumination intensity so as to provide a more comfortable visual experience. In addition, eye tracking techniques may monitor the gaze location of a user and adjust screen parameters based on gaze direction and viewing distance. Still other camera-based face recognition techniques may optimize the screen display based on the facial features and location of the user.
For example, publication No.: the invention patent of CN112406730B discloses a self-adaptive automobile central control screen adjusting device and an adjusting method for avoiding reflection dazzling, wherein the adjusting method comprises the following steps: establishing a data matrix of incident light brightness and central control screen brightness under typical weather conditions; establishing matrix data of an optimal arrangement angle of the eyepoint and the central control screen; adjusting the brightness of a screen; adjusting the arrangement angle of the optimal central control screen; the driver adjusts the screen brightness and the central control screen angle in a personalized way.
For example, publication No.: the invention patent of CN114919520A discloses a seat position-based self-adaptive adjustment method and system for a top screen, and a vehicle, wherein the method comprises the following steps: after the user sits, acquiring seat datum point information of the sitting position of the user; the seat datum point information is coordinate information of a seat datum point in a whole vehicle coordinate system; the whole vehicle coordinate system is constructed by taking left and right wheel centers of a front wheel as an origin; acquiring backrest angle information of the user sitting position; determining an eye ellipse center position of the user according to the seat reference point information and the backrest angle information; determining the relative distance between the overhead screen and the eye ellipse center position; and adjusting the position of the top screen based on the relative distance and a preset distance range so that the relative distance is within the preset distance range.
However, in the process of implementing the technical scheme of the embodiment of the application, the inventor discovers that the above technology has at least the following technical problems:
in the prior art, when a user browses an electronic screen, the electronic screen cannot timely adjust the angle of the electronic screen according to the use habit of the user, and the problem that the adjusting function of the electronic screen according to the sight related information of the user is not personalized exists.
Disclosure of Invention
The embodiment of the application solves the problem that the electronic screen is not personalized enough in the prior art according to the function of adjusting the relevant information of the user's sight by providing the screen adjusting control method and device with self-adaptive visual angles, and realizes that the electronic screen can be adjusted in time and personalized according to the habit of the user.
The embodiment of the application provides a screen adjustment control method with self-adaptive visual angle, which comprises the following steps: s1, an electronic screen is communicated with monitoring equipment, and monitoring data of the head of a user are obtained through the monitoring equipment; s2, the electronic screen obtains the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzes and counts the monitoring data by combining the visual angle information and the sight line position of the user; s3, generating a corresponding target adjustment scheme according to the visual angle information of the user, the sight line position and the analysis and statistics result; s4, the electronic screen is turned over according to the target adjustment scheme.
Further, the specific process of analyzing and counting the monitoring data by combining the user visual angle information and the sight line position is as follows: according to the visual angle information and the sight line position of the user, counting the time period delta t of each time the sight line position of the user falls on the electronic screen and the times sigma of each time period when the sight line position of the user falls on the electronic screen, and obtaining a time period distribution diagram of the times when the sight line position of the user falls on the electronic screen every day; overlapping the time period distribution map of the previous M days, and calculating a use index P of the user falling the sight position on the electronic screen in M days according to the overlapped distribution map information, wherein a specific calculation formula of the use index P is as followsWherein e is a natural constant, lambda 1 Is a correction factor; analyzing the monitoring data by combining the visual angle information and the sight position of the user to obtain the head characteristics of the user, wherein the head characteristics comprise head rotation characteristics and full-face characteristics when the sight position of the user can fall on the electronic screen; the head rotation feature acquiring process when the user sight position can fall on the electronic screen needs to combine all feature pictures of the head in the monitoring data and whether the user sight position falls on the electronic screen at the time corresponding to the pictures, if so, the head rotation feature is marked as an effective head rotation feature, and if the user's full face is detected and the sight position falls on the electronic screen, the head rotation feature is marked as an effective full face feature, wherein the head rotation feature does not comprise the full face feature; an adjustment scheme is generated based on the usage index and the user's head characteristics.
Further, the adjustment scheme includes a high frequency scheme, an economic scheme, and a power saving scheme: high frequency scheme: when the usage index is not lower than G 1 The electronic screen takes the visual angle information and the sight line position of the user obtained by the eye movement tracking technology as the generation basis of a target adjustment scheme, namely the electronic screen starts the eye movement tracking technology in real time to detect the specific visual angle information and the sight line position of the user, and generates a corresponding adjustment scheme; the economic scheme is as follows: when the usage index is lower than G 1 But not lower than G 2 When preset G 1 ＞G 2 The electronic screen takes the head rotation characteristic when the identified sight line position of the user can fall on the electronic screen as the generation basis of a target adjustment scheme, namely: when the electronic screen acquires the effective head rotation characteristics when the historical eye movement tracking technology detects that the sight position falls on the electronic screen, the effective head rotation characteristics are learned, so that a head rotation characteristic identification model capable of identifying the head rotation characteristics when the sight position falls on the electronic screen is obtained, the head rotation characteristics of a user in monitoring data are identified in real time through the head rotation characteristic identification model, and when the effective head rotation characteristics of the user are identified, the eye movement tracking technology is started to detect specific visual angle information and the sight position of the user, and a corresponding adjustment scheme is generated; the energy-saving scheme is as follows: When the usage index is lower than G 2 When the electronic screen only takes the recognized full-face characteristics of the head of the user as the generation basis of a target adjustment scheme, namely, when the electronic screen acquires the effective full-face characteristics when the historical eye movement tracking technology detects that the sight position falls on the electronic screen, the electronic screen learns the effective full-face characteristics to obtain a full-face characteristic recognition model capable of recognizing the full-face characteristics when the sight position falls on the electronic screen, real-time full-face characteristic recognition is carried out on monitoring data through the full-face characteristic recognition model, and when the full-face characteristics of the user are recognized, the eye movement tracking technology is started to detect specific visual angle information and the sight position of the user, and a corresponding adjustment scheme is generated.
Further, the results obtained according to the user visual angle information, the sight line position and the analysis statistics specifically refer to: analyzing the turning angle of the electronic screen according to the visual angle information and the sight line position of the user; counting the real-time moving speed when the sight line position of the user falls on the electronic screen, and analyzing the turning speed of the electronic screen according to the real-time moving speed; counting the entry points of the sight line positions on the electronic screen, and analyzing the reset angles of the electronic screen according to the entry points; and adjusting the electronic screen from the reset angle to the pre-judging position in advance according to the head characteristics of the user.
Further, the specific process of analyzing the turning angle of the electronic screen according to the visual angle information and the sight line position of the user is as follows: acquiring the binocular features of a user in the monitoring data through an image recognition technology, and acquiring the left eye distance between the binocular features and the electronic screenAnd right eye distance->Combining standard distance->Calculating the scaling epsilon of the electronic screen content, wherein the calculation formula of the scaling epsilon is +.>Wherein Δd is the allowable distance difference of the eye distance electronic screen to which the preset scaling ratio belongs, +.>For the set standard distance of eyes from the electronic screen, phi 1 And phi is 2 Respectively setting weight factors corresponding to the left eye-to-electronic screen distance difference and the right eye-to-electronic screen distance difference; identifying a pupil in an ocular feature and locating to the pupil center, calculating the identified pupil shape +.>And standard pupil frontal shape->Is fit psi of (1) 1 Degree of fit ψ 1 The calculation formula of (2) is as follows: />Wherein phi is 3 A correction factor for the set fitness; when the sight line position falls on the electronic screen and the fitness is greater than a certain threshold value, acquiring the horizontal connecting line length L between the centers of pupils of the eyes of the user Flat plate Length L of vertical line from midpoint of horizontal line to electronic screen Hanging down According to the horizontal angle between the horizontal line and the vertical line +.>Calculating the angle theta of the electronic screen to be adjusted in the horizontal direction (left and right) ：/>Wherein phi is 4 And phi is 5 Weighting factors of vertical distances from the left eye and the right eye to the electronic screen respectively; when the sight line position falls on the electronic screen and the fitness is larger than a certain threshold value, the distance between the pupil centers of the eyes of the user and the upper eyelid and the lower eyelid are respectively obtainedThe vertical distance between the two is used for calculating the angle theta of the electronic screen to be adjusted in the vertical direction Up and down ：/>Wherein, the liquid crystal display device comprises a liquid crystal display device,and->The distance between the left pupil center and the right pupil center from the upper eyelid, respectively,/->And->The distance between the center of the left pupil and the lower eyelid of the center of the right pupil, phi 6 Is a correction factor for adjusting the angle in the vertical direction.
Further, the scaling of the electronic screen content is calculated and adjusted in real time according to the distance between the binocular feature and the electronic screen, the scaling is preset with an upper limit and a lower limit, the scaling is not changed after the distance is not changed, at the moment, a gaze point amplifying frame is set under the current scaling, namely, according to the falling point of the gaze position of the user on the electronic screen, the minimum amplifying frame capable of simultaneously comprising the falling points of the gaze positions of the left eye and the right eye is found and set as the gaze point amplifying frame; and the gaze point amplifying frame translates on the electronic screen along with the gaze point falling points of the left eye and the right eye of the user, amplifies the covered content by a certain multiple, and simultaneously zooms in real time according to the gaze point falling range of the left eye and the right eye of the user.
Further, the step of analyzing the turning speed of the electronic screen according to the real-time moving speed specifically includes: acquiring standard turning speed of electronic screenWhen the user's line of sight position falls on the electronic screenReal-time movement speed +.>Line-of-sight dwell time; when the stay time of the sight line position on the electronic screen exceeds a certain threshold value and the real-time moving speed exceeds the sight line moving speed corresponding to the standard turning speed +.>Is not less than a total duration deltat of Total (S) Exceeding a standard time period DeltaT Label (C) The electronic screen passes the formula +.>Calculating new turnover speed->Wherein mu 1 Sum mu 2 The set total duration and the influence factors of the real-time moving speed of the sight line position corresponding to the new turning speed are respectively; and the electronic screen adjusts the turning speed to be a new turning speed according to the analysis and calculation result.
Further, the analyzing the reset angle of the electronic screen according to the access point specifically refers to: when the user falls the sight position on the electronic screen, recording and analyzing the entry points of the sight position into the electronic screen, when the number of the recorded entry points does not reach a certain value, the electronic screen is restored to the standard position after the sight position of the user leaves the electronic screen, and when the number of the recorded entry points reaches a certain value or exceeds a certain value, the electronic screen is restored to the normal position after the sight position of the user leaves the electronic screen; the conventional position refers to counting all recorded cut-in points, and the cut-in point position with the first cut-in point overlap ratio ranking is used as the cut-in point which appears in the next user sight position; and acquiring left and right turning angles and up and down turning angles of the electronic screen at the moment corresponding to the history of the access point, respectively solving a left and right turning angle mean value and an up and down turning angle mean value, and setting the left and right turning angle mean value and the up and down turning angle mean value as an electronic screen turning reset angle corresponding to a conventional position.
Further, the adjusting the electronic screen from the reset angle to the pre-determined position in advance according to the head characteristics of the user specifically refers to: the method comprises the steps of learning head rotation characteristics and head rotation change characteristics of a user in front of an electronic screen in each time of monitoring data; pre-judging the head rotation characteristic that the next time the user falls the sight position in front of the electronic screen; and adjusting the electronic screen from the reset angle to a pre-judging position in advance.
The embodiment of the application provides a screen adjustment control device with self-adaptive visual angle, which comprises an acquisition module, an analysis module, a generation module and an adjustment module: the acquisition module is used for: the electronic screen is communicated with the monitoring equipment, and monitoring data of the head of the user are obtained through the monitoring equipment; the analysis module: the electronic screen is used for acquiring the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzing and counting the monitoring data by combining the visual angle information and the sight line position of the user; the generation module is used for: the target adjustment method comprises the steps of generating a corresponding target adjustment scheme according to user visual angle information, sight line positions and analysis and statistics; and an adjustment module: the electronic screen is turned over according to the target adjustment scheme.
One or more technical solutions provided in the embodiments of the present application at least have the following technical effects or advantages:
1. the head characteristics of the users are distinguished through the identification, and corresponding adjustment schemes, namely a high-frequency scheme, an economic scheme and an energy-saving scheme are generated according to the use index and different head characteristics, so that the users can select the electronic screen adjustment scheme more suitable for themselves after a period of high-frequency scheme, the electronic screen can be adjusted in time and personalized according to the habit of the user, and the problem that in the prior art, the electronic screen is not personalized enough in adjusting function according to the relevant information of the sight of the user is effectively solved.
2. Through statistics user's sight position and velocity of movement, electronic screen can carry out angle adjustment according to individual user's viewing habit and demand to dynamic adjustment electronic screen's upset speed, thereby according to guaranteeing that flip angle and upset speed and user's operation action phase-match, avoid different users to the sight position of screen and velocity of movement to be different but correspond homogenization adjustment scheme, make individualized adjustment can adapt to user's demand better, and then realized providing the viewing experience that accords with user's habit and hobby more, improve user's perception and comfort level to electronic screen upset.
3. The head rotation characteristic and the head rotation change characteristic of each time the user falls in the front time period of the electronic screen in the monitoring data are learned, so that the electronic screen is quickly adjusted to the correct pre-judging position when the user projects the sight to the electronic screen, response delay is reduced, further, the user perceives more rapid interactive feedback is realized, and the real-time performance and the user experience of the system are improved.
Drawings
Fig. 1 is a flowchart of a screen adjustment control method with adaptive viewing angle according to an embodiment of the present application;
FIG. 2 is a flowchart of the pre-judging of angle adjustment according to an embodiment of the present application;
fig. 3 is a block diagram of a viewing angle adaptive screen adjustment control device according to an embodiment of the present application.
Detailed Description
The embodiment of the application solves the problem that in the prior art, the electronic screen is not personalized enough according to the function of adjusting the relevant information of the user's sight by providing the screen adjusting control method and device with self-adapting visual angle, distinguishes the user's head characteristics through the identified user's head characteristics, and generates a corresponding adjusting scheme according to the use index and different head characteristics, thereby realizing that the electronic screen can be adjusted to the electronic screen in a personalized manner in time according to the habit of the user.
The technical scheme in the embodiment of the application aims to solve the problem that the electronic screen is not personalized enough in adjusting function according to the relevant information of the user's sight, and the general thought is as follows:
the method comprises the steps of connecting an electronic screen with monitoring equipment to obtain monitoring data of a user head in the monitoring equipment; the electronic screen obtains relevant information of the user sight through an eye movement tracking technology, the relevant information of the sight comprises visual angle information and sight position, analysis and statistics are carried out on monitoring data by combining the visual angle information of the user and the sight position, and usage index, turnover angle (comprising left and right turnover angles and up and down turnover angles), turnover speed, reset angle, pre-judging adjustment position and three different basic adjustment schemes (comprising a high-frequency scheme, an economic scheme and an energy-saving scheme) of the electronic screen are obtained; generating a corresponding target adjustment scheme according to the visual angle information of the user, the sight line position and the analysis and statistics result; the electronic screen is turned over according to the target adjustment scheme, so that the electronic screen can be adjusted in time according to the custom individuation of the user.
In order to better understand the above technical solutions, the following detailed description will refer to the accompanying drawings and specific embodiments.
As shown in fig. 1, a flow chart of a viewing angle adaptive screen adjustment control method according to an embodiment of the present application is applied to a viewing angle adaptive screen adjustment control device, and the method includes the following steps: s1, an electronic screen is communicated with monitoring equipment, and monitoring data of the head of a user are obtained through the monitoring equipment; s2, the electronic screen obtains the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzes and counts the monitoring data by combining the visual angle information and the sight line position of the user; s3, generating a corresponding target adjustment scheme according to the visual angle information of the user, the sight line position and the analysis and statistics result; s4, the electronic screen is turned over according to the target adjustment scheme.
Further, the specific process of analyzing and counting the monitoring data by combining the visual angle information and the sight line position of the user is as follows: according to the visual angle information and the sight line position of the user, counting the time period delta t of each time the sight line position of the user falls on the electronic screen and the times sigma of each time period when the sight line position of the user falls on the electronic screen, and obtaining a time period distribution diagram of the times when the sight line position of the user falls on the electronic screen every day; overlapping the time period distribution map of the previous M days, and calculating that the sight position of the user falls on electricity in M days according to the overlapped distribution map information The usage index P on the sub-screen is specifically calculated asWherein e is a natural constant, lambda 1 Is a correction factor; analyzing the monitoring data by combining the visual angle information and the sight position of the user to obtain the head characteristics of the user, wherein the head characteristics comprise head rotation characteristics and full-face characteristics when the sight position of the user can fall on the electronic screen; the method comprises the steps that in the head rotation feature acquisition process when the sight position of a user can fall on an electronic screen, whether the sight position of the user falls on the electronic screen or not is required to be combined with all feature pictures of the head in monitoring data and the time corresponding to the pictures, if the sight position of the user falls on the electronic screen, the head rotation feature is marked as an effective head rotation feature, and meanwhile, if the full face of the user is detected and the sight position of the user falls on the electronic screen, the head rotation feature does not comprise the full face feature; an adjustment scheme is generated based on the usage index and the user's head characteristics.
Further, the adjustment scheme includes a high frequency scheme, an economic scheme, and an energy saving scheme: high frequency scheme: when the usage index is not lower than G 1 The electronic screen takes the visual angle information and the sight line position of the user obtained by the eye movement tracking technology as the generation basis of a target adjustment scheme, namely the electronic screen starts the eye movement tracking technology in real time to detect the specific visual angle information and the sight line position of the user, and generates a corresponding adjustment scheme; the economic scheme is as follows: when the usage index is lower than G 1 But not lower than G 2 When preset G 1 ＞G 2 The electronic screen takes the head rotation characteristic when the identified sight line position of the user can fall on the electronic screen as the generation basis of a target adjustment scheme, namely: when the electronic screen acquisition history eye movement tracking technology detects that the sight position falls on the electronic screen, effective head rotation characteristics exist, the effective head rotation characteristics are learned, a head rotation characteristic identification model capable of identifying the head rotation characteristics when the sight position falls on the electronic screen is obtained, and the head rotation characteristics of a user in monitoring data are identified in real time through the head rotation characteristic identification modelWhen the effective user head rotation characteristic is identified, starting an eye tracking technology to detect specific visual angle information and sight line position of a user, and generating a corresponding adjustment scheme; the energy-saving scheme is as follows: when the usage index is lower than G 2 When the electronic screen only takes the recognized full-face characteristics of the head of the user as the generation basis of a target adjustment scheme, namely, when the electronic screen acquires the effective full-face characteristics when the historical eye movement tracking technology detects that the sight position falls on the electronic screen, the electronic screen learns the effective full-face characteristics to obtain a full-face characteristic recognition model capable of recognizing the full-face characteristics when the sight position falls on the electronic screen, real-time full-face characteristic recognition is carried out on monitoring data through the full-face characteristic recognition model, and when the full-face characteristics of the user are recognized, the eye movement tracking technology is started to detect specific visual angle information and the sight position of the user, and a corresponding adjustment scheme is generated.
In this embodiment, the economic scheme and the energy-saving scheme need to be started to be used after the high-frequency scheme is used for a period of time, so that no history data is avoided as learning data of the recognition model. When the economical scheme is started, the eye tracking technology is started only after the effective head rotation feature is identified, the resource waste of the eye tracking technology used in real time is reduced relative to the high-frequency scheme, the response speed of the electronic screen is improved relative to the energy-saving scheme, when the energy-saving scheme is started, the eye tracking technology is started only after the effective full face feature is identified, and meanwhile, the response speed of the electronic screen is lower than that of the economical scheme, namely, the electronic screen is turned over after the full face feature is identified.
Further, the results obtained according to the user viewing angle information, the sight line position and the analysis statistics specifically refer to: analyzing the turning angle of the electronic screen according to the visual angle information and the sight line position of the user; counting the real-time moving speed when the sight line position of the user falls on the electronic screen, and analyzing the turning speed of the electronic screen according to the real-time moving speed; counting the entry points of the sight line positions on the electronic screen, and analyzing the reset angles of the electronic screen according to the entry points; and adjusting the electronic screen from the reset angle to the pre-judging position in advance according to the head characteristics of the user.
In this embodiment, after analysis statistics is performed on the monitoring data in combination with the user viewing angle information and the sight line position, a target adjustment scheme is generated according to analysis statistics results corresponding to the user viewing angle information, the sight line position and the monitoring data. The target adjustment scheme is different from an adjustment scheme generated according to the use index and the head characteristics of a user, wherein the adjustment scheme such as the turning angle, the turning speed, the reset angle and the like of the electronic screen is added on the basis of the adjustment scheme, and the adjustment scheme is the basic adjustment scheme, and the adjustment scheme is used for adjusting the mode of acquiring data.
Further, the specific process of analyzing the turning angle of the electronic screen according to the visual angle information and the sight line position of the user is as follows: acquiring the binocular features of a user in the monitoring data through an image recognition technology, and acquiring the left eye distance between the binocular features and the electronic screenAnd right eye distance->Combining standard distance->Calculating the scaling epsilon of the electronic screen content, wherein the calculation formula of the scaling epsilon is +.>Wherein Δd is the allowable distance difference of the eye distance electronic screen to which the preset scaling ratio belongs, +.>For the set standard distance of eyes from the electronic screen, phi 1 And phi is 2 Respectively setting weight factors corresponding to the left eye-to-electronic screen distance difference and the right eye-to-electronic screen distance difference; identifying a pupil in an ocular feature and locating to the pupil center, calculating the identified pupil shape +. >And standard ofPupil frontal shapeIs fit psi of (1) 1 Degree of fit ψ 1 The calculation formula of (2) is as follows: />Wherein phi is 3 A correction factor for the set fitness; when the sight line position falls on the electronic screen and the fitness is greater than a certain threshold value, acquiring the horizontal connecting line length L between the centers of pupils of the eyes of the user Flat plate Length L of vertical line from midpoint of horizontal line to electronic screen Hanging down According to the horizontal angle between the horizontal line and the vertical line +.>Calculating the angle theta of the electronic screen to be adjusted in the horizontal direction (left and right) ：Wherein phi is 4 And phi is 5 Weighting factors of vertical distances from the left eye and the right eye to the electronic screen respectively; when the sight line position falls on the electronic screen and the fitness is larger than a certain threshold, the distance between the centers of pupils of the eyes of the user and the upper eyelid and the vertical distance between the centers of the pupils of the eyes of the user and the lower eyelid are respectively obtained, and the angle theta required to be adjusted in the vertical direction of the electronic screen is calculated Up and down ：/>Wherein (1)>And->The distance between the left pupil center and the right pupil center from the upper eyelid, respectively,/->And->The distance between the center of the left pupil and the lower eyelid of the center of the right pupil, phi 6 Is a correction factor for adjusting the angle in the vertical direction.
In this embodiment, the display content of the electronic screen is adjusted according to the position of the user, and then the left-right flip angle and the up-down flip angle are calculated.
Further, the scaling of the electronic screen content is calculated and adjusted in real time according to the distance between the binocular features and the electronic screen, the scaling is preset with an upper limit and a lower limit, the scaling is not changed after the distance is not changed, at the moment, a gaze point amplifying frame is set under the current scaling, namely, according to the falling point of the gaze position of a user on the electronic screen, the minimum amplifying frame capable of simultaneously comprising the falling points of the gaze positions of the left eye and the right eye is found and set as the gaze point amplifying frame; the gaze point amplifying frame translates on the electronic screen along with the gaze point falling points of the left eye and the right eye of the user, amplifies the covered content by a certain multiple, and simultaneously zooms in real time according to the gaze point falling range of the left eye and the right eye of the user.
In this embodiment, on the basis of scaling of the original electronic screen content, a gaze point zoom-in frame is set again, and the shape of the zoom-in frame is appropriately selected according to the shape of the electronic screen, so as to ensure that the zoom-in frame can be shifted to the area where each content is located. The fixation point amplifying frame is arranged, so that a user can know the electronic screen according to the adjustment scheme, and the user can concentrate on the fixation point more conveniently.
Further, the step of analyzing the turning speed of the electronic screen according to the real-time moving speed specifically includes: acquiring standard turning speed of electronic screen Real-time movement speed when the user's gaze position falls on the electronic screen +.>Line-of-sight dwell time; when the line of sight is locatedThe stay time is set on the electronic screen to exceed a certain threshold value, and the real-time moving speed exceeds the sight moving speed corresponding to the standard turning speed +.>Is not less than a total duration deltat of Total (S) Exceeding a standard time period DeltaT Label (C) When the electronic screen passes through the formulaCalculating new turnover speed->Wherein mu 1 Sum mu 2 The set total duration and the influence factors of the real-time moving speed of the sight line position corresponding to the new turning speed are respectively; and the electronic screen adjusts the turning speed to be a new turning speed according to the analysis and calculation result.
In this embodiment, this function is used to adapt to the browsing speeds of different users. The purpose of setting the dwell time of the line of sight position on the electronic screen to exceed a certain threshold value is to avoid erroneous judgment caused by the line of sight being drawn across the electronic screen to other objects. The aim of setting the total time length of the line-of-sight moving speed corresponding to the real-time moving speed exceeding the standard turning speed to exceed the standard time length is to ensure that the user belongs to the situation that the long-term browsing time is long and the browsing speed is high, so that the electronic screen can be matched with the browsing speed of the user in time. The sight line moving speed corresponding to the standard turning speed can be preset and can be adjusted by a user to be suitable for the sight line moving speed standard of the user.
Further, the analysis of the reset angle of the electronic screen according to the entry point specifically refers to: when the user falls the sight position on the electronic screen, recording and analyzing the entry points of the sight position into the electronic screen, when the number of the recorded entry points does not reach a certain value, the electronic screen is restored to the standard position after the sight position of the user leaves the electronic screen, and when the number of the recorded entry points reaches a certain value or exceeds a certain value, the electronic screen is restored to the normal position after the sight position of the user leaves the electronic screen; the conventional position refers to counting all recorded access points, and the access point position with the first access point coincidence degree is ranked as the access point which appears in the next user sight position; and acquiring left and right turning angles and up and down turning angles of the electronic screen at the moment corresponding to the history of the access point, respectively solving a left and right turning angle mean value and an up and down turning angle mean value, and setting the left and right turning angle mean value and the up and down turning angle mean value as an electronic screen turning reset angle corresponding to a conventional position.
In this embodiment, when the number of the recorded entry points does not reach a certain value, the electronic screen is reset to the standard reset position after the user's line of sight leaves the electronic screen. The user can set whether to take personalized reset or not, if not, the access point record is reserved, but personalized reset is not carried out.
Further, as shown in fig. 2, in the angle adjustment pre-judging flowchart provided in the embodiment of the present application, the position for adjusting the electronic screen from the reset angle to the pre-judging position in advance according to the head characteristics of the user specifically refers to: the method comprises the steps of learning head rotation characteristics and head rotation change characteristics of a user in front of an electronic screen in each time of monitoring data; pre-judging the head rotation characteristic that the next time the user falls the sight position in front of the electronic screen; and adjusting the electronic screen from the reset angle to a pre-judging position in advance.
In this embodiment, the time period before the line of sight position falls on the electronic screen is a fixed duration, and is preset according to the actual situation, and all the head rotation features in the fixed duration are learned through deep learning, so that different habit rotation actions of the head of the user before the line of sight position falls on the electronic screen are learned, meanwhile, the overturn situation of the electronic screen corresponding to each habit rotation action is learned, the pre-judging position corresponding to each habit rotation action is found, and when a certain habit rotation action is identified next time, the position of the electronic screen is adjusted from the reset angle to the pre-judging position in advance.
As shown in fig. 3, in order to provide a structure diagram of a viewing angle adaptive screen adjustment control device according to an embodiment of the present application, the viewing angle adaptive screen adjustment control device according to the embodiment of the present application includes: the device comprises an acquisition module, an analysis module, a generation module and an adjustment module: the acquisition module is used for: the electronic screen is communicated with the monitoring equipment, and monitoring data of the head of the user are obtained through the monitoring equipment; and an analysis module: the electronic screen is used for acquiring the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzing and counting the monitoring data by combining the visual angle information and the sight line position of the user; the generation module is used for: the target adjustment method comprises the steps of generating a corresponding target adjustment scheme according to user visual angle information, sight line positions and analysis and statistics; and an adjustment module: the electronic screen is turned over according to the target adjustment scheme.
In this embodiment, the electronic screen is first connected to the monitoring device in the acquisition module, the monitoring device is mainly used for acquiring head monitoring data of a user, then the electronic film screen acquires monitoring data of the monitoring device in real time, the electronic screen acquires sight related information of the user in the analysis module through an eye tracking technology, the sight related information includes viewing angle information and sight position of the user, the electronic screen analyzes the sight related information, meanwhile, the monitoring data is analyzed by combining the sight related information, a corresponding target adjustment scheme is generated through the generation module according to a result obtained through analysis, and finally the electronic screen performs screen angle overturning according to the target adjustment scheme through the adjustment module.
The technical scheme provided by the embodiment of the application at least has the following technical effects or advantages: according to the embodiment of the application, the head features of the identified users are distinguished, and corresponding adjustment schemes, namely a high-frequency scheme, an economic scheme and an energy-saving scheme are generated according to the usage index and different head features, so that the users can select an electronic screen adjustment scheme more suitable for themselves after a period of high-frequency scheme, the electronic screen can be adjusted according to habits of the users in time in a personalized manner, and the problem that in the prior art, the electronic screen is not personalized enough in adjusting function according to the relevant information of the user's sight is effectively solved.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. The screen adjustment control method with the self-adaptive visual angle is characterized by comprising the following steps of:
s1, an electronic screen is communicated with monitoring equipment, and monitoring data of the head of a user are obtained through the monitoring equipment;
s2, the electronic screen obtains the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzes and counts the monitoring data by combining the visual angle information and the sight line position of the user;
s3, generating a corresponding target adjustment scheme according to the visual angle information of the user, the sight line position and the analysis and statistics result;
s4, the electronic screen is turned over according to the target adjustment scheme.
2. The method for controlling screen adjustment with adaptive viewing angle according to claim 1, wherein the specific process of analyzing and counting the monitored data by combining the user viewing angle information and the sight line position is as follows:
according to the visual angle information and the sight line position of the user, counting the time period delta t of each time the sight line position of the user falls on the electronic screen and the times sigma of each time period when the sight line position of the user falls on the electronic screen, and obtaining a time period distribution diagram of the times when the sight line position of the user falls on the electronic screen every day;
Overlapping the time period distribution map of the previous M days, and calculating a use index P of the user falling the sight position on the electronic screen in M days according to the overlapped distribution map information, wherein a specific calculation formula of the use index P is as followsWherein e is a natural constant, lambda 1 Is a correction factor;
analyzing the monitoring data by combining the visual angle information and the sight position of the user to obtain the head characteristics of the user, wherein the head characteristics comprise head rotation characteristics and full-face characteristics when the sight position of the user can fall on the electronic screen;
the head rotation feature acquiring process when the user sight position can fall on the electronic screen needs to combine all feature pictures of the head in the monitoring data and whether the user sight position falls on the electronic screen at the time corresponding to the pictures, if so, the head rotation feature is marked as an effective head rotation feature, and if the user's full face is detected and the sight position falls on the electronic screen, the head rotation feature is marked as an effective full face feature, wherein the head rotation feature does not comprise the full face feature;
an adjustment scheme is generated based on the usage index and the user's head characteristics.
3. The viewing angle adaptive screen adjustment control method of claim 2, wherein the adjustment scheme includes a high frequency scheme, an economical scheme, and a power saving scheme:
High frequency scheme: when the usage index is not lower than G 1 The electronic screen takes the visual angle information and the sight line position of the user obtained by the eye movement tracking technology as the generation basis of a target adjustment scheme, namely the electronic screen starts the eye movement tracking technology in real time to detect the specific visual angle information and the sight line position of the user, and generates a corresponding adjustment scheme;
the economic scheme is as follows: when the usage index is lower than G 1 But not lower than G 2 When preset G 1 ＞G 2 The electronic screen takes the head rotation characteristic when the identified sight line position of the user can fall on the electronic screen as the generation basis of a target adjustment scheme, namely: when the electronic screen acquisition history eye movement tracking technology detects that the sight line position falls on the electronic screen, effective head rotation characteristics exist, and the effective head rotation characteristics are learnedAcquiring a head rotation feature recognition model capable of recognizing head rotation features when the sight line position falls on the electronic screen, recognizing the head rotation features of the user in the monitoring data in real time through the head rotation feature recognition model, and starting an eye tracking technology to detect specific visual angle information and the sight line position of the user and generating a corresponding adjustment scheme when the effective head rotation features of the user are recognized;
The energy-saving scheme is as follows: when the usage index is lower than G 2 When the electronic screen only takes the recognized full-face characteristics of the head of the user as the generation basis of a target adjustment scheme, namely, when the electronic screen acquires the effective full-face characteristics when the historical eye movement tracking technology detects that the sight position falls on the electronic screen, the electronic screen learns the effective full-face characteristics to obtain a full-face characteristic recognition model capable of recognizing the full-face characteristics when the sight position falls on the electronic screen, real-time full-face characteristic recognition is carried out on monitoring data through the full-face characteristic recognition model, and when the full-face characteristics of the user are recognized, the eye movement tracking technology is started to detect specific visual angle information and the sight position of the user, and a corresponding adjustment scheme is generated.
4. The screen adjustment control method of visual angle adaptation according to claim 2, wherein the results obtained according to the visual angle information, the visual line position and the analysis statistics of the user specifically refer to:
analyzing the turning angle of the electronic screen according to the visual angle information and the sight line position of the user;
counting the real-time moving speed when the sight line position of the user falls on the electronic screen, and analyzing the turning speed of the electronic screen according to the real-time moving speed;
Counting the entry points of the sight line positions on the electronic screen, and analyzing the reset angles of the electronic screen according to the entry points;
and adjusting the electronic screen from the reset angle to the pre-judging position in advance according to the head characteristics of the user.
5. The method for controlling screen adjustment with adaptive viewing angle according to claim 4, wherein the specific process of analyzing the turning angle of the electronic screen according to the viewing angle information and the line-of-sight position of the user is as follows:
acquiring the binocular features of a user in the monitoring data through an image recognition technology, and acquiring the left eye distance between the binocular features and the electronic screenAnd right eye distance->Combining standard distance->Calculating the scaling epsilon of the electronic screen content, wherein the calculation formula of the scaling epsilon is +.>Wherein Δd is the allowable distance difference of the eye distance electronic screen to which the preset scaling ratio belongs, +.>For the set standard distance of eyes from the electronic screen, phi 1 And phi is 2 Respectively setting weight factors corresponding to the left eye-to-electronic screen distance difference and the right eye-to-electronic screen distance difference;
identifying and locating a pupil in an ocular feature to a pupil center, calculating an identified pupil shapeAnd standard pupil frontal shape->Is fit psi of (1) 1 Degree of fit ψ 1 The calculation formula of (2) is as follows: />Wherein phi is 3 A correction factor for the set fitness;
when the sight line position falls on the electronic screen and the fitness is greater than a certain threshold value, acquiring the horizontal connecting line length L between the centers of pupils of the eyes of the user Flat plate Length L of vertical line from midpoint of horizontal line to electronic screen Hanging down According to the horizontal included angle between the horizontal connecting line and the vertical connecting lineCalculating the angle theta of the electronic screen to be adjusted in the horizontal direction (left and right) ：Wherein phi is 4 And phi is 5 Weighting factors of vertical distances from the left eye and the right eye to the electronic screen respectively;
when the sight line position falls on the electronic screen and the fitness is larger than a certain threshold, the distance between the centers of pupils of the eyes of the user and the upper eyelid and the vertical distance between the centers of the pupils of the eyes of the user and the lower eyelid are respectively obtained, and the angle theta required to be adjusted in the vertical direction of the electronic screen is calculated Up and down ：Wherein (1)>And->The distance between the left pupil center and the right pupil center from the upper eyelid, respectively,/->And->Between the left pupil center and the right pupil center distance lower eyelidDistance of phi 6 Is a correction factor for adjusting the angle in the vertical direction.
6. The viewing angle adaptive screen adjustment control method of claim 5, wherein: the scaling of the electronic screen content is calculated and adjusted in real time according to the distance between the binocular features and the electronic screen, the scaling is preset with an upper limit and a lower limit, the scaling is not changed after the distance is not changed, at the moment, a gaze point amplifying frame is set under the current scaling, namely, according to the falling point of the gaze position of a user on the electronic screen, the minimum amplifying frame which can simultaneously comprise the falling points of the gaze positions of the left eye and the right eye is found and is set as the gaze point amplifying frame;
And the gaze point amplifying frame translates on the electronic screen along with the gaze point falling points of the left eye and the right eye of the user, amplifies the covered content by a certain multiple, and simultaneously zooms in real time according to the gaze point falling range of the left eye and the right eye of the user.
7. The method for controlling adjustment of a screen with adaptive viewing angle according to claim 4, wherein the analyzing the turning speed of the electronic screen according to the real-time moving speed specifically comprises:
acquiring standard turning speed of electronic screenReal-time movement speed when the user's gaze position falls on the electronic screen +.>Line-of-sight dwell time;
when the stay time of the sight line position on the electronic screen exceeds a certain threshold value and the real-time moving speed exceeds the sight line moving speed corresponding to the standard turning speedIs not less than a total duration deltat of Total (S) Exceeding a standard time period DeltaT Label (C) When the electronic screen passes through the formulaCalculating new turnover speed->Wherein mu 1 Sum mu 2 The set total duration and the influence factors of the real-time moving speed of the sight line position corresponding to the new turning speed are respectively;
and the electronic screen adjusts the turning speed to be a new turning speed according to the analysis and calculation result.
8. The method for controlling adjustment of a screen with adaptive viewing angle according to claim 4, wherein the analyzing the reset angle of the electronic screen according to the entry point specifically comprises: when the user falls the sight position on the electronic screen, recording and analyzing the entry points of the sight position into the electronic screen, when the number of the recorded entry points does not reach a certain value, the electronic screen is restored to the standard position after the sight position of the user leaves the electronic screen, and when the number of the recorded entry points reaches a certain value or exceeds a certain value, the electronic screen is restored to the normal position after the sight position of the user leaves the electronic screen;
The conventional position refers to counting all recorded cut-in points, and the cut-in point position with the first cut-in point overlap ratio ranking is used as the cut-in point which appears in the next user sight position;
and acquiring left and right turning angles and up and down turning angles of the electronic screen at the moment corresponding to the history of the access point, respectively solving a left and right turning angle mean value and an up and down turning angle mean value, and setting the left and right turning angle mean value and the up and down turning angle mean value as an electronic screen turning reset angle corresponding to a conventional position.
9. The method for controlling adjustment of a screen according to claim 4, wherein the step of adjusting the electronic screen from the reset angle to the predetermined position in advance according to the head characteristics of the user is as follows:
the method comprises the steps of learning head rotation characteristics and head rotation change characteristics of a user in front of an electronic screen in each time of monitoring data;
pre-judging the head rotation characteristic that the next time the user falls the sight position in front of the electronic screen;
and adjusting the electronic screen from the reset angle to a pre-judging position in advance.
10. The screen adjusting and controlling device with the self-adaptive visual angle is characterized by comprising an acquisition module, an analysis module, a generation module and an adjustment module:
The acquisition module is used for: the electronic screen is communicated with the monitoring equipment, and monitoring data of the head of the user are obtained through the monitoring equipment;
the analysis module: the electronic screen is used for acquiring the visual angle information and the sight line position of the user through an eye movement tracking technology, and analyzing and counting the monitoring data by combining the visual angle information and the sight line position of the user;
the generation module is used for: the target adjustment method comprises the steps of generating a corresponding target adjustment scheme according to user visual angle information, sight line positions and analysis and statistics;
the adjusting module is used for: the electronic screen is turned over according to the target adjustment scheme.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310822577.XA CN116820246A (en) | 2023-07-06 | 2023-07-06 | Screen adjustment control method and device with self-adaptive visual angle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310822577.XA CN116820246A (en) | 2023-07-06 | 2023-07-06 | Screen adjustment control method and device with self-adaptive visual angle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116820246A true CN116820246A (en) | 2023-09-29 |
Family
ID=88141114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310822577.XA Pending CN116820246A (en) | 2023-07-06 | 2023-07-06 | Screen adjustment control method and device with self-adaptive visual angle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116820246A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150109204A1 (en) * | 2012-11-13 | 2015-04-23 | Huawei Technologies Co., Ltd. | Human-machine interaction method and apparatus |
| WO2015184810A1 (en) * | 2014-11-18 | 2015-12-10 | 中兴通讯股份有限公司 | Method and device for adjusting screen display |
| WO2017088487A1 (en) * | 2015-11-27 | 2017-06-01 | 惠州Tcl移动通信有限公司 | Method and system for automatically adjusting screen scrolling speed based on eye recognition |
| US20170278476A1 (en) * | 2016-03-23 | 2017-09-28 | Boe Technology Group Co., Ltd. | Display screen adjusting method, display screen adjusting apparatus, as well as display device |
| CN108427503A (en) * | 2018-03-26 | 2018-08-21 | 京东方科技集团股份有限公司 | Human eye method for tracing and human eye follow-up mechanism |
| US20190121428A1 (en) * | 2017-10-19 | 2019-04-25 | Boe Technology Group Co., Ltd. | Adaptive parallax adjustment method and virtual reality display device |
| US20200090626A1 (en) * | 2017-06-02 | 2020-03-19 | Guangdong Xiaye Household Electrical Appliances Co., Ltd | Information terminal |
| WO2021098454A1 (en) * | 2019-11-21 | 2021-05-27 | 深圳云天励飞技术股份有限公司 | Region of concern detection method and apparatus, and readable storage medium and terminal device |
| CN115840502A (en) * | 2022-11-23 | 2023-03-24 | 深圳市华弘智谷科技有限公司 | Three-dimensional sight tracking method, device, equipment and storage medium |
| CN116382473A (en) * | 2023-03-07 | 2023-07-04 | 沈阳飞机设计研究所扬州协同创新研究院有限公司 | Sight calibration, motion tracking and precision testing method based on self-adaptive time sequence analysis prediction |
-
2023
- 2023-07-06 CN CN202310822577.XA patent/CN116820246A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150109204A1 (en) * | 2012-11-13 | 2015-04-23 | Huawei Technologies Co., Ltd. | Human-machine interaction method and apparatus |
| WO2015184810A1 (en) * | 2014-11-18 | 2015-12-10 | 中兴通讯股份有限公司 | Method and device for adjusting screen display |
| WO2017088487A1 (en) * | 2015-11-27 | 2017-06-01 | 惠州Tcl移动通信有限公司 | Method and system for automatically adjusting screen scrolling speed based on eye recognition |
| US20170278476A1 (en) * | 2016-03-23 | 2017-09-28 | Boe Technology Group Co., Ltd. | Display screen adjusting method, display screen adjusting apparatus, as well as display device |
| US20200090626A1 (en) * | 2017-06-02 | 2020-03-19 | Guangdong Xiaye Household Electrical Appliances Co., Ltd | Information terminal |
| US20190121428A1 (en) * | 2017-10-19 | 2019-04-25 | Boe Technology Group Co., Ltd. | Adaptive parallax adjustment method and virtual reality display device |
| CN108427503A (en) * | 2018-03-26 | 2018-08-21 | 京东方科技集团股份有限公司 | Human eye method for tracing and human eye follow-up mechanism |
| WO2021098454A1 (en) * | 2019-11-21 | 2021-05-27 | 深圳云天励飞技术股份有限公司 | Region of concern detection method and apparatus, and readable storage medium and terminal device |
| CN115840502A (en) * | 2022-11-23 | 2023-03-24 | 深圳市华弘智谷科技有限公司 | Three-dimensional sight tracking method, device, equipment and storage medium |
| CN116382473A (en) * | 2023-03-07 | 2023-07-04 | 沈阳飞机设计研究所扬州协同创新研究院有限公司 | Sight calibration, motion tracking and precision testing method based on self-adaptive time sequence analysis prediction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109937152B (en) | Driving state monitoring method and device, driver monitoring system and vehicle | |
| CN111079476A (en) | Driving state analysis method and device, driver monitoring system and vehicle | |
| CN103885589A (en) | Eye movement tracking method and device | |
| CN106445151B (en) | A kind of control method and terminal of screen luminance of terminal | |
| CN104076510A (en) | Method of adaptively adjusting head-mounted display and head-mounted display | |
| CN111179881B (en) | Method, device and system for adjusting brightness of vehicle-mounted display screen, automobile and controller | |
| CN104361332B (en) | A kind of face eye areas localization method for fatigue driving detection | |
| WO2023071884A1 (en) | Gaze detection method, control method for electronic device, and related devices | |
| CN104793741A (en) | Imaging system and method for guiding eyeballs to trace virtual reality | |
| CN105487782B (en) | A kind of method and system of the adjust automatically roll screen speed based on eye recognition | |
| CN104391574A (en) | Sight processing method, sight processing system, terminal equipment and wearable equipment | |
| TWI729983B (en) | Electronic device, system and method for adjusting display device | |
| CN112666705A (en) | Eye movement tracking device and eye movement tracking method | |
| CN101458921A (en) | Brightness regulating method and apparatus for display and computer thereof | |
| CN108711407B (en) | Display effect adjusting method, adjusting device, display equipment and storage medium | |
| CN111062292A (en) | Fatigue driving detection device and method | |
| CN102043942A (en) | Visual direction judging method, image processing method, image processing device and display device | |
| CN113932388B (en) | Method and device for controlling air conditioner, air conditioner and storage medium | |
| CN115171024A (en) | Face multi-feature fusion fatigue detection method and system based on video sequence | |
| CN106453965A (en) | Method and apparatus for adaptively adjusting backlight of terminal | |
| CN116820246A (en) | Screen adjustment control method and device with self-adaptive visual angle | |
| WO2018120929A1 (en) | Clear and smooth image playback control method based on vr glasses | |
| WO2023093033A1 (en) | Method and apparatus for controlling air conditioner, and air conditioner | |
| CN114980447A (en) | Desk control method and device, desk, electronic equipment and storage medium | |
| CN114816065A (en) | Screen backlight adjusting method, virtual reality device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |