WO2019153927A1 - Screen display method, device having display screen, apparatus, and storage medium - Google Patents

Screen display method, device having display screen, apparatus, and storage medium Download PDF

Info

Publication number
WO2019153927A1
WO2019153927A1 PCT/CN2018/123830 CN2018123830W WO2019153927A1 WO 2019153927 A1 WO2019153927 A1 WO 2019153927A1 CN 2018123830 W CN2018123830 W CN 2018123830W WO 2019153927 A1 WO2019153927 A1 WO 2019153927A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
screen
distance
display
Prior art date
Application number
PCT/CN2018/123830
Other languages
French (fr)
Chinese (zh)
Inventor
覃迪
张垚
朱剑波
韩放
Original Assignee
中国移动通信集团终端有限公司
中国移动通信集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国移动通信集团终端有限公司, 中国移动通信集团有限公司 filed Critical 中国移动通信集团终端有限公司
Publication of WO2019153927A1 publication Critical patent/WO2019153927A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones

Definitions

  • the present disclosure relates to the field of human interface technologies, and in particular, to a screen display method, an apparatus having a display screen, a device, and a storage medium.
  • a device having a display screen such as a mobile phone, a tablet computer, a television, a digital photo frame, a car screen, etc.
  • the user when the environment in which the user is in a change, or when different users use, the user usually needs to repeatedly adjust the direction or size of the screen.
  • the user In order to adapt to their own needs. For example, when the user forgets to wear glasses that correct vision, or when the distance between the user and the display screen changes, it is cumbersome and inconvenient to manually adjust the screen, resulting in a decrease in user experience.
  • an embodiment of the present disclosure provides a screen display method, including: acquiring facial feature information of a user before the screen; identifying identity information of the user according to the facial feature information; and acquiring personalized information of the user according to the identity information, and personalized information. Include the distance between the user's face and the screen, and the personalized display parameters of the corresponding screen; calculate the distance between the user's face and the screen; obtain the corresponding personalized display parameters according to the distance; adjust the screen according to the personalized display parameters The display effect.
  • acquiring facial feature information of the user before the screen includes: acquiring avatar information of the user; and acquiring facial feature information of the user according to the avatar information.
  • calculating a distance between a face of the user and the screen includes: capturing position information of the eyeball of the user according to the facial feature information; and calculating a distance between the face of the user and the screen according to the position information of the eyeball.
  • the method further includes: if the distance between the face of the user and the screen exceeds a minimum allowable value of the distance, and the unit of the screen displays the text within the area
  • the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
  • the method further includes: if the identity information of the user cannot be identified according to the facial feature information, determining that the user is a new user; configuring standardized information for the new user, and standardizing The information includes the distance between the user's face and the screen, and the standardized display parameters of the corresponding screen; reminding the new user to normalize the display parameters corresponding to the distance and distance in the standardized information, and calibrating one by one; storing the calibrated information, The calibrated information is used as personalized information for the user.
  • configuring the standardized information for the new user includes: acquiring uncorrected vision information of the new user and the glasses degree information after correcting the vision; and calculating the degree of the glasses according to the uncorrected vision information and the corrected vision
  • the first normalization information and the second normalization information are respectively configured; the standardized information selected by the new user is acquired, and the standardized information is any one of the first normalization information and the second standardized information.
  • the screen display method further includes: if the user adjusts the distance between the face of the user and the screen for a predetermined number of times within a predetermined time interval, determining that the user has a visual obstacle; selecting the user The standardized information is replaced with any one of the first normalized information and the second standardized information; the user is reminded to calibrate the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; and the calibrated information is stored The calibrated information is used as the personalized information of the user.
  • an embodiment of the present disclosure further provides an apparatus having a display screen, including: a feature collection unit, configured to acquire facial feature information of a user before the screen; and a processing unit, configured to identify the identity of the user according to the facial feature information.
  • Information obtaining personalized information of the user according to the identity information, the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen; calculating a distance between the face of the user and the screen; Obtaining a corresponding personalized display parameter; a display unit configured to adjust a display effect of the screen according to the value of the display parameter.
  • the processing unit is further configured to: if the user's identity information cannot be identified according to the facial feature information, determine that the user is a new user; configure the standardized information for the new user, the standardized information including the user's face and the screen The distance between the distance and the standardized display parameters of the corresponding screen; remind the new user to calibrate the standardized display parameters corresponding to the distance and distance in the standardized information; store the calibrated information, and use the calibrated information as the user's personality Information.
  • a device having a display screen is provided with vision detecting means for acquiring uncorrected visual acuity information of a new user and optician degree information after correcting visual acuity;
  • the processing unit is further configured to respectively configure the first normalization information and the second normalization information according to the uncorrected visual acuity information and the corrected degree information of the corrected visual acuity; acquire the standardized information selected by the new user, and the standardized information is the first standardized information and the second Any of the standardized information.
  • the processing unit is further configured to: if the user adjusts the distance between the face of the user and the screen for a predetermined number of times within a predetermined time interval, determining that the user has a visual obstacle; selecting the user The standardized information is replaced with any one of the first normalized information and the second standardized information; the user is reminded to perform calibration on the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; and the stored information is stored, The calibrated information is used as the personalized information of the user.
  • the processing unit is further configured to: if the distance between the face of the user and the screen exceeds a minimum allowable value of the distance, and the number of characters in the unit display area of the screen is greater than the preset number of characters, then The display area on the screen is moved so that the text is partially enlarged and scrolled line by line in the enlarged area that is left after being moved by the display area.
  • an embodiment of the present disclosure further provides an apparatus having a display screen, including: a memory storing computer program instructions; and a processor, when the computer program instructions are executed by the processor, implementing the screen display method as described above .
  • embodiments of the present disclosure also provide a computer readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform a screen display method as described above.
  • FIG. 1 is a flow chart of a screen display method according to Embodiment 1 of the present disclosure.
  • FIG. 2 is a schematic diagram of an application scenario of the screen display method shown in FIG. 1;
  • FIG. 3 is a schematic diagram of another application scenario of the screen display method shown in FIG. 1;
  • FIG. 4 is a schematic diagram of another application scenario of the screen display method shown in FIG. 1;
  • FIG. 5 is a schematic diagram of another application scenario of the screen display method illustrated in FIG. 1;
  • FIG. 5 is a schematic diagram of another application scenario of the screen display method illustrated in FIG. 1;
  • FIG. 6 is a flow chart of another screen display method according to Embodiment 2 of the present disclosure.
  • FIG. 7 is a schematic diagram of a feature face for identifying identity information of a user in the screen display method shown in FIG. 6;
  • FIG. 8 is a flow chart showing the acquisition of facial feature information of a user in the screen display method shown in FIG. 6;
  • FIG. 9 is a flow chart showing a process of configuring personalized information for a new user in the screen display method shown in FIG. 6;
  • FIG. 10 is a flow chart showing a process of configuring standardization information for a new user in the screen display method shown in FIG. 9;
  • FIG. 11 is a flow chart showing a calculation of a distance between a face of a user and a screen in the screen display method shown in FIG. 6;
  • FIG. 12 is a flow chart showing a process of configuring personalized information for a visually impaired user in the screen display method shown in FIG. 6;
  • FIG. 13 is a schematic diagram of an apparatus having a display screen according to Embodiment 3 of the present disclosure.
  • FIG. 14 is a schematic diagram of another apparatus having a display screen according to Embodiment 4 of the present disclosure.
  • FIG. 15 is a schematic diagram of an application scenario of the device with a display screen shown in FIG. 14.
  • a first embodiment of the present disclosure provides a screen display method, including:
  • step S1' the distance between the face of the user and the screen is calculated.
  • the screen can be a display for devices such as mobile phones, computers, and televisions.
  • the distance between the user's face and the screen can be measured using, but not limited to, an infrared sensing device or a distance sensor. It can also be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision.
  • the distance between the user's face and the screen can be calculated in real time, and the distance between the user's face and the screen can be calculated periodically.
  • the period duration can be 5 to 10 s, depending on the specific use. Depending on the occasion.
  • step S2' the corresponding display parameter is obtained according to the distance.
  • the display parameter of the corresponding screen may be preset. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
  • step S3' the display effect of the screen is adjusted according to the display parameters.
  • obtaining the facial feature information of the user in front of the screen can identify the identity information of the user C, and obtain the personalized information of the user C according to the identity information.
  • the personalized information of the user C is queried according to the distance L, the display parameter P1 corresponding to the distance L is obtained, and the display effect of the screen is adjusted according to the display parameter P1, such as As shown in interface a in Figure 2, four icons are displayed in the display of the mobile phone.
  • the display parameter P2 corresponding to the distance L is obtained by querying the personalized information of the user C, and the display of the screen is adjusted according to the display parameter P2.
  • the effect as shown in the interface b in FIG. 3, is that the icons in the display screen of the mobile phone are reduced according to a fixed rule and then rearranged, and a total of six icons are displayed.
  • the display parameter P3 corresponding to the distance L is obtained by querying the personalized information of the user C, and the display effect of the screen is adjusted according to the display parameter P3.
  • the icons in the display screen of the mobile phone are further reduced according to a fixed rule, and then rearranged, and a total of eight icons are displayed.
  • the distances A, B, and C in the predetermined information are merely exemplary descriptions, and are not limited to these three values, and may be set according to specific application scenarios.
  • the method further includes: if the distance between the face of the user and the screen exceeds the minimum allowable value of the distance, and the unit of the screen displays the text within the area When the number is greater than the preset number of characters, the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
  • the image can also be enlarged at the same time in accordance with the magnification of the text.
  • the size of the normal display area and the enlarged area can be adjusted according to the user's usage scenario.
  • the screen display method provided in Embodiment 1 of the present disclosure can make the screen adaptively change according to changes in the environment in which the user is located, so that the user can better view the screen and improve the user experience.
  • a second embodiment of the present disclosure further provides a screen display method, including:
  • step S1 facial feature information of the user before the screen is acquired.
  • the screen can be a display for devices such as mobile phones, computers, and televisions.
  • the facial feature information may be the facial contour of the human body, the size and position of the eyeball or the size and position of the bridge of the nose, and may also include whether or not to wear glasses or the like.
  • step S2 the identity information of the user is identified according to the facial feature information.
  • the identity information of the user can be identified.
  • the identity information of the user may be identified according to an avatar recognition algorithm in the related art, including but not limited to a feature face algorithm (Eigenface).
  • a feature face algorithm Eigenface
  • M face images including facial feature information of a human body are acquired, and each face image can be converted into an N-dimensional vector to form an M*N-dimensional training image set S, and the training image set S After the dimension reduction is N*N matrix, the feature vector u is solved.
  • the feature vector u is the deviation of each image vector and the mean image in the training image set S in the direction, and the projection of the face to be recognized in the feature vector is performed. , the difference between the face to be recognized and the mean image in different directions can be known. If these feature vectors are restored to pixel arrangement, it is like a human face, so it is called a feature face, as shown in Figure 2.
  • the kth feature face can be marked as:
  • u k is the vector of the kth feature face
  • is the N-dimensional vector of the face image
  • is the N-dimensional vector of the mean image of the training image set S.
  • Equation (1) can calculate the weight of the kth feature face u k , and M weights can form a vector ⁇ T , as shown in equation (2):
  • ⁇ T [ ⁇ 1 , ⁇ 2 , ... ⁇ M ] (2)
  • the face to be recognized is identified according to formula (3):
  • is the weight vector of the face to be recognized
  • ⁇ k is the weight vector of a certain face in the training image set S
  • ⁇ k is the Euclidean distance of the two.
  • Step S3 Acquire personalized information of the user according to the identity information, where the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen, as shown in FIG. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
  • step S4 the distance between the face of the user and the screen is calculated.
  • the calculation method of the distance can be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision. It can also be measured using, for example, but not limited to, an infrared sensing device or a distance sensor.
  • step S5 the corresponding personalized display parameter is obtained according to the distance.
  • step S6 the display effect of the screen is adjusted according to the personalized display parameter.
  • the screen display method provided by the second embodiment of the present disclosure can query the personalized information of the user according to the identity information of the user and the change of the environment, so that the screen is adaptively changed, so as to meet the usage requirements of each user and enable the user. Better viewing of the screen further enhances the user experience.
  • step S1 obtaining facial feature information of the user before the screen includes:
  • step S11 the avatar information of the user is obtained.
  • the avatar information of the user may obtain avatar information by, for example, but not limited to, a camera device, an infrared sensing device, or other sensing means.
  • Step S12 Acquire facial feature information of the user according to the avatar information.
  • step S2 after identifying the identity information of the user according to the facial feature information, the method further includes:
  • Step S21 if the identity information of the user cannot be identified according to the facial feature information, it is determined that the user is a new user.
  • the eigenface algorithm described above when the Euclidean distance of the face to be recognized and all the faces in the training image set S are greater than the threshold, it can be determined that the face to be recognized is not in the training image set S, so it is determined that The user is a new user.
  • Step S22 configuring standardization information for the new user, the standardized information including the distance between the face of the user and the screen, and the standardized display parameter of the screen corresponding to the distance;
  • step S23 the new user is reminded to perform calibration on the standardized display parameters corresponding to the distance and the distance in the standardized information.
  • step S24 the calibrated information is stored, and the calibrated information is used as the personalized information of the user.
  • step S22 standardization information is configured for a new user, including:
  • Step S221 acquiring uncorrected vision information of the new user and the glasses degree information after correcting the vision
  • Step S222 respectively configuring first normalization information and second normalization information according to the uncorrected visual acuity information and the corrected degree information of the corrected visual acuity;
  • step S4 calculating the distance between the user's face and the screen includes:
  • Step S41 capturing location information of the user's eyeball based on the facial feature information.
  • the position information of the user's eyeball can be captured in real time, and the position information of the user's eyeball can be periodically captured.
  • the period duration can be 5 to 10 s, depending on the specific use occasion.
  • the eyeball tracking algorithm can be used to capture the position information of the user's eyeball. Based on the aforementioned eigenface algorithm, it is possible to lock the possible positional area of the eyeball, and when looking for the eyeball position, it is only necessary to process it in the area where the smaller human eye is possible. In this area, the eyeball model can be approximately circular, or partially circular due to eyelids or other objects. Due to the distinct color differences between the iris and the white of the eye, there is also a significant edge separation in the grayscale image with a large gradient at the edges. Geometrically: the center of a circular object can be detected by analyzing the vector field of the image gradient, which has previously been used for eye center positioning.
  • the center of the eyeball is detected by utilizing the characteristics of the flow field generated by the strong gray scale contrast between the iris and the sclera.
  • This method calculates the direction of the gradient vector for each point on the image and plots the line along the direction of the gradient. For each such point added to each point, a count is added to the corresponding container at that point. Finally, the cumulative count of the corresponding containers at all points on the image is counted.
  • the point corresponding to the container with the largest count value can be considered as the center of a circular area in the image, and the center can be considered as the center of the eyeball.
  • the eye tracking algorithm can overcome these problems through a post-processing step, which is to set a threshold to judge the objective function. Applying this threshold to delete a part of the fake eye target, and then determining the maximum eigenvalue of the remaining candidate eye targets, thereby determining the true target among the remaining candidate targets. This process is compared with the initial judgment, and most of the interference targets are eliminated, and the remaining candidate targets are judged, thereby improving the accuracy of the detection. And this threshold can be used to take 90% of the maximum eigenvalue in the entire image.
  • the above-mentioned eye tracking algorithm is a technology in the related art, and will not be described herein.
  • step S42 the distance between the face of the user and the screen is calculated according to the position information of the eyeball.
  • the distance between the user's face and the screen can be calculated.
  • the position information of the two eyeballs of the user can be captured in real time or periodically, and the three-dimensional information of the measured object can be obtained by using the imaging difference of the same target on the two projected images, thereby calculating The distance between the user's face and the screen.
  • the above distance identification algorithm is a technology in the related art, and details are not described herein again.
  • the screen display method provided by the embodiment of the present disclosure further includes:
  • step S7 if the user adjusts the distance between the face of the user and the screen more than the preset number of times within the predetermined time interval, it is determined that the user has a visual disorder.
  • Step S8 replacing the standardized information selected by the user with any one of the first normalization information and the second normalization information;
  • Step S9 prompting the user to perform calibration on the standardized display parameters corresponding to the distance and the distance in the standardized information after the replacement;
  • step S10 the calibrated information is stored, and the calibrated information is used as the personalized information of the user.
  • step S4 after calculating the distance between the face of the user and the screen in step S4, further comprising: if the distance between the face of the user and the screen exceeds the minimum allowable value of the distance, and When the number of characters in the unit display area of the screen is larger than the preset number of characters, the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
  • the image can also be enlarged at the same time in accordance with the magnification of the text.
  • the size of the normal display area and the enlarged area can be adjusted according to the user's usage scenario.
  • the screen display method provided by the second embodiment of the present disclosure can identify the personalized needs of different users in different environments by recognizing the identity information of the user, thereby enabling the screen to be adaptively changed, such as zooming in, zooming out, zooming, Partially zoom in and out and rearrange according to fixed rules, so that users can better watch the screen and improve the user experience.
  • a third embodiment of the present disclosure also provides an apparatus having a display screen, comprising: a processing unit 20' and a display unit 30'.
  • the device having the display screen may be a terminal device such as a mobile phone, a computer, a tablet computer, or a separate display device.
  • the embodiment of the present disclosure is described by taking a computer as an example.
  • the processing unit 20' is configured to calculate the distance between the face of the user and the screen, which may be calculated in real time or periodically, and the corresponding display parameters are obtained from the distance.
  • the display parameter of the corresponding screen may be preset. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
  • processing unit 20' may measure the distance between the user's face and the screen based on, for example, a distance sensor including, but not limited to, an infrared sensing device. It can also be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision.
  • the display unit 30' is for adjusting the display effect of the screen in accordance with the display parameters.
  • the processing unit 20' is further configured to: on the screen The display area is moved to partially enlarge the text and scroll by line by line in the enlarged area remaining after being moved by the display area.
  • the device with the display screen provided by the third embodiment of the present disclosure can make the screen adaptively change according to the change of the user's environment, so that the user can better view the screen and improve the user experience.
  • Embodiment 4 of the present disclosure further provides an apparatus having a display screen, including: a feature collection unit 10, a processing unit 20, and a display unit 30.
  • the device having the display screen may be a terminal device such as a mobile phone, a computer, a tablet computer, or a separate display device.
  • the embodiment of the present disclosure is described by taking a computer as an example.
  • the feature collection unit 10 is configured to acquire facial feature information of the user before the screen.
  • the feature collection unit 10 can be, but not limited to, an infrared sensing device.
  • the apparatus for displaying a screen provided by the embodiment of the present disclosure further includes an image capturing apparatus for acquiring the avatar information of the user, and the feature collecting unit 10 acquires the facial feature information of the user according to the avatar information.
  • the processing unit 20 is configured to identify the identity information of the user according to the facial feature information, and obtain the personalized information of the user according to the identity information, where the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen; Calculating the distance between the user's face and the screen, the distance can be calculated in real time or periodically, and the corresponding display parameters are obtained according to the distance.
  • processing unit 20 may measure the distance between the user's face and the screen based on, for example, a distance sensor including, but not limited to, an infrared sensing device.
  • the processing unit 20 may further acquire the facial feature information of the user according to the avatar information of the user acquired by the feature collecting unit 10, and capture the position information of the eyeball of the user in real time or periodically according to the facial feature information. And using the eye tracking technology and the three-dimensional ranging principle in stereo vision, the distance between the user's face and the screen is calculated.
  • the display unit 30 is configured to adjust the display effect of the screen according to the personalized display parameter.
  • the device with the display screen provided in Embodiment 4 of the present disclosure can make the screen adaptively change according to the identity information of the user and the environment of the user, so that the user can better view the screen and improve the user experience.
  • the processing unit 20 is further configured to determine that the user is a new user; configure standardized information for the new user, and the standardized information includes a distance between the face of the user and the screen, and Normalized display parameters of the corresponding screen; remind new users to normalize the display parameters corresponding to the distance and distance in the standardized information, and calibrate one by one, for example, by pop-up dialog; store the calibrated information, and calibrate the information Personalized information as a user.
  • the device with the display screen provided by the embodiment of the present disclosure is configured with a vision detecting device (not shown), and the visual acuity detecting device can detect whether the visual acuity of the user is myopia, hyperopia, astigmatism or even night blindness, and according to the detection result. Obtain the information on the degree of optician after correcting vision. The vision detecting device can also acquire uncorrected vision information of the user.
  • processing unit 20 is further configured to: respectively configure the first normalization information and the second normalization information according to the uncorrected vision information and the corrected degree information of the corrected vision; acquire the standardized information selected by the new user, and the standardized information is the first standardized Any of information and second standardized information.
  • the processing unit 20 is further configured to: determine that the user has a visual obstacle; and replace the standardized information selected by the user. For any one of the first normalization information and the second normalization information; reminding the user to perform calibration on the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; storing the calibrated information, and calibrating the information Information as personalized information for users.
  • the processing unit 20 is further configured to: display on the screen The area is moved so that the text is partially enlarged and scrolled line by line within the enlarged area that is left after being moved by the display area.
  • the device having the display screen provided by the embodiment of the present disclosure is the execution body of the foregoing screen display method.
  • the specific execution manner of each unit refer to the content of the foregoing screen display method, and details are not described herein again.
  • an embodiment of the present disclosure further provides an apparatus having a display screen, including: a memory storing computer program instructions; and a processor, when the computer program instructions are executed by the processor, implementing the screen display method as described above.
  • embodiments of the present disclosure also provide a computer readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform a screen display method as previously described.

Abstract

A screen display method, a device having a display screen, an apparatus, and a storage medium. The screen display method comprises: acquiring facial feature information of a user in front of a screen (S1); identifying identity information of the user according to the facial feature information (S2); acquiring personalized information of the user according to the identity information, the personalized information comprising a distance between the face of the user and the screen, and personalized display parameters of the screen corresponding to distances (S3); calculating the distance between the face of the user and the screen (S4); acquiring a personalized display parameter corresponding to the distance (S5); and adjusting a display effect of the screen according to the personalized display parameter (S6).

Description

屏幕显示方法、具有显示屏幕的装置、设备及存储介质Screen display method, device with display screen, device and storage medium
相关申请的交叉引用Cross-reference to related applications
本申请主张在2018年2月11日在中国提交的中国专利申请号No.201810140198.1的优先权,其全部内容通过引用包含于此。The present application claims priority to Chinese Patent Application No. 20110114019, the entire disclosure of which is incorporated herein in
技术领域Technical field
本公开涉及人机接口技术领域,特别是涉及一种屏幕显示方法、具有显示屏幕的装置、设备及存储介质。The present disclosure relates to the field of human interface technologies, and in particular, to a screen display method, an apparatus having a display screen, a device, and a storage medium.
背景技术Background technique
相关技术中,对于手机、平板电脑、电视、数码相框、车载屏幕等具有显示屏幕的装置,用户所处的环境发生变化时,或者不同的用户使用时,通常需要用户反复调整屏幕的方向或大小,以便适应自己的需求。例如,用户忘记佩戴矫正视力的眼镜,或者用户与显示屏幕之间的距离变动时,但是,手动调整屏幕比较繁琐且不方便,导致用户体验降低。In the related art, for a device having a display screen such as a mobile phone, a tablet computer, a television, a digital photo frame, a car screen, etc., when the environment in which the user is in a change, or when different users use, the user usually needs to repeatedly adjust the direction or size of the screen. In order to adapt to their own needs. For example, when the user forgets to wear glasses that correct vision, or when the distance between the user and the display screen changes, it is cumbersome and inconvenient to manually adjust the screen, resulting in a decrease in user experience.
发明内容Summary of the invention
一方面,本公开实施例提供了一种屏幕显示方法,其包括:获取屏幕前用户的面部特征信息;根据面部特征信息识别用户的身份信息;根据身份信息获取用户的个性化信息,个性化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的个性化显示参数;计算用户的面部与屏幕之间的距离;根据距离获取对应的个性化显示参数;根据个性化显示参数调整屏幕的显示效果。In one aspect, an embodiment of the present disclosure provides a screen display method, including: acquiring facial feature information of a user before the screen; identifying identity information of the user according to the facial feature information; and acquiring personalized information of the user according to the identity information, and personalized information. Include the distance between the user's face and the screen, and the personalized display parameters of the corresponding screen; calculate the distance between the user's face and the screen; obtain the corresponding personalized display parameters according to the distance; adjust the screen according to the personalized display parameters The display effect.
根据本公开实施例的一方面,获取屏幕前用户的面部特征信息包括:获取用户的头像信息;根据头像信息获取用户的面部特征信息。According to an aspect of the embodiments of the present disclosure, acquiring facial feature information of the user before the screen includes: acquiring avatar information of the user; and acquiring facial feature information of the user according to the avatar information.
根据本公开实施例的一方面,计算用户的面部与屏幕之间的距离包括:根据面部特征信息捕捉用户的眼球的位置信息;根据眼球的位置信息计算 用户的面部与屏幕之间的距离。According to an aspect of an embodiment of the present disclosure, calculating a distance between a face of the user and the screen includes: capturing position information of the eyeball of the user according to the facial feature information; and calculating a distance between the face of the user and the screen according to the position information of the eyeball.
根据本公开实施例的一方面,计算用户的面部与屏幕之间的距离之后,进一步包括:如果用户的面部与屏幕之间的距离超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。According to an aspect of an embodiment of the present disclosure, after calculating a distance between a face of the user and the screen, the method further includes: if the distance between the face of the user and the screen exceeds a minimum allowable value of the distance, and the unit of the screen displays the text within the area When the number is greater than the preset number of characters, the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
根据本公开实施例的一方面,根据面部特征信息识别用户的身份信息之后,还包括:如果根据面部特征信息无法识别用户的身份信息,则判断用户为新用户;为新用户配置标准化信息,标准化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的标准化显示参数;提醒新用户对标准化信息中的距离及距离对应的标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为用户的个性化信息。According to an aspect of an embodiment of the present disclosure, after identifying the identity information of the user according to the facial feature information, the method further includes: if the identity information of the user cannot be identified according to the facial feature information, determining that the user is a new user; configuring standardized information for the new user, and standardizing The information includes the distance between the user's face and the screen, and the standardized display parameters of the corresponding screen; reminding the new user to normalize the display parameters corresponding to the distance and distance in the standardized information, and calibrating one by one; storing the calibrated information, The calibrated information is used as personalized information for the user.
根据本公开实施例的一方面,为新用户配置标准化信息,包括:获取新用户的未矫正视力信息和矫正视力后的配镜度数信息;根据未矫正视力信息和矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;获取新用户选择的标准化信息,标准化信息为第一标准化信息和第二标准化信息中的任一者。According to an aspect of the embodiments of the present disclosure, configuring the standardized information for the new user includes: acquiring uncorrected vision information of the new user and the glasses degree information after correcting the vision; and calculating the degree of the glasses according to the uncorrected vision information and the corrected vision The first normalization information and the second normalization information are respectively configured; the standardized information selected by the new user is acquired, and the standardized information is any one of the first normalization information and the second standardized information.
根据本公开实施例的一方面,屏幕显示方法还包括:如果用户在预定时间间隔内,调整用户的面部与屏幕之间的距离的次数大于预设次数,则判断用户有视觉障碍;将用户选择的标准化信息更换为,第一标准化信息和第二标准化信息中的任一者;提醒用户对更换后的标准化信息中的距离与距离对应的标准化的显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为用户的个性化信息。According to an aspect of an embodiment of the present disclosure, the screen display method further includes: if the user adjusts the distance between the face of the user and the screen for a predetermined number of times within a predetermined time interval, determining that the user has a visual obstacle; selecting the user The standardized information is replaced with any one of the first normalized information and the second standardized information; the user is reminded to calibrate the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; and the calibrated information is stored The calibrated information is used as the personalized information of the user.
另一方面,本公开实施例还提供了一种具有显示屏幕的装置,其包括:特征采集单元,用于获取屏幕前用户的面部特征信息;处理单元,用于根据面部特征信息识别用户的身份信息;根据身份信息获取用户的个性化信息,个性化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的个性化显示参数;计算用户的面部与屏幕之间的距离;根据距离获取对 应的个性化显示参数;显示单元,用于根据显示参数的数值调整屏幕的显示效果。On the other hand, an embodiment of the present disclosure further provides an apparatus having a display screen, including: a feature collection unit, configured to acquire facial feature information of a user before the screen; and a processing unit, configured to identify the identity of the user according to the facial feature information. Information; obtaining personalized information of the user according to the identity information, the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen; calculating a distance between the face of the user and the screen; Obtaining a corresponding personalized display parameter; a display unit configured to adjust a display effect of the screen according to the value of the display parameter.
根据本公开实施例的一方面,处理单元进一步用于,如果根据面部特征信息无法识别用户的身份信息,则判断用户为新用户;为新用户配置标准化信息,标准化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的标准化显示参数;提醒新用户对标准化信息中的距离及距离对应的标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为用户的个性化信息。According to an aspect of an embodiment of the present disclosure, the processing unit is further configured to: if the user's identity information cannot be identified according to the facial feature information, determine that the user is a new user; configure the standardized information for the new user, the standardized information including the user's face and the screen The distance between the distance and the standardized display parameters of the corresponding screen; remind the new user to calibrate the standardized display parameters corresponding to the distance and distance in the standardized information; store the calibrated information, and use the calibrated information as the user's personality Information.
根据本公开实施例的一方面,具有显示屏幕的装置配置有视力检测装置,用于获取新用户的未矫正视力信息和矫正视力后的配镜度数信息;According to an aspect of an embodiment of the present disclosure, a device having a display screen is provided with vision detecting means for acquiring uncorrected visual acuity information of a new user and optician degree information after correcting visual acuity;
处理单元进一步用于,根据未矫正视力信息和矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;获取新用户选择的标准化信息,标准化信息为第一标准化信息和第二标准化信息中的任一者。The processing unit is further configured to respectively configure the first normalization information and the second normalization information according to the uncorrected visual acuity information and the corrected degree information of the corrected visual acuity; acquire the standardized information selected by the new user, and the standardized information is the first standardized information and the second Any of the standardized information.
根据本公开实施例的一方面,处理单元进一步用于,如果用户在预定时间间隔内,调整用户的面部与屏幕之间的距离的次数大于预设次数,则判断用户有视觉障碍;将用户选择的标准化信息更换为,第一标准化信息和第二标准化信息中的任一者;提醒用户对更换后的标准化信息中的距离与距离对应的标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为用户的个性化信息。According to an aspect of an embodiment of the present disclosure, the processing unit is further configured to: if the user adjusts the distance between the face of the user and the screen for a predetermined number of times within a predetermined time interval, determining that the user has a visual obstacle; selecting the user The standardized information is replaced with any one of the first normalized information and the second standardized information; the user is reminded to perform calibration on the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; and the stored information is stored, The calibrated information is used as the personalized information of the user.
根据本公开实施例的一方面,处理单元进一步用于,如果用户的面部与屏幕之间的距离超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。According to an aspect of an embodiment of the present disclosure, the processing unit is further configured to: if the distance between the face of the user and the screen exceeds a minimum allowable value of the distance, and the number of characters in the unit display area of the screen is greater than the preset number of characters, then The display area on the screen is moved so that the text is partially enlarged and scrolled line by line in the enlarged area that is left after being moved by the display area.
另一方面,本公开实施例还提供了一种具有显示屏幕的设备,包括:存储器,存储有计算机程序指令;处理器,当计算机程序指令被处理器执行时实现如前所述的屏幕显示方法。In another aspect, an embodiment of the present disclosure further provides an apparatus having a display screen, including: a memory storing computer program instructions; and a processor, when the computer program instructions are executed by the processor, implementing the screen display method as described above .
另一方面,本公开实施例还提供了一种计算机可读存储介质,计算机可读存储介质包括指令,当指令在计算机上运行时,使得计算机执行如前 所述的屏幕显示方法。In another aspect, embodiments of the present disclosure also provide a computer readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform a screen display method as described above.
附图说明DRAWINGS
下面将参考附图来描述本公开示例性实施例的特征、特点和技术效果。Features, features, and technical effects of the exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings.
图1是本公开实施例一提供的一种屏幕显示方法的流程框图;1 is a flow chart of a screen display method according to Embodiment 1 of the present disclosure;
图2是图1所示的屏幕显示方法的一个应用场景示意图;2 is a schematic diagram of an application scenario of the screen display method shown in FIG. 1;
图3是图1所示的屏幕显示方法的另一个应用场景示意图;3 is a schematic diagram of another application scenario of the screen display method shown in FIG. 1;
图4是图1所示的屏幕显示方法的另一个应用场景示意图;4 is a schematic diagram of another application scenario of the screen display method shown in FIG. 1;
图5是图1所示的屏幕显示方法的另一个应用场景示意图;FIG. 5 is a schematic diagram of another application scenario of the screen display method illustrated in FIG. 1; FIG.
图6是本公开实施例二提供的另一种屏幕显示方法的流程框图;6 is a flow chart of another screen display method according to Embodiment 2 of the present disclosure;
图7是图6所示的屏幕显示方法中识别用户的身份信息的特征脸的示意图;7 is a schematic diagram of a feature face for identifying identity information of a user in the screen display method shown in FIG. 6;
图8是图6所示的屏幕显示方法中获取用户的面部特征信息的流程框图;8 is a flow chart showing the acquisition of facial feature information of a user in the screen display method shown in FIG. 6;
图9是图6所示的屏幕显示方法中为新用户配置个性化信息的流程框图;9 is a flow chart showing a process of configuring personalized information for a new user in the screen display method shown in FIG. 6;
图10是图9所示的屏幕显示方法中为新用户配置标准化信息的流程框图;10 is a flow chart showing a process of configuring standardization information for a new user in the screen display method shown in FIG. 9;
图11是图6所示的屏幕显示方法中计算用户的面部与屏幕之间的距离的流程框图;11 is a flow chart showing a calculation of a distance between a face of a user and a screen in the screen display method shown in FIG. 6;
图12是图6所示的屏幕显示方法中为有视觉障碍的用户配置个性化信息的流程框图;12 is a flow chart showing a process of configuring personalized information for a visually impaired user in the screen display method shown in FIG. 6;
图13是本公开实施例三提供的一种具有显示屏幕的装置的示意图;FIG. 13 is a schematic diagram of an apparatus having a display screen according to Embodiment 3 of the present disclosure; FIG.
图14是本公开实施例四提供的另一种具有显示屏幕的装置的示意图;14 is a schematic diagram of another apparatus having a display screen according to Embodiment 4 of the present disclosure;
图15是图14所示的具有显示屏幕的装置的一种应用场景示意图。FIG. 15 is a schematic diagram of an application scenario of the device with a display screen shown in FIG. 14.
具体实施方式Detailed ways
下面结合附图和实施例对本公开的实施方式作进一步详细描述。以下 实施例的详细描述和附图用于示例性地说明本公开的原理,但不能用来限制本公开的范围,即本公开不限于所描述的实施例。Embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. The detailed description and the accompanying drawings are set forth to illustrate the embodiments of the present invention, and are not intended to limit the scope of the disclosure.
为了更好地理解本公开,下面结合图1至图15对本公开实施例的屏幕显示方法及具有显示屏幕的装置进行详细描述。In order to better understand the present disclosure, a screen display method and an apparatus having a display screen of an embodiment of the present disclosure will be described in detail below with reference to FIGS. 1 through 15.
实施例一Embodiment 1
参阅图1,本公开实施例一提供了一种屏幕显示方法,包括:Referring to FIG. 1, a first embodiment of the present disclosure provides a screen display method, including:
步骤S1’,计算用户的面部与屏幕之间的距离。In step S1', the distance between the face of the user and the screen is calculated.
该屏幕可以为手机、电脑、电视等设备的显示屏。用户的面部与屏幕之间的距离可以采用但不限于红外感应装置或者距离传感器的方式来测量。还可以根据眼球追踪算法及立体视觉中的三维测距原理获得。在实际使用中,可以实时地计算用户的面部与屏幕之间的距离,也可以周期性地计算用户的面部与屏幕之间的距离,例如,该周期时长可以为5~10s,根据具体的使用场合而定。The screen can be a display for devices such as mobile phones, computers, and televisions. The distance between the user's face and the screen can be measured using, but not limited to, an infrared sensing device or a distance sensor. It can also be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision. In actual use, the distance between the user's face and the screen can be calculated in real time, and the distance between the user's face and the screen can be calculated periodically. For example, the period duration can be 5 to 10 s, depending on the specific use. Depending on the occasion.
步骤S2’,根据距离获取对应的显示参数。距离对应的屏幕的显示参数可以为预先设定的,例如,距离为20cm时,屏幕上显示的字体的大小为四号字体。In step S2', the corresponding display parameter is obtained according to the distance. The display parameter of the corresponding screen may be preset. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
步骤S3’,根据显示参数调整屏幕的显示效果。In step S3', the display effect of the screen is adjusted according to the display parameters.
请一并参阅图2至图4,以手机的显示屏为例,获取屏幕前用户的面部特征信息可以识别出用户C的身份信息,根据身份信息获取用户C的个性化信息。Please refer to FIG. 2 to FIG. 4 together, taking the display screen of the mobile phone as an example, obtaining the facial feature information of the user in front of the screen can identify the identity information of the user C, and obtain the personalized information of the user C according to the identity information.
当计算出用户的面部与显示屏之间的距离L≥A时,根据距离L查询用户C的个性化信息,获取该距离L对应的显示参数P1,根据显示参数P1调整屏幕的显示效果,如图2中的界面a所示,手机的显示屏中显示了4个图标。When the distance L ≥ A between the user's face and the display screen is calculated, the personalized information of the user C is queried according to the distance L, the display parameter P1 corresponding to the distance L is obtained, and the display effect of the screen is adjusted according to the display parameter P1, such as As shown in interface a in Figure 2, four icons are displayed in the display of the mobile phone.
当计算出用户的面部与显示屏之间的距离L变化为A≤L≤B时,通过查询用户C的个性化信息,获得该距离L对应的显示参数P2,根据显示参数P2调整屏幕的显示效果,如图3中的界面b所示,即将手机的显示屏中的图标按照固定规则缩小后进行重排,共显示了6个图标。When it is calculated that the distance L between the face of the user and the display screen changes to A ≤ L ≤ B, the display parameter P2 corresponding to the distance L is obtained by querying the personalized information of the user C, and the display of the screen is adjusted according to the display parameter P2. The effect, as shown in the interface b in FIG. 3, is that the icons in the display screen of the mobile phone are reduced according to a fixed rule and then rearranged, and a total of six icons are displayed.
当计算出用户的面部与显示屏之间的距离L继续变化为L≤C时,通过查询用户C的个性化信息,获得该距离L对应的显示参数P3,根据显示参数P3调整屏幕的显示效果,如图4中的界面c所示,即将手机的显示屏中的图标按照固定规则继续缩小后进行重排,共显示了8个图标。When it is calculated that the distance L between the user's face and the display screen continues to change to L ≤ C, the display parameter P3 corresponding to the distance L is obtained by querying the personalized information of the user C, and the display effect of the screen is adjusted according to the display parameter P3. As shown in the interface c in FIG. 4, the icons in the display screen of the mobile phone are further reduced according to a fixed rule, and then rearranged, and a total of eight icons are displayed.
可以理解的是,预定信息中的距离A、B、C仅是示例性的说明,并不局限于这三个数值,可以根据具体的应用场景而设定。It can be understood that the distances A, B, and C in the predetermined information are merely exemplary descriptions, and are not limited to these three values, and may be set according to specific application scenarios.
参阅图5,步骤S1’中,计算用户的面部与屏幕之间的距离之后,进一步包括:如果用户的面部与屏幕之间的距离超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。Referring to FIG. 5, after calculating the distance between the face of the user and the screen in step S1', the method further includes: if the distance between the face of the user and the screen exceeds the minimum allowable value of the distance, and the unit of the screen displays the text within the area When the number is greater than the preset number of characters, the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
相应地,图片也可以按照文字的放大比例同时进行放大。正常显示区域和放大区域的大小可以根据用户的使用场景进行调整。Accordingly, the image can also be enlarged at the same time in accordance with the magnification of the text. The size of the normal display area and the enlarged area can be adjusted according to the user's usage scenario.
本公开实施例一提供的屏幕显示方法,能够使屏幕根据用户所处环境的变化而进行自适应变化,以便于用户能够更好的观看屏幕,提升了用户体验。The screen display method provided in Embodiment 1 of the present disclosure can make the screen adaptively change according to changes in the environment in which the user is located, so that the user can better view the screen and improve the user experience.
实施例二Embodiment 2
参阅图6,本公开实施例二还提供了一种屏幕显示方法,包括:Referring to FIG. 6, a second embodiment of the present disclosure further provides a screen display method, including:
步骤S1,获取屏幕前用户的面部特征信息。该屏幕可以为手机、电脑、电视等设备的显示屏。面部特征信息可以是人体的脸部轮廓、眼球大小及位置或鼻梁的大小及位置,还可以包括是否佩戴眼镜等。In step S1, facial feature information of the user before the screen is acquired. The screen can be a display for devices such as mobile phones, computers, and televisions. The facial feature information may be the facial contour of the human body, the size and position of the eyeball or the size and position of the bridge of the nose, and may also include whether or not to wear glasses or the like.
步骤S2,根据面部特征信息识别用户的身份信息。In step S2, the identity information of the user is identified according to the facial feature information.
根据上述识别出的面部特征信息和系统中预存的用户身份特征信息进行对比,可以识别用户的身份信息。According to the facial feature information identified above and the user identity feature information pre-stored in the system, the identity information of the user can be identified.
例如,可以根据相关技术中的头像识别算法识别用户的身份信息,包括但不限于特征脸算法(Eigenface)。下面以特征脸算法为例描述识别用户的身份信息的方法。For example, the identity information of the user may be identified according to an avatar recognition algorithm in the related art, including but not limited to a feature face algorithm (Eigenface). The following describes a method for identifying identity information of a user by taking a feature face algorithm as an example.
参阅图7,获取包含人体的面部特征信息的M张人脸图像,每张人脸 图像可以转换为一个N维的向量,以形成M*N维的训练图像集合S,将该训练图像集合S降维为N*N矩阵后求解特征向量u,该特征向量u即为训练图像集合S内的每个图像向量与均值图像在该方向上的偏差,通过待识别的人脸在特征向量的投影,可以获知待识别的人脸与均值图像在不同方向上的差距。如果将这些特征向量还原成像素排列的话,很像人脸,所以称之为特征脸,如图2所示。Referring to FIG. 7, M face images including facial feature information of a human body are acquired, and each face image can be converted into an N-dimensional vector to form an M*N-dimensional training image set S, and the training image set S After the dimension reduction is N*N matrix, the feature vector u is solved. The feature vector u is the deviation of each image vector and the mean image in the training image set S in the direction, and the projection of the face to be recognized in the feature vector is performed. , the difference between the face to be recognized and the mean image in different directions can be known. If these feature vectors are restored to pixel arrangement, it is like a human face, so it is called a feature face, as shown in Figure 2.
对于待识别的人脸,用第k个特征脸可以标示为:For the face to be recognized, the kth feature face can be marked as:
Figure PCTCN2018123830-appb-000001
Figure PCTCN2018123830-appb-000001
其中,k=1,2…M,u k为第k个特征脸的向量,Γ为人脸图像的N维向量,Ψ为训练图像集合S的均值图像的N维向量。 Where k=1, 2...M, u k is the vector of the kth feature face, Γ is the N-dimensional vector of the face image, and Ψ is the N-dimensional vector of the mean image of the training image set S.
式(1)可以计算出第k个特征脸u k的权重,M个权重可以构成一个向量Ω T,如式(2)所示: Equation (1) can calculate the weight of the kth feature face u k , and M weights can form a vector Ω T , as shown in equation (2):
Ω T=[ω 12,……ω M]        (2) Ω T = [ω 1 , ω 2 , ... ω M ] (2)
对待识别的人脸进行识别依据式(3):The face to be recognized is identified according to formula (3):
ε k=||Ω-Ω k|| 2           (3) ε k =||Ω-Ω k || 2 (3)
其中,Ω为待识别的人脸的权重向量,Ω k为训练图像集合S内的某个人脸的权重向量,ε k即为两者的欧氏距离。当第k个欧氏距离小于阈值时,可以判别待识别的人脸即为训练图像集合S内的第k个人脸,从而识别该用户的身份信息。当遍历训练图像集合S内的所有人脸,求得的每一个欧氏距离均大于阈值时,可以判别待识别的人脸不在训练图像集合S内,而是新用户的人脸。阈值的设定可以根据训练图像集合S的不同适用场合而定。 Where Ω is the weight vector of the face to be recognized, Ω k is the weight vector of a certain face in the training image set S, and ε k is the Euclidean distance of the two. When the kth Euclidean distance is less than the threshold, it can be discriminated that the face to be recognized is the kth face in the training image set S, thereby identifying the identity information of the user. When traversing all the faces in the training image set S, and each Euclidean distance obtained is greater than the threshold, it can be discriminated that the face to be recognized is not in the training image set S, but is the face of the new user. The setting of the threshold may be determined according to different applicable occasions of the training image set S.
步骤S3,根据身份信息获取用户的个性化信息,个性化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的个性化显示参数,如图3所示。例如,距离为20cm时,屏幕上显示的字体的大小为四号字体。Step S3: Acquire personalized information of the user according to the identity information, where the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen, as shown in FIG. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
步骤S4,计算用户的面部与屏幕之间的距离。距离的计算方法可以根据眼球追踪算法及立体视觉中的三维测距原理获得。也可以利用例如但不限于红外感应装置或者距离传感器来测量。In step S4, the distance between the face of the user and the screen is calculated. The calculation method of the distance can be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision. It can also be measured using, for example, but not limited to, an infrared sensing device or a distance sensor.
步骤S5,根据距离获取对应的个性化显示参数。In step S5, the corresponding personalized display parameter is obtained according to the distance.
步骤S6,根据个性化显示参数调整屏幕的显示效果。In step S6, the display effect of the screen is adjusted according to the personalized display parameter.
本公开实施例二提供的屏幕显示方法,能够根据用户的身份信息及所处环境的变化查询用户的个性化信息,从而使屏幕进行自适应变化,以便于满足每个用户的使用需求,使用户能够更好的观看屏幕,进一步提升了用户体验。The screen display method provided by the second embodiment of the present disclosure can query the personalized information of the user according to the identity information of the user and the change of the environment, so that the screen is adaptively changed, so as to meet the usage requirements of each user and enable the user. Better viewing of the screen further enhances the user experience.
下面结合附图进一步详细描述本公开实施例二提供的屏幕显示方法的实现步骤。The implementation steps of the screen display method provided by the second embodiment of the present disclosure are described in further detail below with reference to the accompanying drawings.
参阅图8,步骤S1中,获取屏幕前用户的面部特征信息包括:Referring to FIG. 8, in step S1, obtaining facial feature information of the user before the screen includes:
步骤S11,获取用户的头像信息。用户的头像信息可以通过例如但不限于摄像装置、红外感应装置或其它感应方式来获取头像信息。In step S11, the avatar information of the user is obtained. The avatar information of the user may obtain avatar information by, for example, but not limited to, a camera device, an infrared sensing device, or other sensing means.
步骤S12,根据头像信息获取用户的面部特征信息。Step S12: Acquire facial feature information of the user according to the avatar information.
参阅图9,步骤S2中,根据面部特征信息识别用户的身份信息之后,还包括:Referring to FIG. 9, in step S2, after identifying the identity information of the user according to the facial feature information, the method further includes:
步骤S21,如果根据面部特征信息无法识别用户的身份信息,则判断用户为新用户。根据前述的特征脸算法,当待识别的人脸与训练图像集合S内的所有人脸的欧氏距离均大于阈值时,可以判别待识别的人脸不在训练图像集合S内,故判断出该用户为新用户。Step S21, if the identity information of the user cannot be identified according to the facial feature information, it is determined that the user is a new user. According to the eigenface algorithm described above, when the Euclidean distance of the face to be recognized and all the faces in the training image set S are greater than the threshold, it can be determined that the face to be recognized is not in the training image set S, so it is determined that The user is a new user.
步骤S22,为新用户配置标准化信息,标准化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的标准化显示参数;Step S22, configuring standardization information for the new user, the standardized information including the distance between the face of the user and the screen, and the standardized display parameter of the screen corresponding to the distance;
步骤S23,提醒新用户对标准化信息中的距离及距离对应的标准化显示参数,逐一进行校准。In step S23, the new user is reminded to perform calibration on the standardized display parameters corresponding to the distance and the distance in the standardized information.
步骤S24,存储校准后的信息,将校准后的信息作为用户的个性化信息。In step S24, the calibrated information is stored, and the calibrated information is used as the personalized information of the user.
参阅图10,步骤S22中,为新用户配置标准化信息,包括:Referring to FIG. 10, in step S22, standardization information is configured for a new user, including:
步骤S221,获取新用户的未矫正视力信息和矫正视力后的配镜度数信息;Step S221, acquiring uncorrected vision information of the new user and the glasses degree information after correcting the vision;
步骤S222,根据未矫正视力信息和矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;Step S222, respectively configuring first normalization information and second normalization information according to the uncorrected visual acuity information and the corrected degree information of the corrected visual acuity;
步骤S223,获取新用户选择的标准化信息,标准化信息为第一标准化信息和第二标准化信息中的任一者。Step S223, acquiring normalization information selected by the new user, and the normalization information is any one of the first normalization information and the second normalization information.
参阅图11,步骤S4中,计算用户的面部与屏幕之间的距离包括:Referring to FIG. 11, in step S4, calculating the distance between the user's face and the screen includes:
步骤S41,根据面部特征信息捕捉用户的眼球的位置信息。Step S41, capturing location information of the user's eyeball based on the facial feature information.
在实际使用中,可以实时地捕捉用户的眼球的位置信息,也可以周期性地捕捉用户的眼球的位置信息,例如,该周期时长可以为5~10s,根据具体的使用场合而定。In actual use, the position information of the user's eyeball can be captured in real time, and the position information of the user's eyeball can be periodically captured. For example, the period duration can be 5 to 10 s, depending on the specific use occasion.
利用眼球追踪算法可以捕捉用户的眼球的位置信息。基于前述的特征脸算法可以锁定眼球的可能位置区域,在寻找眼球位置时,只需要在这个较小的人眼可能的区域处理即可。在这个区域内,眼球模型可以近似为圆形,或者因为眼睑或其他物体遮挡情况下为部分圆形。由于虹膜和眼白有明显的颜色差异,在灰度图像中也存在明显的边缘分隔,在边缘处有很大的梯度。从几何学上讲:圆形对象的中心可以通过分析图像梯度的矢量场来检测,以前它已被用于眼中心定位。例如:通过利用虹膜和巩膜之间强烈的灰度反差产生的流场特征来检测眼球中心。这种方法计算图像上每个点的梯度向量方向,并绘制沿这个梯度方向的直线,对于每一个点每增加一根这样的直线就在此点对应的容器中增加一个计数。最后统计图像上所有点的对应容器的累积计数,拥有最大计数值的容器对应的点就可以认为是图像中一个圆形区域的中心,进而可以认为这个中心就是眼球的中心。The eyeball tracking algorithm can be used to capture the position information of the user's eyeball. Based on the aforementioned eigenface algorithm, it is possible to lock the possible positional area of the eyeball, and when looking for the eyeball position, it is only necessary to process it in the area where the smaller human eye is possible. In this area, the eyeball model can be approximately circular, or partially circular due to eyelids or other objects. Due to the distinct color differences between the iris and the white of the eye, there is also a significant edge separation in the grayscale image with a large gradient at the edges. Geometrically: the center of a circular object can be detected by analyzing the vector field of the image gradient, which has previously been used for eye center positioning. For example, the center of the eyeball is detected by utilizing the characteristics of the flow field generated by the strong gray scale contrast between the iris and the sclera. This method calculates the direction of the gradient vector for each point on the image and plots the line along the direction of the gradient. For each such point added to each point, a count is added to the corresponding container at that point. Finally, the cumulative count of the corresponding containers at all points on the image is counted. The point corresponding to the container with the largest count value can be considered as the center of a circular area in the image, and the center can be considered as the center of the eyeball.
然而,图像中眉毛、眼睑或眼镜等各种干扰对象可能会使这种方法在检测过程中出现误差而带来识别错误,特别是头发和眼镜的强反射显示出的显著的图像梯度并不像瞳孔和虹膜的图像梯度具有相同的方向,此时估计出的眼睛中心可能是错的。而眼球追踪算法可以通过一个后处理步骤来克服这些问题,即设置一个阈值来判断目标函数。应用这个阈值来删除一部分假的眼球目标,然后再确定剩余的候选眼球目标的最大特征值,以此来判断剩余的候选目标中的真实目标。这个过程相对于先进行初步判断,剔除到大部分的干扰目标,再对剩下的候选目标进行判断,从而提高检测的准确性。而这个阈值可以按照经验可以取整个图像中最大特征值的90%。 上述眼球追踪算法为相关技术中的技术,此处不再赘述。However, various interfering objects such as eyebrows, eyelids or glasses in the image may cause errors in the detection process and cause recognition errors, especially the strong reflection of the hair and the glasses show a significant image gradient. The image gradients of the pupil and iris have the same direction, and the estimated eye center may be wrong at this time. The eye tracking algorithm can overcome these problems through a post-processing step, which is to set a threshold to judge the objective function. Applying this threshold to delete a part of the fake eye target, and then determining the maximum eigenvalue of the remaining candidate eye targets, thereby determining the true target among the remaining candidate targets. This process is compared with the initial judgment, and most of the interference targets are eliminated, and the remaining candidate targets are judged, thereby improving the accuracy of the detection. And this threshold can be used to take 90% of the maximum eigenvalue in the entire image. The above-mentioned eye tracking algorithm is a technology in the related art, and will not be described herein.
步骤S42,根据眼球的位置信息计算用户的面部与屏幕之间的距离。In step S42, the distance between the face of the user and the screen is calculated according to the position information of the eyeball.
根据立体视觉中的三维测距原理可以计算出用户的面部与屏幕之间的距离。具体来说,根据上述眼球追踪算法可以实时地或者周期性地捕捉到用户的两个眼球的位置信息,利用同一目标在两个投影图像上的成像差异可以获得被测目标的三维信息,进而计算出用户的面部与屏幕之间的距离。上述距离识别算法为相关技术中的技术,此处不再赘述。According to the three-dimensional ranging principle in stereo vision, the distance between the user's face and the screen can be calculated. Specifically, according to the above-mentioned eyeball tracking algorithm, the position information of the two eyeballs of the user can be captured in real time or periodically, and the three-dimensional information of the measured object can be obtained by using the imaging difference of the same target on the two projected images, thereby calculating The distance between the user's face and the screen. The above distance identification algorithm is a technology in the related art, and details are not described herein again.
参阅图12,本公开实施例提供的屏幕显示方法还包括:Referring to FIG. 12, the screen display method provided by the embodiment of the present disclosure further includes:
步骤S7,如果用户在预定时间间隔内,调整用户的面部与屏幕之间的距离的次数大于预设次数,则判断用户有视觉障碍。In step S7, if the user adjusts the distance between the face of the user and the screen more than the preset number of times within the predetermined time interval, it is determined that the user has a visual disorder.
步骤S8,将用户选择的标准化信息更换为,第一标准化信息和第二标准化信息中的任一者;Step S8, replacing the standardized information selected by the user with any one of the first normalization information and the second normalization information;
步骤S9,提醒用户对更换后的标准化信息中的距离与距离对应的标准化显示参数,逐一进行校准;Step S9, prompting the user to perform calibration on the standardized display parameters corresponding to the distance and the distance in the standardized information after the replacement;
步骤S10,存储校准后的信息,将校准后的信息作为用户的个性化信息。In step S10, the calibrated information is stored, and the calibrated information is used as the personalized information of the user.
另外,与实施例一中的屏幕显示方法类似,步骤S4中,计算用户的面部与屏幕之间的距离之后,进一步包括:如果用户的面部与屏幕之间的距离超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。In addition, similar to the screen display method in the first embodiment, after calculating the distance between the face of the user and the screen in step S4, further comprising: if the distance between the face of the user and the screen exceeds the minimum allowable value of the distance, and When the number of characters in the unit display area of the screen is larger than the preset number of characters, the display area on the screen is moved to partially enlarge the text and scroll by line by line in the enlarged area that is left after being moved by the display area.
相应地,图片也可以按照文字的放大比例同时进行放大。正常显示区域和放大区域的大小可以根据用户的使用场景进行调整。Accordingly, the image can also be enlarged at the same time in accordance with the magnification of the text. The size of the normal display area and the enlarged area can be adjusted according to the user's usage scenario.
由此,本公开实施例二提供的屏幕显示方法,通过识别用户的身份信息来获知不同用户在不同的环境下的个性化需求,从而能够使屏幕进行自适应变化,例如放大、缩小、变焦、局部放大滚动以及按照固定规则进行重排,以便于用户能够更好的观看屏幕,提升了用户体验。Therefore, the screen display method provided by the second embodiment of the present disclosure can identify the personalized needs of different users in different environments by recognizing the identity information of the user, thereby enabling the screen to be adaptively changed, such as zooming in, zooming out, zooming, Partially zoom in and out and rearrange according to fixed rules, so that users can better watch the screen and improve the user experience.
实施例三Embodiment 3
参阅图13,本公开实施例三还提供了一种具有显示屏幕的装置,包括: 处理单元20’和显示单元30’。该具有显示屏幕的装置可以为手机、计算机、平板电脑等终端设备,也可以为单独的显示设备。本公开实施例以计算机为例进行描述。Referring to Figure 13, a third embodiment of the present disclosure also provides an apparatus having a display screen, comprising: a processing unit 20' and a display unit 30'. The device having the display screen may be a terminal device such as a mobile phone, a computer, a tablet computer, or a separate display device. The embodiment of the present disclosure is described by taking a computer as an example.
处理单元20’用于计算用户的面部与屏幕之间的距离,可以实时地或者周期性地计算该距离,根据距离获取对应的显示参数。距离对应的屏幕的显示参数可以为预先设定的,例如,距离为20cm时,屏幕上显示的字体的大小为四号字体。The processing unit 20' is configured to calculate the distance between the face of the user and the screen, which may be calculated in real time or periodically, and the corresponding display parameters are obtained from the distance. The display parameter of the corresponding screen may be preset. For example, when the distance is 20 cm, the size of the font displayed on the screen is the fourth font.
作为一种可选的实施方式,处理单元20’可以根据例如包括但不限于红外感应装置的距离传感器测量出用户的面部与屏幕之间的距离。还可以根据眼球追踪算法及立体视觉中的三维测距原理获得。As an alternative embodiment, processing unit 20' may measure the distance between the user's face and the screen based on, for example, a distance sensor including, but not limited to, an infrared sensing device. It can also be obtained according to the eyeball tracking algorithm and the three-dimensional ranging principle in stereo vision.
显示单元30’用于根据显示参数调整屏幕的显示效果。The display unit 30' is for adjusting the display effect of the screen in accordance with the display parameters.
另外,如果用户的面部与屏幕之间的距离L超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则处理单元20’还用于:对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。In addition, if the distance L between the face of the user and the screen exceeds the minimum allowable value of the distance, and the number of characters in the unit display area of the screen is greater than the preset number of characters, the processing unit 20' is further configured to: on the screen The display area is moved to partially enlarge the text and scroll by line by line in the enlarged area remaining after being moved by the display area.
本公开实施例三提供的具有显示屏幕的装置,能够使屏幕根据用户所处环境的变化而进行自适应变化,以便于用户能够更好的观看屏幕,提升了用户体验。The device with the display screen provided by the third embodiment of the present disclosure can make the screen adaptively change according to the change of the user's environment, so that the user can better view the screen and improve the user experience.
实施例四 Embodiment 4
参阅图14,本公开实施例四还提供了一种具有显示屏幕的装置,包括:特征采集单元10、处理单元20和显示单元30。该具有显示屏幕的装置可以为手机、计算机、平板电脑等终端设备,也可以为单独的显示设备。本公开实施例以计算机为例进行描述。Referring to FIG. 14 , Embodiment 4 of the present disclosure further provides an apparatus having a display screen, including: a feature collection unit 10, a processing unit 20, and a display unit 30. The device having the display screen may be a terminal device such as a mobile phone, a computer, a tablet computer, or a separate display device. The embodiment of the present disclosure is described by taking a computer as an example.
特征采集单元10用于获取屏幕前用户的面部特征信息。The feature collection unit 10 is configured to acquire facial feature information of the user before the screen.
作为一种可选的实施方式,特征采集单元10可以为但不限于红外感应装置。As an optional implementation manner, the feature collection unit 10 can be, but not limited to, an infrared sensing device.
作为一种可选的实施方式,本公开实施例提供的具有显示屏幕的装置还包括摄像装置,摄像装置用于获取用户的头像信息,特征采集单元10根 据头像信息获取用户的面部特征信息。As an optional implementation manner, the apparatus for displaying a screen provided by the embodiment of the present disclosure further includes an image capturing apparatus for acquiring the avatar information of the user, and the feature collecting unit 10 acquires the facial feature information of the user according to the avatar information.
处理单元20用于根据面部特征信息识别用户的身份信息;根据身份信息获取用户的个性化信息,个性化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的个性化显示参数;计算用户的面部与屏幕之间的距离,可以实时地或者周期性地计算该距离,根据距离获取对应的显示参数。The processing unit 20 is configured to identify the identity information of the user according to the facial feature information, and obtain the personalized information of the user according to the identity information, where the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the corresponding screen; Calculating the distance between the user's face and the screen, the distance can be calculated in real time or periodically, and the corresponding display parameters are obtained according to the distance.
作为一种可选的实施方式,处理单元20可以根据例如包括但不限于红外感应装置的距离传感器测量出用户的面部与屏幕之间的距离。As an alternative embodiment, processing unit 20 may measure the distance between the user's face and the screen based on, for example, a distance sensor including, but not limited to, an infrared sensing device.
作为一种可选的实施方式,处理单元20还可以根据特征采集单元10获取用户的头像信息来获取用户的面部特征信息,根据面部特征信息实时地或者周期性地捕捉用户的眼球的位置信息,并利用眼球追踪技术和立体视觉中的三维测距原理,计算出用户的面部与屏幕之间的距离。As an optional implementation manner, the processing unit 20 may further acquire the facial feature information of the user according to the avatar information of the user acquired by the feature collecting unit 10, and capture the position information of the eyeball of the user in real time or periodically according to the facial feature information. And using the eye tracking technology and the three-dimensional ranging principle in stereo vision, the distance between the user's face and the screen is calculated.
显示单元30用于根据个性化显示参数调整屏幕的显示效果。The display unit 30 is configured to adjust the display effect of the screen according to the personalized display parameter.
本公开实施例四提供的具有显示屏幕的装置,能够使屏幕根据用户的身份信息及所处环境的变化而进行自适应变化,以便于用户能够更好的观看屏幕,提升了用户体验。The device with the display screen provided in Embodiment 4 of the present disclosure can make the screen adaptively change according to the identity information of the user and the environment of the user, so that the user can better view the screen and improve the user experience.
参阅图15,如果根据面部特征信息无法识别用户的身份信息,则处理单元20还用于判断用户为新用户;为新用户配置标准化信息,标准化信息包括用户的面部与屏幕之间的距离,以及距离对应的屏幕的标准化显示参数;提醒新用户对标准化信息中的距离及距离对应的标准化显示参数,逐一进行校准,例如以弹出对话框的方式提醒;存储校准后的信息,将校准后的信息作为用户的个性化信息。Referring to FIG. 15, if the identity information of the user cannot be identified according to the facial feature information, the processing unit 20 is further configured to determine that the user is a new user; configure standardized information for the new user, and the standardized information includes a distance between the face of the user and the screen, and Normalized display parameters of the corresponding screen; remind new users to normalize the display parameters corresponding to the distance and distance in the standardized information, and calibrate one by one, for example, by pop-up dialog; store the calibrated information, and calibrate the information Personalized information as a user.
另外,本公开实施例提供的具有显示屏幕的装置配置有视力检测装置(图中未示出),视力检测装置能够检测出用户的视力为近视、远视、散光甚至是否为夜盲症,并根据检测结果获知矫正视力后的配镜度数信息。视力检测装置还可以获取用户的未矫正视力信息。In addition, the device with the display screen provided by the embodiment of the present disclosure is configured with a vision detecting device (not shown), and the visual acuity detecting device can detect whether the visual acuity of the user is myopia, hyperopia, astigmatism or even night blindness, and according to the detection result. Obtain the information on the degree of optician after correcting vision. The vision detecting device can also acquire uncorrected vision information of the user.
进一步地,处理单元20还用于:根据未矫正视力信息和矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;获取新用户选择的标准化信息,标准化信息为第一标准化信息和第二标准化信息中的任 一者。Further, the processing unit 20 is further configured to: respectively configure the first normalization information and the second normalization information according to the uncorrected vision information and the corrected degree information of the corrected vision; acquire the standardized information selected by the new user, and the standardized information is the first standardized Any of information and second standardized information.
进一步地,如果用户在预定时间间隔内,调整用户的面部与屏幕之间的距离L的次数大于预设次数,则处理单元20还用于:判断用户有视觉障碍;将用户选择的标准化信息更换为,第一标准化信息和第二标准化信息中的任一者;提醒用户对更换后的标准化信息中的距离与距离对应的标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为用户的个性化信息。Further, if the user adjusts the distance L between the face of the user and the screen to be greater than the preset number of times within a predetermined time interval, the processing unit 20 is further configured to: determine that the user has a visual obstacle; and replace the standardized information selected by the user. For any one of the first normalization information and the second normalization information; reminding the user to perform calibration on the standardized display parameters corresponding to the distance and the distance in the replaced standardized information; storing the calibrated information, and calibrating the information Information as personalized information for users.
另外,如果用户的面部与屏幕之间的距离L超出距离的最小允许值,并且屏幕的单位显示面积内的文字数量大于预设文字数量时,则处理单元20还用于:对屏幕上的显示区域进行移动处理,以使文字局部放大并逐行滚动显示在由显示区域移动后空余出的放大区域内。In addition, if the distance L between the face of the user and the screen exceeds the minimum allowable value of the distance, and the number of characters in the unit display area of the screen is greater than the preset number of characters, the processing unit 20 is further configured to: display on the screen The area is moved so that the text is partially enlarged and scrolled line by line within the enlarged area that is left after being moved by the display area.
可以理解的是,本公开实施例提供的具有显示屏幕的装置是前述屏幕显示方法的执行主体,关于各单元具体的执行方式可以参见前述屏幕显示方法的内容,在此不再赘述。It is to be understood that the device having the display screen provided by the embodiment of the present disclosure is the execution body of the foregoing screen display method. For the specific execution manner of each unit, refer to the content of the foregoing screen display method, and details are not described herein again.
另外,本公开实施例还提供了一种具有显示屏幕的设备,包括:存储器,存储有计算机程序指令;处理器,当计算机程序指令被处理器执行时实现如前所述的屏幕显示方法。In addition, an embodiment of the present disclosure further provides an apparatus having a display screen, including: a memory storing computer program instructions; and a processor, when the computer program instructions are executed by the processor, implementing the screen display method as described above.
另外,本公开实施例还提供了一种计算机可读存储介质,计算机可读存储介质包括指令,当指令在计算机上运行时,使得计算机执行如前所述的屏幕显示方法。Additionally, embodiments of the present disclosure also provide a computer readable storage medium comprising instructions that, when executed on a computer, cause the computer to perform a screen display method as previously described.
虽然已经参考可选实施例对本公开进行了描述,但在不脱离本公开的范围的情况下,可以对其进行各种改进并且可以用等效物替换其中的部件。尤其是,只要不存在结构冲突,各个实施例中所提到的各项技术特征均可以任意方式组合起来。本公开并不局限于文中公开的预定实施例,而是包括落入权利要求的范围内的所有技术方案。While the present disclosure has been described with reference to the preferred embodiments thereof, various modifications may be made thereto and the components may be substituted with equivalents without departing from the scope of the present disclosure. In particular, the technical features mentioned in the various embodiments can be combined in any manner as long as there is no structural conflict. The present disclosure is not limited to the specific embodiments disclosed herein, but includes all technical solutions falling within the scope of the claims.

Claims (14)

  1. 一种屏幕显示方法,包括:A screen display method comprising:
    获取屏幕前用户的面部特征信息;Obtaining facial feature information of the user before the screen;
    根据所述面部特征信息识别所述用户的身份信息;Identifying identity information of the user according to the facial feature information;
    根据所述身份信息获取所述用户的个性化信息,所述个性化信息包括用户的所述面部与所述屏幕之间的距离,以及所述距离对应的所述屏幕的个性化显示参数;Acquiring the personalized information of the user according to the identity information, where the personalized information includes a distance between the face of the user and the screen, and a personalized display parameter of the screen corresponding to the distance;
    计算所述用户的所述面部与所述屏幕之间的距离;Calculating a distance between the face of the user and the screen;
    根据所述距离获取对应的个性化显示参数;Obtaining a corresponding personalized display parameter according to the distance;
    根据所述个性化显示参数调整所述屏幕的显示效果。Adjusting the display effect of the screen according to the personalized display parameter.
  2. 根据权利要求1所述的屏幕显示方法,其中,所述获取屏幕前用户的面部特征信息包括:The screen display method according to claim 1, wherein the acquiring facial feature information of the user before the screen comprises:
    获取所述用户的头像信息;Obtaining avatar information of the user;
    根据所述头像信息获取所述用户的所述面部特征信息。Obtaining the facial feature information of the user according to the avatar information.
  3. 根据权利要求1或2所述的屏幕显示方法,其中,所述计算所述用户的所述面部与所述屏幕之间的距离包括:The screen display method according to claim 1 or 2, wherein the calculating the distance between the face of the user and the screen comprises:
    根据所述面部特征信息捕捉所述用户的眼球的位置信息;Capturing position information of the eyeball of the user according to the facial feature information;
    根据所述眼球的位置信息计算所述用户的所述面部与所述屏幕之间的距离。Calculating a distance between the face of the user and the screen according to position information of the eyeball.
  4. 根据权利要求1所述的屏幕显示方法,所述计算所述用户的所述面部与所述屏幕之间的距离之后,所述屏幕显示方法还包括:The screen display method according to claim 1, after the calculating the distance between the face of the user and the screen, the screen display method further comprises:
    如果所述用户的所述面部与所述屏幕之间的所述距离超出所述距离的最小允许值,并且所述屏幕的单位显示面积内的文字数量大于预设文字数量时,则对所述屏幕上的显示区域进行移动处理,以使所述文字局部放大并逐行滚动显示在由所述显示区域移动后空余出的放大区域内。If the distance between the face of the user and the screen exceeds a minimum allowable value of the distance, and the number of characters in the unit display area of the screen is greater than a preset number of characters, then The display area on the screen is subjected to a moving process so that the text is partially enlarged and scrolled progressively in the enlarged area remaining after being moved by the display area.
  5. 根据权利要求1所述的屏幕显示方法,所述根据所述面部特征信息识别所述用户的身份信息之后,所述屏幕显示方法还包括:The screen display method according to claim 1, after the identifying the identity information of the user according to the facial feature information, the screen display method further includes:
    如果根据所述面部特征信息无法识别所述用户的所述身份信息,则判断 所述用户为新用户;If the identity information of the user cannot be identified according to the facial feature information, determining that the user is a new user;
    为所述新用户配置标准化信息,所述标准化信息包括用户的所述面部与所述屏幕之间的距离,以及所述距离对应的所述屏幕的标准化显示参数;Configuring standardization information for the new user, the standardized information including a distance between the face of the user and the screen, and a standardized display parameter of the screen corresponding to the distance;
    提醒所述新用户对所述标准化信息中的所述距离及所述距离对应的所述标准化显示参数,逐一进行校准;Reminding the new user to perform calibration on the normalized display parameters corresponding to the distance and the distance in the standardized information;
    存储校准后的信息,将校准后的信息作为所述用户的个性化信息。The calibrated information is stored, and the calibrated information is used as the personalized information of the user.
  6. 根据权利要求5所述的屏幕显示方法,其中,所述为所述新用户配置标准化信息,包括:The screen display method according to claim 5, wherein the configuring the standardized information for the new user comprises:
    获取所述新用户的未矫正视力信息和矫正视力后的配镜度数信息;Obtaining the uncorrected vision information of the new user and the glasses degree information after correcting the vision;
    根据所述未矫正视力信息和所述矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;Disposing the first normalization information and the second normalization information according to the uncorrected visual acuity information and the corrected degree of vision information;
    获取所述新用户选择的所述标准化信息,所述标准化信息为所述第一标准化信息和所述第二标准化信息中的任一者。Obtaining the normalization information selected by the new user, the normalization information being any one of the first normalization information and the second normalization information.
  7. 根据权利要求6所述的屏幕显示方法,还包括:The screen display method according to claim 6, further comprising:
    如果所述用户在预定时间间隔内,调整所述用户的所述面部与所述屏幕之间的距离的次数大于预设次数,则判断所述用户有视觉障碍;Determining that the user has a visual impairment if the number of times the user adjusts the distance between the face of the user and the screen is greater than a preset number of times within a predetermined time interval;
    将所述用户选择的所述标准化信息更换为,所述第一标准化信息和所述第二标准化信息中的任一者;Replacing the standardized information selected by the user with any one of the first normalization information and the second normalization information;
    提醒所述用户对更换后的所述标准化信息中的所述距离与所述距离对应的所述标准化的显示参数,逐一进行校准;Reminding the user to perform calibration on the standardized display parameters corresponding to the distance in the standardized information after the replacement;
    存储校准后的信息,将校准后的信息作为所述用户的个性化信息。The calibrated information is stored, and the calibrated information is used as the personalized information of the user.
  8. 一种具有显示屏幕的装置,包括:A device having a display screen, comprising:
    特征采集单元(10),用于获取屏幕前用户的面部特征信息;a feature collection unit (10), configured to acquire facial feature information of the user before the screen;
    处理单元(20),用于根据所述面部特征信息识别所述用户的身份信息;根据所述身份信息获取所述用户的个性化信息,所述个性化信息包括用户的所述面部与所述屏幕之间的距离,以及所述距离对应的所述屏幕的个性化显示参数;计算所述用户的所述面部与所述屏幕之间的距离;根据所述距离获取对应的个性化显示参数;a processing unit (20), configured to identify identity information of the user according to the facial feature information; acquire personalized information of the user according to the identity information, where the personalized information includes the face of the user and the a distance between the screens, and a personalized display parameter of the screen corresponding to the distance; calculating a distance between the face of the user and the screen; and acquiring a corresponding personalized display parameter according to the distance;
    显示单元(30),用于根据所述个性化显示参数调整所述屏幕的显示效果。The display unit (30) is configured to adjust a display effect of the screen according to the personalized display parameter.
  9. 根据权利要求8所述的具有显示屏幕的装置,其中,所述处理单元(20)进一步用于,如果根据所述面部特征信息无法识别所述用户的所述身份信息,则判断所述用户为新用户;为所述新用户配置标准化信息,所述标准化信息包括用户的所述面部与所述屏幕之间的距离,以及所述距离对应的所述屏幕的标准化显示参数;提醒所述新用户对所述标准化信息中的所述距离及所述距离对应的所述标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为所述用户的个性化信息。The device with a display screen according to claim 8, wherein the processing unit (20) is further configured to: if the identity information of the user cannot be identified according to the facial feature information, determine that the user is a new user; configuring standardized information for the new user, the standardized information including a distance between the face of the user and the screen, and a standardized display parameter of the screen corresponding to the distance; reminding the new user And calibrating the standardized display parameters corresponding to the distance and the distance in the standardized information; storing the calibrated information, and using the calibrated information as the personalized information of the user.
  10. 根据权利要求9所述的具有显示屏幕的装置,其中,所述具有显示屏幕的装置配置有视力检测装置(40),用于获取所述新用户的未矫正视力信息和矫正视力后的配镜度数信息;A device having a display screen according to claim 9, wherein said device having a display screen is provided with vision detecting means (40) for acquiring uncorrected visual acuity information and corrective vision of said new user Degree information;
    所述处理单元(20)进一步用于,根据所述未矫正视力信息和所述矫正视力后的配镜度数信息分别配置第一标准化信息和第二标准化信息;获取所述新用户选择的所述标准化信息,所述标准化信息为所述第一标准化信息和所述第二标准化信息中的任一者。The processing unit (20) is further configured to respectively configure first normalization information and second normalization information according to the uncorrected visual acuity information and the corrected degree of vision information; and acquiring the new user selected The standardized information is any one of the first normalization information and the second normalization information.
  11. 根据权利要求10所述的具有显示屏幕的装置,其中,所述处理单元(20)进一步用于,如果所述用户在预定时间间隔内,调整所述用户的面部与所述屏幕之间的距离的次数大于预设次数,则判断所述用户有视觉障碍;将所述用户选择的所述标准化信息更换为,所述第一标准化信息和所述第二标准化信息中的任一者;提醒所述用户对更换后的所述标准化信息中的所述距离与所述距离对应的所述标准化显示参数,逐一进行校准;存储校准后的信息,将校准后的信息作为所述用户的个性化信息。The apparatus according to claim 10, wherein said processing unit (20) is further configured to adjust a distance between said user's face and said screen if said user is within a predetermined time interval Determining that the user has a visual impairment; and replacing the standardized information selected by the user with any one of the first normalization information and the second standardized information; The user performs calibration on the normalized display parameters corresponding to the distance and the distance in the standardized information after the replacement; stores the calibrated information, and uses the calibrated information as the personalized information of the user. .
  12. 根据权利要求8所述的具有显示屏幕的装置,其中,所述处理单元(20)进一步用于,如果所述用户的所述面部与所述屏幕之间的所述距离超出所述距离的最小允许值,并且所述屏幕的单位显示面积内的文字数量大于预设文字数量时,则对所述屏幕上的显示区域进行移动处理,以使所述文字局部放大并逐行滚动显示在由所述显示区域移动后空余出的放大区域内。The apparatus according to claim 8, wherein the processing unit (20) is further configured to: if the distance between the face of the user and the screen exceeds a minimum of the distance When the value is allowed, and the number of characters in the unit display area of the screen is greater than the preset number of characters, the display area on the screen is moved to make the text partially enlarged and scrolled by line by line. In the enlarged area where the display area moves after the space is left.
  13. 一种具有显示屏幕的设备,包括:A device having a display screen, comprising:
    存储器,存储有计算机程序指令;a memory storing computer program instructions;
    处理器,当所述计算机程序指令被所述处理器执行时实现如权利要求1-7 任一项所述的屏幕显示方法。A processor, when the computer program instructions are executed by the processor, implements the screen display method of any one of claims 1-7.
  14. 一种计算机可读存储介质,其中,A computer readable storage medium, wherein
    所述计算机可读存储介质包括指令,当所述指令在计算机上运行时,使得计算机执行如权利要求1-7任一项所述的屏幕显示方法。The computer readable storage medium includes instructions that, when executed on a computer, cause the computer to perform the screen display method of any of claims 1-7.
PCT/CN2018/123830 2018-02-11 2018-12-26 Screen display method, device having display screen, apparatus, and storage medium WO2019153927A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810140198.1 2018-02-11
CN201810140198.1A CN110162232A (en) 2018-02-11 2018-02-11 Screen display method, device, equipment and storage medium with display screen

Publications (1)

Publication Number Publication Date
WO2019153927A1 true WO2019153927A1 (en) 2019-08-15

Family

ID=67547896

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/123830 WO2019153927A1 (en) 2018-02-11 2018-12-26 Screen display method, device having display screen, apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN110162232A (en)
WO (1) WO2019153927A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112069480A (en) * 2020-08-06 2020-12-11 Oppo广东移动通信有限公司 Display method and device, storage medium and wearable device
CN113029152A (en) * 2021-03-20 2021-06-25 深圳市天策规划设计有限公司 Intelligent imaging type indexing method, device, system, equipment and storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110605505A (en) * 2019-09-23 2019-12-24 佛山耀立电气有限公司 Control method and device for display duration of screen content of welding machine and welding machine
CN111752516A (en) * 2020-06-10 2020-10-09 Oppo(重庆)智能科技有限公司 Screen adjustment method and device for terminal equipment, terminal equipment and storage medium
CN113029018A (en) * 2021-02-03 2021-06-25 深圳市优必选科技股份有限公司 Eye protection prompting method and device, terminal equipment and computer readable storage medium
CN114253623B (en) * 2021-11-19 2024-01-19 惠州Tcl移动通信有限公司 Screen amplification processing method and device based on mobile terminal, terminal and medium
CN114995937A (en) * 2022-06-08 2022-09-02 深圳创维-Rgb电子有限公司 Self-adaptive screen display method, device, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955664A (en) * 2011-08-19 2013-03-06 鸿富锦精密工业(深圳)有限公司 Method and system for electronic book display adjustment
CN107179824A (en) * 2016-03-11 2017-09-19 中国电信股份有限公司 A kind of method, device and the terminal of adjust automatically screen display
CN107436681A (en) * 2016-05-27 2017-12-05 爱唯秀股份有限公司 Automatically adjust the mobile terminal and its method of the display size of word
CN107528972A (en) * 2017-08-11 2017-12-29 维沃移动通信有限公司 A kind of display methods and mobile terminal

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60328578D1 (en) * 2002-12-18 2009-09-10 Microsoft Corp Automatic detection of suitable characteristics
CN101533327A (en) * 2008-03-13 2009-09-16 英业达股份有限公司 Window adjusting interface and adjusting method thereof
JP5423183B2 (en) * 2009-07-03 2014-02-19 ソニー株式会社 Display control apparatus and display control method
CN102147655B (en) * 2010-12-21 2013-01-23 华为终端有限公司 Display control method on electronic display equipment and electronic display equipment
US20120287163A1 (en) * 2011-05-10 2012-11-15 Apple Inc. Scaling of Visual Content Based Upon User Proximity
JP5752572B2 (en) * 2011-11-24 2015-07-22 シャープ株式会社 Display control apparatus, display method, control program, and recording medium
CN103760980A (en) * 2014-01-21 2014-04-30 Tcl集团股份有限公司 Display method, system and device for conducting dynamic adjustment according to positions of two eyes
US9582851B2 (en) * 2014-02-21 2017-02-28 Microsoft Technology Licensing, Llc Using proximity sensing to adjust information provided on a mobile device
CN105759971A (en) * 2016-03-08 2016-07-13 珠海全志科技股份有限公司 Method and system for automatically prompting distance from human eyes to screen
CN106980448A (en) * 2017-02-20 2017-07-25 上海与德通讯技术有限公司 A kind of display methods and mobile terminal
CN106919256A (en) * 2017-02-27 2017-07-04 深圳市金立通信设备有限公司 A kind of method and terminal of protection terminal user's eye health
CN106911962B (en) * 2017-04-01 2020-03-13 上海进馨网络科技有限公司 Scene-based mobile video intelligent playing interaction control method
CN106981150A (en) * 2017-04-19 2017-07-25 西安超嗨网络科技有限公司 A kind of supermarket's intelligent anti-theft system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955664A (en) * 2011-08-19 2013-03-06 鸿富锦精密工业(深圳)有限公司 Method and system for electronic book display adjustment
CN107179824A (en) * 2016-03-11 2017-09-19 中国电信股份有限公司 A kind of method, device and the terminal of adjust automatically screen display
CN107436681A (en) * 2016-05-27 2017-12-05 爱唯秀股份有限公司 Automatically adjust the mobile terminal and its method of the display size of word
CN107528972A (en) * 2017-08-11 2017-12-29 维沃移动通信有限公司 A kind of display methods and mobile terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112069480A (en) * 2020-08-06 2020-12-11 Oppo广东移动通信有限公司 Display method and device, storage medium and wearable device
CN113029152A (en) * 2021-03-20 2021-06-25 深圳市天策规划设计有限公司 Intelligent imaging type indexing method, device, system, equipment and storage medium

Also Published As

Publication number Publication date
CN110162232A (en) 2019-08-23

Similar Documents

Publication Publication Date Title
WO2019153927A1 (en) Screen display method, device having display screen, apparatus, and storage medium
US9291834B2 (en) System for the measurement of the interpupillary distance using a device equipped with a display and a camera
EP3339943A1 (en) Method and system for obtaining optometric parameters for fitting eyeglasses
US20190129501A1 (en) Interactive Motion-Based Eye Tracking Calibration
CN109788894B (en) Measurement method for determining a vision correction requirement value for an individual's near vision
EP3681371B1 (en) Reliability of gaze tracking data for left and right eye
US20070189584A1 (en) Specific expression face detection method, and imaging control method, apparatus and program
US11232586B2 (en) Line-of-sight estimation device, line-of-sight estimation method, and program recording medium
CN104809424B (en) Method for realizing sight tracking based on iris characteristics
WO2008007781A1 (en) Visual axis direction detection device and visual line direction detection method
WO2012137801A1 (en) Input device, input method, and computer program
US20220206571A1 (en) Personalized calibration-independent regional fixation prediction for simultaneous users of a digital display
EP4172723B1 (en) Computer-implemented method for determining a position of a center of rotation of an eye using a mobile device, mobile device and computer program
EP3720335B1 (en) Method and apparatus for determining a reference head posture of a subject
JP2012186821A (en) Face image processing device, face image processing method, electronic still camera, digital image processing device and digital image processing method
JP6572841B2 (en) Information processing apparatus and program
US20230342976A1 (en) Interpupillary distance estimation method
US20230206598A1 (en) Interpupillary distance estimation method
EP4160362A1 (en) Gaze defect compensation
US20220270407A1 (en) Image processing method, image processing device, and non-transitory computer readable storage medium
CN116086396A (en) Method, device, system and storage medium for acquiring distance
JP2021061048A (en) Information processing device, information processing method, and program
JP5017476B2 (en) Facial image processing apparatus, facial image processing method, and electronic still camera
CN115039130A (en) Method, device and program for estimating apparent distance
WO2023073240A1 (en) Method and system for determining eye test screen distance

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18904925

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 231120)

122 Ep: pct application non-entry in european phase

Ref document number: 18904925

Country of ref document: EP

Kind code of ref document: A1