CN116524877A - Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium - Google Patents

Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116524877A
CN116524877A CN202310799214.9A CN202310799214A CN116524877A CN 116524877 A CN116524877 A CN 116524877A CN 202310799214 A CN202310799214 A CN 202310799214A CN 116524877 A CN116524877 A CN 116524877A
Authority
CN
China
Prior art keywords
vehicle
driver
mounted screen
image
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310799214.9A
Other languages
Chinese (zh)
Inventor
郭平
卢晶
杨继山
刘祥
郭玉峰
王玉珏
张斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FAW Jiefang Automotive Co Ltd
Original Assignee
FAW Jiefang Automotive Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FAW Jiefang Automotive Co Ltd filed Critical FAW Jiefang Automotive Co Ltd
Priority to CN202310799214.9A priority Critical patent/CN116524877A/en
Publication of CN116524877A publication Critical patent/CN116524877A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10Intensity circuits
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02BCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
    • Y02B20/40Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

The embodiment of the invention discloses a vehicle-mounted screen brightness adjusting method, a device, electronic equipment and a storage medium, wherein the vehicle-mounted screen brightness adjusting method comprises the following steps: judging the eye position of the collected face image of the driver to obtain the eye position in the face image; determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen; determining a range relationship of an eye gaze of the driver and the vehicle screen based on the initial eye position; and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. According to the invention, the initial human eye position judgment is carried out on the distance from the vehicle-mounted screen, the range relation between the eye sight of the driver and the vehicle-mounted screen is determined on the basis of the initial human eye position judgment, the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.

Description

Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium
Technical Field
The embodiment of the invention relates to the technical field of electronics and electrics, in particular to a vehicle-mounted screen brightness adjusting method and device, electronic equipment and a storage medium.
Background
The vehicle-mounted display screen is a display tool for displaying a certain electronic file on the screen through a specific transmission device and reflecting the electronic file to human eyes, and a user often uses the vehicle-mounted display screen to display interactive information when driving daily. However, the vehicle-mounted screen has larger size and higher brightness, the attention of a driver is easily dispersed when the driver drives, the service life of the display screen can be shortened when the vehicle-mounted display screen is in a high-brightness state for a long time, the luminous efficiency of the light-emitting diode is reduced, the light color of the display screen is changed, and even the screen is thoroughly damaged.
In the process of realizing the invention, the inventor finds that the hardware of the vehicle-mounted screen is changed in the related technology, the additional cost is increased, and certain loss is caused to the vehicle-mounted screen in the process of realizing the invention.
Disclosure of Invention
The invention provides a vehicle-mounted screen brightness adjusting method, a device, electronic equipment and a storage medium.
In a first aspect, a method for adjusting brightness of a vehicle-mounted screen provided by an embodiment of the present invention includes:
judging the eye position of the collected face image of the driver to obtain the eye position in the face image;
determining an initial position of the human eye position to obtain an initial human eye position away from the vehicle-mounted screen;
determining a range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position;
and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
In a second aspect, the present invention provides a vehicle-mounted screen brightness adjustment device, including:
the position judging module is used for judging the eye position of the collected face image of the driver to obtain the eye position in the face image;
the position determining module is used for determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen;
the range determining module is used for determining the range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position;
and the brightness adjusting module is used for correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
In a third aspect, an electronic device provided by an embodiment of the present invention includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the method for adjusting brightness of a vehicle-mounted screen according to any one of the embodiments of the present invention when executing the program.
In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium having stored thereon a computer program that when executed by a processor implements a vehicle-mounted screen brightness adjustment method according to any one of the embodiments of the present invention.
According to the scheme provided by the embodiment of the invention, the collected face image of the driver can be subjected to the judgment of the human eye position, so that the human eye position in the face image is obtained; determining an initial position of the human eye position to obtain an initial human eye position away from the vehicle-mounted screen; determining a range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position; and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. In the method, the initial human eye position judgment is carried out on the distance from the vehicle-mounted screen, the range relation between the eye sight of the driver and the vehicle-mounted screen is determined on the basis of the initial human eye position judgment, the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present invention and should not be considered as limiting the scope, and that other related drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a method for adjusting brightness of a vehicle-mounted screen according to an embodiment of the present invention;
fig. 2 is a second flow chart of a method for adjusting brightness of a vehicle-mounted screen according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a vehicle-mounted screen brightness adjusting device according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the embodiment of the invention, the technical scheme can be applied to a display screen, for example: and (5) a vehicle-mounted display screen. In the following description, the technical solution of the embodiment of the present invention will be described by taking a scene of a vehicle-mounted display screen as an example, but it should be noted that the technical solution of the embodiment of the present invention may be applied not only to a vehicle-mounted display screen, but also to a front windshield, an instrument display screen or a central control display screen, which is not limited herein.
As shown in fig. 1, fig. 1 is a schematic flow chart of a vehicle-mounted screen brightness adjustment method provided by an embodiment of the present invention, where the vehicle-mounted screen brightness adjustment method provided by the embodiment of the present invention may be implemented by a vehicle-mounted screen brightness adjustment device provided by the embodiment of the present invention, and the device may be implemented in a software and/or hardware manner. In a specific embodiment, the apparatus may be integrated in an electronic device, which may be a computer, a server, or the like. Referring to fig. 1, the vehicle-mounted screen brightness adjustment method of the present embodiment may specifically include the following steps:
s101, judging the human eye position of the collected human face image of the driver to obtain the human eye position in the human face image.
The human face includes various organs, such as a visual organ and an olfactory organ, and in this embodiment, the electronic device performs a visual organ position determination, that is, a position determination of a human eye, on the face image of the driver acquired by the image capturing device, to obtain a human eye position in the human eye image.
For example, the normalized face image may be subjected to feature extraction, and processed according to a trained classification and screening model to obtain a boundary range of eyes, so as to determine the position of eyes in the face image; or converting the face image to obtain a gray face image, wherein the edges of organs such as eyes, nose, mouth and the like in the gray face image have the characteristic of large gradient difference, and the eye region can be separated out by setting a corresponding threshold value for the gradient difference of the eyes, so that the boundary coordinates of the eye region are obtained, and the position of human eyes is estimated further; or, firstly determining the left and right boundaries of the human face according to the peak width, then determining the upper and lower boundaries formed by the top of the head and the middle part of the nose by using the horizontal gray level projection curve of the human face region, firstly determining the approximate position of the human eye in the eyebrow region by using a prediction method, and determining the position of the human eye by detecting the edge and edge groups of the eyebrow region; or extracting the characteristics of the face image, screening by using black characteristics, and further screening according to the fact that eyes are in pairs, so as to obtain the positions of eyes in the face image, wherein the positions are not limited.
S102, determining an initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen.
Specifically, because there are differences in the position of the seat and the driver's body type, such as: the difference of the heights causes that the positions or distance values of different drivers and vehicle-mounted screens in space are different, so the electronic equipment firstly determines the initial position of human eyes of the drivers, wherein the initial position comprises the space distance of human eyes corresponding to the vehicle-mounted screen, and the positions of left eye sockets, left eye balls, right eye balls and eye whites.
S103, determining the range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position.
Specifically, after the initial eye position is obtained, the electronic device may calculate an eye gaze angle value using a gaze tracking model (not limited herein), and determine a range relationship between the eye gaze of the driver and the vehicle-mounted screen according to the eye gaze angle value.
S104, correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
Specifically, the electronic device may control the vehicle-mounted screen to perform brightness adjustment according to a range relationship between the eye sight of the driver and the vehicle-mounted screen, where the range relationship between the eye sight of the driver and the vehicle-mounted screen is different, and the brightness of the vehicle-mounted screen is also different. If the eye sight of the driver is on the vehicle-mounted screen, the vehicle-mounted screen can be lightened, and if the eye sight of the driver is not on the vehicle-mounted screen, the vehicle-mounted screen can be darkened, so that the aim of saving energy of the vehicle-mounted screen is fulfilled.
It can be understood that in the embodiment of the invention, the electronic device judges the eye position of the collected face image of the driver to obtain the eye position in the face image; determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen; determining a range relationship of an eye gaze of the driver and the vehicle screen based on the initial eye position; and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. According to the invention, the initial human eye position judgment is carried out on the distance from the vehicle-mounted screen, the range relation between the eye sight of the driver and the vehicle-mounted screen is determined on the basis of the initial human eye position judgment, the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.
The method for adjusting the brightness of the vehicle-mounted screen according to the embodiment of the present invention is further described below, as shown in fig. 2, fig. 2 is a schematic flow chart of a method for adjusting the brightness of the vehicle-mounted screen according to the embodiment of the present invention. The method specifically comprises the following steps:
s201, capturing an image by using an imaging device, wherein the image includes a face image of the driver.
Specifically, the face image of the driver can be monitored and collected in real time through the in-vehicle monitoring camera, the collected face image containing the driver is transmitted to the electronic equipment, and the face image can be analyzed through a sight line analysis processing controller in the electronic equipment.
Specifically, when the image is acquired by the image pickup device, the acquired image can be classified and identified, whether the acquired image contains a face image or not is judged, and when the acquired image does not contain the face image, the image is acquired again, so that the complexity of various subsequent operations on the image is reduced. The camera in the vehicle may be disposed in the ceiling of the vehicle or in the middle of the rear view mirror, without limitation.
S202, performing image signal processing on the acquired image to obtain a processed image.
Specifically, the light collected by the image pickup device falls into the photosensitive recording system, and is processed by the sensor to obtain a preliminary original image, but the image of the type is far from ideal, so that further processing is required for the images, and the collected images can be subjected to black level correction, automatic exposure, white balance, color correction, gamma correction and the like to obtain processed images.
Specifically, the black level correction: to eliminate any offset present in the image data; white balance processing: white balance is correlated with color temperature and is used for measuring the color authenticity and accuracy of an image. Simply, the colors of the pictures shot under various optical conditions are completely the same as the colors of scenes seen by eyes through image adjustment; automatic exposure: the exposure degree is controlled, so that the brightness of the image is suitable; color correction: the spectral sensitivity of the image sensor deviates from human vision. Therefore, the image directly output from the sensor does not show the correct color, and various color corrections are required; gamma correction: the response of the sensor to light is different from the response of the human eye to light. Gamma correction is the process of making an image appear to conform to the characteristics of the human eye.
S203, performing facial markers on the processed image to obtain a marked image.
Specifically, the image acquired by the image pickup apparatus includes other images in the vehicle in addition to the face image of the driver, so that the form of the face can be obtained by performing facial markers of the face on the processed image.
By way of example, a number of marker points may be drawn on the face, the marker points typically being drawn in key locations such as edges, corners, contours, intersections, etc., by means of which the morphology of the face may be described.
S204, evaluating the image quality of the marked image to obtain an evaluation result.
In this embodiment, after the face image is marked, the quality evaluation is performed on the marked image.
For example, the marked image can be evaluated in various aspects such as black screen, blurring, snowflake, static frame, frame clamping and the like, and an evaluation result is obtained. When the black screen evaluation is carried out on the marked image, the marked image can be grayed, the dark pixels are detected to occupy the total proportion, and whether the black screen is detected or not is deduced; in the case of performing the blur degree evaluation on the marked image, the marked image may be subjected to blur detection using gaussian filtering and laplace operator, and the like, and the present invention is not limited thereto.
S205, judging whether the image after the evaluation result characterization mark meets the preset condition, and if not, executing S206; if yes, S207 is executed.
S206, the image acquisition is carried out again.
S207, clipping the marked image to obtain a face image of the driver.
Specifically, when evaluating the marked image in various aspects, such as: after the black screen, the blurring, the snowflake, the static frame, the frame clamping and the like are evaluated, the evaluation result proves that the face image after the mark is qualified, and the face image after the pretreatment can be independently obtained from the image acquired by the original camera equipment by cutting the image after the mark.
S208, judging the human eye position of the human face image of the driver to obtain the human eye position in the human face image.
In this embodiment, the position of the visual organ, that is, the position of the human eye, is determined in the face image of the driver, so as to obtain the position of the human eye in the human eye image.
For example, the normalized face image may be subjected to feature extraction, and processed according to a trained classification and screening model to obtain a boundary range of eyes, so as to determine the position of eyes in the face image; or converting the face image to obtain a gray face image, wherein the edges of organs such as eyes, nose, mouth and the like in the gray face image have the characteristic of large gradient difference, and the eye region can be separated out by setting a corresponding threshold value for the gradient difference of the eyes, so that the boundary coordinates of the eye region are obtained, and the position of human eyes is estimated further; or, firstly, determining the left and right boundaries of the human face according to the peak width, and then determining the upper and lower boundaries formed by the top of the head and the middle of the nose by using the horizontal gray scale projection curve of the human face region. Firstly, determining the approximate position of the human eye in the eyebrow region by using a prediction method, and determining the position of the human eye by detecting the edges and edge groups of the eyebrow region; or, the face image is subjected to feature extraction, firstly, screening is performed by using black features, and then, screening is further performed according to the fact that eyes are in pairs, and the method is not limited.
S209, determining an initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen.
Specifically, because there are differences in the position of the seat and the driver's body type, such as: the difference of the heights causes that the positions or distance values of different drivers and vehicle-mounted screens in space are different, so that the initial position of human eyes of the drivers is firstly determined, and the initial position comprises the spatial distance of human eyes corresponding to the vehicle-mounted screen, and the positions of left and right eyeboxes, left and right eyeballs and eye whites.
Specifically, for the same driver, each time the determination of the initial human eye position from the vehicle-mounted screen is performed during driving, the initial human eye position of the previous driver may be taken as a reference. In the first driving process of the driver, the initial human eye position away from the vehicle-mounted screen is determined, the position value is stored, and if the driver drives next time, the initial human eye position last time is used as the initial human eye position of the driver at the current time after the driver is judged to be the same driver through face recognition.
S210, calculating an angle value of the human eye sight line according to the initial human eye position, and obtaining the calculated angle value of the human eye sight line.
Specifically, after the initial human eye position (the spatial distance corresponding to the vehicle-mounted screen, and the positions of the left eye socket, the right eye socket, the left eye ball, the right eye ball and the white eye ball) is obtained, when the eyes and the heads are not movable, the eyes can rotate, a reference sight line can be set, and when the eyes look forward in a head-on manner, the reference sight line takes the eyes (the center of the eye socket) as a starting point, the angle value of the human eye sight line, namely the angle of the current driver sight line center deviating from the reference sight line, can be calculated by utilizing a sight line tracking model technology; or the straight line in the normal direction of the human face outline plane with the eyeball (the center of the eye socket) as the starting point can be used for obtaining the horizontal and vertical offset angles of the eye sight line center relative to the reference sight line according to the proportion (the distance ratio of the horizontal and vertical directions to the eye socket side) of the current eyeball in the eye socket range, so as to obtain the eye sight line angle value of the driver; or when the head rotates and the eyeballs are fixed, setting a reference sight line, calculating the horizontal and vertical offset angles of the head relative to the reference sight line, and estimating the angle value of the eye sight line.
S211, executing S212 if the eye sight angle value is unchanged in the preset time; if the human eye viewing angle value is changed, S215 is performed.
In this embodiment, frequent adjustment of the brightness of the vehicle-mounted screen can be avoided by the preset time.
S212, comparing the human eye sight angle value with a preset sight angle value to obtain a comparison result.
Specifically, after the eye sight angle value is calculated, if the eye sight angle value is fixed within a preset time, the eye sight angle value is compared with the preset sight angle value. The preset sight angle value is a whole vehicle calibration value, the whole vehicle calibration value can be set according to a whole vehicle coordinate system, a seat position and the position of the vehicle-mounted screen under the whole vehicle coordinate system, and whether the current sight of the driver is watching the vehicle-mounted display screen can be judged by comparing the human eye sight angle value with the whole vehicle calibration value.
S213, judging whether the comparison result represents that the human eye sight angle value is within the range of the preset sight angle value, if yes, executing S214, and if not, executing S215.
S214, displaying that the eye sight line is in the range of the vehicle-mounted screen, and controlling the vehicle-mounted screen to perform brightness display with a first brightness value.
In this embodiment, if the comparison result table shows that the current eye gaze angle value is within the range of the preset gaze angle value, it indicates that the eye gaze of the current driver is within the range of the vehicle-mounted screen, and the driver is currently looking at the vehicle-mounted screen is displayed on the vehicle-mounted screen.
Illustratively, when the driver is looking at the in-vehicle display screen, the luminance of the in-vehicle display screen is set to, for example, 90% for luminance display.
S215, controlling the vehicle-mounted screen to perform brightness display at a second brightness value; the second luminance value is smaller than the first luminance value.
Illustratively, when the driver is looking at the in-vehicle display screen, the luminance of the in-vehicle display screen is set to, for example, 30% for luminance display.
It can be understood that in the embodiment of the invention, the image including the face of the driver acquired by the image pickup device is subjected to image preprocessing in various aspects such as image signal, facial mark, image quality detection and the like, so that the accuracy of image recognition is improved. Judging the eye position of the collected face image of the driver to obtain the eye position in the face image; determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen; and determining the range relation between the eye sight of the driver and the vehicle-mounted screen based on the initial eye position, so that the accuracy in judging the range relation between the eye sight of the driver and the vehicle-mounted screen is further improved. And correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. And the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, so that a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.
The vehicle-mounted screen brightness adjusting method is described below in a specific scene, when a driver A drives a vehicle, in-vehicle image acquisition is carried out in real time by using in-vehicle image pickup equipment, when the acquired image is judged to not contain a face image, image acquisition is carried out again until the acquired image contains the face image of the driver, the acquired image containing the driver A is subjected to black level correction, automatic exposure, white balance, color correction, gamma correction and the like, the processed image is obtained, and in the processed image, the face of the driver A is marked, so that the form of the face of the driver A is obtained; detecting the face after the mark of the driver A, namely the face shape of the driver A, in various aspects such as black screen, blurring, snowflake, static frame, frame clamping and the like, if the face quality after the mark of the driver A is displayed after detection is qualified, cutting out the image after the mark, namely cutting out the face shape of the driver A, determining the eye position in the face shape of the driver A, and determining the spatial distance of eyes of the driver A corresponding to the vehicle-mounted screen, and the positions of left and right eyeboxes, left and right eyeballs and eye whites according to the seat position and the body shape of the driver A; after the initial human eye position is obtained, a current value of the yaw/pitch/roll in the gazing direction of the driver can be obtained through a gaze tracking model technology (without limitation), in a preset time, the value of the eye gaze angle is compared with a preset gaze angle value (whole vehicle calibration value) if the value of the eye gaze angle is fixed, whether the value of the gaze angle of the driver A is in the preset gaze angle value range or not is judged, if yes, the driver A is proved to stare at a vehicle-mounted screen, at the moment, the vehicle-mounted screen is controlled, the brightness is adjusted to a certain brightness value, and the certain brightness value can be set according to actual needs. When the driver A does not stare at the vehicle-mounted display screen, the brightness of the vehicle-mounted display screen can be adjusted to a certain brightness value, and the certain brightness value can be set according to actual needs. According to the scheme, the brightness of the vehicle-mounted screen is adjusted according to the sight of the driver, the service life of the vehicle-mounted display screen is prolonged, when the driver does not stare at the vehicle-mounted display screen, the brightness of the vehicle-mounted display screen is lower, and other people in the vehicle can watch the content of the vehicle-mounted display screen while the vehicle-mounted display screen can save energy better.
Fig. 3 is a schematic structural diagram of a vehicle-mounted screen brightness adjustment device according to an embodiment of the present invention, as shown in fig. 3, the device may specifically include:
the position judging module 301 is configured to judge a human eye position of an acquired face image of a driver, so as to obtain a human eye position in the face image;
the position determining module 302 is configured to perform initial position determination on the human eye position to obtain an initial human eye position away from the vehicle-mounted screen;
a range determining module 303, configured to determine a range relationship between the eye gaze of the driver and the vehicle-mounted screen based on the initial eye position;
and the brightness adjusting module 304 is configured to correspondingly adjust the brightness of the vehicle-mounted screen based on the range relationship.
The device also comprises an image determining module, a processing module and a processing module, wherein the image determining module is used for processing the acquired image to obtain a processed image; the image comprises a face image of the driver; and determining a face image of the driver based on the processed image.
In one embodiment, the image determining module is specifically configured to:
carrying out facial markers on the processed images to obtain marked images;
and determining a face image of the driver based on the marked image.
In one embodiment, the image determining module is specifically configured to:
performing image quality evaluation on the marked image to obtain an evaluation result;
and if the evaluation result represents that the marked image meets the preset condition, cutting the marked image to obtain the face image of the driver.
In one embodiment, the range determining module 303 is specifically configured to:
calculating an angle value of the human eye sight line according to the initial human eye position to obtain a calculated angle value of the human eye sight line;
and determining the range relation between the eye sight of the driver and the vehicle-mounted screen based on the eye sight angle value.
In one embodiment, the range determining module 303 is specifically configured to:
in the preset time, if the human eye sight angle value is unchanged, comparing the human eye sight angle value with a preset sight angle value to obtain a comparison result;
and if the comparison result indicates that the eye sight angle value is in the range of the preset sight angle value, the eye sight is in the range of the vehicle-mounted screen.
In one embodiment, the brightness adjustment module 304 is specifically configured to:
when the eye sight line is in the range of the vehicle-mounted screen, controlling the vehicle-mounted screen to perform brightness display with a first brightness value;
when the eye sight line is not in the range of the vehicle-mounted screen, controlling the vehicle-mounted screen to perform brightness display with a second brightness value; the second luminance value is smaller than the first luminance value.
The device of the embodiment of the invention judges the human eye position of the collected human face image of the driver to obtain the human eye position in the human face image; determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen; determining a range relationship of an eye gaze of the driver and the vehicle screen based on the initial eye position; and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. According to the invention, the initial human eye position judgment is carried out on the distance from the vehicle-mounted screen, the range relation between the eye sight of the driver and the vehicle-mounted screen is determined on the basis of the initial human eye position judgment, the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.
The embodiment of the invention also provides electronic equipment, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the processor realizes the vehicle-mounted screen brightness adjusting method provided by any embodiment when executing the program.
The embodiment of the invention also provides a computer readable medium, on which a computer program is stored, which when executed by a processor, implements the vehicle-mounted screen brightness adjustment method provided by any of the above embodiments.
Referring now to FIG. 4, there is illustrated a schematic diagram of a computer system 400 suitable for use in implementing an electronic device of an embodiment of the present invention. The electronic device shown in fig. 4 is only an example and should not impose any limitation on the functionality and scope of use of the present invention.
As shown in fig. 4, the computer system 400 includes a Central Processing Unit (CPU) 401, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 402 or a program loaded from a storage section 408 into a Random Access Memory (RAM) 403. In the RAM403, various programs and data required for the operation of the computer system 400 are also stored. The CPU401, ROM 402, and RAM403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
The following components are connected to the I/O interface 405: an input section 406 including a keyboard, a mouse, and the like; an output portion 407 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker, and the like; a storage section 408 including a hard disk or the like; and a communication section 409 including a network interface card such as a LAN card, a modem, or the like. The communication section 409 performs communication processing via a network such as the internet. The drive 410 is also connected to the I/O interface 405 as needed. A removable medium 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed on the drive 410 as needed, so that a computer program read therefrom is installed into the storage section 408 as needed.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 409 and/or installed from the removable medium 411. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 401.
The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules and/or units described in the present invention may be implemented in software or in hardware. The described modules and/or units may also be provided in a processor, e.g., may be described as: a processor includes a location determination module, a range determination module, and a brightness adjustment module. The names of these modules do not constitute a limitation on the module itself in some cases.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include:
judging the eye position of the collected face image of the driver to obtain the eye position in the face image;
determining an initial position of the human eye position to obtain an initial human eye position away from the vehicle-mounted screen;
determining a range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position;
and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
In the scheme of the invention, the collected face image of the driver is subjected to eye position judgment to obtain the eye position in the face image; determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen; determining a range relationship of an eye gaze of the driver and the vehicle screen based on the initial eye position; and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation. According to the invention, the initial human eye position judgment is carried out on the distance from the vehicle-mounted screen, the range relation between the eye sight of the driver and the vehicle-mounted screen is determined on the basis of the initial human eye position judgment, the vehicle-mounted screen is controlled to carry out brightness adjustment according to different range relations, a better energy-saving effect is achieved on the vehicle-mounted screen, and the service life of the vehicle-mounted screen is prolonged.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
It should be noted that, in the technical solution of the present disclosure, the related aspects of collecting, updating, analyzing, processing, using, transmitting, storing, etc. of the personal information of the user all conform to the rules of the related laws and regulations, and are used for legal purposes without violating the public order colloquial. Necessary measures are taken for the personal information of the user, illegal access to the personal information data of the user is prevented, and the personal information security, network security and national security of the user are maintained.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A vehicle-mounted screen brightness adjustment method, characterized by comprising:
judging the eye position of the collected face image of the driver to obtain the eye position in the face image;
determining an initial position of the human eye position to obtain an initial human eye position away from the vehicle-mounted screen;
determining a range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position;
and correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
2. The method according to claim 1, wherein before the step of determining the eye position of the collected face image of the driver, the method further comprises:
processing the acquired image by image signals to obtain a processed image; the image comprises a face image of the driver;
and determining a face image of the driver based on the processed image.
3. The method of claim 2, wherein the determining a face image of the driver based on the processed image comprises:
carrying out facial markers on the processed images to obtain marked images;
and determining a face image of the driver based on the marked image.
4. A method according to claim 3, wherein said determining a face image of the driver based on said post-landmark image comprises:
performing image quality evaluation on the marked image to obtain an evaluation result;
and if the evaluation result represents that the marked image meets the preset condition, cutting the marked image to obtain the face image of the driver.
5. The method of claim 1, wherein the determining a range relationship of the driver's eye gaze and the on-board screen based on the initial human eye position comprises:
calculating an angle value of the human eye sight line according to the initial human eye position to obtain a calculated angle value of the human eye sight line;
and determining the range relation between the eye sight of the driver and the vehicle-mounted screen based on the eye sight angle value.
6. The method of claim 5, wherein the determining a range relationship of the driver's eye gaze and the on-board screen based on the eye gaze angle value comprises:
in the preset time, if the human eye sight angle value is unchanged, comparing the human eye sight angle value with a preset sight angle value to obtain a comparison result;
and if the comparison result indicates that the eye sight angle value is in the range of the preset sight angle value, the eye sight is in the range of the vehicle-mounted screen.
7. The method of claim 1, wherein the adjusting the brightness of the on-board screen based on the range relationship comprises:
when the eye sight line is in the range of the vehicle-mounted screen, controlling the vehicle-mounted screen to perform brightness display with a first brightness value;
when the eye sight line is not in the range of the vehicle-mounted screen, controlling the vehicle-mounted screen to perform brightness display with a second brightness value; the second luminance value is smaller than the first luminance value.
8. An in-vehicle screen brightness adjustment device, comprising:
the position judging module is used for judging the eye position of the collected face image of the driver to obtain the eye position in the face image;
the position determining module is used for determining the initial position of the human eye position to obtain the initial human eye position away from the vehicle-mounted screen;
the range determining module is used for determining the range relation between the eye sight line of the driver and the vehicle-mounted screen based on the initial eye position;
and the brightness adjusting module is used for correspondingly adjusting the brightness of the vehicle-mounted screen based on the range relation.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the in-vehicle screen brightness adjustment method according to any one of claims 1 to 7 when executing the program.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that the program, when executed by a processor, implements the in-vehicle screen brightness adjustment method according to any one of claims 1 to 7.
CN202310799214.9A 2023-07-03 2023-07-03 Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium Pending CN116524877A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310799214.9A CN116524877A (en) 2023-07-03 2023-07-03 Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310799214.9A CN116524877A (en) 2023-07-03 2023-07-03 Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116524877A true CN116524877A (en) 2023-08-01

Family

ID=87401489

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310799214.9A Pending CN116524877A (en) 2023-07-03 2023-07-03 Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116524877A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116880702A (en) * 2023-09-08 2023-10-13 深圳市江元科技(集团)有限公司 Control method, system and storage medium of induction type vehicle-mounted medium

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020075136A1 (en) * 2000-12-05 2002-06-20 Nissan Motor Co., Ltd. Display apparatus and method for automotive vehicle
JP2006219000A (en) * 2005-02-10 2006-08-24 Honda Motor Co Ltd Vehicular operating device
JP2012162126A (en) * 2011-02-04 2012-08-30 Fuji Heavy Ind Ltd Luminance control system, luminance control program and luminance control method of in-vehicle display unit
CN104461005A (en) * 2014-12-15 2015-03-25 东风汽车公司 Vehicle-mounted screen switch control method
DE102015215180A1 (en) * 2015-08-07 2017-02-09 Bayerische Motoren Werke Aktiengesellschaft View-dependent adjustment of the brightness of the display of a head-up display
CN108875672A (en) * 2018-06-28 2018-11-23 广东小天才科技有限公司 The screen brightness regulation method and device of intelligent wearable device
CN110969984A (en) * 2019-12-02 2020-04-07 英华达(上海)科技有限公司 Dynamic brightness adjusting method, system, equipment and storage medium of display equipment
CN111179881A (en) * 2020-01-21 2020-05-19 重庆长安汽车股份有限公司 Method, device and system for adjusting brightness of vehicle-mounted display screen, automobile and controller
US20200286292A1 (en) * 2019-03-07 2020-09-10 Denso Corporation In-vehicle display device, in-vehicle display operating method, and computer readable medium storing program executing in-vehicle display
JP2021113842A (en) * 2020-01-16 2021-08-05 株式会社デンソー On-vehicle display device
TW202141975A (en) * 2020-04-26 2021-11-01 新煒科技有限公司 Vehicle-mounted display device based on automobile a-pillar, method, system and storage medium
CN113762210A (en) * 2021-09-23 2021-12-07 上海豫兴电子科技有限公司 Vehicle-mounted display screen control method, device, equipment and storage medium
CN114187881A (en) * 2021-10-25 2022-03-15 东风汽车集团股份有限公司 Screen brightness control method and device of electronic rearview mirror, terminal equipment and medium
CN115376113A (en) * 2022-08-08 2022-11-22 合肥杰发科技有限公司 Driver distraction detection method, driver monitoring system and storage medium
CN115831077A (en) * 2022-11-29 2023-03-21 合众新能源汽车股份有限公司 Vehicle-mounted screen brightness control method and device and related equipment

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020075136A1 (en) * 2000-12-05 2002-06-20 Nissan Motor Co., Ltd. Display apparatus and method for automotive vehicle
JP2006219000A (en) * 2005-02-10 2006-08-24 Honda Motor Co Ltd Vehicular operating device
JP2012162126A (en) * 2011-02-04 2012-08-30 Fuji Heavy Ind Ltd Luminance control system, luminance control program and luminance control method of in-vehicle display unit
CN104461005A (en) * 2014-12-15 2015-03-25 东风汽车公司 Vehicle-mounted screen switch control method
DE102015215180A1 (en) * 2015-08-07 2017-02-09 Bayerische Motoren Werke Aktiengesellschaft View-dependent adjustment of the brightness of the display of a head-up display
CN108875672A (en) * 2018-06-28 2018-11-23 广东小天才科技有限公司 The screen brightness regulation method and device of intelligent wearable device
US20200286292A1 (en) * 2019-03-07 2020-09-10 Denso Corporation In-vehicle display device, in-vehicle display operating method, and computer readable medium storing program executing in-vehicle display
CN110969984A (en) * 2019-12-02 2020-04-07 英华达(上海)科技有限公司 Dynamic brightness adjusting method, system, equipment and storage medium of display equipment
JP2021113842A (en) * 2020-01-16 2021-08-05 株式会社デンソー On-vehicle display device
CN111179881A (en) * 2020-01-21 2020-05-19 重庆长安汽车股份有限公司 Method, device and system for adjusting brightness of vehicle-mounted display screen, automobile and controller
TW202141975A (en) * 2020-04-26 2021-11-01 新煒科技有限公司 Vehicle-mounted display device based on automobile a-pillar, method, system and storage medium
CN113762210A (en) * 2021-09-23 2021-12-07 上海豫兴电子科技有限公司 Vehicle-mounted display screen control method, device, equipment and storage medium
CN114187881A (en) * 2021-10-25 2022-03-15 东风汽车集团股份有限公司 Screen brightness control method and device of electronic rearview mirror, terminal equipment and medium
CN115376113A (en) * 2022-08-08 2022-11-22 合肥杰发科技有限公司 Driver distraction detection method, driver monitoring system and storage medium
CN115831077A (en) * 2022-11-29 2023-03-21 合众新能源汽车股份有限公司 Vehicle-mounted screen brightness control method and device and related equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116880702A (en) * 2023-09-08 2023-10-13 深圳市江元科技(集团)有限公司 Control method, system and storage medium of induction type vehicle-mounted medium
CN116880702B (en) * 2023-09-08 2024-01-05 深圳市江元科技(集团)有限公司 Control method, system and storage medium of induction type vehicle-mounted medium

Similar Documents

Publication Publication Date Title
Hautiere et al. Blind contrast enhancement assessment by gradient ratioing at visible edges
US8295559B2 (en) Face image pickup device and method
CN110703904B (en) Visual line tracking-based augmented virtual reality projection method and system
US7784943B2 (en) Eyelid detecting apparatus, eyelid detecting method and program thereof
CN110009720B (en) Image processing method and device in AR scene, electronic equipment and storage medium
US8532414B2 (en) Region-of-interest video quality enhancement for object recognition
US8055016B2 (en) Apparatus and method for normalizing face image used for detecting drowsy driving
CN112767392B (en) Image definition determining method, device, equipment and storage medium
US20170323465A1 (en) Image processing apparatus, image processing method, and storage medium
CN107451969A (en) Image processing method, device, mobile terminal and computer-readable recording medium
CN109670421B (en) Fatigue state detection method and device
CN108965839B (en) Method and device for automatically adjusting projection picture
WO2011158463A1 (en) External light glare assessment device, line of sight detection device and external light glare assessment method
US20120076421A1 (en) Methods and systems for estimating illumination source characteristics from a single image
JPWO2006098358A1 (en) Image processing apparatus and method, program, and recording medium
JP2009116742A (en) Onboard image processor, image processing method, and program
WO2019033469A1 (en) Augmented reality display method and device based on transparent display
JP2003051017A (en) White line detector
CN116524877A (en) Vehicle-mounted screen brightness adjustment method and device, electronic equipment and storage medium
US10129458B2 (en) Method and system for dynamically adjusting parameters of camera settings for image enhancement
CN113866983A (en) Head-up display device and display method of head-up display device
US9147115B2 (en) Method and device for detecting an object in an image
CN113808135B (en) Image brightness abnormality detection method, electronic device, and storage medium
CN110688887A (en) Transverse image processing device and method for vehicle without rearview mirror
CN114764779A (en) Computing device and defect detection method for near-eye display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination