CN116142078A - Rearview mirror adjustment method, device, system and storage medium - Google Patents

Rearview mirror adjustment method, device, system and storage medium Download PDF

Info

Publication number
CN116142078A
CN116142078A CN202211566167.5A CN202211566167A CN116142078A CN 116142078 A CN116142078 A CN 116142078A CN 202211566167 A CN202211566167 A CN 202211566167A CN 116142078 A CN116142078 A CN 116142078A
Authority
CN
China
Prior art keywords
sight
user
point
falling point
line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211566167.5A
Other languages
Chinese (zh)
Inventor
尚姝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SAIC General Motors Corp Ltd
Pan Asia Technical Automotive Center Co Ltd
Original Assignee
SAIC General Motors Corp Ltd
Pan Asia Technical Automotive Center Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SAIC General Motors Corp Ltd, Pan Asia Technical Automotive Center Co Ltd filed Critical SAIC General Motors Corp Ltd
Priority to CN202211566167.5A priority Critical patent/CN116142078A/en
Publication of CN116142078A publication Critical patent/CN116142078A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/06—Rear-view mirror arrangements mounted on vehicle exterior
    • B60R1/062—Rear-view mirror arrangements mounted on vehicle exterior with remote control for adjusting position
    • B60R1/07—Rear-view mirror arrangements mounted on vehicle exterior with remote control for adjusting position by electrically powered actuators
    • B60R1/072—Rear-view mirror arrangements mounted on vehicle exterior with remote control for adjusting position by electrically powered actuators for adjusting the mirror relative to its housing
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00—Road transport of goods or passengers
    • Y02T10/10—Internal combustion engine [ICE] based vehicles
    • Y02T10/40—Engine management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The application discloses a rearview mirror adjustment method, device, system and storage medium, wherein the method comprises the following steps: acquiring a user sight falling point in the running process of the vehicle; when a user sight falling point is positioned on a vehicle rearview mirror, determining a nearest target point on a rearview mirror edge line from the user sight falling point; when the distance between the target point and the sight falling point is smaller than a first preset distance, acquiring the movement trend of the sight falling point; and when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center. By adopting the scheme provided by the application, the automatic adjustment of the rearview mirror can be realized, so that the convenience and safety of driving are improved.

Description

Rearview mirror adjustment method, device, system and storage medium
Technical Field
The present disclosure relates to the field of automotive technologies, and in particular, to a method, an apparatus, a system, and a storage medium for adjusting a rearview mirror.
Background
The automobile outer rearview mirror is positioned on two sides of an automobile, is one of important parts of the automobile, and has the main function of providing visual fields on two sides and the rear of an automobile body for a driver. The existing outer rearview mirror lens is all changed in position by the driver through active adjustment. Under the condition of no manual adjustment, the original position can be kept still, the visual field is fixed and limited, and in the running process of the vehicle, if the driver manually adjusts the angle of the rearview mirror, the driving safety of the driver is reduced.
Therefore, how to provide a method for adjusting a rearview mirror to automatically adjust the angle of the rearview mirror and improve the convenience and safety of driving is a technical problem to be solved.
Disclosure of Invention
The application provides a rearview mirror adjusting method, device, system and storage medium, which are used for improving the convenience and safety of driving.
The application provides a rearview mirror adjustment method, which comprises the following steps:
acquiring a user sight falling point in the running process of the vehicle;
when a user sight falling point is positioned on a vehicle rearview mirror, determining a nearest target point on a rearview mirror edge line from the user sight falling point;
when the distance between the target point and the sight falling point is smaller than a first preset distance, acquiring the movement trend of the sight falling point;
and when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center.
The beneficial effects of this application lie in: acquiring a user sight falling point in the running process of a vehicle, and determining a nearest target point on the edge line of the rearview mirror to the user sight falling point when the user sight falling point is on the rearview mirror of the vehicle; when the distance between the line-of-sight falling point of the user and the target point is smaller than a first preset distance, acquiring the movement trend of the line-of-sight falling point; and when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center. Furthermore, the angle of the rearview mirror of the vehicle can be automatically adjusted according to the falling point of the sight of the user and the movement trend of the falling point of the sight in the running process of the vehicle, so that the convenience and safety of driving are improved.
In one embodiment, the acquiring the user line-of-sight landing point includes:
acquiring eye movement data of a user according to an eye movement instrument;
and determining the line-of-sight falling point of the user according to the eye movement data of the user.
In one embodiment, the acquiring the user line-of-sight landing point includes:
acquiring eye movement data of a user according to an eye movement instrument, and acquiring face offset data of the user and iris offset data of the user according to a camera;
and determining the line-of-sight drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user.
In one embodiment, the determining the eye drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user comprises:
determining a first sight drop point of a user according to the eye movement data, and determining a second sight drop point of the user according to the face offset data of the user and the iris offset data of the user;
judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance or not;
and when the distance between the first sight falling point and the second sight falling point is smaller than a second preset distance, determining that the first sight falling point is the sight falling point of the user.
In one embodiment, the face offset data of the user includes a face offset, the iris offset data of the user includes an iris offset, and the determining the second gaze location of the user based on the face offset data of the user and the iris offset data of the user includes:
acquiring a sight line drop point before face and iris offset according to an eye tracker;
and determining a second sight drop point of the user according to the sight drop point before the face and the iris offset and the face offset and/or the iris offset.
In one embodiment, the method further comprises:
when the distance between the first sight line falling point and the second sight line falling point is larger than a second preset distance, taking the line segment center point with the first sight line falling point and the second sight line falling point as endpoints as the sight line falling point of the user.
In one embodiment, the face offset data of the user includes a face offset direction of the user, the iris offset data of the user includes an iris offset direction of the user, and the obtaining the movement trend of the line-of-sight landing includes:
and determining the movement trend of the sight drop point according to the face offset direction of the user and/or the iris offset direction of the user.
In one embodiment, the method further comprises:
and when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
The application also provides a rearview mirror adjustment device, including:
the first acquisition module is used for acquiring a user sight falling point in the vehicle running process;
the determining module is used for determining a target point closest to the user sight falling point on the edge line of the rearview mirror when the user sight falling point is positioned on the rearview mirror of the vehicle;
the second acquisition module is used for acquiring the movement trend of the sight falling point when the distance between the target point and the sight falling point is smaller than a first preset distance;
and the adjusting module is used for adjusting the angle of the rearview mirror to enlarge the user visual field range in a preset area taking the position of the sight falling point as the center when the movement trend of the sight falling point approaches the target point.
In one embodiment, the first acquisition module includes:
the first acquisition sub-module is used for acquiring eye movement data of a user according to the eye movement instrument;
and the first determining submodule is used for determining the sight drop point of the user according to the eye movement data of the user.
In one embodiment, the first acquisition module includes:
the second acquisition sub-module is used for acquiring eye movement data of the user according to the eye movement instrument, and acquiring face offset data of the user and iris offset data of the user according to the camera;
and the second determining submodule is used for determining the sight drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user.
In one embodiment, the second determination submodule is further configured to:
determining a first sight drop point of a user according to the eye movement data, and determining a second sight drop point of the user according to the face offset data of the user and the iris offset data of the user;
judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance or not;
and when the distance between the first sight falling point and the second sight falling point is smaller than a second preset distance, determining that the first sight falling point is the sight falling point of the user.
In one embodiment, the face offset data of the user includes a face offset, the iris offset data of the user includes an iris offset, and the determining the second gaze location of the user based on the face offset data of the user and the iris offset data of the user includes:
Acquiring a sight line drop point before face and iris offset according to an eye tracker;
and determining a second sight drop point of the user according to the sight drop point before the face and the iris offset and the face offset and/or the iris offset.
In one embodiment, the second determination submodule is further configured to:
when the distance between the first sight line falling point and the second sight line falling point is larger than a second preset distance, taking the line segment center point with the first sight line falling point and the second sight line falling point as endpoints as the sight line falling point of the user.
In one embodiment, the face offset data of the user includes a face offset direction of the user, the iris offset data of the user includes an iris offset direction of the user, and the obtaining the movement trend of the line-of-sight landing includes:
and determining the movement trend of the sight drop point according to the face offset direction of the user and/or the iris offset direction of the user.
In one embodiment, the adjustment module is further configured to:
and when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
The application also provides a rearview mirror adjustment system, comprising:
At least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to implement the rearview mirror adjustment method as described in any of the above embodiments.
The present application also provides a computer readable storage medium, which when executed by a processor corresponding to the rearview mirror adjustment system, enables the rearview mirror adjustment system to implement the rearview mirror adjustment method described in any one of the above embodiments.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the present application is described in further detail below through the accompanying drawings and examples.
Drawings
The accompanying drawings are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate the application and together with the embodiments of the application, and not constitute a limitation to the application. In the drawings:
FIG. 1 is a flow chart of a rearview mirror adjustment method according to an embodiment of the present application;
FIG. 2 is a block diagram of a rearview mirror adjustment device in accordance with one embodiment of the present application;
fig. 3 is a schematic hardware structure of a rearview mirror adjustment system according to an embodiment of the present application.
Detailed Description
The preferred embodiments of the present application will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present application only and are not intended to limit the present application.
Fig. 1 is a flowchart of a rearview mirror adjustment method according to an embodiment of the present application, where the method may be used to automatically adjust an angle of a rearview mirror of a vehicle according to a falling point of a line of sight of a user and a movement trend of the falling point of the line of sight during a traveling process of the vehicle, so as to improve convenience and safety of driving, and as shown in fig. 1, the method may be implemented as steps S101 to S104:
in step S101, during the travel of the vehicle, a user line-of-sight landing point is acquired;
in step S102, when a user line-of-sight landing point is located on a vehicle rearview mirror, determining a target point closest to the user line-of-sight landing point on a rearview mirror edge line;
in step S103, when the distance between the target point and the line-of-sight falling point is smaller than a first preset distance, acquiring a movement trend of the line-of-sight falling point;
In step S104, when the movement trend of the line-of-sight landing point approaches the target point, the rearview mirror angle is adjusted to increase the user field of view range in a preset area centered on the line-of-sight landing point position.
During the travel of the vehicle, a user line-of-sight landing point is acquired. In this application, there are a variety of ways to obtain a user's line of sight. For example, a user's eye drop point may be obtained by an eye tracker, specifically, eye movement data of the user may be obtained according to the eye tracker, where the eye movement data includes position coordinates of the eye, pupil diameter, gaze point coordinates, gaze time, and the like; and then, determining the eye drop point of the user according to the eye movement data of the user, wherein random errors exist in the data acquisition process, and tremble, micro-eye jump, micro-glance and other conditions exist in the eye movement of the user, so that the acquired original eye movement data are preprocessed according to pupil diameter, gaze time and the like, and the gaze point is combined according to gaze time, gaze point moving distance and the like of the gaze point, so that the eye drop point of the user is obtained.
For another example, the calibration can be performed by combining the face offset data of the user acquired by the camera and the iris offset data of the user on the basis of acquiring the eye drop point of the user through the eye tracker. The camera acquires face offset data of the user and iris offset data of the user, and the face offset data and the iris offset data are determined through position changes of feature points of the face and eyes of the user. Firstly, determining a first sight line drop point of the user according to the eye movement data, wherein the first sight line drop point is obtained by preprocessing and combining the eye movement data acquired by the eye movement instrument. And secondly, determining a second sight drop point of the user according to the face offset data of the user and the iris offset data of the user. When the second sight falling point is obtained, a 3D space stereoscopic model can be built according to the position of the camera, the relative position of the camera and the rearview mirror, the relative position of the user and the rearview mirror, iris offset data of the user and face offset data of the user, coordinates of two eyes of the user, the sight direction and coordinates of the rearview mirror are determined, and then the sight falling point of the user, where the sight falls on the rearview mirror, is determined to be the second sight falling point. In addition, a second sight line falling point can be obtained by combining the offset direction and the offset of the face and the iris of the user on the basis of the sight line falling point obtained by the eye tracker. Specifically, the eye drop points before the face and the iris are offset are obtained according to the eye tracker, and the determination of the eye drop points is the same as that described above, and the description is omitted here; and then, determining a second sight falling point of the user according to the sight falling point before the face and the iris are offset and the face offset and/or the iris offset, and determining the falling point after the offset of the sight falling point as the second sight falling point by combining the face offset and/or the iris offset as the space coordinates of the sight falling point can be obtained. And then judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance. In order to avoid data acquisition errors, therefore, a first sight line falling point obtained by eye movement data acquired by the eye movement instrument is compared with a second sight line falling point obtained by data acquired by the camera, when the data acquisition is correct, the distance between the first sight line falling point and the second sight line falling point should be smaller than a second preset distance, and therefore, when the distance between the first sight line falling point and the second sight line falling point is smaller than the second preset distance, the first sight line falling point is determined to be the sight line falling point of the user. When the distance between the first sight falling point and the second sight falling point is larger than a second preset distance, the deviation of data acquisition is indicated, and the line segment center point with the first sight falling point and the second sight falling point as endpoints is taken as the sight falling point of the user.
When the user line of sight landing point is located on the vehicle rearview mirror, determining a target point closest to the user line of sight landing point on a rearview mirror edge line. In order to determine whether the user has an intention to adjust the rearview mirror, in this embodiment, when the user's line of sight landing point is on the rearview mirror of the vehicle, a target point on the line of sight landing point closest to the user's line of sight landing point is determined from the relationship between the line of sight landing point and the line of sight edge of the rearview mirror.
And when the distance between the target point and the sight falling point is smaller than a first preset distance, acquiring the movement trend of the sight falling point. When the distance between the target point and the sight drop point is smaller than a first preset distance, the fact that the sight drop point of the user is close to the edge of the rearview mirror is indicated, and at the moment, in order to judge whether the current visual field range meets the user requirement, the movement trend of the sight drop point of the user is determined through face offset data and iris offset data collected by the camera. The face offset data of the user comprises a face offset direction of the user, the iris offset data of the user comprises an iris offset direction of the user, and the moving trend of the sight line drop point is determined according to the face offset direction of the user and/or the iris offset direction of the user, specifically, the face offset direction can be directly used as the moving trend of the sight line drop point; the iris deviation direction can also be directly used as the movement trend of the sight falling point; the face offset vector can be obtained through the face offset direction and the offset, the iris offset vector can be obtained through the iris offset direction and the offset, and the vector obtained by adding the face offset vector and the iris offset vector is used as the movement trend of the sight drop point.
And when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center. In order to judge whether the view range of the rearview mirror meets the requirement of a user, when the distance between the target point at the edge of the rearview mirror and the sight falling point of the user is smaller than the first preset distance and the movement trend of the sight falling point of the user is still the target point approaching to the edge of the rearview mirror, the view range of the user is indicated to be in the direction of the target point, so that the angle of the rearview mirror is adjusted along the movement trend of the sight falling point to increase the view range of the user in a preset area taking the position of the sight falling point as the center. In the specific adjustment process, adjustment can be performed according to a preset step length, and the user sight falling point is continuously monitored in the adjustment process until the movement trend of the user sight falling point does not trend towards the target point any more. And when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
The beneficial effects of this application lie in: acquiring a user sight falling point in the running process of a vehicle, and determining a nearest target point on the edge line of the rearview mirror to the user sight falling point when the user sight falling point is on the rearview mirror of the vehicle; when the distance between the line-of-sight falling point of the user and the target point is smaller than a first preset distance, acquiring the movement trend of the line-of-sight falling point; and when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center. Furthermore, the angle of the rearview mirror of the vehicle can be automatically adjusted according to the falling point of the sight of the user and the movement trend of the falling point of the sight in the running process of the vehicle, so that the convenience and safety of driving are improved.
In one embodiment, the step S101 may be implemented as steps A1-A2 as follows:
in step A1, eye movement data of a user is obtained according to an eye movement instrument;
in step A2, a line of sight landing point of the user is determined according to the eye movement data of the user.
In this embodiment, eye movement data of a user is acquired according to an eye movement apparatus, wherein the eye movement data includes position coordinates of eyes, pupil diameters, fixation point coordinates, fixation time, and the like.
And then, determining the line-of-sight falling point of the user according to the eye movement data of the user. Because random errors exist in the data acquisition process, the acquired original eye movement data are preprocessed according to pupil diameters, fixation time and the like, fixation points with fixation time being larger than preset time and fixation point moving distance being smaller than preset distance are combined, and the sight falling point of the user is obtained.
In one embodiment, the above step S101 may be implemented as the following steps B1-B2:
in step B1, acquiring eye movement data of a user according to an eye movement instrument, and acquiring face offset data of the user and iris offset data of the user according to a camera;
in step B2, a line of sight drop point of the user is determined according to the eye movement data, the face offset data of the user and the iris offset data of the user.
In this embodiment, eye movement data of a user is obtained according to an eye movement meter, and face offset data of the user and iris offset data of the user are obtained according to a camera. The eye movement data comprise position coordinates, pupil diameter, fixation point coordinates, fixation time and the like of eyes, and the eye movement data collected by the eye movement instrument can determine the line of sight falling point of a user. The camera acquires face offset data of the user and iris offset data of the user, the face offset data and the iris offset data of the user are determined through position changes of feature points of the face and eyes of the user, and calibration is carried out by combining the face offset data of the user and the iris offset data of the user acquired by the camera.
And determining the line-of-sight drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user. Specifically, a first sight drop point of the user is determined according to the eye movement data, and a second sight drop point of the user is determined according to the face offset data of the user and the iris offset data of the user. The first sight line falling point is obtained by preprocessing and combining the eye movement data acquired by the eye movement instrument; the second line of sight falling point can be obtained by combining the offset direction and the offset amount of the face and the iris of the user on the basis of the line of sight falling point obtained by the eye tracker, specifically, the line of sight falling point before the face and the iris are offset is obtained according to the eye tracker, and the determination of the line of sight falling point is the same as that of the first line of sight falling point and is not repeated here; and then, determining a second sight falling point of the user according to the sight falling point before the face and the iris are offset and the face offset and/or the iris offset, and determining the falling point after the offset of the sight falling point as the second sight falling point by combining the face offset and/or the iris offset as the space coordinates of the sight falling point can be obtained. Judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance or not; when the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance, determining the first sight line falling point as the sight line falling point of the user; when the distance between the first sight line falling point and the second sight line falling point is larger than a second preset distance, taking the line segment center point with the first sight line falling point and the second sight line falling point as endpoints as the sight line falling point of the user.
In one embodiment, the above step B2 may be implemented as the following steps B21-B23:
in step B21, determining a first eye drop point of the user according to the eye movement data, and determining a second eye drop point of the user according to the face offset data of the user and the iris offset data of the user;
in step B22, determining whether the distance between the first line-of-sight falling point and the second line-of-sight falling point is smaller than a second preset distance;
in step B23, when the distance between the first line-of-sight falling point and the second line-of-sight falling point is smaller than a second preset distance, determining that the first line-of-sight falling point is the line-of-sight falling point of the user.
In this embodiment, a first eye drop point of the user is determined according to the eye movement data, and a second eye drop point of the user is determined according to the face offset data of the user and the iris offset data of the user. In the same way, the first sight line drop point is a sight line drop point of the user obtained by preprocessing and combining the eye movement data acquired by the eye movement instrument. When the second sight falling point is obtained, a 3D space stereoscopic model can be built according to the position of the camera, the relative position of the camera and the rearview mirror, the relative position of the user and the rearview mirror, iris offset data of the user and face offset data of the user, coordinates of two eyes of the user, the sight direction and coordinates of the rearview mirror are determined, and then the sight falling point of the user, where the sight falls on the rearview mirror, is determined to be the second sight falling point. In addition, a second sight line falling point can be obtained by combining the offset direction and the offset of the face and the iris of the user on the basis of the sight line falling point obtained by the eye tracker. Specifically, the eye drop points before the face and the iris are offset are obtained according to the eye tracker, and the determination of the eye drop points is the same as that described above, and the description is omitted here; and then, determining a second sight falling point of the user according to the sight falling point before the face and the iris are offset and the face offset and/or the iris offset, and determining the falling point after the offset of the sight falling point as the second sight falling point by combining the face offset and/or the iris offset as the space coordinates of the sight falling point can be obtained.
And judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance. In order to avoid data acquisition errors, therefore, a first sight line falling point obtained by eye movement data acquired by the eye movement instrument is compared with a second sight line falling point obtained by data acquired by the camera, when the data acquisition is correct, the distance between the first sight line falling point and the second sight line falling point should be smaller than a second preset distance, and therefore, when the distance between the first sight line falling point and the second sight line falling point is smaller than the second preset distance, the first sight line falling point is determined to be the sight line falling point of the user. When the distance between the first sight falling point and the second sight falling point is larger than a second preset distance, the deviation of data acquisition is indicated, and the line segment center point with the first sight falling point and the second sight falling point as endpoints can be taken as the sight falling point of the user.
In one embodiment, the face offset data of the user includes a face offset, and the iris offset data of the user includes an iris offset, the above step B21 may be implemented as the following steps B211-B212:
in step B211, acquiring a line-of-sight falling point before face and iris offset according to an eye tracker;
In step B212, a second eye drop point for the user is determined based on the eye drop point before the face and iris offset, and the face offset and/or iris offset.
In this embodiment, the eye drop point before the face and iris offset is acquired from the eye tracker. The determination of the line-of-sight landing point is the same as the determination of the first line-of-sight landing, and is obtained by the eye movement data acquired by the eye movement instrument, and will not be described in detail here.
And determining a second sight-line falling point of the user according to the sight-line falling point before the face and the iris are offset and the face offset and/or the iris offset, and then determining the space coordinates of the sight-line falling point after the offset of the sight-line falling point, namely the second sight-line falling point, by combining the face offset and/or the iris offset.
In one embodiment, the method may be implemented as the following step B24:
in step B24, when the distance between the first line-of-sight falling point and the second line-of-sight falling point is greater than a second preset distance, the line segment center point taking the first line-of-sight falling point and the second line-of-sight falling point as the end points is taken as the line-of-sight falling point of the user.
In this embodiment, in order to avoid data acquisition errors, a first line-of-sight falling point obtained from eye movement data acquired by an eye movement instrument is compared with a second line-of-sight falling point obtained from data acquired by a camera, and when a distance between the first line-of-sight falling point and the second line-of-sight falling point is greater than a second preset distance, it is indicated that data acquisition has deviation, and a line segment center point with the first line-of-sight falling point and the second line-of-sight falling point as endpoints may be a line-of-sight falling point of a user.
The beneficial effects of this embodiment lie in: and the dead drop point of the user is calibrated through the user face and iris data acquired by the camera, so that the probability of deviation in acquisition of the line-of-sight drop point data of the user is reduced.
In one embodiment, the face offset data of the user includes a face offset direction of the user, and the iris offset data of the user includes an iris offset direction of the user, the step S103 may be implemented as follows:
and determining the movement trend of the sight drop point according to the face offset direction of the user and/or the iris offset direction of the user.
In this embodiment, in order to determine whether the current field of view meets the user requirement, the movement trend of the user's line of sight falling point is determined by the face offset data and the iris offset data collected by the camera. The face offset data of the user comprises a face offset direction of the user, the iris offset data of the user comprises an iris offset direction of the user, and the moving trend of the sight line drop point is determined according to the face offset direction of the user and/or the iris offset direction of the user, specifically, the face offset direction can be directly used as the moving trend of the sight line drop point; the iris deviation direction can also be directly used as the movement trend of the sight falling point; the face offset vector can be obtained through the face offset direction and the offset, the iris offset vector can be obtained through the iris offset direction and the offset, and the vector obtained by adding the face offset vector and the iris offset vector is used as the movement trend of the sight drop point.
The beneficial effects of this embodiment lie in: the face offset data and the iris offset data of the user are collected through the camera, the movement trend of the sight falling point of the user is determined, and then the adjustment intention of the user is determined, so that the angle of the rearview mirror is adjusted according to the adjustment intention of the user, the automatic adjustment of the rearview mirror is realized, and the convenience and the safety of driving are improved.
In one embodiment, the method may also be implemented as the following steps:
and when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
In this embodiment, when the movement trend of the line-of-sight falling point is not approaching the target point, the field-of-view range indicating the target point direction is not the target direction of the user, so that it is determined that the rearview mirror angle does not need to be adjusted.
The beneficial effects of this embodiment lie in: in the rearview mirror adjustment process, the adjustment angle of the rearview mirror is judged by monitoring the movement trend of the sight falling point of the user, and adjustment is stopped when the movement trend no longer approaches to the target point, so that the automatic adjustment of the rearview mirror is realized, the manual adjustment of the user is not needed, and the convenience and safety of driving are improved.
Fig. 2 is a structural diagram of a rearview mirror adjustment device according to an embodiment of the present application, as shown in fig. 2, including:
a first obtaining module 201, configured to obtain a user's line-of-sight landing point during a vehicle traveling process;
a determining module 202, configured to determine, when a user line-of-sight landing point is located on a vehicle rearview mirror, a target point on a line of a rearview mirror edge that is closest to the user line-of-sight landing point;
a second obtaining module 203, configured to obtain a movement trend of the line-of-sight landing point when the distance between the target point and the line-of-sight landing point is smaller than a first preset distance;
and the adjusting module 204 is configured to adjust the rearview mirror angle to increase the user field of view in a preset area centered on the line of sight landing point when the movement trend of the line of sight landing point approaches the target point.
In one embodiment, the first acquisition module includes:
the first acquisition sub-module is used for acquiring eye movement data of a user according to the eye movement instrument;
and the first determining submodule is used for determining the sight drop point of the user according to the eye movement data of the user.
In one embodiment, the first acquisition module includes:
the second acquisition sub-module is used for acquiring eye movement data of the user according to the eye movement instrument, and acquiring face offset data of the user and iris offset data of the user according to the camera;
And the second determining submodule is used for determining the sight drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user.
In one embodiment, the second determination submodule is further configured to:
determining a first sight drop point of a user according to the eye movement data, and determining a second sight drop point of the user according to the face offset data of the user and the iris offset data of the user;
judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance or not;
and when the distance between the first sight falling point and the second sight falling point is smaller than a second preset distance, determining that the first sight falling point is the sight falling point of the user.
In one embodiment, the face offset data of the user includes a face offset, the iris offset data of the user includes an iris offset, and the determining the second gaze location of the user based on the face offset data of the user and the iris offset data of the user includes:
acquiring a sight line drop point before face and iris offset according to an eye tracker;
and determining a second sight drop point of the user according to the sight drop point before the face and the iris offset and the face offset and/or the iris offset.
In one embodiment, the second determination submodule is further configured to:
when the distance between the first sight line falling point and the second sight line falling point is larger than a second preset distance, taking the line segment center point with the first sight line falling point and the second sight line falling point as endpoints as the sight line falling point of the user.
In one embodiment, the face offset data of the user includes a face offset direction of the user, the iris offset data of the user includes an iris offset direction of the user, and the obtaining the movement trend of the line-of-sight landing includes:
and determining the movement trend of the sight drop point according to the face offset direction of the user and/or the iris offset direction of the user.
In one embodiment, the adjustment module is further configured to:
and when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
Fig. 3 is a schematic hardware structure of a rearview mirror adjustment system according to an embodiment of the present application, as shown in fig. 3, including:
at least one processor 320; the method comprises the steps of,
a memory 304 communicatively coupled to the at least one processor 320; wherein,,
the memory 304 stores instructions executable by the at least one processor 320 to implement the rearview mirror adjustment method described in any of the above embodiments.
Referring to fig. 3, the rearview mirror adjustment system 300 can include one or more of the following components: a processing component 302, a memory 304, a power supply component 306, a multimedia component 308, an audio component 310, an input/output (I/O) interface 312, a sensor component 314, and a communication component 316.
The processing assembly 302 generally controls the overall operation of the rearview mirror adjustment system 300. The processing component 302 may include one or more processors 320 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 302 can include one or more modules that facilitate interactions between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate interaction between the multimedia component 308 and the processing component 302.
The memory 304 is configured to store various types of data to support the operation of the rearview mirror adjustment system 300. Examples of such data include instructions for any application or method operating on the rearview mirror adjustment system 300, such as text, pictures, video, and the like. The memory 304 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply assembly 306 provides power to the various components of the rearview mirror adjustment system 300. The power components 306 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the in-vehicle control system 300.
The multimedia component 308 includes a screen between the rearview mirror adjustment system 300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation. In some embodiments, the multimedia component 308 can also include a front-facing camera and/or a rear-facing camera. When the rearview mirror adjustment system 300 is in an operational mode, such as a capture mode or a video mode, the front-facing camera and/or the rear-facing camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 310 is configured to output and/or input audio signals. For example, the audio component 310 includes a Microphone (MIC) configured to receive external audio signals when the rearview mirror adjustment system 300 is in an operational mode, such as an alarm mode, a recording mode, a voice recognition mode, and a voice output mode. The received audio signals may be further stored in the memory 304 or transmitted via the communication component 316. In some embodiments, audio component 310 further comprises a speaker for outputting audio signals.
The I/O interface 312 provides an interface between the processing component 302 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 314 includes one or more sensors for providing a status assessment of various aspects of the rearview mirror adjustment system 300. For example, the sensor assembly 314 may include a sound sensor. In addition, the sensor assembly 314 may detect the open/closed state of the rearview mirror adjustment system 300, the relative positioning of the components, such as the display and keypad of the rearview mirror adjustment system 300, the sensor assembly 314 may also detect the operational state of the rearview mirror adjustment system 300 or one of the components of the rearview mirror adjustment system 300, such as the operational state of the air distribution plate, the structural state, the operational state of the discharge blade, etc., the orientation or acceleration/deceleration of the rearview mirror adjustment system 300, and the temperature change of the rearview mirror adjustment system 300. The sensor assembly 314 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, a material bulk thickness sensor, or a temperature sensor.
The communication component 316 is configured to enable the rearview mirror adjustment system 300 to provide communication capabilities in a wired or wireless manner with other devices and cloud platforms. The rearview mirror adjustment system 300 can access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 316 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 316 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the rearview mirror adjustment system 300 can be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components for performing the rearview mirror adjustment methods described in any of the above embodiments.
The present application also provides a computer readable storage medium, which when executed by a processor corresponding to the rearview mirror adjustment system, enables the rearview mirror adjustment system to implement the rearview mirror adjustment method described in any one of the above embodiments.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims (10)

1. A rearview mirror adjustment method, characterized by comprising:
acquiring a user sight falling point in the running process of the vehicle;
when a user sight falling point is positioned on a vehicle rearview mirror, determining a nearest target point on a rearview mirror edge line from the user sight falling point;
when the distance between the target point and the sight falling point is smaller than a first preset distance, acquiring the movement trend of the sight falling point;
and when the movement trend of the sight line falling point approaches the target point, adjusting the angle of the rearview mirror to increase the user visual field range in a preset area taking the sight line falling point position as the center.
2. The method of claim 1, wherein the obtaining a user line-of-sight landing point comprises:
acquiring eye movement data of a user according to an eye movement instrument;
and determining the line-of-sight falling point of the user according to the eye movement data of the user.
3. The method of claim 1, wherein the obtaining a user line-of-sight landing point comprises:
acquiring eye movement data of a user according to an eye movement instrument, and acquiring face offset data of the user and iris offset data of the user according to a camera;
and determining the line-of-sight drop point of the user according to the eye movement data, the face offset data of the user and the iris offset data of the user.
4. The method of claim 3, wherein the determining a gaze point of the user based on the eye movement data, the face offset data of the user, and the iris offset data of the user comprises:
determining a first sight drop point of a user according to the eye movement data, and determining a second sight drop point of the user according to the face offset data of the user and the iris offset data of the user;
judging whether the distance between the first sight line falling point and the second sight line falling point is smaller than a second preset distance or not;
and when the distance between the first sight falling point and the second sight falling point is smaller than a second preset distance, determining that the first sight falling point is the sight falling point of the user.
5. The method of claim 4, wherein the method further comprises:
when the distance between the first sight line falling point and the second sight line falling point is larger than a second preset distance, taking the line segment center point with the first sight line falling point and the second sight line falling point as endpoints as the sight line falling point of the user.
6. The method of claim 3, wherein the user's face offset data comprises a user's face offset direction, the user's iris offset data comprises a user's iris offset direction, the obtaining the trend of movement of the gaze point comprises:
And determining the movement trend of the sight drop point according to the face offset direction of the user and/or the iris offset direction of the user.
7. The method of claim 1, wherein the method further comprises:
and when the movement trend of the sight line falling point is not approaching to the target point, determining that the rearview mirror angle does not need to be adjusted.
8. A rearview mirror adjustment apparatus, characterized by comprising:
the first acquisition module is used for acquiring a user sight falling point in the vehicle running process;
the determining module is used for determining a target point closest to the user sight falling point on the edge line of the rearview mirror when the user sight falling point is positioned on the rearview mirror of the vehicle;
the second acquisition module is used for acquiring the movement trend of the sight falling point when the distance between the target point and the sight falling point is smaller than a first preset distance;
and the adjusting module is used for adjusting the angle of the rearview mirror to enlarge the user visual field range in a preset area taking the position of the sight falling point as the center when the movement trend of the sight falling point approaches the target point.
9. A rearview mirror adjustment system, comprising:
at least one processor; the method comprises the steps of,
A memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to implement the rearview mirror adjustment method of any one of claims 1-7.
10. A computer readable storage medium, characterized in that instructions in the storage medium, when executed by a corresponding processor of a mirror adjustment system, enable the mirror adjustment system to implement a mirror adjustment method according to any one of claims 1-7.
CN202211566167.5A 2022-12-07 2022-12-07 Rearview mirror adjustment method, device, system and storage medium Pending CN116142078A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211566167.5A CN116142078A (en) 2022-12-07 2022-12-07 Rearview mirror adjustment method, device, system and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211566167.5A CN116142078A (en) 2022-12-07 2022-12-07 Rearview mirror adjustment method, device, system and storage medium

Publications (1)

Publication Number Publication Date
CN116142078A true CN116142078A (en) 2023-05-23

Family

ID=86359132

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211566167.5A Pending CN116142078A (en) 2022-12-07 2022-12-07 Rearview mirror adjustment method, device, system and storage medium

Country Status (1)

Country Link
CN (1) CN116142078A (en)

Similar Documents

Publication Publication Date Title
CN104742903B (en) Realize the method and device of cruise
KR101663113B1 (en) Apparatus for communicating with wearable device in car and method for controlling the same
EP4072122A1 (en) Method and system for controlling vehicle-mounted camera by means of mobile device, and device
CN106274699B (en) Method and device for adjusting vehicle rearview mirror and vehicle
US20160140760A1 (en) Adapting a display on a transparent electronic display
CN118068830A (en) Method and device for controlling movement of balance car and balance car
CN114103985A (en) Obstacle-based prompting method, device and equipment
CN107284358A (en) Rearview mirror method of adjustment, device and terminal
US11276378B2 (en) Vehicle operation system and computer readable non-transitory storage medium
CN115675473A (en) Driving mode adjusting method, system and storage medium
CN116142078A (en) Rearview mirror adjustment method, device, system and storage medium
CN107832726B (en) User identification and confirmation device and vehicle central control system
JP6620682B2 (en) In-vehicle display device
CN113561970A (en) Method, device, equipment and storage medium for determining initial parking position information
CN115771569A (en) Spoiler adjusting method, device and system and storage medium
CN114368357B (en) Vehicle control method, vehicle, intelligent wearable device and readable storage medium
CN113928073A (en) Active suspension adjusting method, device and equipment
CN115118950B (en) Image processing method and device
JP2019046240A (en) Sight line direction detecting apparatus and calibration method
CN111355925B (en) Control device, vehicle, image display system, and image display method
CN117207885A (en) Rearview mirror angle adjustment method, device, system and storage medium
US20240092292A1 (en) System and method for a voice-activated user support system
CN117885721A (en) Vehicle acceleration method, device, system and storage medium
CN116674541A (en) Steering control optimization method and device for keeping vehicle running lane
CN118238837A (en) Method, device, equipment and readable storage medium for displaying surrounding environment of vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination