CN114043932A - Control method, device and equipment of vehicle head-up display and storage medium - Google Patents
Control method, device and equipment of vehicle head-up display and storage medium Download PDFInfo
- Publication number
- CN114043932A CN114043932A CN202111361028.4A CN202111361028A CN114043932A CN 114043932 A CN114043932 A CN 114043932A CN 202111361028 A CN202111361028 A CN 202111361028A CN 114043932 A CN114043932 A CN 114043932A
- Authority
- CN
- China
- Prior art keywords
- information
- driver
- target
- pose
- seat
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 230000006855 networking Effects 0.000 claims abstract description 33
- 238000013499 data model Methods 0.000 claims abstract description 25
- 238000004590 computer program Methods 0.000 claims description 10
- 230000001815 facial effect Effects 0.000 claims description 6
- 238000012806 monitoring device Methods 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 18
- 230000036544 posture Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 14
- 210000003128 head Anatomy 0.000 description 13
- 230000006870 function Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 230000008859 change Effects 0.000 description 6
- 230000001276 controlling effect Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000008034 disappearance Effects 0.000 description 2
- 206010016256 fatigue Diseases 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000003867 tiredness Effects 0.000 description 1
- 208000016255 tiredness Diseases 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
- B60R2300/205—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used using a head-up display
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Instrument Panels (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a control method, a control device, control equipment and a storage medium of a vehicle head-up display. The control method comprises the following steps: acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information; when the networking state is a connected state, determining target pose information based on a data model of a cloud server, seat pose information, driver pose information and eye box position information; and adjusting the pose of a curved mirror in the head-up display according to the target pose information. The target pose information can be determined based on a big data model of the cloud server, and the corresponding relation between the target information and the target pose information can be more accurately described through the big data model, so that more accurate target pose information is obtained; the method can also be combined with real-time target information in the driving process of a driver to dynamically determine the target pose information in real time, and automatically and timely adjust the pose of the curved mirror, so that the pose of the curved mirror meets the driving requirement.
Description
Technical Field
The invention relates to the technical field of intelligent automobile driving, in particular to a control method, a control device, control equipment and a storage medium of a vehicle head-up display.
Background
An augmented reality head-up display (AR-HUD) is a device that reflects a virtual image to a person's eyes through two free-form surface mirrors and then a windshield. The eye box in the AR-HUD is an area with movable eyes, if the eyes are positioned in the area, a driver can see the whole image clearly, the driver leaves the area, the driver cannot see the whole image, the problem of double images occurs, and even the image disappears.
However, in the actual driving process, the position of the eyes of the driver may change due to various factors, such as adjustment of the seat or change of the sitting posture, in which case, the position of the eyes of the driver may be out of the area, so that the whole image cannot be seen, or even the image may disappear, thereby seriously affecting the driving safety.
Therefore, there is a need for an intelligent and highly accurate method and apparatus for controlling a vehicle head-up display.
Disclosure of Invention
The application provides a control method, a control device, control equipment and a storage medium of a vehicle head-up display, and at least solves the technical problem that in the prior art, a driver cannot see an AR-HUD display image clearly due to the change of the position of the eyes of the driver.
According to an aspect of the present application, there is provided a control method of a vehicular head-up display, including:
acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information;
when the networking state is a connected state, determining target pose information based on a data model of a cloud server, the seat pose information, the driver pose information and the eyebox position information;
and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
In one possible implementation, before the obtaining the target information and the networking status of the vehicle, the method further includes: acquiring a driving state image of a driver;
the driver pose information includes head position information, trunk inclination angle information and contour information, and the acquiring target information includes:
and determining the head position information, the trunk inclination angle information and the contour information according to the driving state image.
In a possible implementation manner, the obtaining target information further includes:
and determining the eye box position information according to the driving state image.
In one possible implementation, the acquiring the driving state image of the driver includes:
the driving status image is acquired by a driver monitoring device, which is a camera of a driver monitoring system.
In one possible implementation, before the obtaining the target information and the networking status of the vehicle, the method further includes:
acquiring user database information, wherein the user database information comprises user identity information and user attribute information corresponding to the user identity information;
acquiring a face image of a driver;
the driver pose information includes driver attribute information, and the acquiring target information includes:
determining driver identity information according to the facial image;
and determining the driver attribute information according to the driver identity information and the user database information.
In one possible implementation manner, the seat pose information includes seat position information and seat inclination information, and the acquiring the target information includes:
and acquiring the seat position information and the seat inclination angle information through a seat sensor.
In one possible implementation, before adjusting the pose of a curved mirror in a head-up display according to the target pose information, the method further comprises:
when the networking state is an unconnected state, acquiring preset relation information, wherein the preset relation information represents the corresponding relation between the target information and the target pose information;
and determining the target pose information according to the preset relation information and the target information.
Further, the present application also provides a control device of a vehicular head-up display, including:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring target information and the networking state of a vehicle, and the target information comprises seat position and attitude information, driver position and eye box position information;
a first determining module, configured to determine target pose information based on a data model of a cloud server, the seat pose information, the driver pose information, and the eyebox position information when the networking state is a connected state;
and the first control module is used for adjusting the pose of a curved mirror in the head-up display according to the target pose information.
Further, the present application also provides a control apparatus of a vehicular head-up display, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform:
acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information;
when the networking state is a connected state, determining target pose information based on a data model of a cloud server, the seat pose information, the driver pose information and the eyebox position information;
and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
According to another aspect of the application, a non-transitory computer-readable storage medium is provided, having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.
The data model is a big data model obtained by mass data training, and can accurately reflect the corresponding relation between the target information and the target pose information. The method and the system can utilize the characteristics of the vast audience of the vehicle, and model building is carried out by using the parameters of most drivers at the cloud end, so that a big data model is trained. When a new user gets on the vehicle, the existing optimal output can be obtained immediately; its personal data can also be used to train the model so that the recommendation tends towards absolute optimization.
The target pose information can be determined based on the big data model of the cloud server, and the big data model can describe the corresponding relation between the target information and the target pose information more accurately, so that more accurate target pose information is obtained; the target pose information can be dynamically determined in real time by combining with real-time target information in the driving process of a driver, and the pose of the curved mirror can be automatically and timely adjusted in the driving process, so that the pose of the curved mirror meets the driving requirement; the types of the target information are diverse and comprise seat position and attitude information, driver position and attitude information and eye box position information, the seat position and attitude information and the driver position and attitude information can reflect the sitting posture of a driver, the sitting posture of the driver and the eye box position information are combined, and the target position and attitude information is analyzed and determined from more comprehensive and diverse angles; the target pose information is more accurate, so that the curved mirror can be adjusted to the optimal position, image disappearance or ghost image can be avoided, a driver can observe a complete and clearer display image of the AR-HUD, driving safety is guaranteed, and driving intelligence is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram illustrating a method of controlling a vehicular heads-up display in accordance with an exemplary embodiment;
FIG. 2 is a schematic flow chart diagram illustrating a method of controlling a vehicular heads-up display in accordance with another exemplary embodiment;
FIG. 3 is a schematic flow chart diagram illustrating a method of controlling a vehicular heads-up display in accordance with yet another exemplary embodiment;
FIG. 4 illustrates a block diagram of a control device for a vehicular heads-up display in accordance with an exemplary embodiment.
Detailed Description
Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present application. It will be understood by those skilled in the art that the present application may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the present application.
The invention provides a control method, a control device, control equipment and a storage medium of a vehicle head-up display, which can at least solve the technical problem that in the prior art, a driver cannot clearly see an AR-HUD display image due to the change of the position of the eyes of the driver.
With reference to fig. 1 to fig. 3, a method for controlling a vehicle head-up display according to an embodiment of the present disclosure includes the following steps:
step S101: and acquiring target information and the networking state of the vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information.
In this specification embodiment, the networking state of the vehicle may be a connection state between the vehicle and the mobile network, and the networking state may include a connected state and an unconnected state. The seat position information can represent the position and the posture of the seat in the vehicle, the driver position information can represent the position and the posture of the driver in the vehicle, and the eye box position information can represent the position of the eye box in the vehicle.
The eye box in the AR-HUD refers to an area where the eyes can move, and the entire image can be seen if the eyes of the driver are located in the area, and the image cannot be seen if the eyes of the driver are out of the area. The range allowing the driver's eyes to see the entire display image generally requires an eyebox size of 130mmx50 mm. Due to the different heights of drivers, the requirement is met that the eye box has a movement range of +/-50 mm in the vertical direction. The head-up display can adjust the image display position to enable the image display position to be located in the projection range of the eye box, so that the display image can be clearly observed by the eyes of a driver in the eye box range, and the projection range of the eye box refers to the projection range obtained by projecting the eye box on a vehicle window along the sight line direction of the driver.
Step S102: and when the networking state is the connected state, determining target pose information based on the data model of the cloud server, the seat pose information, the driver pose information and the eye box position information.
In the embodiment of the specification, when the networking state of the vehicle is in the connected state, the vehicle can perform information interaction with the cloud server through the mobile network; the vehicle may send the target information to the cloud server; the cloud server can receive the target information and determine target pose information based on a data model and the target information of the cloud server; the cloud server can send the target pose information to the vehicle; the vehicle may receive target pose information. The cloud server is a simple and efficient computing service which is safe and reliable, and the processing capacity of the computing service can be elastically stretched, and the management mode of the computing service is simpler and more efficient than that of a physical server. The data model is a big data model obtained by mass data training, and can accurately reflect the corresponding relation between the target information and the target pose information.
The embodiment of the specification can utilize the characteristics of the vast audience of vehicles, and the parameters of most drivers are used for modeling in the cloud to train an input model and an output model. When a new user gets on the vehicle, the existing optimal output can be obtained; its personal data can also be used to train the model so that the recommendation tends towards absolute optimization. The target pose information of the embodiment of the present specification is self-learning, and the training process of the data model of the cloud server may include: the method comprises the steps of establishing an initial model, carrying out model training based on small-capacity sample data, releasing the initial model along with a vehicle model, obtaining large-capacity sample data correspondingly generated in the vehicle type driving process, correcting the initial model based on the large-capacity sample data, and continuously optimizing the model to enable the model to tend to be optimal.
Step S103: and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
In an embodiment of the present disclosure, the head-up display may include a projection module, a primary curved mirror, a secondary curved mirror, and a controller, wherein the projection module may emit a projection light, the projection light is reflected by the primary curved mirror to the secondary curved mirror, and the secondary curved mirror reflects the projection light for a second time to project the projection light to a front window of the vehicle; the position and the angle of the secondary curved mirror can be adjusted. After the vehicle acquires the target pose information, the specific pose of the secondary curved mirror can be adjusted according to the target pose information, the HUD controller can generate a PWM signal according to the target pose information to control the motor, the motor can drive the secondary curved mirror to translate, and the motor can also adjust the inclination angle of the secondary curved mirror.
In the prior art, the display position of the AR-HUD is manually adjusted by a driver, and the driver often does a thing after getting on the vehicle, namely, the up-down and left-right positions of the AR-HUD are manually adjusted by using buttons and menus on a steering wheel, so that the AR-HUD is very inconvenient in a clear visual range. During driving, the AR-HUD image is also affected if there is a change in the seat or sitting position. In the prior art, the regulation of AR-HUD is a mechanical position regulation, the sitting posture requirement of a driver in the driving process is changed, and the regulation of AR-HDU is disposable and discontinuously changed.
In the embodiment of the specification, the target pose information can be dynamically determined in real time by combining with the real-time target information in the driving process of a driver, and the pose of the curved mirror can be automatically and timely adjusted in the driving process, so that the pose of the curved mirror meets the driving requirement; the target pose information can be determined based on a big data model of the cloud server, and the corresponding relation between the target information and the target pose information can be more accurately described through the big data model, so that more accurate target pose information is obtained; the types of the target information are diverse and comprise seat position and attitude information, driver position and attitude information and eye box position information, the seat position and attitude information and the driver position and attitude information can reflect the sitting posture of a driver, the sitting posture of the driver and the eye box position information are combined, and the target position and attitude information is analyzed and determined from more comprehensive and diverse angles; the target pose information is more accurate, so that the curved mirror can be adjusted to the optimal position, image disappearance or ghost image can be avoided, a driver can observe a complete and clearer display image of the AR-HUD, driving safety is guaranteed, and driving intelligence is improved.
In a possible implementation manner, before step S101, the method further includes:
step S104: acquiring a driving state image of a driver;
the driver pose information includes head position information, torso inclination angle information, and contour information, and step S101 includes:
step S1011: and determining head position information, body inclination angle information and contour information according to the driving state image.
In the embodiment of the present specification, the driving state image may be an omnidirectional image of the driver. A three-dimensional coordinate system can be established by taking a certain point in the vehicle as an origin, head position information, body inclination angle information, sitting posture information and contour information of a driver are determined based on the three-dimensional coordinate system, and a vehicle center can be taken as the origin of the coordinate system. The head position information can be coordinate information of the head of the driver relative to the origin of the coordinate system, the trunk inclination angle information can be included angle information of the trunk of the driver relative to three coordinate axes of the coordinate system, and the contour information can be coordinate information of a plurality of points on the body contour of the driver relative to the origin of the coordinate system. The driving state image can be subjected to image recognition and image analysis processing, and head position information, torso inclination angle information and contour information are determined.
In the embodiment of the specification, the head position information, the trunk inclination angle information and the contour information are combined, so that the sitting posture of a driver can be determined more accurately, more accurate target pose information can be obtained, and the curved mirror can be adjusted to the optimal position.
In one possible implementation manner, step S101 further includes:
step S1012: and determining eye box position information according to the driving state image.
In the embodiment of the specification, the position information of the area in front of the eyes of the driver can be determined according to the driving state image, and the position information of the eye box can be determined according to the position information of the area in front of the eyes of the driver and the preset range information; the preset range information may refer to movable range information of the eye box, and the eye box may be adjusted in position within a preset range to fit the position of the driver's eyes. In the embodiment of the specification, accurate eye box position information can be obtained in real time, so that more accurate target pose information is obtained, and the curved mirror is adjusted to the optimal position.
In one possible implementation, step S104 includes: the driving status image is acquired by a driver monitoring device, which is a camera of a driver monitoring system.
In the embodiment of the present specification, the driver monitoring device may be a camera of a Driver Monitoring System (DMS), and the driver monitoring System is an information technology System that monitors a fatigue state and a dangerous driving behavior of a driver all around the clock in a driving process of the driver. After finding that the driver has fatigue, yawning, squinting and other wrong driving states, the DMS system can analyze the behaviors in time and prompt by voice and light, thereby playing the roles of warning the driver and correcting the wrong driving behaviors. In the embodiment of the specification, the camera shooting function of the camera in the DMS can be fully utilized, the driving state image of the driver can be accurately and comprehensively acquired, and more accurate position and attitude information of the driver and position information of the eye box can be obtained, so that more accurate target position and attitude information can be obtained, and the curved mirror can be adjusted to the optimal position. And a special camera is not required to be additionally arranged, so that the production and manufacturing cost can be reduced.
In a possible implementation manner, before step S101, the method further includes:
step S105: acquiring user database information, wherein the user database information comprises user identity information and user attribute information corresponding to the user identity information;
step S106: acquiring a face image of a driver;
the driver pose information includes driver attribute information, and step S101 includes:
step S1013: determining driver identity information according to the facial image;
step S1014: and determining driver attribute information according to the driver identity information and the user database information.
In this embodiment, the user identity information may include a user account, a user name, a user face, and the like, the user attribute information may include a user height, a user age, a user eye medical history, and the like, the user identity information and the user attribute information in the user database information correspond to each other, and various user attribute information corresponding to the user may be determined according to any user identity information. The method can acquire the facial image of the driver according to the camera in the DMS, can obtain the facial image according to the driving state image, and determines the driver attribute information corresponding to the facial image through a face recognition technology. The user database information can be stored in a memory built in the vehicle, and also can be stored in the cloud server at the same time, and the vehicle can call the user database information at any time. The driver can set own database information through the man-machine interaction system in the vehicle when driving the vehicle for the first time. In the embodiment of the specification, target pose information can be determined by combining with driver attribute information, so that the target pose information is more adaptive to a driver, more accurate target pose information is obtained, a curved mirror is adjusted to an optimal position, and the visual experience when the AR-HUD image is watched is improved.
In one possible implementation, the seat pose information includes seat position information and seat inclination information, and the step S101 includes:
step S1015: seat position information and seat inclination information are acquired by a seat sensor.
In the embodiments of the present specification, the seat position information may be coordinate information of the driver seat with respect to an origin of a coordinate system, and the seat inclination information may be angle information of the driver seat with respect to three coordinate axes of the coordinate system. Be equipped with seat sensor in the vehicle, seat sensor can automated inspection seat position information and seat inclination information. In the embodiment of the specification, the sitting posture of a driver can be more accurately determined by combining the seat position information and the seat inclination angle information, so that more accurate target pose information is obtained, the curved mirror is adjusted to the optimal position, and the visual experience when the AR-HUD image is watched is improved.
In a possible implementation manner, before step S103, the method further includes:
step S107: when the networking state is the unconnected state, acquiring preset relation information, wherein the preset relation information represents the corresponding relation between the target information and the target pose information;
step S108: and determining target pose information according to the preset relation information and the target information.
In the embodiment of the specification, when the networking state is the unconnected state, the vehicle cannot perform information interaction with the cloud server, the vehicle can determine target pose information according to preset relationship information and target information, the preset relationship information can be calibration relationship information set when the vehicle leaves a factory, and the preset relationship information can represent a corresponding relationship between the target information and the target pose information. In the embodiment of the specification, when the vehicles are not networked, the target pose information can be dynamically determined in real time by combining with the real-time target information in the driving process of the driver, and the pose of the curved mirror can be automatically and timely adjusted in the driving process, so that the pose of the curved mirror meets the driving requirement.
In one possible implementation, when the networking state is the unconnected state and the vehicle is powered on, the target pose information can be determined according to the pose information of the curved mirror when the vehicle was last powered off.
The display position of the AR-HUD can be adjusted in real time along with changes of sitting postures, head postures, inclination angles of seats and positions of back cushions and waist cushions; the modeling of output adjustment is carried out by utilizing big data and cloud computing power and utilizing the characteristics of high vehicle model sales and wide audience, and the model is continuously optimized by using new user data.
The display position of the AR-HUD can be automatically adjusted in real time in the embodiment of the specification, a driver does not need to manually adjust the display position when getting on a vehicle, the display position is automatically matched through the camera, and the problem that the position of the AR-HUD can only be manually adjusted in the prior art is solved; the embodiment of the specification can solve the problem of discomfort caused by the fixed functional relationship between the eye box position and the HUD information display position when some cameras are adjusted, and a cloud computing mode is adopted to recommend the most suitable position adjusting mode to a driver; the embodiment of the specification can solve the problem that when some cameras are adjusted, only the capture of the eye position is considered, and the influence of parameters such as seat parameters/head inclination and the like on the position is ignored.
The embodiment of the specification can utilize the existing vision processing capability of the DMS, breaks through the limitation that the DMS only captures the behaviors of distraction, call, tiredness and the like of the driver in the past, and applies the technologies of face recognition, eye box position positioning and the like to the position adjustment of the AR-HUD, so that the face recognition, eye box position positioning and the like can be actively adapted to the height, sitting posture and change in the driving process of the driver.
The regulated output of the embodiments of the present description is self-learning. The characteristics of the vast audience of vehicles are utilized, the parameters of most drivers are used for modeling in the cloud, and an input and output model is trained. When a new user gets on the vehicle, the existing optimal output can be obtained; its personal data can also be used to train the model so that the recommendation tends towards absolute optimization.
In the driving process, because the posture of the driver is constantly changed (the head depends on or leans forward, and the seat/backrest/seat cushion are different), the embodiment of the specification can use parameters such as different heights, seat positions and body inclination angles, input the parameters into the cloud computing model, calculate the optimal adjusting position and recommend the optimal adjusting position to the driver.
As shown in fig. 4, an embodiment of the present specification provides a control apparatus for a vehicular head-up display, including:
the first acquisition module 10 is used for acquiring target information and the networking state of the vehicle, wherein the target information comprises seat position and attitude information, driver position and eyebox position information;
a first determining module 20, configured to determine target pose information based on the data model of the cloud server, the seat pose information, the driver pose information, and the eye box position information when the networking state is the connected state;
and the first control module 30 is used for adjusting the pose of the curved mirror in the head-up display according to the target pose information.
In the embodiment of the specification, the target pose information can be determined based on a big data model of a cloud server, and the corresponding relation between the target information and the target pose information can be more accurately described through the big data model, so that more accurate target pose information is obtained; the target pose information can be dynamically determined in real time by combining with real-time target information in the driving process of a driver, and the pose of the curved mirror can be automatically and timely adjusted in the driving process, so that the pose of the curved mirror meets the driving requirement; the types of the target information are diverse, including seat pose information, driver pose information and eye box position information, and influence factors of the target pose information are more comprehensively referred to; the target pose information is more accurate, the curved mirror is adjusted to the optimal position, and a driver can observe a clearer display image of the AR-HUD.
In a possible implementation manner, the device further comprises a second obtaining module, wherein the second obtaining module is used for obtaining a driving state image of the driver;
the first acquisition module comprises a first acquisition unit, and the first acquisition unit is used for: and determining head position information, body inclination angle information and contour information according to the driving state image.
In a possible implementation manner, the first obtaining module includes a second obtaining unit, and the second obtaining unit is configured to: and determining eye box position information according to the driving state image.
In one possible implementation, the second obtaining module is configured to obtain the driving state image through a driver monitoring device, and the driver monitoring device is a camera of the driver monitoring system.
In one possible implementation, the apparatus further includes:
the third acquisition module is used for acquiring user database information, wherein the user database information comprises user identity information and user attribute information corresponding to the user identity information;
the fourth acquisition module is used for acquiring a face image of the driver;
the driver pose information includes driver attribute information, and the first acquisition module includes:
a third acquisition unit for determining driver identity information based on the face image;
and the fourth acquisition unit is used for determining the attribute information of the driver according to the identity information of the driver and the information of the user database.
In one possible implementation manner, the seat pose information includes seat position information and seat inclination information, and the first obtaining module includes a fifth obtaining unit configured to obtain the seat position information and the seat inclination information through a seat sensor.
In one possible implementation, the apparatus further includes:
the fifth acquisition module is used for acquiring preset relationship information when the networking state is the unconnected state, wherein the preset relationship information represents the corresponding relationship between the target information and the target pose information;
and the second determining module is used for determining the target pose information according to the preset relation information and the target information.
It should be noted that, when the apparatus provided in the foregoing embodiment implements the functions thereof, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus may be divided into different functional modules to implement all or part of the functions described above. In addition, the apparatus and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
Further, an embodiment of the present specification also provides a control apparatus of a vehicular head-up display, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform:
acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information;
when the networking state is a connected state, determining target pose information based on a data model of a cloud server, seat pose information, driver pose information and eye box position information;
and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
Furthermore, the present specification embodiment also provides a non-volatile computer-readable storage medium on which computer program instructions are stored, the computer program instructions, when executed by a processor, implementing the above-described control method of the vehicular head-up display.
The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present application.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present application may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (10)
1. A control method of a vehicular head-up display, characterized by comprising:
acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information;
when the networking state is a connected state, determining target pose information based on a data model of a cloud server, the seat pose information, the driver pose information and the eyebox position information;
and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
2. The method of controlling a vehicular heads-up display of claim 1 wherein prior to obtaining the target information and the networking status of the vehicle, the method further comprises: acquiring a driving state image of a driver;
the driver pose information includes head position information, trunk inclination angle information and contour information, and the acquiring target information includes:
and determining the head position information, the trunk inclination angle information and the contour information according to the driving state image.
3. The control method of a vehicular heads-up display according to claim 2, wherein the acquiring target information further includes:
and determining the eye box position information according to the driving state image.
4. The control method of the vehicular head-up display according to claim 2 or 3, wherein the acquiring of the driving state image of the driver includes:
the driving status image is acquired by a driver monitoring device, which is a camera of a driver monitoring system.
5. The method of controlling a vehicular heads-up display of claim 1 wherein prior to obtaining the target information and the networking status of the vehicle, the method further comprises:
acquiring user database information, wherein the user database information comprises user identity information and user attribute information corresponding to the user identity information;
acquiring a face image of a driver;
the driver pose information includes driver attribute information, and the acquiring target information includes:
determining driver identity information according to the facial image;
and determining the driver attribute information according to the driver identity information and the user database information.
6. The control method of a vehicular heads-up display according to claim 1, characterized in that the seat pose information includes seat position information and seat inclination information, and the acquiring target information includes:
and acquiring the seat position information and the seat inclination angle information through a seat sensor.
7. The control method of a vehicular heads-up display according to claim 1, wherein before adjusting a pose of a curved mirror in the heads-up display in accordance with the object pose information, the method further comprises:
when the networking state is an unconnected state, acquiring preset relation information, wherein the preset relation information represents the corresponding relation between the target information and the target pose information;
and determining the target pose information according to the preset relation information and the target information.
8. A control apparatus of a vehicular head-up display, characterized by comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring target information and the networking state of a vehicle, and the target information comprises seat position and attitude information, driver position and eye box position information;
a first determining module, configured to determine target pose information based on a data model of a cloud server, the seat pose information, the driver pose information, and the eyebox position information when the networking state is a connected state;
and the first control module is used for adjusting the pose of a curved mirror in the head-up display according to the target pose information.
9. A control apparatus of a vehicular head-up display, characterized by comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform:
acquiring target information and the networking state of a vehicle, wherein the target information comprises seat position and attitude information, driver position and eye box position information;
when the networking state is a connected state, determining target pose information based on a data model of a cloud server, the seat pose information, the driver pose information and the eyebox position information;
and adjusting the pose of a curved mirror in the head-up display according to the target pose information.
10. A non-transitory computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111361028.4A CN114043932A (en) | 2021-11-17 | 2021-11-17 | Control method, device and equipment of vehicle head-up display and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111361028.4A CN114043932A (en) | 2021-11-17 | 2021-11-17 | Control method, device and equipment of vehicle head-up display and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114043932A true CN114043932A (en) | 2022-02-15 |
Family
ID=80209655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111361028.4A Pending CN114043932A (en) | 2021-11-17 | 2021-11-17 | Control method, device and equipment of vehicle head-up display and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114043932A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114879367A (en) * | 2022-05-27 | 2022-08-09 | 中国第一汽车股份有限公司 | Display control method and device for vehicle-mounted head-up display device, vehicle and storage medium |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105329168A (en) * | 2015-11-30 | 2016-02-17 | 惠州市华阳多媒体电子有限公司 | Head up display system and method with driving recording function and driving assistance function |
| CN106226910A (en) * | 2016-09-08 | 2016-12-14 | 邹文韬 | HUD system and image regulating method thereof |
| CN106950696A (en) * | 2017-04-21 | 2017-07-14 | 苏州车萝卜汽车电子科技有限公司 | The head-up display device and its implementation of a kind of split type installation |
| CN109407320A (en) * | 2018-12-04 | 2019-03-01 | 中国科学院重庆绿色智能技术研究院 | Light path system and imaging optimization method are shown in conjunction with the new line of human eye tracing system |
| CN109515361A (en) * | 2018-12-07 | 2019-03-26 | 上海科世达-华阳汽车电器有限公司 | A kind of cockpit regulating system and vehicle |
| CN109889807A (en) * | 2019-03-14 | 2019-06-14 | 百度在线网络技术（北京）有限公司 | Vehicle-mounted projection adjusting method, device, equipment and storage medium |
| US20190187790A1 (en) * | 2016-08-05 | 2019-06-20 | Samsung Electronics Co., Ltd. | Vehicle display device and control method thereof |
| CN110197400A (en) * | 2019-05-22 | 2019-09-03 | 未来（北京）黑科技有限公司 | The method for pushing and device of advertisement, head-up display HUD and server |
| CN209534920U (en) * | 2019-01-07 | 2019-10-25 | 上汽通用汽车有限公司 | HUD system for regulating angle and vehicle |
| CN111016785A (en) * | 2019-11-26 | 2020-04-17 | 惠州市德赛西威智能交通技术研究院有限公司 | Head-up display system adjusting method based on human eye position |
| CN111123518A (en) * | 2019-12-05 | 2020-05-08 | 浙江合众新能源汽车有限公司 | Intelligent control method and system for AR-HUD display of automobile |
| CN111164493A (en) * | 2018-08-29 | 2020-05-15 | 法国圣戈班玻璃厂 | Detection device for head-up display (HUD) |
| CN112396824A (en) * | 2020-11-10 | 2021-02-23 | 恒大新能源汽车投资控股集团有限公司 | Vehicle monitoring method and system and vehicle |
| CN112622762A (en) * | 2019-10-08 | 2021-04-09 | 株式会社斯巴鲁 | Head-up display system for vehicle |
| US20210174767A1 (en) * | 2019-12-10 | 2021-06-10 | Volvo Car Corporation | Automated adjustment of head up display image in a vehicle |
| CN112946888A (en) * | 2019-12-11 | 2021-06-11 | 未来（北京）黑科技有限公司 | Head-up display device, imaging system, vehicle, control method and apparatus |
| CN113002461A (en) * | 2021-03-26 | 2021-06-22 | 芜湖汽车前瞻技术研究院有限公司 | Virtual image position adjusting method, device and storage medium of AR-HUD system |
| CN113247012A (en) * | 2020-02-12 | 2021-08-13 | Aptiv技术有限公司 | System and method for displaying spatial information in a field of view of a driver of a vehicle |
| CN113485136A (en) * | 2021-06-30 | 2021-10-08 | 东风汽车集团股份有限公司 | System and method for displaying and controlling working state of smart home in real time based on AR-HUD |
-
2021
- 2021-11-17 CN CN202111361028.4A patent/CN114043932A/en active Pending
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105329168A (en) * | 2015-11-30 | 2016-02-17 | 惠州市华阳多媒体电子有限公司 | Head up display system and method with driving recording function and driving assistance function |
| US20190187790A1 (en) * | 2016-08-05 | 2019-06-20 | Samsung Electronics Co., Ltd. | Vehicle display device and control method thereof |
| CN106226910A (en) * | 2016-09-08 | 2016-12-14 | 邹文韬 | HUD system and image regulating method thereof |
| CN106950696A (en) * | 2017-04-21 | 2017-07-14 | 苏州车萝卜汽车电子科技有限公司 | The head-up display device and its implementation of a kind of split type installation |
| CN111164493A (en) * | 2018-08-29 | 2020-05-15 | 法国圣戈班玻璃厂 | Detection device for head-up display (HUD) |
| CN109407320A (en) * | 2018-12-04 | 2019-03-01 | 中国科学院重庆绿色智能技术研究院 | Light path system and imaging optimization method are shown in conjunction with the new line of human eye tracing system |
| CN109515361A (en) * | 2018-12-07 | 2019-03-26 | 上海科世达-华阳汽车电器有限公司 | A kind of cockpit regulating system and vehicle |
| CN209534920U (en) * | 2019-01-07 | 2019-10-25 | 上汽通用汽车有限公司 | HUD system for regulating angle and vehicle |
| CN109889807A (en) * | 2019-03-14 | 2019-06-14 | 百度在线网络技术（北京）有限公司 | Vehicle-mounted projection adjusting method, device, equipment and storage medium |
| CN110197400A (en) * | 2019-05-22 | 2019-09-03 | 未来（北京）黑科技有限公司 | The method for pushing and device of advertisement, head-up display HUD and server |
| CN112622762A (en) * | 2019-10-08 | 2021-04-09 | 株式会社斯巴鲁 | Head-up display system for vehicle |
| CN111016785A (en) * | 2019-11-26 | 2020-04-17 | 惠州市德赛西威智能交通技术研究院有限公司 | Head-up display system adjusting method based on human eye position |
| CN111123518A (en) * | 2019-12-05 | 2020-05-08 | 浙江合众新能源汽车有限公司 | Intelligent control method and system for AR-HUD display of automobile |
| US20210174767A1 (en) * | 2019-12-10 | 2021-06-10 | Volvo Car Corporation | Automated adjustment of head up display image in a vehicle |
| CN112946888A (en) * | 2019-12-11 | 2021-06-11 | 未来（北京）黑科技有限公司 | Head-up display device, imaging system, vehicle, control method and apparatus |
| CN113247012A (en) * | 2020-02-12 | 2021-08-13 | Aptiv技术有限公司 | System and method for displaying spatial information in a field of view of a driver of a vehicle |
| CN112396824A (en) * | 2020-11-10 | 2021-02-23 | 恒大新能源汽车投资控股集团有限公司 | Vehicle monitoring method and system and vehicle |
| CN113002461A (en) * | 2021-03-26 | 2021-06-22 | 芜湖汽车前瞻技术研究院有限公司 | Virtual image position adjusting method, device and storage medium of AR-HUD system |
| CN113485136A (en) * | 2021-06-30 | 2021-10-08 | 东风汽车集团股份有限公司 | System and method for displaying and controlling working state of smart home in real time based on AR-HUD |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114879367A (en) * | 2022-05-27 | 2022-08-09 | 中国第一汽车股份有限公司 | Display control method and device for vehicle-mounted head-up display device, vehicle and storage medium |
| CN114879367B (en) * | 2022-05-27 | 2024-03-19 | 中国第一汽车股份有限公司 | Display control method and device of vehicle-mounted head-up display device, vehicle and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101655818B1 (en) | Wearable glass, control method thereof and vehicle control system | |
| US20210012128A1 (en) | Driver attention monitoring method and apparatus and electronic device | |
| KR101459432B1 (en) | System and method of controlling refraction in windshield based on driver ocular prescription | |
| EP3110662B1 (en) | Vehicle mirror adjustment | |
| US9043042B2 (en) | Method to map gaze position to information display in vehicle | |
| EP2876484A1 (en) | Maintenance assistant system | |
| CN111873911B (en) | Method, device, medium, and electronic apparatus for adjusting rearview mirror | |
| US9835861B2 (en) | System having an adjustment device and method for automatically adjusting/switching the adjustment device for a head-up display device | |
| CN111252074B (en) | Multi-modal control method, device, computer-readable storage medium and vehicle | |
| CN107010077B (en) | Method for transmitting information to a driver of a motor vehicle and adaptive driver assistance system | |
| US10065504B2 (en) | Intelligent tutorial for gestures | |
| WO2015151457A1 (en) | Information display system | |
| CN109968979A (en) | Vehicle-mounted projection processing method, device, mobile unit and storage medium | |
| CN114043932A (en) | Control method, device and equipment of vehicle head-up display and storage medium | |
| CN113799698A (en) | Method, device and equipment for adjusting interior rearview mirror and storage medium | |
| CN116061819A (en) | Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle | |
| CN113895357B (en) | Rearview mirror adjustment method, device, equipment and storage medium | |
| CN110949272A (en) | Vehicle-mounted display equipment adjusting method and device, vehicle, medium and equipment | |
| JP6822325B2 (en) | Maneuvering support device, maneuvering support method, program | |
| CN112083795A (en) | Object control method and device, storage medium and electronic equipment | |
| Liu et al. | Motion sickness modeling with visual vertical estimation and its application to autonomous personal mobility vehicles | |
| CN115690251A (en) | Method and device for displaying image on front windshield of vehicle | |
| EP4254348A2 (en) | Method and device for multi-camera hole filling | |
| KR102070870B1 (en) | Apparatus and method for providing augmented reality | |
| KR101655826B1 (en) | Wearable glass, control method thereof and vehicle control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |