CN113377202B - Head-up display method and system based on ARHUD - Google Patents

Head-up display method and system based on ARHUD Download PDF

Info

Publication number
CN113377202B
CN113377202B CN202110711248.9A CN202110711248A CN113377202B CN 113377202 B CN113377202 B CN 113377202B CN 202110711248 A CN202110711248 A CN 202110711248A CN 113377202 B CN113377202 B CN 113377202B
Authority
CN
China
Prior art keywords
information
display
controller
computing
force controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110711248.9A
Other languages
Chinese (zh)
Other versions
CN113377202A (en
Inventor
王云帆
管晋
陈哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Fervcloud Technology Co ltd
Original Assignee
Hangzhou Fervcloud Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Fervcloud Technology Co ltd filed Critical Hangzhou Fervcloud Technology Co ltd
Priority to CN202110711248.9A priority Critical patent/CN113377202B/en
Publication of CN113377202A publication Critical patent/CN113377202A/en
Application granted granted Critical
Publication of CN113377202B publication Critical patent/CN113377202B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention relates to the field of automobiles, and provides a head-up display method and a head-up display system based on ARHUD, wherein the method comprises the following steps: receiving different types of signals to be displayed for AR head-up display through a first computing force controller; processing the signal to be displayed into AR display information of a corresponding type by using the first computing force controller and sending the AR display information to a second computing force controller; and sending the AR display information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display. The ARHUD system development mode designed by the invention has better function expansibility, quicker development period, better display experience, lower cost price and easy realization of serialization.

Description

Head-up display method and system based on ARHUD
Technical Field
The invention relates to the field of automobiles, in particular to a head-up display method and system based on ARHUD.
Background
The existing HUD system has a very loose system structure due to the simple display content. Fusion bluetooth, GPS, various sensor HUD systems are constantly emerging. The signal transmission between the host and the HUD is also based on CAN bus transmission, and the CAN bus transmission rate is low. For HUD systems with continuously rich display content, the functionality is continuously complex, and the architecture of part of the functionality based on HUD and part of the functionality based on host is somewhat confusing. Because as the complexity of visual images increases, the use of high performance HUD chips is also of no benefit.
Meanwhile, as the whole vehicle is 'interconnected' and 'intelligent', HUD display content is continuously increased, and better systematic guidance is needed for accessing more information content, otherwise, later research and development time is longer, communication cost is increased, and system hardware cost is increased.
Disclosure of Invention
The invention aims to solve the problems, and is realized by the following technology:
the invention provides a head-up display method based on ARHUD, comprising the following steps:
receiving different types of signals to be displayed for AR head-up display through a first computing force controller;
processing the signal to be displayed into AR display information of a corresponding type by using the first computing force controller and sending the AR display information to a second computing force controller;
and sending the AR display information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Further preferably, the method further comprises:
calculating corresponding basic guide information and drawing guide line information by the first computing force controller based on the navigation signals in the signals to be displayed and combining the position signals, and sending the basic guide information and drawing guide line information to a second computing force controller;
and sending the basic guide information and the drawing guide line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Further preferably, the method further comprises:
calculating lane line equation characteristic values of lanes on two sides based on lane signals in the signals to be displayed through the first force calculating controller, drawing lane line information and sending the lane line information to the second force calculating controller;
and sending the lane line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Further preferably, the method further comprises:
calculating corresponding obstacle alarm information based on the obstacle alarm signals in the signals to be displayed through the first computing force controller;
calculating, by the first computing force controller, corresponding obstacle position information based on an obstacle position signal and a relative speed signal of an obstacle in the signal to be displayed;
transmitting the obstacle alarm information and the obstacle position information to a second force calculating controller through the first force calculating controller;
sending the obstacle alarm information and the obstacle position information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display;
wherein the obstacle signal includes position information and relative speed information of the obstacle.
Further preferably, the method further comprises:
receiving a control signal through the second computing force controller, and automatically adjusting the head-up display based on the ARHUD based on the control signal;
after the head-up display based on the ARHUD is automatically adjusted, feedback data is sent to the vehicle machine through the second computing force controller;
the feedback data comprises display adjustment data and general display data.
Further preferably, the receiving, by the second computing force controller, a control signal, and automatically adjusting the ARHUD-based head-up display based on the control signal, includes:
and acquiring a light sensor signal through the second power calculation controller, and automatically adjusting the display height and the display brightness of the head-up display based on the ARHUD based on the control signal and the light sensor signal.
Further preferably, the method further comprises:
and acquiring a temperature sensor signal through the second computing force controller, and executing a corresponding temperature protection mode based on the temperature sensor signal.
In another aspect, the present invention further provides an ARHUD-based head-up display system, including:
the first computing force controller is used for acquiring signals to be displayed in different types;
the first computing force controller is used for processing the signal to be displayed through the first computing force controller, generating corresponding type AR display information and sending the AR display information to the second computing force controller;
the second computing force controller is configured to send the AR display information to an AR virtual image imaging structure through the second computing force controller, so as to perform AR head-up display.
Further preferably, the first computing force controller is provided in an ARHUD controller.
Further preferably, the first force calculation controller is disposed in the vehicle.
The head-up display method and system based on ARHUD provided by the invention have at least the following beneficial effects: the ARHUD system development mode designed by the invention has better function expansibility, quicker development period, better display experience, lower cost price and easy realization of serialization.
Drawings
The above features, technical features, advantages and implementation of an ARHUD-based head-up display method and system will be further described in the following in a clear and understandable manner with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of one embodiment of an ARHUD-based head-up display method of the present invention;
FIG. 2 is a schematic diagram of one embodiment of an ARHUD-based heads-up display system of the present invention;
FIG. 3 is a schematic illustration of an application of an ARHUD-based heads-up display system of the present invention;
FIG. 4 is a schematic diagram of another embodiment of an ARHUD-based heads-up display system of the present invention;
FIG. 5 is a schematic illustration of an application of an ARHUD-based heads-up display system of the present invention;
FIG. 6 is a schematic diagram of another embodiment of an ARHUD-based heads-up display system of the present invention;
fig. 7 is a schematic diagram of an application of an ARHUD-based head-up display system according to the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the sake of simplicity of the drawing, the parts relevant to the present invention are shown only schematically in the figures, which do not represent the actual structure thereof as a product. Additionally, in order to simplify the drawing for ease of understanding, components having the same structure or function in some of the drawings are shown schematically with only one of them, or only one of them is labeled. Herein, "a" means not only "only this one" but also "more than one" case.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
In addition, in the description of the present application, the terms "first," "second," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will explain the specific embodiments of the present invention with reference to the accompanying drawings. It is evident that the drawings in the following description are only examples of the invention, from which other drawings and other embodiments can be obtained by a person skilled in the art without inventive effort.
In one embodiment of the present invention, as shown in fig. 1, a head-up display method based on ARHUD includes:
receiving different types of signals to be displayed for AR head-up display through a first computing force controller;
processing the signal to be displayed into AR display information of a corresponding type by using the first computing force controller and sending the AR display information to a second computing force controller;
and sending the AR display information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Illustratively, S100 obtains different types of signals to be displayed using a first computing force controller.
Specifically, the first computing force controller belongs to a high computing force controller, and different types of signals to be displayed can be collected through the high computing force controller, and AR image information is formed through analysis and calculation.
S200, processing the signal to be displayed through the first computing force controller, generating corresponding type AR display information and sending the AR display information to the second computing force controller.
Specifically, the second computing power controller belongs to the low computing power controller, only needs to receive the AR image information of the first computing power controller, and controls the virtual image imaging structure to perform head-up display on the AR image information.
In this embodiment, the calculation of a large amount of data can be realized by the high-computation-power controller, which solves the problem that in the prior art, when the overall system is designed, a plurality of design uncertainties cause that in order to realize the ARHUD system, the ARHUD controller chip and the connector interface are required to be arranged to additionally increase computation power.
Meanwhile, the second calculation force controller does not need to perform a large amount of calculation, so that the head-up display system can process a lot of data through the clear division of the first calculation force controller and the second calculation force controller, and a redundant acquisition module, a calculation force module or an interface module is not needed to be integrated. Therefore, the structure of the controller is simplified, the size of the controller is reduced, the later integrated design is not needed to be used, and the flexibility of expansion of the head-up display system is improved.
S300, sending the AR display information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Specifically, the ARHUD belongs to a manner of projecting AR image information by AR technology, and may include 3D-AR HUD: based on a 3D virtual display, it is possible to project in front of the windscreen, where the AR technique will dynamically project according to the 3D position of the object.
Through the design of the power calculation controller and the corresponding division design of the embodiment, the ARHUD can be simple in structure, display content can be flexibly increased, and the limitation of the integrated function of the controller is avoided.
Meanwhile, the ARHUD can perform various functions during driving of the user, so that the user is helped to keep concentration and the driving experience of the user is improved. The AR HUD displays a guide arrow before switching lanes, thereby accurately projecting lane markers and informing the user of a blocked path in front. The AR HUD may precisely highlight any object of interest (e.g., a car or a pedestrian) and display text or graphic information in the vicinity of the object to avoid possible traffic accidents.
Example two
Based on the foregoing embodiments, the same parts as those of the foregoing embodiments are not repeated in this embodiment, and this embodiment provides a head-up display method based on ARHUD, and further preferably further includes:
preferably, the method further comprises:
calculating corresponding basic guide information and drawing guide line information by the first computing force controller based on the navigation signals in the signals to be displayed and combining the position signals, and sending the basic guide information and drawing guide line information to a second computing force controller;
and sending the basic guide information and the drawing guide line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Illustratively, the first computing force controller, i.e. the high computing force controller, has functions, specifically including:
Figure BDA0003133034330000071
by way of example only, and not by way of limitation,
the head-up display system of the ARHUD can also collect basic navigation signals for navigation. Specifically, the following contents can be included:
Figure BDA0003133034330000072
Figure BDA0003133034330000081
for example, after the first computing power controller collects the navigation guidance signal, the lane guidance information is directly calculated during the normal navigation, for example: the steering information, the steering distance, the speed limit information and the overspeed information are transmitted to a main second power controller, the second power controller transmits the information to the virtual image imaging structure, and the virtual image imaging structure is controlled to perform head-up display on a windshield.
Meanwhile, the first computing power controller calculates a bird's eye view map based on the map signal, sends bird's eye view map information to the second computing power controller, and the second computing power controller sends the information to the virtual image imaging structure and controls the virtual image imaging structure to perform head-up display on the windshield.
In an exemplary embodiment, when a destination display instruction exists, the first computing force controller directly calculates the location information, such as destination information, collected in real time to obtain destination target information, destination coordinate position, remaining distance, remaining time, congestion time condition, estimated arrival time and full navigation path preview information, and sends the above information to the main second computing force controller, and the second computing force controller sends the above information to the virtual image imaging structure and controls the virtual image imaging structure to perform head-up display on the windshield.
Meanwhile, the first calculation force controller can calculate the information and the coordinate position of the common calculation point based on the common movement point in the place signal, and send the information to the second calculation force controller, and the second calculation force controller sends the information to the virtual image imaging structure and controls the virtual image imaging structure to perform head-up display on the windshield.
Further preferably, the method further comprises:
calculating lane line equation characteristic values of lanes on two sides based on lane signals in the signals to be displayed through the first force calculating controller, drawing lane line information and sending the lane line information to the second force calculating controller;
and sending the lane line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
By way of example only, and not by way of limitation,
Figure BDA0003133034330000091
further preferably, the method further comprises:
calculating corresponding obstacle alarm information based on the obstacle alarm signals in the signals to be displayed through the first computing force controller;
calculating, by the first computing force controller, corresponding obstacle position information based on an obstacle position signal and a relative speed signal of an obstacle in the signal to be displayed;
transmitting the obstacle alarm information and the obstacle position information to a second force calculating controller through the first force calculating controller;
sending the obstacle alarm information and the obstacle position information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display;
wherein the obstacle signal includes position information and relative speed information of the obstacle.
Exemplary, as shown in the following table:
Figure BDA0003133034330000092
Figure BDA0003133034330000101
further preferably, the method further comprises:
calculating a target vehicle position and a target vehicle size based on a target vehicle signal in the signal to be displayed through the first computing force controller, drawing target vehicle position and target vehicle size and type information, and sending the information to a second computing force controller;
and sending the target vehicle position and the target vehicle size and type information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Exemplary, as shown in the following table:
Figure BDA0003133034330000102
further preferably, the method further comprises:
calculating, by the first computing force controller, an object type, a position, a relative speed, and a warning level based on a moving object signal in the signal to be displayed, and transmitting to a second computing force controller;
and sending the object type, the position, the relative speed and the warning level to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Exemplary, as shown in the following table:
Figure BDA0003133034330000103
exemplary, further comprising:
ADAS signal for displaying driving assistance information. The following may also be included:
Figure BDA0003133034330000111
for example, after the first computing power controller collects the lane offset prompt LDW, the lane line state may be directly calculated, for example: left lane line status, right lane line status; and lane line type, for example: the color of the lane lines at two sides and the type of the lane lines at two sides are used for transmitting the information to a main second calculation force controller, the second calculation force controller is used for transmitting the information to the virtual image imaging structure, and the virtual image imaging structure is controlled to perform head-up display on a windshield.
Meanwhile, the first computing force controller also calculates a front vehicle early warning signal based on the front vehicle collision early warning/emergency braking FCW/AEB signal, for example: a front collision early warning alert activation signal, a front collision early warning approach alert activation signal. And sending the corresponding front vehicle early warning signal to a second power computing controller, sending the information to a virtual image imaging structure by the second power computing controller, and controlling the virtual image imaging structure to perform head-up display on a windshield so as to perform front vehicle early warning.
For example, after the first power controller collects the blind area monitoring BSW, the blind area monitoring alarm signal is directly calculated, the information is sent to the main second power controller, the second power controller sends the information to the virtual image imaging structure, and the virtual image imaging structure is controlled to perform head-up display on the windshield.
Meanwhile, the first computing power controller may also calculate an adaptive cruise setting and mode based on the adaptive cruise ACC, for example: setting a self-adaptive cruising mode and a target vehicle speed; and ACC target vehicles such as: the following distance and the target vehicle, and sends corresponding information to a second calculation force controller, the second calculation force controller sends the information to the virtual image imaging structure, and controls the virtual image imaging structure to perform head-up display on a windshield.
Preferably, the method further comprises:
calculating corresponding general display information based on the general signals in the signals to be displayed through the first computing force controller, and sending the corresponding general display information to a second computing force controller;
and sending the general display information to a virtual image imaging structure through the second computing force controller so as to perform head-up display.
2. General display: the general display content is derived from other controllers of the whole vehicle, multimedia signals, bluetooth signals and the like, and the specific display content is as follows:
Figure BDA0003133034330000121
Figure BDA0003133034330000131
preferably, the functions of the second computing force controller include:
and receiving a control signal through the second computing force controller, and automatically adjusting the head-up display based on the ARHUD based on the control signal.
And after the head-up display based on the ARHUD is automatically adjusted, sending feedback data to the vehicle machine through the second computing force controller. The feedback data comprises display adjustment data and general display data.
Illustratively, the display adjustment data includes brightness adjustment, height adjustment, and the like.
Illustratively, the second, low-power controller, serves only as a projection display: control input, status feedback:
1. input: mainly comprises the adjustment of image display height and image display brightness;
Figure BDA0003133034330000141
2. feedback: and feeding back the current height, brightness and controller state.
Figure BDA0003133034330000142
Figure BDA0003133034330000151
Preferably, the receiving, by the second computing force controller, a control signal, and automatically adjusting the head-up display based on the ARHUD based on the control signal, includes:
and acquiring a light sensor signal through the second power calculation controller, and automatically adjusting the display height and the display brightness of the head-up display based on the ARHUD based on the control signal and the light sensor signal.
Preferably, the method further comprises: and acquiring a temperature sensor signal through the second computing force controller, and executing a corresponding temperature protection mode based on the temperature sensor signal.
Preferably, the method further comprises: and acquiring a temperature sensor signal through the second computing force controller, and executing a corresponding temperature protection mode based on the temperature sensor signal.
Illustratively, the second force controller collects sensor signals that do not require calculation and may be used directly, for example:
and the light sensor signal is used for automatically adjusting the brightness of the picture.
Wherein, the light sensor is generally integrated with the rainfall sensor by using an I2C interface. This value is sent to the low-power controller via CAN (FD) or ETH when the HUD is not integrating the light sensor alone.
Temperature sensor signal: since the optics in the HUD affect performance and lifetime when operating at excessive temperatures, the HUD requires integration of temperature sensors at low-power controllers to implement temperature protection strategies.
Note that, regarding distortion correction: since optical imaging must have a distortion of the pattern, this part of the work can be done by a high-power controller through software correction, or by additional hardware with separate distortion correction.
Wherein, the virtual image imaging structure completes the optical virtual image imaging through optical design.
In the embodiment, the HUD system development mode designed by the invention has better function expansibility, quicker development period, better display experience and lower cost price. And serialization is easy to realize.
Example III
On the other hand, based on the above embodiment, the same parts as those of the above embodiment are not repeated in this embodiment, and as shown in fig. 2 and 3, the present invention further provides an ARHUD-based head-up display system, including:
the first computing force controller 100 is configured to acquire signals to be displayed in different types by using the first computing force controller.
The first computing force controller is further configured to process the signal to be displayed through the first computing force controller, generate corresponding type of AR display information, and send the corresponding type of AR display information to the second computing force controller.
And the second computing force controller 200 is connected with the first computing force controller and is used for sending the AR display information to the AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
In this embodiment, the present embodiment provides an ARHUD system architecture based on video transmission. The system is composed of three parts:
1.a first computing force controller, which is a host that provides computing force and forms a graphical display.
2. An ARHUD controller, i.e. a second force controller, controls the position and intensity of the ARHUD virtual image imaging structure.
3. The virtual image imaging structure for optical imaging is composed of three core components.
Wherein the first and second computing force controllers have a partial system interface:
video transmission interface: and transmitting the image generated by the host.
Control interface: for transmitting control commands for the adjustment of ARHUD height, brightness etc.
And (3) state feedback: the ARHUD should feed back the execution result of the host control command to the host.
Wherein the second computing power controller and a portion of the system interface of the virtual image imaging structure: only image transmission is used for display.
Preferably, the first computing force controller is provided in an ARHUD controller. As illustrated in fig. 4 and 5.
Illustratively, the system is divided into a high-calculation-force controller and a low-calculation-force controller, and the actual structure is as follows: the ARHUD has a high-power controller and a low-power controller.
Wherein, the high power controller possesses the function: navigation signal for navigation. In the architecture of the present embodiment, the navigation signal may transmit navigation information through CAN (FD), ETH.
The present embodiment provides a high performance ARHUD head-up display system. The ARHUD is a head-up display system for displaying imaging through a windshield, and the high performance of the ARHUD is characterized in that compared with the traditional HUD, the display content of the ARHUD is richer, and the ARHUD comprises intelligent content such as ADAS, navigation and the like; the display also has a larger field angle and projection distance.
The architecture of the high-performance ARHUD consists of a host controller, a HUD controller and an optical projection structure. Wherein the host controller is responsible for collecting signals for image generation, and the HUD controller is responsible for receiving video signals from the host controller and for adjusting the display. The product is applied to the field of automobiles.
In the embodiment, the HUD system development mode designed by the invention has better function expansibility, quicker development period, better display experience and lower cost price. And serialization is easy to realize.
Example IV
On the other hand, based on the above embodiment, the same parts as those of the above embodiment are not repeated in this embodiment, and as shown in fig. 6 and 7, the present invention further provides an ARHUD-based head-up display system, including:
the first computing force controller 100 is configured to acquire signals to be displayed in different types by using the first computing force controller.
The first computing force controller is further configured to process the signal to be displayed through the first computing force controller, generate corresponding type of AR display information, and send the corresponding type of AR display information to the second computing force controller.
And the second computing force controller 200 is connected with the first computing force controller and is used for sending the AR display information to the AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
Preferably, the first force calculation controller is arranged in the vehicle machine.
Illustratively, the system is divided into a high-calculation-force controller and a low-calculation-force controller, and the actual structure is as follows: the vehicle machine performs high-power work content, and the ARHUD controller performs only low-power work content.
The high-power controller, namely the first power controller, is located on the vehicle.
Illustratively, the high-power controller should have the following functions: navigation signal for navigation. In the architecture of the embodiment, the navigation is a module of the vehicle and the content of the navigation information is transmitted by using an API defined by internal software.
In the embodiment, the ARHUD system development mode designed by the invention has better function expansibility, quicker development period, better display experience and lower cost price. And serialization is easy to realize.
It will be apparent to those skilled in the art that the above-described program modules are only illustrated in the division of the above-described program modules for convenience and brevity, and that in practical applications, the above-described functional allocation may be performed by different program modules, i.e., the internal structure of the apparatus is divided into different program units or modules, to perform all or part of the above-described functions. The program modules in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one processing unit, where the integrated units may be implemented in a form of hardware or in a form of a software program unit. In addition, the specific names of the program modules are also only for distinguishing from each other, and are not used to limit the protection scope of the present application.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the parts of a certain embodiment that are not described or depicted in detail may be referred to in the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. The above-described embodiments of the apparatus are exemplary only, and exemplary, the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, exemplary, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
It should be noted that the above embodiments can be freely combined as needed. The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.

Claims (9)

1. An ARHUD-based head-up display method, comprising:
receiving different types of signals to be displayed for AR head-up display through a first computing force controller;
processing the signal to be displayed into AR display information of a corresponding type by using the first computing force controller and sending the AR display information to a second computing force controller;
sending the AR display information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display;
calculating corresponding basic guide information and drawing guide line information by the first computing force controller based on the navigation signals in the signals to be displayed and combining the position signals, and sending the basic guide information and drawing guide line information to a second computing force controller;
transmitting the basic guide information and the guide line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display;
after the first power controller collects navigation guide signals, lane guide information is calculated based on the navigation guide signals, the lane guide information is sent to the second power controller, the second power controller sends the lane guide information to the AR virtual image imaging structure, and the lane guide information comprises steering information, steering distance, speed limit information and overspeed information;
the first computing power controller calculates an aerial view map based on a map signal, and sends aerial view map information to the second computing power controller, and the second computing power controller sends the aerial view map information to the AR virtual image imaging structure;
when receiving a destination display instruction, the first computing force controller calculates destination information in real time, wherein the destination information comprises destination coordinate positions, residual distances, residual time, congestion time conditions, predicted arrival time and whole navigation path preview information, the destination information is sent to the second computing force controller, and the second computing force controller sends the destination information to the AR virtual image imaging structure.
2. The ARHUD-based head-up display method of claim 1, further comprising:
calculating lane line equation characteristic values of lanes on two sides based on lane signals in the signals to be displayed through the first force calculating controller, drawing lane line information and sending the lane line information to the second force calculating controller;
and sending the lane line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
3. The ARHUD-based heads-up display method according to claim 1, further comprising:
calculating corresponding obstacle alarm information based on the obstacle alarm signals in the signals to be displayed through the first computing force controller; as above
Calculating, by the first computing force controller, corresponding obstacle position information based on an obstacle position signal and a relative speed signal of an obstacle in the signal to be displayed;
transmitting the obstacle alarm information and the obstacle position information to a second force calculating controller through the first force calculating controller;
and sending the barrier alarm information and the barrier position information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display.
4. The ARHUD-based head-up display method of claim 1, further comprising:
receiving a control signal through the second computing force controller, and automatically adjusting the head-up display based on the ARHUD based on the control signal;
after the head-up display based on the ARHUD is automatically adjusted, feedback data are sent to the vehicle machine through the second computing force controller;
the feedback data comprises display adjustment data and general display data.
5. The ARHUD-based heads-up display method of claim 4 wherein the receiving a control signal by the second computing force controller and automatically adjusting the ARHUD-based heads-up display based on the control signal includes:
and acquiring a light sensor signal through the second power calculation controller, and automatically adjusting the display height and the display brightness of the head-up display based on the ARHUD based on the control signal and the light sensor signal.
6. The ARHUD-based head-up display method according to any one of claims 1 to 5, further comprising:
and acquiring a temperature sensor signal through the second computing force controller, and executing a corresponding temperature protection mode based on the temperature sensor signal.
7. An ARHUD-based heads-up display system, comprising:
the first computing force controller is used for acquiring signals to be displayed in different types;
the first computing force controller is used for processing the signal to be displayed through the first computing force controller, generating corresponding type AR display information and sending the AR display information to the second computing force controller;
the second computing force controller is configured to send the AR display information to an AR virtual image imaging structure through the second computing force controller, so as to perform AR head-up display;
calculating corresponding basic guide information and drawing guide line information by the first computing force controller based on the navigation signals in the signals to be displayed and combining the position signals, and sending the basic guide information and drawing guide line information to a second computing force controller;
transmitting the basic guide information and the guide line information to an AR virtual image imaging structure through the second computing force controller so as to perform AR head-up display;
after the first power controller collects navigation guide signals, lane guide information is calculated based on the navigation guide signals, the lane guide information is sent to the second power controller, the second power controller sends the lane guide information to the AR virtual image imaging structure, and the lane guide information comprises steering information, steering distance, speed limit information and overspeed information;
the first computing power controller calculates an aerial view map based on a map signal, and sends aerial view map information to the second computing power controller, and the second computing power controller sends the aerial view map information to the AR virtual image imaging structure;
when receiving a destination display instruction, the first computing force controller calculates destination information in real time, wherein the destination information comprises destination coordinate positions, residual distances, residual time, congestion time conditions, predicted arrival time and whole navigation path preview information, the destination information is sent to the second computing force controller, and the second computing force controller sends the destination information to the AR virtual image imaging structure.
8. The ARHUD-based heads-up display system of claim 7 wherein the first computing force controller is disposed in an ARHUD controller.
9. The ARHUD-based heads-up display system of claim 7 wherein the first computing force controller is disposed in a vehicle.
CN202110711248.9A 2021-06-25 2021-06-25 Head-up display method and system based on ARHUD Active CN113377202B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110711248.9A CN113377202B (en) 2021-06-25 2021-06-25 Head-up display method and system based on ARHUD

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110711248.9A CN113377202B (en) 2021-06-25 2021-06-25 Head-up display method and system based on ARHUD

Publications (2)

Publication Number Publication Date
CN113377202A CN113377202A (en) 2021-09-10
CN113377202B true CN113377202B (en) 2023-07-07

Family

ID=77579142

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110711248.9A Active CN113377202B (en) 2021-06-25 2021-06-25 Head-up display method and system based on ARHUD

Country Status (1)

Country Link
CN (1) CN113377202B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102027319A (en) * 2008-06-25 2011-04-20 通腾科技股份有限公司 Navigation device and method
CN109219551A (en) * 2016-06-30 2019-01-15 英特尔公司 Condition of road surface head up display
CN109982006A (en) * 2017-12-27 2019-07-05 财团法人工业技术研究院 Virtual guiding illustrates and coincide device and its related method that coincides of true picture
CN109990797A (en) * 2017-12-29 2019-07-09 周秦娜 A kind of control method of the augmented reality navigation display for HUD
CN112995584A (en) * 2019-12-13 2021-06-18 本田技研工业株式会社 Display device and parking assist system for vehicle

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10347046B2 (en) * 2017-06-16 2019-07-09 Daqri, Llc Augmented reality transportation notification system
CN109240628A (en) * 2018-08-05 2019-01-18 深圳市技达信息技术有限公司 The display width of calculating character, character string etc. high method, apparatus and computer readable storage medium
CN109050405A (en) * 2018-08-23 2018-12-21 毕则乾 A kind of multi-functional augmented reality head-up-display system and method
CN110017846A (en) * 2019-03-19 2019-07-16 深圳市谙达信息技术有限公司 A kind of navigation system based on line holographic projections technology
CN110027410B (en) * 2019-04-16 2021-06-01 深圳市尼欧科技有限公司 Display method and device of vehicle-mounted head-up display
CN110244465A (en) * 2019-06-25 2019-09-17 中国第一汽车股份有限公司 A kind of automobile head-up display brightness control method and system
CN110758286A (en) * 2019-10-22 2020-02-07 同济大学 AR-HUD (augmented reality) -based automobile side and rear blind spot detection system and method based on head-up display
CN212709189U (en) * 2020-07-27 2021-03-16 扬州航盛科技有限公司 Vehicle-mounted intelligent w-hud head-up display system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102027319A (en) * 2008-06-25 2011-04-20 通腾科技股份有限公司 Navigation device and method
CN109219551A (en) * 2016-06-30 2019-01-15 英特尔公司 Condition of road surface head up display
CN109982006A (en) * 2017-12-27 2019-07-05 财团法人工业技术研究院 Virtual guiding illustrates and coincide device and its related method that coincides of true picture
CN109990797A (en) * 2017-12-29 2019-07-09 周秦娜 A kind of control method of the augmented reality navigation display for HUD
CN112995584A (en) * 2019-12-13 2021-06-18 本田技研工业株式会社 Display device and parking assist system for vehicle

Also Published As

Publication number Publication date
CN113377202A (en) 2021-09-10

Similar Documents

Publication Publication Date Title
US10789490B2 (en) Method for calculating a display of additional information for an advertisement, a display unit, apparatus for carrying out the method, and transportation vehicle and computer program
US20190120646A1 (en) Vehicle display control device and vehicle display control method
CN111052733B (en) Surrounding vehicle display method and surrounding vehicle display device
EP3031656A1 (en) Information provision device, information provision method, and carrier medium storing information provision program
CN109353279A (en) A kind of vehicle-mounted head-up-display system of augmented reality
CN111788459A (en) Presentation of auxiliary information on a display unit
CN111279689B (en) Display system, display method, and storage medium
JP6969509B2 (en) Vehicle display control device, vehicle display control method, and control program
US20210231452A1 (en) Vehicle display device
JP2017166913A (en) Display controller and display control method
TWM553426U (en) Dynamic information system
CN111034186A (en) Surrounding vehicle display method and surrounding vehicle display device
CN110271417B (en) Full liquid crystal instrument system based on ADAS and AR technology
JP7255608B2 (en) DISPLAY CONTROLLER, METHOD, AND COMPUTER PROGRAM
JP6186905B2 (en) In-vehicle display device and program
US20230373309A1 (en) Display control device
CN113377202B (en) Head-up display method and system based on ARHUD
JP7400242B2 (en) Vehicle display control device and vehicle display control method
EP3702864B1 (en) Accounting for latency in teleoperated remote driving
CN209257986U (en) The vehicle-mounted head-up-display system of augmented reality
CN116572837A (en) Information display control method and device, electronic equipment and storage medium
CN113433695A (en) Head-up display method and system based on WHUD
CN114034310B (en) Automatic navigation auxiliary driving system based on AR-HUD and gesture interaction
WO2023145852A1 (en) Display control device, display system, and display control method
US20230288926A1 (en) Control device, control method, and non-transitory computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant