WO2024001846A1

WO2024001846A1 - Information projection method and apparatus, and vehicle control system

Info

Publication number: WO2024001846A1
Application number: PCT/CN2023/101159
Authority: WO
Inventors: 曹宇宁
Original assignee: 深圳市中兴微电子技术有限公司
Priority date: 2022-06-28
Filing date: 2023-06-19
Publication date: 2024-01-04
Also published as: CN117348242A

Abstract

An information projection method and apparatus, and a vehicle control system. The method comprises: receiving vehicle traveling information, and processing the vehicle traveling information to obtain the processed vehicle traveling information (S202); and directly projecting the processed vehicle traveling information onto the retinas of a driver by a retinal projector (S204). The problems in the related art of poor direct projection effect caused by projecting WHUD onto a front windshield for assisting in driving, and high costs and low yield caused by performing projection after image correction can be solved. An AR head-up display (HUD) (84) directly projects necessary driving information onto the retinas of the driver by means of the retinal projector, such that projected information can be maintained in a focused state regardless of how far the driver looks ahead. Compared with an HUD technique or other AR near-eye display techniques, the focus of the eyes of the driver does not need to be switched back and forth between road condition and prompt information, such that visual fatigue and a vergence-accommodation conflict which are generated thereby can be avoided, thereby improving the driving safety and the driving experience.

Description

An information projection method, device and vehicle control system

Cross-references to related applications

This disclosure is based on the Chinese patent application CN202210746947.1 with the invention title "An information projection method, device and vehicle control system" submitted on June 28, 2022, and claims the priority of this patent application, which is disclosed by reference The contents of are all incorporated into this disclosure.

Technical field

Embodiments of the present disclosure relate to the field of communications, specifically, to an information projection method, device and vehicle control system.

Background technique

In actual driving situations, the display image of the Head-Up Display (HUD) and the road are not on the same plane (the VID of the current HUD is basically about 8 meters, and when driving generally, the focus is mainly on the 20 meters ahead) (left and right), at this time the human eye also needs to switch back and forth between the road and the HUD to adjust the focus of the eye. Although the driver does not need to lower his head, frequent adjustments to focus can also cause visual fatigue.

Related technology proposes Windshield Head UP Display (WHUD for short). WHUD directly uses the front windshield. Both surfaces of the glass will reflect light. Due to the influence of glass refraction, the light reflected by the two surfaces The image will be shifted to a certain extent, forming a ghost image. The only way to solve this problem is to make a special one and sandwich a wedge-shaped layer of PVB glue in the middle of the glass to create an angle between the two reflective surfaces so that the two reflected images overlap as much as possible, which also increases the cost.

Projecting WHUD onto the front windshield will also cause another problem. Front windshields are generally irregular curved glass, and direct projection will only result in deformed images. At this time, an aspherical mirror must be added to the optical machine to correct the image before projecting it out. To achieve a good enough correction effect, the aspherical mirror must be refined according to the shape of the front windshield and the layout of the HUD. This technology and production method are also destined to be difficult to reduce the current cost and the output is limited.

In related technologies, WHUD is projected onto the front windshield to assist driving. The direct projection effect is not good. If the projection after image correction has high cost and low output, no solution has been proposed.

Contents of the invention

Embodiments of the present disclosure provide an AR head display and vehicle control system to at least solve the problem in related technologies of assisting driving by projecting WHUD onto the front windshield. The direct projection effect is not good. If the projection after image correction has high cost and output low question.

According to an embodiment of the present disclosure, an information projection method is provided, which is applied to an AR head display. The AR head display includes a processor and a retina projector. The method includes:

Receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

Through the retina projector, the processed vehicle driving information is directly projected onto the driver's retina.

According to another embodiment of the present disclosure, an information projection method is provided, applied to automobile central control, including:

Obtain vehicle driving information;

The vehicle traveling information is sent to the AR head display, so that the AR head display processes the vehicle traveling information to obtain the processed vehicle traveling information, and the processed vehicle traveling information is processed by the retina projector. Vehicle driving information is projected directly onto the driver's retina.

According to another embodiment of the present disclosure, an information projection device is provided, applied to an AR head-mounted display, and the device includes:

A processing module configured to receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

A projection module is configured to directly project the processed vehicle driving information onto the driver's retina through the retina projector.

According to another embodiment of the present disclosure, an information projection device is provided for use in automobile central control, including:

Acquisition module, set to obtain vehicle driving information;

The sending module is configured to send the vehicle traveling information to the AR head display, so that the AR head display processes the vehicle traveling information, obtains the processed vehicle traveling information, and transmits the vehicle traveling information through the retina projector. The processed vehicle driving information is directly projected onto the driver's retina.

According to another embodiment of the present disclosure, a vehicle control system is provided, including: an AR head display and a car central control, wherein,

The car central control is used to obtain vehicle driving information and send the vehicle driving information to the AR head display;

The AR head display is used to process the vehicle driving information, obtain processed vehicle driving information, and directly project the processed vehicle driving information onto the driver's retina through the retina projector. .

According to yet another embodiment of the present disclosure, a computer-readable storage medium is also provided, and a computer program is stored in the storage medium, wherein the computer program is configured to execute any of the above method embodiments when running. steps in.

According to yet another embodiment of the present disclosure, an electronic device is also provided, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to perform any of the above. Steps in method embodiments.

Description of drawings

Figure 1 is a hardware structure block diagram of a mobile terminal of an information projection method according to an embodiment of the present disclosure;

Figure 2 is a flowchart 1 of an information projection method according to an embodiment of the present disclosure;

Figure 3 is a flow chart 2 of an information projection method according to an embodiment of the present disclosure;

Figure 4 is a flow chart of human-vehicle interaction according to an embodiment of the present disclosure;

Figure 5 is a workflow actively initiated by ADAS according to an embodiment of the present disclosure;

Figure 6 is a block diagram 1 of an information projection device according to an embodiment of the present disclosure;

Figure 7 is a second block diagram of an information projection device according to an embodiment of the present disclosure;

Figure 8 is a block diagram of an information projection system according to an embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and embodiments.

It should be noted that the terms "first", "second", etc. in the description and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

The method embodiments provided in the embodiments of the present disclosure can be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 is a hardware structure block diagram of a mobile terminal of the information projection method according to an embodiment of the present disclosure. As shown in Figure 1, the mobile terminal may include one or more (only one is shown in Figure 1 ) processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned mobile terminal may also include a processor for communication functions. Transmission device 106 and input and output device 108. Persons of ordinary skill in the art can understand that the structure shown in Figure 1 is only illustrative, and it does not limit the structure of the above-mentioned mobile terminal. For example, the mobile terminal may also include more or fewer components than shown in FIG. 1 , or have a different configuration than shown in FIG. 1 .

The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer programs corresponding to the information projection method in the embodiments of the present disclosure. The processor 102 executes various operations by running the computer programs stored in the memory 104. Functional applications and business chain address pool slicing processing implement the above method. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely relative to the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

Transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC for short), which can be connected to other network devices through a base station to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (Radio Frequency, RF for short) module, which is used to communicate with the Internet wirelessly.

In this embodiment, an information projection method running on the above-mentioned mobile terminal or network architecture is provided. Figure 2 is a flow chart of the information projection method according to an embodiment of the present disclosure. As shown in Figure 2, it is applied to an AR head display. , the AR head display includes a processor and a retina projector, and the process includes the following steps:

Step S202, receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

Step S204: Project the processed vehicle driving information directly onto the driver's retina through a retina projector.

In this embodiment, in the above-mentioned step S202, the vehicle driving information includes at least one of the following: control information, road condition information, speed information, navigation information, instrument information; specifically, the vehicle driving information can be received in the following ways: receiving the information sent by the central control of the car. Control information, and/or, receive road condition information, speed information and/or navigation information sent by the advanced assisted driving system ADAS, and/or receive instrument information from the instrument; or receive at least one of the following sent by the car central control: control information , road condition information, speed information, navigation information, instrument information, that is, all vehicle driving information can be received directly from the car central control, or only control information can be received from the car central control, instrument information can be received from the instrument, and road conditions can be received from ADAS. Information, the specific receiving method is relatively flexible.

In this embodiment, in the above step S202, the vehicle driving information may be received through a wireless communication protocol or a wired communication protocol; the vehicle driving information is converted into a format recognized by the retina projector to obtain the processed vehicle driving information. Further, in When the vehicle driving information is road condition information, speed information and/or navigation information, the road condition information, speed information and/or navigation information are converted into a format that can be recognized by the retina projector by fusing it with a pre-stored map. Obtain processed vehicle driving information.

In an optional embodiment, after the above step S202, the method further includes: obtaining the information type of the vehicle driving information, and calling the corresponding function function to parse the vehicle driving information according to the information type, so that the retina projector can identify it, Prepare for projection; or when the vehicle driving information is navigation information, position through GPS or gyroscope to obtain positioning information; navigate based on the navigation information and positioning information, and also navigate through the retina projector, further improving user experience.

According to another embodiment of the present disclosure, an information projection method is provided, which is applied to automobile central control. Figure 3 is a flow chart 2 of the information projection method according to an embodiment of the present disclosure. As shown in Figure 3, the process includes the following step:

Step S302, obtain vehicle driving information;

Step S304: Send the vehicle driving information to the AR head display, so that the AR head display processes the vehicle driving information, obtains the processed vehicle driving information, and directly projects the processed vehicle driving information to the driver through the retina projector. on the member's retina.

In this embodiment, the vehicle driving information includes at least one of the following: control information, road condition information, speed information, navigation information, and instrument information. Correspondingly, the above step S302 may specifically include: receiving an input signal input through the steering wheel, and analyzing the input signal. Analyze and convert it into control information identifiable by the AR headset; and/or receive traffic information, speed information and/or navigation information sent by ADAS; and/or obtain instrument information from the instrument.

In an optional embodiment, the method further includes: judging whether the driver's current operation is safe based on the road condition information and control information; if the judgment result is yes, calling the corresponding function function according to the menu selected by the driver. , process the information output by the function function accordingly, abstract the information that needs to be transmitted into descriptive information, and send the descriptive information to the AR head display; when the judgment result is no, send prompt information to the AR head display.

This embodiment will be described in detail below.

Figure 4 is a flow chart of human-vehicle interaction according to an embodiment of the present disclosure. As shown in Figure 4, it includes:

Step S401, the driver selects the corresponding function menu;

Step S402: The car central control determines whether the driver's operation is safe. If the judgment result is that the driver's operation is safe, step S403 is executed. If the driver's operation is judged to be unsafe, step S401 is returned;

Step S403, the car's central control calls corresponding functions to perform corresponding processing. Specifically, it calls corresponding functional functions to analyze and process vehicle driving information according to different types of information, and convert it into a mode or format suitable for retinal projection, such as position , speed information is integrated with the map built into the AR glasses;

Step S404, the car central control transmits the processed information to the AR head display;

Step S405: The built-in processor of the AR head display processes the vehicle driving information. Specifically, the vehicle driving information is converted into a format that can be recognized by the retina projector. For example, the vehicle driving information is abstracted into descriptive information, such as speed, time, location, etc.;

Step S406: Project the processed information directly onto the driver's retina.

Since the driving information is directly projected on the driver's retina through AR glasses, the relative position of the image and the driver's eyes remains unchanged. Therefore, the driver does not need to lower his head when selecting the function menu, and only needs to design on the steering wheel. Menu selections can be made using physical buttons that can be distinguished by touch. When working, the driver first presses the corresponding keys according to the feel, such as the up, down, left, and right direction keys and the OK key. After the car's central control CPU receives the input signal from the steering wheel, it analyzes the input signal and converts it into a message that can be accepted by the GUI of the AR glasses.

ADAS tracks the road conditions in all directions of the vehicle in real time and continuously feeds the information back to the central control computer after processing. The computer determines whether the driver's current operation is safe based on the road condition information returned by ADAS and the control information incoming in the first step. If not, the computer determines whether the driver's current operation is safe. Safety directly projects unsafe prompts onto the driver's retina through AR glasses. If it is safe, when ADAS determines that the current road conditions are safe, the central control computer calls the corresponding function function, such as navigation, according to the menu selected by the driver, and then processes the information output by the function function accordingly to abstract the information that needs to be transmitted. into descriptive information, such as speed, time, location, etc. Compared with directly transmitting images, the amount of abstracted information is greatly reduced, making it easier to meet the real-time requirements of transmission. After the information is processed, the CPU transmits the processed information to the communication module. The communication module transmits the processed information to the AR glasses according to the communication protocol connected between the AR glasses and the car central control, such as Bluetooth 5.0 or wifi6;

After the communication module of the AR glasses receives the information, it transmits it to the SOC. The CPU in the SOC calls the corresponding function according to the type of information, analyzes and processes the information from the car, and converts it into a format suitable for retinal projection. mode, such as integrating position and speed information with the map built into the AR glasses, and then transmitting it to the retina projector, which is then observed by the driver. The driver performs reasonable operations on the car based on the information obtained through retinal projection.

Figure 5 is a workflow actively initiated by ADAS according to an embodiment of the present disclosure. As shown in Figure 5, it includes:

Step S501, ADAS collects traffic information;

Step S502, ADAS determines whether it is necessary to notify the driver. If the judgment result is that the driver needs to be notified, step S503 is executed. If the judgment result is that the driver does not need to be notified, step S501 is returned;

Step S503, ADAS transmits the road condition information to the AR head display, and the AR head display transmits the road condition information to the driver's retina;

Step S504: The driver performs corresponding processing or no processing according to the road condition information.

ADAS tracks the road conditions ahead in real time and performs traffic processing based on its own logic, such as real-time pedestrian detection. If a road condition that requires driver intervention is found, such as a pedestrian found ahead, the road condition information will be processed accordingly, such as abstracting some descriptive information, such as the pedestrian's height and width and position on the road.

The car central control performs secondary processing on the information processed by ADAS, such as adding some GUI description information, and then passes the processed information to the AR head according to the communication protocol connected between the AR glasses and the car central control, such as Bluetooth 5.0 or wifi6. The communication module displays the information. After the communication module receives the information, it transmits it to the SOC. The CPU in the SOC calls the corresponding function according to the type of information, analyzes and processes the information from the car, and converts it into a suitable The mode of retinal projection, such as integrating position and speed information with the map built into AR glasses, then transmits it to the retina projector, and then is observed by the driver; after receiving the prompt, the driver will judge the road conditions and handle it accordingly.

According to another embodiment of the present disclosure, an information projection device is provided, which is applied to an AR head display. Figure 6 is a block diagram of the information projection device according to an embodiment of the present disclosure. As shown in Figure 6, it includes:

The processing module 62 is used to receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

The projection module 64 is used to directly project the processed vehicle driving information onto the driver's retina through the retina projector.

In one embodiment, the vehicle driving information that the processing module 62 can receive includes at least one of the following: control information, road condition information, speed information, navigation information, instrument information; receiving control information sent by the central control of the car, and /or, receive road condition information, speed information and/or navigation information sent by the advanced assisted driving system ADAS, and/or receive instrument information from the instrument; or receive at least one of the following sent by the car central control: control information, road condition information, Speed information, navigation information, instrument information.

In one embodiment, the processing module 62 includes:

A receiving submodule, used to receive the vehicle driving information through a wireless communication protocol or a wired communication protocol;

A conversion submodule is used to convert the vehicle driving information into a format recognized by the retina projector to obtain the processed vehicle driving information.

In one embodiment, the conversion sub-module is also used to convert the vehicle driving information by integrating it with a pre-stored map when the vehicle driving information is road condition information, speed information and/or navigation information. The road condition information, the speed information and/or the navigation information are converted into a format that can be recognized by the retina projector, and the processed vehicle driving information is obtained.

In one embodiment, the device further includes:

An analysis module, used to obtain the information type of the vehicle driving information, and call the corresponding functional function to analyze the vehicle driving information according to the information type; or

A positioning module is used to perform positioning through GPS or gyroscope when the vehicle driving information is navigation information, and to obtain positioning information; and to perform navigation based on the navigation information and the positioning information.

According to another embodiment of the present disclosure, an information projection device is provided for use in automobile central control. Figure 7 is a second block diagram of the information projection device according to an embodiment of the present disclosure. As shown in Figure 7, it includes:

Obtaining module 72 is used to obtain vehicle driving information;

The sending module 74 is used to send the vehicle traveling information to the AR head display, so that the AR head display processes the vehicle traveling information, obtains the processed vehicle traveling information, and passes the retina projector, The processed vehicle driving information is directly projected onto the driver's retina.

In one embodiment, the vehicle driving information that the acquisition module 72 can receive includes at least one of the following: control information, road condition information, speed information, navigation information, instrument information; receiving input signals input through the steering wheel, all Analyze the input signal and convert it into control information identifiable by the AR head display; and/or receive the road condition information, speed information and/or navigation information sent by the advanced assisted driving system ADAS; and/or obtain Instrument information for the instrument.

In one embodiment, the device further includes:

A judgment module, used to judge whether the driver's current operation is safe based on the road condition information and the control information;

The abstract module is used to call the corresponding functional function according to the menu selected by the driver when the judgment result is yes, process the information output by the functional function accordingly, and abstract the information that needs to be transmitted into descriptive information. Send the descriptive information to the AR headset;

A prompt module, used to send prompt information to the AR head display when the judgment result is no.

According to another embodiment of the present disclosure, a vehicle control system is provided. Figure 8 is a block diagram of an information projection system according to an embodiment of the present disclosure. As shown in Figure 8, it includes: a car central control 82 and an AR head display 84, in,

The car central control 82 is used to obtain vehicle driving information and send the vehicle driving information to the AR head display;

The AR head display 84 is used to process vehicle driving information, obtain processed vehicle driving information, and directly project the processed vehicle driving information onto the driver's retina through a retina projector.

Further, the AR head-mounted display also includes: a processor and a retina projector, among which,

A processor configured to receive vehicle travel information, process the vehicle travel information, obtain processed vehicle travel information, and transmit the processed vehicle travel information to the retina projector;

The retina projector is used to project the processed vehicle driving information directly onto the driver's retina.

The retina projector in this embodiment is the core component of the AR head display and is responsible for projecting information from the car's central control, instruments or ADAS onto the driver's retina.

The AR head display in this embodiment is a technology that calculates the position and angle of camera images in real time and adds corresponding images. It is a new technology that "seamlessly" integrates real world information and virtual world information.

In one embodiment, the vehicle driving information includes at least one of the following: instrument information, road condition information, speed information, navigation information, and control information; the processor is also configured to receive control information sent by the central control of the car, and/or , to receive the road condition information, speed information and/or navigation information sent by the ADAS system, and/or to receive the instrument information of the instrument; or the processor is used to receive the control information, road condition information, speed information and navigation information sent by the central control of the car. and/or instrument information.

In one embodiment, the processor includes: a communication module and a System On Chip (SOC for short), wherein the communication module is used to receive the vehicle driving information through a wireless communication protocol or a wired communication protocol, and Transmit the vehicle driving information to the SOC;

The communication module in this embodiment can choose to support wireless communication protocols such as Bluetooth and wifi or corresponding wired communication protocols such as USB3.0 according to needs. It is mainly responsible for receiving information from the central control system, instruments, ADAS and physical buttons, such as Speed, navigation information or control information.

SOC is used to convert the vehicle driving information into a format recognized by the retina projector to obtain processed vehicle driving information.

The main components of the SOC in this embodiment are a central processing unit (Central Processing Unit, referred to as CPU), a graphics processor (Graphic Processing Unit, referred to as GPU), digital signal processing (Digital Signal Processing, referred to as DSP), etc., It is responsible for processing the information received by the communication module in real time, converting the processed information into a form suitable for retinal projection and outputting it to the retina projector, and projecting it onto the driver's retina; in addition, it is also responsible for analyzing the audio information received by the communication module and transmitting it to Headphones are used to alert the driver.

In one embodiment, the SOC is also used to obtain the information type of the vehicle travel information after receiving the vehicle travel information, and call the corresponding functional function to parse the vehicle travel information according to the information type.

In one embodiment, the SOC is also used to combine the road condition information, the speed information and/or the navigation information by fusing it with a pre-stored map when the vehicle driving information is road condition information, speed information and/or navigation information. The speed information and/or the navigation information is converted into a format that can be recognized by the retina projector, and the processed vehicle driving information is obtained.

In another embodiment, the AR head-mounted display further includes: a navigation module, wherein,

A navigation module is used to perform positioning through GPS or gyroscope when the vehicle driving information is navigation information, and to obtain positioning information; and to perform navigation according to the navigation information and the positioning information.

In another embodiment, the AR head-mounted display further includes a power module for powering the processor and the retina projector, that is, responsible for powering the system;

The AR head display in this embodiment also includes an operating system, and the software is system software, which is responsible for the software and hardware management of the entire device.

The main application scenario of the disclosed embodiment is inside the smart car cockpit. When the driver wears the AR smart headset mentioned above when driving a car, the cockpit can project instrument information, navigation information and road condition information onto the driver's retina, and can change the display according to the movement of the driver's head. content, thereby better assisting the driver in handling road conditions and controlling the car, and improving driving safety and driving experience.

In one embodiment, the car central control 82 is also used to collect instrument information; and/or receive input signals input through the steering wheel, analyze the input signals, and convert them into controls identifiable by the AR head display. information; and/or, receive road condition information, speed information and/or navigation information sent by the advanced assisted driving system ADAS.

In one embodiment, the car central control 82 is also used to determine whether the driver's current operation is safe based on the road condition information and the control information; if the judgment result is yes, call the corresponding menu according to the driver's selection. The functional function performs corresponding processing on the information output by the functional function, abstracts the information that needs to be transmitted into descriptive information, and sends the descriptive information to the AR head display; when the judgment result is no , sending prompt information to the AR head display.

In one embodiment, the vehicle driving information includes at least one of the following: instrument information, road condition information, speed information, navigation information, and control information; the car central control 82 is used to receive input signals input through the steering wheel, and The input signal is parsed and converted into control information identifiable by the AR headset. The vehicle control system also includes: ADAS, used to collect road condition information, speed information and/or navigation information of the vehicle, and send the road condition information, speed information and/or navigation information to the AR head Display; and/or instrument, used to collect instrument data and send the instrument data to the AR head display.

Embodiments of the present disclosure also provide a computer-readable storage medium that stores a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.

In an exemplary embodiment, the computer-readable storage medium may include but is not limited to: U disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM) , mobile hard disk, magnetic disk or optical disk and other media that can store computer programs.

Embodiments of the present disclosure also provide an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

In an exemplary embodiment, the above-mentioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the above-mentioned processor, and the input-output device is connected to the above-mentioned processor.

For specific examples in this embodiment, reference may be made to the examples described in the above-mentioned embodiments and exemplary implementations, and details will not be described again in this embodiment.

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present disclosure can be implemented using general-purpose computing devices, and they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices. They may be implemented in program code executable by a computing device, such that they may be stored in a storage device for execution by the computing device, and in some cases may be executed in a sequence different from that shown herein. or the described steps, or they are respectively made into individual integrated circuit modules, or multiple modules or steps among them are made into a single integrated circuit module. As such, the present disclosure is not limited to any specific combination of hardware and software.

The above are only preferred embodiments of the present disclosure and are not intended to limit the present disclosure. For those skilled in the art, the present disclosure may have various modifications and changes. Any modifications, equivalent substitutions, improvements, etc. made within the principles of this disclosure shall be included in the protection scope of this disclosure.

Claims

An information projection method applied to an AR head display. The AR head display includes a processor and a retina projector. The method includes:

Receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

Through the retina projector, the processed vehicle driving information is directly projected onto the driver's retina.
The method according to claim 1, wherein the vehicle driving information includes at least one of the following: control information, road condition information, speed information, navigation information, and instrument information;

Receiving the vehicle driving information includes:

Receive control information sent by the central control of the car, and/or receive road condition information, speed information and/or navigation information sent by the advanced driver assistance system ADAS, and/or receive instrument information from the instrument; or

Receive at least one of the following sent by the car central control: control information, road condition information, speed information, navigation information, instrument information.
The method according to claim 2, wherein receiving the vehicle travel information, processing the vehicle travel information, and obtaining the processed vehicle travel information includes:

Receive the vehicle driving information through a wireless communication protocol or a wired communication protocol;

The vehicle traveling information is converted into a format recognized by the retina projector to obtain the processed vehicle traveling information.
The method according to claim 3, wherein converting the vehicle traveling information into a format recognized by the retina projector, and obtaining the processed vehicle traveling information includes:

When the vehicle driving information is road condition information, speed information and/or navigation information, the road condition information, speed information and/or navigation information are converted by integrating with a pre-stored map. The processed vehicle driving information is obtained in a format that can be recognized by the retina projector.
The method of claim 2, wherein after receiving the vehicle travel information, the method further includes:

Obtain the information type of the vehicle driving information, and call the corresponding function function to analyze the vehicle driving information according to the information type; or

When the vehicle driving information is navigation information, positioning is performed through GPS or gyroscope to obtain positioning information; navigation is performed based on the navigation information and the positioning information.
An information projection method, applied to automobile central control, including:

Obtain vehicle driving information;

The vehicle traveling information is sent to the AR head display, so that the AR head display processes the vehicle traveling information to obtain the processed vehicle traveling information, and uses the retina projector to display the processed vehicle traveling information. Information is projected directly onto the driver's retina.
The method according to claim 6, wherein obtaining the vehicle driving information includes:

The vehicle driving information includes at least one of the following: control information, road condition information, speed information, navigation information, and instrument information;

Receive input signals input through the steering wheel, analyze the input signals, and convert them into control information identifiable by the AR head display; and/or receive road condition information, speed information and/or sent by the advanced assisted driving system ADAS. Navigation information; and/or, obtain instrument information for the instrument.
The method of claim 7, further comprising:

Determine whether the driver's current operation is safe based on the road condition information and the control information;

When the judgment result is yes, the corresponding functional function is called according to the menu selected by the driver, the information output by the functional function is processed accordingly, the information that needs to be transmitted is abstracted into descriptive information, and the descriptive information is Information is sent to the AR headset;

If the judgment result is no, prompt information is sent to the AR head display.
An information projection device applied to an AR head-mounted display, the device includes:

A processing module configured to receive vehicle travel information, process the vehicle travel information, and obtain processed vehicle travel information;

The projection module is configured to directly project the processed vehicle driving information onto the driver's retina through a retina projector.
An information projection device used in automobile central control, including:

Acquisition module, set to obtain vehicle driving information;

The sending module is configured to send the vehicle traveling information to the AR head display, so that the AR head display processes the vehicle traveling information, obtains the processed vehicle traveling information, and transmits the processed vehicle traveling information through the retina projector. The vehicle driving information is directly projected onto the driver's retina.
A vehicle control system, including: AR head display and car central control, wherein,

The car central control is used to obtain vehicle driving information and send the vehicle driving information to the AR head display;

The AR head display is used to process the vehicle driving information, obtain processed vehicle driving information, and directly project the processed vehicle driving information onto the driver's retina through a retina projector.
A computer-readable storage medium having a computer program stored in the storage medium, wherein the computer program is configured to execute the method described in any one of claims 1 to 5 or the claim when running. A method as described in any one of claims 6 to 8.
An electronic device including a memory and a processor, a computer program stored in the memory, the processor being configured to run the computer program to perform the method described in any one of claims 1 to 5, or The method described in any one of claims 6 to 8.