CN111086518B

CN111086518B - Display method and device, vehicle-mounted head-up display equipment and storage medium

Info

Publication number: CN111086518B
Application number: CN201811221773.7A
Authority: CN
Inventors: 胡永涛; 戴景文; 贺杰
Original assignee: Guangdong Virtual Reality Technology Co Ltd
Current assignee: Guangdong Virtual Reality Technology Co Ltd
Priority date: 2018-10-19
Filing date: 2018-10-19
Publication date: 2022-05-31
Anticipated expiration: 2038-10-19
Also published as: CN111086518A

Abstract

The application discloses a display method, a display device, vehicle-mounted head-up display equipment and a storage medium, and relates to the technical field of display. The display method is applied to a vehicle-mounted head-up display device, and comprises the following steps: detecting the driving state of the automobile; when the automobile is in a driving state, acquiring road condition information of a road where the automobile is located in real time; and when the road condition information is preset road condition information, displaying a virtual image for indicating the driving operation of a driver, wherein the virtual image is used for prompting that the current driving state of the automobile needs to be changed. The method can better prompt the driver in the driving process.

Description

Display method and device, vehicle-mounted head-up display equipment and storage medium

Technical Field

The present application relates to the field of display technologies, and in particular, to a display method and apparatus, a vehicle-mounted head-up display device, and a storage medium.

Background

With the advancement of science and technology, Augmented Reality (AR) technology has gradually become a hot spot of domestic and foreign research, and technology for increasing the perception of a user to the real world through information provided by a computer system is added, and content objects such as virtual objects, scenes or system prompt information generated by a computer are overlaid into real scenes to enhance or modify the perception of the real world environment or data representing the real world environment. The automobile is one of scenes in which augmented reality technology is applied as an indispensable vehicle in the work and life of people.

Disclosure of Invention

The embodiment of the application provides a display method and device, a vehicle-mounted head-up display device and a storage medium, which can better prompt a driver.

In a first aspect, an embodiment of the present application provides a display method, which is applied to an on-vehicle head-up display device, and the method includes: detecting the driving state of the automobile; when the automobile is in a driving state, acquiring road condition information of a road where the automobile is located in real time; and when the road condition information is preset road condition information, displaying a virtual image for indicating the driving operation of a driver, wherein the virtual image is used for prompting that the current driving state of the automobile needs to be changed.

In a second aspect, an embodiment of the present application provides a display apparatus, applied to an on-vehicle head-up display device, the apparatus including: the system comprises a state detection module, a road condition acquisition module and a prompt display module, wherein the state detection module is used for detecting the driving state of the automobile; the road condition detection module is used for acquiring the road condition information of the road where the automobile is located in real time when the automobile is in a driving state; the prompting display module is used for displaying a virtual image for indicating the driving operation of a driver when the road condition information is preset road condition information, and the virtual image is used for prompting that the current driving state of the automobile needs to be changed.

In a third aspect, an embodiment of the present application provides an on-vehicle head-up display apparatus, including: one or more processors; a memory; one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the display method provided by the first aspect above.

In a fourth aspect, an embodiment of the present application provides a storage medium, where a program code is stored in the computer-readable storage medium, and the program code may be called by a processor to execute the display method provided in the first aspect.

The scheme that this application provided is applied to on-vehicle head-up display equipment, through the travel state that detects the car, when the car is travel state, acquires the road conditions information of car place road in real time, when the road conditions information that acquires is when predetermineeing road conditions information, shows the virtual image of instructing driver's driving operation, and the virtual image is used for the suggestion car and needs to change current travel state to can realize the intelligent suggestion to driver among the driving process, promote the driving safety nature.

Drawings

Fig. 1 shows a schematic diagram of an application scenario suitable for use in an embodiment of the present application.

Fig. 2 shows another schematic diagram of an application scenario suitable for use in an embodiment of the present application.

FIG. 3 shows a flow diagram of a display method according to one embodiment of the present application.

Fig. 4 shows a display effect schematic diagram of an in-vehicle head-up display device according to an embodiment of the application.

FIG. 5 shows a flow diagram of a display method according to another embodiment of the present application.

Fig. 6 shows a flowchart of step S220 in a display method according to another embodiment of the present application.

FIG. 7 shows a flow chart of a display method according to yet another embodiment of the present application.

FIG. 8 shows a block diagram of a display device according to one embodiment of the present application.

FIG. 9 shows a block diagram of a display device according to yet another embodiment of the present application.

Fig. 10 is a block diagram of a terminal device for executing a display method according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

With the development of economy and technology, the automobile reserves are larger and larger, and the requirement on safety in the driving process is higher and higher. At present, generally, the driving operation of the driver is controlled by the behavior awareness of the driver, and the driving operation of the driver cannot be presented well.

In view of the above technical problems, the present application provides a display method, an apparatus, a vehicle-mounted head-up display device, and a storage medium, by detecting a driving state of an automobile, acquiring road condition information of a road where the automobile is located in real time when the automobile is in the driving state, and displaying a virtual image for indicating a driving operation of a driver when the road condition information is preset road condition information, so as to realize an intelligent prompt for the driver.

An application scenario of the display method provided in the embodiment of the present application is described below.

Referring to fig. 1 and fig. 2, schematic diagrams of application scenarios of the display method provided in the embodiment of the present application are shown, where the application scenarios include a display system 10. The display system 10 includes: an in-vehicle head-up display apparatus 100, and an automobile 200. The in-vehicle head-up display apparatus 100 may be provided to the automobile 200, the in-vehicle head-up display apparatus 100 being used to display contents.

The vehicle-mounted Head-Up Display device (HUD) is applied to a vehicle, and can Display important driving information such as speed, engine revolution, oil consumption, tire pressure, navigation and information of an external intelligent device in the field of vision of a driver above a front windshield or a steering wheel in real time, so that the driver can see the driving information without lowering the Head, the attention of the driver to a road in front is avoided, and potential driving hazards are eliminated; moreover, since the virtual image falls right in front of the vehicle during projection, the time for the driver to adjust the visual focus is shortened, which is safer for the driver. Meanwhile, the driver does not need to adjust the sight angle of eyes between the instrument observing the distant road and the instrument observing the nearby road, so that the fatigue of eyes can be avoided, and the driving experience can be greatly enhanced and improved.

In some embodiments, the above vehicle-mounted head-up display device may include a display component, which may be a transparent display screen and may be used to directly display content, that is, the display screen is connected with a control module having a display function, and the display screen may display content under the control of the control module. In some embodiments, the vehicle-mounted head-up display device may include a display component, which may also be a transflective display lens, and a projection module, which may be a micro projector, and the projection module may project the display content onto the display lens, so as to display the display content. In some embodiments, the vehicle-mounted head-up display device may include a projection module, in this manner, a front windshield of the vehicle may be a transflective optical lens, and the projection module may directly project the display content on the front windshield of the vehicle, so as to realize the display of the display content. Of course, the specific display mode of the vehicle-mounted head-up display device may not be limited in the embodiment of the present application.

A specific display method will be described below.

Referring to fig. 3, an embodiment of the present application provides a display method applicable to a vehicle-mounted head-up display device, where the method may include:

step S110: the driving state of the automobile is detected.

In some embodiments, the in-vehicle head-up display device may be turned on when it is needed for use, thereby entering a use state. When the vehicle-mounted head-up display device is in a use state, the driving state of the vehicle can be detected, and relevant information for prompting the driving operation of the driver can be acquired according to the driving state of the vehicle. The detecting of the driving state of the vehicle may be detecting whether the vehicle is in a moving driving state.

In some embodiments, the current speed of the vehicle may be detected, and when the current speed of the vehicle is greater than a speed threshold, the current driving state of the vehicle may be determined, wherein the speed threshold may be set according to a requirement, such as 20km/h (kilometer/hour), or 23km/h, 30km/h, and the like, which is not limited herein. The vehicle-mounted head-up display device detects the current speed of the automobile, so that the current speed of the automobile can be acquired by using a speed sensor arranged in the vehicle-mounted head-up display device; the vehicle-mounted head-up display device can also acquire the current speed of the automobile from other devices capable of measuring the speed of the automobile.

Of course, a specific manner of detecting the driving state of the vehicle may not be limited in this application, and may be other manners, for example, the Positioning information of the vehicle may be obtained through a Global Positioning System (GPS), and when the Positioning information changes within a preset time, it may be determined that the vehicle is currently in the driving state.

Step S120: and when the automobile is in a driving state, acquiring the road condition information of the road where the automobile is located in real time.

In some embodiments, when it is detected that the vehicle is in a running state, that is, when it is detected that the vehicle is in a driving state in motion, information for prompting a driving operation of the driver may be acquired. Specifically, the vehicle-mounted head-up display device may acquire road condition information of a road where the vehicle is located to determine whether to instruct a driver to perform driving operation.

In some embodiments, the traffic information may include, but is not limited to, traffic lights, obstacles in the road of the automobile, and the like, wherein the obstacles may include, but are not limited to, vehicles, pedestrians, roadblocks, and the like ahead of the automobile. It can be understood that the information of the traffic light and the information of the obstacles on the road where the car is located are information that may affect the driving state of the car, and if the car does not drive according to the information of the traffic light or does not consider the information of the obstacles on the road when driving, a traffic accident may occur or the traffic may be blocked.

When the vehicle-mounted head-up display equipment acquires the road condition information of the road where the automobile is located, the image of the road where the automobile is located can be acquired, and the acquired image of the road where the automobile is located is identified, so that the road condition information of the road where the automobile is located is obtained. The road condition information of the road where the automobile is located can also be acquired through the arranged sensor or navigation software and the like. The specific manner of acquiring the road condition information of the road where the automobile is located may not be limited in the embodiment of the present application.

Step S130: and when the road condition information is preset road condition information, displaying a virtual image for indicating the driving operation of a driver, wherein the virtual image is used for prompting that the automobile needs to change the current driving state.

In some embodiments, when the acquired road condition information of the road where the automobile is located is the preset road condition information, it may indicate that the current automobile needs to change its driving state, for example, changing the current driving state may be to stop the current driving state of the automobile, or to start the automobile and enter the driving state, or to adjust the current driving speed, or the like. The preset road condition information may be information that the traffic indicator light is in a set state, or information that the automobile is in an obstacle on the road. For example, a red traffic light indicates that the vehicle needs to be decelerated, and for example, when an obstacle on the road of the vehicle is close to the vehicle, the vehicle needs to be decelerated.

Therefore, when the acquired road condition information of the road where the automobile is located is the preset road condition information, a virtual image for indicating the driving operation of the driver is displayed, and the virtual image is used for prompting that the automobile needs to change the current driving state. The virtual image may be an image with a prompting or indicating effect, for example, as shown in fig. 4, a preset image a may be displayed on a display component of the vehicle-mounted head-up display device 100 on the automobile 200 to prompt or indicate a user to change a current driving state, and of course, specific image content may not be limited in the embodiment of the present application. On-vehicle head-up display equipment can be with the virtual image projection display assembly in, the virtual image of demonstration superposes with real world's road, realizes AR's display effect, can make the effect of suggestion more lifelike to improve driver's alertness, guarantee driving safety.

The display method is applied to vehicle-mounted head-up display equipment, and by detecting the driving state of a vehicle, the road condition information of the road where the vehicle is located is acquired in real time when the vehicle is in the driving state, and when the acquired road condition information is preset road condition information, a virtual image for indicating the driving operation of a driver is displayed.

Referring to fig. 5, another embodiment of the present application provides a display method applicable to a vehicle-mounted head-up display device, where the method may include:

step S210: the driving state of the automobile is detected.

In some embodiments, step S210 may refer to the contents in the above embodiments, which are not described herein again.

Step S220: and when the automobile is in a driving state, acquiring the road condition information of the road where the automobile is located in real time.

In some embodiments, the road condition information acquired by the vehicle-mounted head-up display device in real time may include: at least one of real-time color information of traffic indicator lights in the road, estimated change information of the color of the traffic indicator lights, distance information of pedestrians to automobiles in the road, and distance information of vehicles to automobiles in the road. The real-time color information of the traffic indicator light, the color change information of the traffic indicator light, the distance information between a pedestrian and the automobile on the road and the distance information between a vehicle and the automobile on the road in the road information of the road where the automobile is located are all information capable of influencing the driving state of the automobile, so that at least one of the information can be monitored to indicate the driving operation of a driver.

Further, when the road condition information of the road where the automobile is located comprises real-time color information of the traffic indicator lamp in the road. Referring to fig. 6, the obtaining of the road condition information of the road where the automobile is located in real time may include:

step S221: and acquiring a road image of a road in front of the automobile in real time.

In some embodiments, the vehicle-mounted head-up display device may include a camera for capturing images of a road in front of the vehicle, or the vehicle-mounted head-up display device may be connected with a device that may be used for capturing images of a road in front of the vehicle, such as a mobile phone, an external camera, etc., so that the vehicle-mounted head-up display device may acquire images of the road in front of the vehicle. When the vehicle-mounted head-up display device acquires the color of the traffic indicator light on the road in front of the automobile, the vehicle-mounted head-up display device can acquire the road image of the road in front of the automobile to identify the road image to obtain whether the traffic indicator light exists on the road in front of the automobile, and when the traffic indicator light exists, the vehicle-mounted head-up display device can further identify and acquire information such as real-time color of the traffic indicator light.

Step S222: when the traffic indicator light is detected to be contained in the road image, the image characteristics of the traffic indicator light are extracted, and the color of the traffic indicator light in the road is determined according to the image characteristics.

In some embodiments, after the road image of the road in front of the automobile is acquired, the road image may be identified, and whether the road image includes the traffic indicator light may be identified, so that when the road image includes the traffic indicator light, the real-time color of the traffic indicator light is acquired. As a mode, by identifying a connected region in a road image, judging whether the profile of the connected region is a target profile, and judging whether the size of the connected region is a preset size, when it is judged that the target profile and the connected region of the target size exist in the road image, it can be determined that the acquired road image of the road where the automobile is located contains the content of the traffic indicator light, so that it is determined that the road where the automobile is located has the traffic indicator light. It can be understood that the traffic light is usually a light with a certain shape, such as a circle, and the size of the traffic light is usually within a certain range, so that whether the traffic light is included in the road image can be identified according to the characteristics of the traffic light, and when the contour area with the shape and the size exists in the road image, it can be determined that the traffic light is included in the road image of the road where the automobile is located.

As another mode, whether the road image has the target color and the target contour region may be identified, and when the road image has the target color and the target contour region, it may be determined that the acquired road image of the road where the automobile is located includes the content of the traffic indicator light, so as to determine that the road where the automobile is located has the traffic indicator light.

It can be understood that the traffic light is usually in a certain color and shape, for example, usually has three colors of red, green and yellow, and the shape is usually circular, and whether the traffic light is included in the road image can be identified according to the characteristic of the traffic light, and when the road image has the contour area of the above color and shape, it can be determined that the traffic light is included in the road image of the road where the automobile is located.

Further, when it is detected that the road image contains the traffic indicator light, the image features of the traffic indicator light can be extracted, and the real-time color of the traffic indicator light in the road can be determined according to the extracted image features of the traffic indicator light. Specifically, the real-time color of the traffic light in the road of the automobile may be determined by determining the color of the identified area where the traffic light is located, for example, when the RGB value of the area where the traffic light is located is (255,0,0), the real-time color of the traffic light may be determined to be red, for example, when the RGB value of the area where the traffic light is located is (0,255,0), the real-time color of the traffic light may be determined to be green, and for example, when the RGB value of the area where the traffic light is located is (255, 0), the real-time color of the traffic light may be determined to be yellow. Of course, the RGB values of the traffic light color are merely examples, and do not represent the limitation of the RGB values of the real-time color of the traffic light in the embodiment of the present application, and may also vary within a certain range, for example, when the RGB values are (255,220,0), the real-time color of the traffic light may also be determined to be yellow.

In some embodiments, the change of the traffic light can be estimated according to the real-time color of the traffic light and the time change rule of the traffic light, so as to obtain the estimated change information of the color of the traffic light. The time change rule of the traffic indicator light can obtain the color change rule of the traffic light corresponding to the positioning information through the positioning information. For example, if the traffic light has a time change rule of yellow for 5 seconds, red for 30 seconds, and green for 50 seconds, the traffic light will change to red after 5 seconds when the real-time color of the traffic light is recognized as yellow.

In some embodiments, when the traffic information of the road where the automobile is located includes a distance from a pedestrian in the road to the automobile, the distance from the pedestrian in the road to the automobile may be obtained by using the distance measuring sensor when the infrared sensor detects the pedestrian through the distance measuring sensor and the infrared sensor arranged at the front portion of the automobile body. Of course, it is also possible to identify the image in the road obtained by the camera, identify whether there is a pedestrian in the road, and obtain the distance from the pedestrian to the automobile in the road according to a monocular distance measurement manner or by a distance measurement sensor when there is a pedestrian in the road.

In some embodiments, when the road condition information of the road where the automobile is located includes information of a distance from the vehicle in the road to the automobile, the distance from the vehicle in the road to the automobile may also be acquired by a distance measurement sensor disposed at a front portion of a body of the automobile. Of course, it is also possible to recognize the image in the road acquired by the camera, recognize whether there is a vehicle in the road, and acquire the distance information from the vehicle in the road to the car according to a binocular distance measurement manner or by a distance measurement sensor when it is recognized that there is a vehicle in the road. The binocular ranging is that stereo matching is carried out on left and right images shot by two cameras at the same time, and the distance of a target object is calculated according to a parallax image obtained by the stereo matching.

Of course, the manner of specifically acquiring the color of the traffic light on the road, the estimated change of the color of the traffic light, the distance from the pedestrian to the automobile on the road, and the distance from the vehicle to the automobile on the road may not be limited in the present application.

Step S230: and when the road condition information is preset road condition information, displaying a virtual image for indicating the driving operation of a driver, wherein the virtual image is used for prompting that the automobile needs to change the current driving state.

In some embodiments, the preset traffic information may include: the real-time color information of the traffic indicator light is at least one of target color information, the estimated change information of the color of the traffic indicator light is target change information, the distance from a pedestrian to an automobile on the road is smaller than a first preset distance, and the distance from a vehicle to the automobile on the road is smaller than a second preset distance. When the acquired real-time color information of the traffic indicator light is the target color information, the current driving state of the automobile needs to be changed currently. For example, when the real-time color of the traffic light is red or yellow, it indicates that the automobile needs to be decelerated and stopped to avoid running the red light; when the real-time color of the traffic indicator light is green, the automobile needs to start and move forward, so that the traffic is prevented from being blocked.

When the obtained estimated change information of the color of the traffic indicator light is the target change information, the current driving state of the automobile needs to be changed at present. For example, when the estimated change information of the color of the traffic light is that the color is to be changed from green to yellow, it indicates that the vehicle needs to be decelerated to avoid running the red light; when the estimated change of the color of the traffic indicator light is information, namely the color of the traffic indicator light is changed from red to green, the traffic indicator light indicates that the automobile needs to start and move forward so as to avoid blocking traffic.

When the distance between the pedestrian and the automobile on the road is smaller than a first preset distance or the distance between the vehicle and the automobile on the road is smaller than a second preset distance, the current driving state of the automobile needs to be changed at present. It will be understood that when the distance from the pedestrian to the car on the road is less than the first predetermined distance, or the distance from the vehicle to the car on the road is less than the second predetermined distance, it indicates that the car may collide with the pedestrian or the vehicle, and therefore the car needs to be decelerated to avoid the collision.

Therefore, when the real-time color information of the traffic indicator light is the target color information, the estimated change information of the color of the traffic indicator light is the target change information, the distance from the pedestrian to the automobile in the road is less than the first preset distance, and the distance from the vehicle to the automobile in the road is less than the second preset distance, the virtual image for indicating the driving operation of the driver can be displayed, and the virtual image is used for prompting that the automobile needs to change the current driving state.

In some embodiments, three-dimensional virtual barrier content of a preset color can be displayed on a display component of the vehicle-mounted head-up display device to prompt a driver of the need to change a current driving state, wherein the three-dimensional virtual barrier content can be virtual content with an intercepting effect, such as a three-dimensional stereo wall, a three-dimensional stereo roadblock or a three-dimensional stereo fence. The virtual barrier content can be a virtual barrier image with depth information, and after the virtual barrier content is displayed on the display component, the driver can generate an effect of fusing the virtual barrier content with a real scene, so that the display enhancement effect is realized, the displayed virtual barrier content has a sense of reality, and a better prompt effect is achieved. The preset color may be a vivid color such as red, yellow, or green, and the specific preset color may not be limited in the embodiment of the present application. Compared with the traditional simple prompt, the virtual barrier content is displayed, the AR type display effect is achieved, visual perception can be more visually brought to a driver, and driving safety is improved.

In some embodiments, displaying a virtual image for indicating a driving operation of a driver may further include: the method comprises the steps that a virtual barrier with preset colors is contained in a display assembly of vehicle-mounted head-up display equipment and is sequentially displayed according to a first preset direction and a first preset display speed; or the virtual barrier content displayed in the display assembly of the vehicle-mounted head-up display equipment is cancelled to be displayed in sequence according to a second preset direction and a second preset speed.

In some embodiments, when the road condition information acquired by the vehicle-mounted head-up display device is the first type of preset road condition information, the virtual barrier content with the preset color can be sequentially displayed on the display component according to a first preset direction and a first preset display speed, wherein the first type of preset road condition information may refer to preset road condition information that enables the vehicle to reduce the driving speed or stop driving. It can be understood that displaying the virtual barrier content according to the preset direction and the preset display speed may be that the virtual barrier content is displayed in a manner of filling the display assembly from the direction of the display assembly to the full according to the preset display speed, and the specific first preset direction and the first preset display speed may not be limited in this embodiment of the application, for example, when the color of the traffic light is red, the driver needs to be instructed to reduce the driving speed and stop the driving state, and the red virtual barrier content may be displayed on the display assembly in a manner from bottom to top and at a slow display speed, so that the red virtual barrier content displays a slow rising effect.

In some embodiments, the first preset display speed may be determined according to real-time traffic information, for example, the distance between an automobile and a traffic light, the distance between an automobile and a vehicle ahead, or the like, and when the distance is smaller, the first preset display speed may be higher, so as to display the virtual barrier content at a faster speed; when the distance is greater, the first preset display speed may be smaller, and the virtual barrier content may be displayed at a slower speed. The first preset display speed may also be a preset fixed speed value, and the vehicle-mounted head-up display device may determine a time point for displaying the virtual barrier content according to the real-time traffic information, for example, when the distance between the vehicle and the traffic light is less than the threshold, the virtual barrier content may be displayed according to the first preset direction and the first preset display speed.

When the road condition information acquired by the vehicle-mounted head-up display device is the preset road condition information of the second type, the display of the virtual barrier content of the preset color displayed on the display assembly can be cancelled in sequence according to the second preset direction and the second preset display speed, wherein the preset road condition information of the second type can refer to the preset road condition information enabling the automobile to enter a driving state. It can be understood that the sequentially canceling the display of the virtual barrier content according to the preset direction and the preset display speed may be to cancel the display of the virtual barrier content in a manner that the virtual barrier content sequentially disappears from the direction of the display assembly according to the preset speed, and the specific display direction and the preset speed may not be limited in this embodiment of the application.

In some embodiments, the second preset display speed may be determined according to real-time traffic information, for example, the second preset display speed may be determined according to a change time of a color of a traffic light, and when the change time of the color of the traffic light changing from a current color to a next color is shorter, the second preset display speed may be higher, and the display of the content of the virtual barrier may be cancelled at a higher speed; when the change time of the traffic light from the current color to the next color is long, the second preset display speed may be small, and the display of the virtual barrier contents is cancelled at a slow speed. The second preset display speed may also be a preset fixed speed value, and the vehicle-mounted head-up display device may determine a time point for canceling the display of the virtual barrier content according to the real-time traffic information, for example, when a change time of the traffic indicator light changing from the current color to the next color is less than a time threshold, the virtual barrier content may be canceled according to the second preset direction and the second preset display speed.

In some embodiments, when the real-time color information of the traffic indicator light is the target color information, the virtual barrier content of the preset color can be displayed on the display element of the vehicle-mounted head-up display device. Specifically, when the color of the traffic light is red, the red virtual barrier content can be displayed on the display component; the display device may display the yellow virtual barrier content when the traffic light is yellow.

When the estimated change of the color of the traffic indicator light is the target change, the virtual barrier with the preset color is contained in the display assembly of the vehicle-mounted head-up display device and is sequentially displayed according to the preset direction and the preset display speed, or the virtual barrier content displayed in the display assembly of the vehicle-mounted head-up display device is sequentially canceled to be displayed according to the preset direction and the preset speed. Specifically, when the color of the current traffic light is red, the current display component may display red virtual barrier content, and when the estimated change of the color of the traffic light is that the color of the traffic light is to be changed from red to green, the red virtual barrier content may be sequentially cancelled from being displayed in the above manner, so that the driver knows that the color of the red light is to be changed into green, and is ready to control the automobile to start and advance. When the color of the current traffic indicator light is green and the estimated change of the color of the traffic indicator light is changed from yellow to green, the yellow virtual barrier contents can be sequentially displayed according to the mode, so that a driver knows that the green light is about to be changed into the yellow light, and the automobile is controlled to decelerate.

The virtual barrier content with the preset color can be displayed on the display component when the distance from the pedestrian to the automobile in the road is smaller than a first preset distance or the distance from the vehicle to the automobile in the road is smaller than a second preset distance. For example, red virtual barrier content may be displayed to prompt the driver to slow down. In addition, when the distance from the pedestrian to the automobile is smaller than a first preset distance, or the distance from the vehicle in the road to the automobile is smaller than a second preset distance, the color depth of the content of the virtual barrier can be dynamically adjusted according to the specific distance from the pedestrian to the automobile or the specific distance from the automobile to the automobile, for example, the smaller the distance from the pedestrian to the automobile or the distance from the automobile to the automobile, the deeper the content of the virtual barrier is, so as to have a better prompt effect for the user.

Of course, the manner of displaying the virtual image for instructing the driving operation of the driver is not limited in the present application, and may be adjusted according to the specific needs and the preference of the user.

Step S240: and adjusting the light transmittance of the display component according to the preset frequency.

In some embodiments, a display assembly of an in-vehicle heads-up display device may be provided with electrochromic functionality. The display element may be an optical element made of a material having an electrochromic function, and may have an electrochromic function. The display module may be a general optical element having an electro-optical function, and may have an electro-chromic function. The electrochromic function refers to a function in which the color or transparency can be changed reversibly and stably under the action of an applied voltage or electric field.

When the acquired road condition information of the road where the automobile is located is the preset road condition information, the light transmittance of the display assembly can be adjusted according to the preset frequency while the virtual image used for indicating the driving operation of the driver is displayed, so that the light transmittance of the display assembly is dynamically changed, and a better indication effect is achieved for the driver. For example, the light transmittance of the display assembly can be controlled to change from high to low or from low to high, so that a user can observe the virtual image and the light transmittance of the display assembly, and a good indication effect is achieved.

In some embodiments, in order to enable a driver to better see the virtual image displayed by the vehicle-mounted head-up display device, the light transmittance of the display assembly can be adjusted according to the preset frequency according to the environment information of the vehicle-mounted head-up display device.

Further, when the road condition information that on-vehicle head-up display equipment obtained is for predetermineeing road condition information, can acquire the environmental information that on-vehicle head-up display equipment is located to according to predetermineeing the luminousness to the target luminousness of frequency adjustment display module.

Wherein, the environmental information of the vehicle-mounted head-up display device can include: the system comprises the environment light intensity of the environment where the vehicle-mounted head-up display device is located, the environment scene where the vehicle-mounted head-up display device is located and weather information of the environment where the display device is located. Of course, the specific environment information of the vehicle-mounted head-up display device is not limited in the embodiment of the present application, and may also include other environment information, for example, visibility of the environment where the vehicle-mounted head-up display device is located, where the visibility refers to a maximum distance that a person with normal vision can recognize a target object from a background. In the embodiment of the application, the environment information of the vehicle-mounted head-up display device may be obtained by detecting a sensor of the display device, or may be obtained by other electronic devices. The specific acquisition mode is not limited in the embodiments of the present application.

After the environmental information where the vehicle-mounted head-up display equipment is located is acquired, the light transmittance of the display assembly can be adjusted according to the environmental information, and the adjusted light transmittance of the display assembly is the target light transmittance corresponding to the environmental information.

Further, the vehicle-mounted head-up display device may store therein a correspondence between the environmental information and the light transmittance of the display assembly. When the light transmittance of the display assembly is adjusted according to the environmental information, the vehicle-mounted head-up display equipment can read the corresponding relation, and then the target light transmittance corresponding to the environmental information where the vehicle-mounted head-up display equipment is located is obtained. By adjusting the driving parameters of the driving circuit for driving the display module, the transmittance of the display module can be adjusted to the target transmittance.

When the vehicle-mounted head-up display equipment displays the virtual image, the light transmittance of the display assembly of the vehicle-mounted head-up display equipment is adjusted to be the target light transmittance corresponding to the environment information of the environment where the vehicle-mounted head-up display equipment is located according to the preset adjustment, the light transmittance of the display assembly can be dynamically changed, a good indication effect is achieved for a driver, the ambient light which penetrates through the display assembly and enters the eyes of people can be reduced, and the display effect of the virtual image is improved.

As an embodiment, the environment information of the vehicle-mounted head-up display device may include an illumination intensity of an environment in which the vehicle-mounted head-up display device is located. The vehicle-mounted head-up display device can store a plurality of illumination intensity levels, namely, the illumination intensity levels are stored in a manner of being divided into a plurality of illumination intensity levels from low to high. For example, the first rank is set to 0 to 500Lx (lux), the second rank is set to 500Lx to 750Lx, the third rank is set to 750Lx to 1000Lx, the fourth rank is set to 1000Lx to 1500Lx, the fifth rank is set to 1500Lx to 2000Lx, the sixth rank is set to 2000Lx to 3000Lx, the seventh rank is set to 3000Lx to 5000Lx, the eighth rank is set to 5000Lx or more, and the 8 ranks are divided from low to high. Therefore, according to the divided illumination intensity levels, a target illumination intensity level corresponding to the illumination intensity of the environment where the vehicle-mounted head-up display device is located can be obtained, and according to the target illumination intensity level, the light transmittance of the vehicle-mounted head-up display device is adjusted to be the target light transmittance corresponding to the target illumination intensity level according to the preset frequency. Each of the illumination intensity levels may correspond to a transmittance, that is, different illumination intensity levels correspond to different transmittances of the display elements, and the transmittances of the display elements corresponding to the illumination intensities at the same illumination intensity level are the same.

Further, the light transmittance corresponding to the above-mentioned level of the light intensity may be set in such a manner that the higher the level of the light intensity, the lower the light transmittance. That is, the higher the illumination intensity level corresponding to the illumination intensity of the environment in which the in-vehicle head-up display device is located, the lower the light transmittance of the display assembly is required, and thus the lower the light transmittance of the display assembly may be. When the illumination intensity of the environment in which the vehicle-mounted head-up display device is located is high, the irradiation of the ambient light makes the ambient light which penetrates through the display module and enters the human eyes more, and the influence on the human eyes of the user and the display content of the display module is large. Therefore, when the illumination intensity is higher, that is, the target illumination intensity level corresponding to the illumination intensity is higher, the target light transmittance of the adjusted display assembly is lower, so that the light transmittance of the display assembly is reduced, and ambient light is prevented from entering human eyes of a user; conversely, the smaller the illumination intensity is, that is, the lower the target illumination intensity level corresponding to the illumination intensity is, the higher the target transmittance of the adjusted display module is. Therefore, after the light transmittance of the display assembly of the vehicle-mounted head-up display device is adjusted according to the mode, the amount of ambient light which is transmitted through the display assembly of the vehicle-mounted head-up display device and enters human eyes of a user can be reduced, the amount of the ambient light which is transmitted through the display assembly of the vehicle-mounted head-up display device and is used for observing the virtual image displayed by the vehicle-mounted head-up display device to the user is reduced, and the prompt effect on the driver is improved.

The application provides a display method, through the driving state that detects the car, when the car is the driving state, acquire the colour of traffic light, the prediction of traffic light's colour changes, the road conditions information of pedestrian apart from the distance of car and vehicle apart from the distance of car in the road, and when acquireing preset road conditions information, show the virtual image that is used for instructing driver's driving operation, and the display method of virtual image is provided, in addition, adjust the luminousness of display module simultaneously, thereby can be when road conditions information is preset road conditions information, play better suggestion effect to driver's driving operation, avoid the traffic accident and hinder the emergence of traffic.

Referring to fig. 7, another embodiment of the present application provides a display method applicable to a vehicle-mounted head-up display device, where the method may include:

step S310: the driving state of the automobile is detected.

In some embodiments, the content of step S310 may refer to the content of the above embodiments, and is not described herein again.

Step S320: and when the automobile is in a driving state, acquiring the road condition information of the road where the automobile is located in real time.

In some embodiments, the traffic information of the road on which the car is located includes real-time color information of traffic lights in the road. The real-time acquisition of the road condition information of the road where the automobile is located may include:

acquiring navigation information of an automobile in real time; and acquiring real-time color information of the traffic indicator lamp in the road based on the navigation information. When the automobile runs, the navigation information of the automobile can be acquired in real time, and the navigation information comprises the positioning information of the automobile. According to the positioning information of the automobile, the information of the traffic indicator light corresponding to the positioning information can be obtained from the related server, so that whether the traffic indicator light exists on the road where the automobile is located or not and the real-time color of the traffic indicator light are obtained.

Step S330: and when the road condition information is preset road condition information, judging whether the automobile needs to change the driving state or not according to the navigation information.

In some embodiments, when the acquired traffic information is the preset traffic information, whether the current driving state of the vehicle needs to be changed or not may be determined according to the acquired navigation information. Specifically, the driving route of the vehicle can be acquired according to the navigation information of the vehicle, and whether the driving state of the vehicle needs to be changed in the driving route in the navigation information is judged according to the acquired road condition information.

Step S340: if the automobile needs to change the driving state, a virtual image for indicating the driving operation of the driver is displayed.

In some embodiments, if it is determined that the vehicle needs to change the driving state in the driving route in the navigation information according to the acquired road condition information, a virtual image indicating the driving operation of the driver may be displayed. For example, when the positioning information of the automobile is at the intersection, the color of the traffic indicator light in the left turning direction is green, and the color of the traffic indicator light in the straight walking direction is red, if the driving route in the navigation information needs to be turned left, the virtual image is not displayed, and if the driving route in the navigation information needs to be turned straight, the virtual image is displayed to prompt the driver to stop for waiting; and if the driving route in the navigation information needs to be turned left, displaying a virtual image to prompt the driver to stop for waiting, and if the driving route in the navigation information needs to be turned straight, not displaying the virtual image.

In one embodiment, the on-vehicle heads-up display device may include a second camera for capturing an in-vehicle image of the automobile in addition to the first camera for capturing an image of the road in front of the automobile. It will be appreciated that the in-vehicle image captured by the second camera may be an in-vehicle image at a viewing angle, for example, an in-vehicle image taken at a viewing angle toward the driver. The images outside the automobile collected by the second camera can be stored as video images for monitoring in the automobile.

The vehicle-mounted head-up display equipment can acquire the in-vehicle image which is acquired through the second camera and contains the driver, acquires the behavior content of the driver according to the in-vehicle image, and can output prompt information for prompting the driver when the behavior content is preset content. The behavior content of the driver may include head movement, eye closing, gaze direction, hand movement, and mouth movement of the driver, among others. The preset content may be a behavior that a driver is dangerous to drive, for example, when the eyes of the driver are closed for more than a set time, the driver is tired to drive, for example, when the gaze direction of the driver is not the forward direction of the automobile, the driver does not pay attention to the content of the forward direction, for example, when the mouth of the driver moves for a long time, the driver is in an alternating state for a long time. Of course, the specific content of the behavior and the preset content may not be limited in the embodiments of the present application.

In one embodiment, the vehicle-mounted head-up display device may acquire driving data of an automobile, and transmit the road condition information, the driving data, and the behavior content to the server for storage, where the driving data may include a driving route, navigation information, and a driving speed of a driver, and the specific driving data may not be limited in this embodiment of the application. And sending the road condition information, the driving data and the behavior content to a server so that the server stores the road condition information, the driving data and the behavior content as intelligent driving data of the driver, thereby realizing the acquisition of the intelligent driving data of the driver.

According to the display method, the driving state of the automobile is detected, when the automobile is in the driving state, the real-time color of the traffic indicator lamp is obtained through the navigation information of the automobile, when the road condition information is preset road condition information, whether the driving state of the automobile needs to be changed or not is judged according to the navigation information, and when the driving state of the automobile needs to be changed is judged, the virtual image used for indicating the driving operation of a driver is displayed, so that the better indication effect of the driving operation of the driver is achieved.

Referring to fig. 8, a block diagram of a display device 400 provided in the present application is shown. The display device 400 is applied to an on-vehicle head-up display apparatus, and the display device 400 includes: a status detection module 410, a road condition acquisition module 420 and a prompt display module 430. The state detection module 410 is used for detecting the driving state of the automobile; the road condition detection module 420 is configured to obtain road condition information of a road where an automobile is located in real time when the automobile is in a driving state; the prompt display module 430 is configured to display a virtual image for indicating a driving operation of a driver when the road condition information is the preset road condition information, where the virtual image is used to prompt that the vehicle needs to change the current driving state.

In some embodiments, the traffic information comprises: at least one of real-time color information of a traffic indicator lamp in the road, estimated change information of the color of the traffic indicator lamp, distance information of a pedestrian in the road from an automobile and distance information of a vehicle in the road from the automobile; the preset road condition information comprises the following steps: the real-time color information of the traffic indicator light is at least one of target color information, the estimated change information of the color of the traffic indicator light is target change information, the distance from a pedestrian to an automobile on the road is smaller than a first preset distance, and the distance from a vehicle to the automobile on the road is smaller than a second preset distance.

In some embodiments, the prompt display module 430 may be specifically configured to: displaying virtual barrier content of a preset color on a display component of the vehicle-mounted head-up display device.

Further, the prompt display module 430 may be further specifically configured to: the method comprises the steps that a virtual barrier with preset colors is contained in a display assembly of vehicle-mounted head-up display equipment and is sequentially displayed according to a first preset direction and a first preset display speed; or the virtual barrier content displayed in the display assembly of the vehicle-mounted head-up display equipment is cancelled to be displayed in sequence according to a second preset direction and a second preset speed.

In some embodiments, a display assembly of an in-vehicle heads-up display device is provided with electrochromic functionality. Referring to fig. 9, the display device 400 may further include: a color cue module 440. The color prompt module 440 is configured to adjust the transmittance of the display module according to a preset frequency when the road condition information is the preset road condition information.

In some embodiments, the traffic information may include the color of traffic lights in the road. As a manner, the road condition obtaining module 420 may be specifically configured to: acquiring a road image of a road in front of an automobile in real time; when the fact that the road image contains the traffic indicator light is detected, the image characteristics of the traffic indicator light are extracted, and the real-time color information of the traffic indicator light in the road is determined according to the image characteristics. As another mode, the road condition obtaining module 420 may also be specifically configured to: acquiring navigation information of an automobile in real time; and acquiring real-time color information of the traffic indicator lamp in the road based on the navigation information.

In some embodiments, the prompt display module 430 may be specifically configured to: when the road condition information is preset road condition information, judging whether the automobile needs to change the driving state or not according to the navigation information; if the vehicle needs to change the driving state, a virtual image indicating the driving operation of the driver is displayed.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling. In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

To sum up, the scheme that this application provided is applied to on-vehicle head-up display equipment, through the driving state that detects the car, when the car is the driving state, acquires the road conditions information of car place road in real time, when the road conditions information who acquires is for predetermineeing road conditions information, shows the virtual image of instructing driver's driving operation, and the virtual image is used for the suggestion car and needs to change current driving state to can realize the intelligent suggestion to driver among the driving process, promote driving safety.

In one embodiment, the present application provides a device control method, which is applicable to a head-mounted display device that may include a device body and a display component having an electrochromic function. A state of the head mounted display device may be detected, which may include, but is not limited to, an undisplayed content state, a displayed content state, a worn state, a non-worn state, and the like. When the head-mounted display device is in a preset state, the environment information where the head-mounted display device is located can be acquired, and the preset state can be a display content state, a wearing state and the like. The environment information may include illumination intensity of ambient light of an environment in which the head-mounted display device is located, an environmental scene in which the head-mounted display device is located, and weather information of the environment in which the head-mounted display device is located. After the environmental information that the head-mounted display device is located is obtained, the head-mounted display device can adjust the light transmittance of the display assembly according to the environmental information, and the light transmittance of the display assembly is adjusted to be the target light transmittance corresponding to the environmental information.

In one embodiment, the environment information of the head-mounted display device may include the illumination intensity of the environment where the head-mounted display device is located, and multiple illumination intensity levels may be stored, that is, the illumination intensity may be divided into multiple illumination intensity levels from low to high and the like for storage. The head-mounted display equipment can acquire a target illumination intensity grade corresponding to the illumination intensity of the environment where the head-mounted display equipment is located, and adjust the light transmittance of the display assembly to the target light transmittance corresponding to the target illumination intensity grade according to the target illumination intensity grade, wherein different illumination intensity grades can correspond to different light transmittances of the display assembly. Further, the light transmittance corresponding to the above-mentioned level of the light intensity may be set in such a manner that the higher the level of the light intensity, the lower the light transmittance.

In one embodiment, the head-mounted display device may obtain a target driving parameter corresponding to a target illumination intensity level according to a pre-stored correspondence between the illumination intensity level and the driving parameter, where the driving parameter includes at least one of a driving voltage value, a driving current value, and the like. The head-mounted display equipment can store various driving parameters corresponding to the driving circuit of the display component, and the light transmittance of the display component is different when the driving circuit works according to different driving parameters. For example, the larger the driving voltage value and/or driving current value, the darker the color of the display element, i.e. the lower the light transmittance of the display element. It can be understood that the relationship between the driving parameter and the transmittance depends on the material of the display module, and the driving parameters corresponding to different transmittances can be set and stored according to the color change condition of the material of the display module under the driving of voltage and/or current.

And the head-mounted display equipment acquires a target drive parameter corresponding to a target illumination intensity grade of the illumination intensity of the environment where the head-mounted display equipment is located according to the corresponding relation between the illumination intensity grade and the drive parameter. And then, adjusting the driving parameters of the driving circuit to target driving parameters, namely controlling the driving circuit to work according to the target driving parameters, so that the driving circuit drives the display component, and the light transmittance of the display component is the target light transmittance under the driving of the driving circuit.

In one embodiment, the environment information may further include an environment scene in which the head-mounted display device is located, where the environment scene is scene information of an environment in which the head-mounted display device is located, for example, the environment scene in which the head-mounted display device is located may be an indoor scene or an outdoor scene. The head-mounted display equipment can acquire an image of the environment where the head-mounted display equipment is located through the image acquisition device, and then the environment image is identified according to the acquired environment image of the environment where the head-mounted display equipment is located, so that the environment information where the head-mounted display equipment is located is obtained.

In one embodiment, when the environmental scene is an indoor scene, the head-mounted display device may obtain a first target transmittance corresponding to a target illumination intensity level in the indoor scene, and adjust the transmittance of the display assembly to the first target transmittance. When the environment scene is an outdoor scene, the head-mounted display device can acquire a second target light transmittance corresponding to the target illumination intensity level in the outdoor scene, and adjust the light transmittance of the display assembly to the second target light transmittance, wherein the second target light transmittance can be smaller than the first target light transmittance.

In one embodiment, the environmental information may also include weather information, i.e., weather information for the environment in which the head-mounted display device is located. The weather information of the environment where the head-mounted display device is located can be acquired from a server for monitoring the weather information. The weather information may be a weather state of an environment where the head-mounted display device is located, and may include, but is not limited to, a cloudy day, a rainy day, or a sunny day.

The head-mounted display device can acquire a third target light transmittance corresponding to the target illumination intensity level under the condition of the weather information, and adjust the light transmittance of the display assembly to the third target light transmittance. As an embodiment, the third target transmittance of the display module corresponding to the same illumination intensity may be sequentially increased in the order of sunny days, cloudy days and rainy days, that is, under the condition of the same illumination intensity, the third target transmittance of the display module in sunny days, the third target transmittance of the display module in cloudy days and the third target transmittance of the display module in rainy days are sequentially increased.

The head-mounted display device can synthesize a plurality of different environmental information and adjust the light transmittance of the display component. The head-mounted display device can determine a target illumination intensity grade according to the illumination intensity, and then adjust the light transmittance of the display assembly to the target light transmittance corresponding to the target illumination intensity grade according to other information except the illumination intensity in the environment information where the head-mounted display device is located, so that the light transmittance of the display assembly corresponds to the other information in the environment information.

In one embodiment, the head-mounted display device may be used for displaying the captured image of the drone, i.e., the captured image captured by the drone through the camera is transmitted back to the head-mounted display device for display. The user can be when controlling unmanned aerial vehicle flight, directly see the picture that unmanned aerial vehicle shot through the head-mounted display device that wears, and still can see the position at unmanned aerial vehicle place of control simultaneously through the display module, need not frequently to bow, look over the shooting picture and the unmanned aerial vehicle position of transmission back-up, can reduce the emergence of unmanned aerial vehicle accident, and more convenient.

Wear the shooting image that display device obtained unmanned aerial vehicle and sent, when showing the shooting image, can acquire the environmental information that is located at present to adjust the luminousness to the display module who wears display device, can reduce the influence of ambient light to the display effect who wears display device, so that the user sees unmanned aerial vehicle in the real scene clearly.

In one embodiment, when the head-mounted display device is worn on the head of the user, the light transmittance of the display assembly can be adjusted according to the posture information of the head-mounted display device. The head-mounted display device can detect the posture information, adjust the light transmittance of the display assembly according to the posture information, and implement adjustment on the target light transmittance according to the posture information. When the posture of the head-mounted display device is detected to be the downward posture of the head-mounted display device, the influence of the ambient light on the display effect of the head-mounted display device is small, so that the light transmittance of the display assembly does not need to be too low, and the light transmittance of the display assembly can be increased by a certain size. On the contrary, when the posture of the head-mounted display device is detected to be the upward posture of the head-mounted display device, the influence of the ambient light on the display effect of the head-mounted display device is large, so that the light transmittance of the display assembly cannot be too high, and the light transmittance of the display assembly can be reduced by a certain size.

In one embodiment, the head-mounted display device can further obtain the distance and the position relationship of the target real object relative to the head-mounted display device, and adjust the light transmittance of the display assembly according to the distance and the position relationship. The light transmittance of the display assembly can be adjusted according to the relation that the farther the distance and the position of the target object relative to the head-mounted display device are, the lower the light transmittance of the display assembly is. In foretell application scene, target object in kind is unmanned aerial vehicle, can be through fixing a position unmanned aerial vehicle, and obtains the relative head-mounted display device's of unmanned aerial vehicle distance and position, and when unmanned aerial vehicle was more far away or more high, then the luminousness of the display module who wears display device was lower.

The device control method provided by the application comprises the steps that the display state of the head-mounted display device is detected, when the head-mounted display device is detected to display a shot image sent by the unmanned aerial vehicle, the light transmittance of the display assembly is adjusted according to the environmental information where the head-mounted display device is located, the light transmittance of the display assembly of the head-mounted display device corresponds to the environmental information, the influence of the environmental light on the head-mounted display device is reduced, and the user can conveniently observe the unmanned aerial vehicle in a real scene through the head-mounted display device. In addition, a scheme for adjusting the light transmittance of the display assembly according to the posture information of the head-mounted display device and a scheme for adjusting the light transmittance of the display assembly according to the distance and the position information of the target real object relative to the head-mounted display device are provided, so that a user can see the real object in a real scene clearly through the display assembly.

Referring to fig. 10, a block diagram of a vehicle-mounted head-up display device according to an embodiment of the present application is shown. The in-vehicle head-up display device 100 may be a head-up display device capable of running an application, such as a smart phone, a tablet computer, an e-book, or the like. The in-vehicle head-up display apparatus 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform a method as described in the aforementioned method embodiments.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the entire in-vehicle head-up display apparatus 100 using various interfaces and lines, performs various functions of the head-up display apparatus 100 and processes data by operating or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The stored data area may also store data created by the in-vehicle head-up display apparatus 100 in use, and the like.

The present application provides a computer readable storage medium having stored therein program code that can be invoked by a processor to perform the method described in the method embodiments above. The computer-readable storage medium may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 800 includes a non-volatile computer-readable storage medium. The computer readable storage medium has a storage space for program code for performing any of the method steps of the above-described method. The program code can be read from or written to one or more computer program products. The program code may be compressed, for example, in a suitable form.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A display method is characterized by being applied to an on-vehicle head-up display device and comprising the following steps:

detecting the driving state of the automobile;

when the automobile is in a driving state, acquiring road condition information of a road where the automobile is located in real time, wherein the road condition information comprises real-time color information of a traffic indicator lamp in the road and estimated change information of the color of the traffic indicator lamp;

when the road condition information is preset road condition information, displaying virtual barrier content with preset colors on a display assembly of the vehicle-mounted head-up display equipment, wherein the virtual barrier content is used for prompting that the vehicle needs to change the current driving state, the preset road condition information comprises that real-time color information of the traffic indicator lamp is target color information and estimated change information of the color of the traffic indicator lamp is target change information, the target color information at least comprises red and yellow, and the preset colors correspond to the target color information;

the displaying of virtual barrier content of a preset color on a display component of the vehicle-mounted head-up display device comprises:

when the color of the traffic light is red, displaying red virtual barrier contents in the display assembly, and when the estimated change information of the color of the traffic light is that the color of the traffic light is changed from red to green, sequentially canceling the display of the red virtual barrier contents according to a second preset direction and a second preset speed;

and when the color of the traffic indicator light is green and the estimated change of the color of the traffic indicator light is changed from green to yellow, sequentially displaying the yellow virtual barrier contents on the display component according to a first preset direction and a first preset display speed.

2. The method as claimed in claim 1, wherein the traffic information further comprises: at least one of distance information of a pedestrian in the road from the automobile and distance information of a vehicle in the road from the automobile;

the preset traffic information further includes: the distance between the pedestrian and the automobile on the road is smaller than at least one of a first preset distance and the distance between the vehicle and the automobile on the road is smaller than a second preset distance.

3. The method as claimed in claim 1 or 2, wherein the display assembly of the in-vehicle heads-up display device is electrochromic enabled, the method further comprising:

and when the road condition information is preset road condition information, adjusting the light transmittance of the display component according to preset frequency.

4. The method according to claim 1 or 2, wherein the traffic information includes real-time color information of traffic lights in the road, and the acquiring the traffic information of the road where the automobile is located in real time includes:

acquiring a road image of a road in front of the automobile in real time;

when the road image is detected to contain the traffic indicator light, the image characteristics of the traffic indicator light are extracted, and the real-time color information of the traffic indicator light in the road is determined according to the image characteristics.

5. The method according to claim 1 or 2, wherein the traffic information includes real-time color information of traffic lights in the road, and the acquiring the traffic information of the road where the automobile is located in real time includes:

acquiring navigation information of the automobile in real time;

and acquiring real-time color information of the traffic indicator lamp in the road based on the navigation information.

6. The method according to claim 5, wherein when the traffic information is preset traffic information, displaying a virtual image for indicating a driving operation of a driver comprises:

when the road condition information is preset road condition information, judging whether the automobile needs to change the driving state or not according to the navigation information;

displaying a virtual image indicating a driving operation of a driver if the automobile needs to change a driving state.

7. A display apparatus applied to a vehicle-mounted head-up display device, the apparatus comprising: a state detection module, a road condition acquisition module and a prompt display module, wherein,

the state detection module is used for detecting the driving state of the automobile;

the road condition acquisition module is used for acquiring road condition information of a road where the automobile is located in real time when the automobile is in a driving state, wherein the road condition information comprises real-time color information of a traffic indicator lamp in the road and estimated change information of the color of the traffic indicator lamp;

the prompting display module is used for displaying virtual barrier content with a preset color on a display component of the vehicle-mounted head-up display equipment when the road condition information is preset road condition information, the virtual barrier content is used for prompting that the vehicle needs to change the current driving state, the preset road condition information comprises that the real-time color information of the traffic indicator lamp is target color information and the estimated change information of the color of the traffic indicator lamp is target change information, the target color information at least comprises red and yellow, and the preset color corresponds to the target color information;

the prompt display module is specifically configured to:

when the color of the traffic indicator light is red, displaying red virtual barrier contents in the display assembly, and when the estimated change information of the color of the traffic indicator light is that the color is changed from red to green, sequentially canceling the display of the red virtual barrier contents according to a second preset direction and a second preset speed;

8. An on-vehicle head-up display apparatus characterized by comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-6.

9. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 6.