CN117250761A

CN117250761A - Display method, display device, storage medium, and vehicle

Info

Publication number: CN117250761A
Application number: CN202311269790.9A
Authority: CN
Inventors: 蒋维衡; 董道明; 邓远博
Original assignee: Nanjing Ruiweishi Technology Co ltd
Current assignee: Nanjing Ruiweishi Technology Co ltd
Priority date: 2023-09-28
Filing date: 2023-09-28
Publication date: 2023-12-19

Abstract

The present disclosure relates to the field of projection display technologies, and in particular, to a display method, a display device, a storage medium, and a vehicle. The display area projected on the transparent surface is divided into a first display area which is easy to cause display problems and a second display area which is not easy to cause display problems, and different display strategies are adopted for display elements in the first display area and the second display area respectively so as to avoid abnormal display of the display elements caused by double images, blurring and the like. According to the method and the device, the problem that display effects are affected due to the fact that display elements are double-image, fuzzy and the like can be avoided, and viewing experience of a user is improved.

Description

Display method, display device, storage medium, and vehicle

Technical Field

The present disclosure relates to the field of projection display technologies, and in particular, to a display method, a display device, a storage medium, and a vehicle.

Background

The HUD (Head Up Display) is a brand new way of realizing vehicle-mounted Display by using reflection on a vehicle windshield, and specifically, a light machine of the HUD Display device emits Display light, and the Display light is projected on the windshield through a corresponding optical lens to generate a corresponding virtual image, so that an enhanced Display effect is formed with the real world outside the windshield. However, with the increase of the Field of View (FOV), the larger projection area makes the light path more difficult to control, so that the display elements are easy to generate double images, blur, and other display problems, and accordingly the display effect is reduced, the display elements cannot be identified, and the viewing experience of the user is affected.

Disclosure of Invention

The purpose of the application is to provide a display method, display equipment, a storage medium and a vehicle, which solve the technical problems that display elements in a projection range in the prior art are abnormal in display such as ghosts and blurs which cannot be overcome, and the viewing experience of users is affected.

In order to solve the technical problems, the following technical scheme is adopted.

In a first aspect, the present application provides a display method, including:

the display equipment is provided with a display area in a projection mode on the transparent surface, wherein the display area comprises a first display area and a second display area, the first display area is a projection abnormal area, and the second display area is a projection normal area;

displaying a first display element in the display area, the first display element being configured with a graphic having a tendency to distortion;

the first display element does not display the distortion-prone graphic in response to the first display element being in the first display region.

According to the description, the optional embodiment defines the projected display area as the first display area and the second display area, and avoids the distortion trend graph from appearing in the first display area as much as possible during display, so that the display elements in the whole display area can be ensured to be normally displayed, and the watching effect is improved.

In an optional implementation manner of the first aspect, the display method further includes:

the first display element displays the distortion-prone graphic in response to the first display element being in the second display region.

According to the description, the optional implementation manner ensures that the display elements are displayed in the normal projection area or in the standard display mode, so that the display integrity is improved, and the user experience is enhanced.

In an optional implementation manner of the first aspect, the first display area and the second display area are determined according to a detection calibration in advance.

According to the above description, the optional embodiment flexibly configures the positions of the first display area and the second display area according to the windshield and display equipment conditions of the actual vehicle, and accurately divides the area which is easy to generate ghost and blur and the area which is not easy to generate ghost and blur through detection calibration.

In an optional implementation manner of the first aspect, the first display area is at an upper portion of the display area, and the second display area is at a lower portion of the display area.

In an optional implementation manner of the first aspect, the first display area is at a lower portion of the display area, and the second display area is at an upper portion of the display area.

According to the above description, the alternative embodiments mainly solve the situations that the curvature variation of the upper and lower positions of the windshield is large, such as the relationship between the direct-view area of the windshield and the joint area of the lower frame, or the relationship between the direct-view area of the windshield and the joint area of the upper frame.

In an optional implementation manner of the first aspect, the first display area is at a left part of the display area, and the second display area is at a right part of the display area.

In an optional implementation manner of the first aspect, the first display area is at a right part of the display area, and the second display area is at a left part of the display area.

According to the above description, the alternative embodiments mainly solve the situations that the curvature of the left and right positions of the windshield varies greatly, such as the relationship between the direct-view area of the windshield and the joint area of the left frame, or the relationship between the direct-view area of the windshield and the joint area of the right frame.

In an optional implementation manner of the first aspect, the first display area is at a specific position in the middle of the display area, and the second display area is around the first display area.

In an optional implementation manner of the first aspect, the second display area is at a specific position in the middle of the display area, and the first display area is around the second display area.

According to the description, the optional embodiment mainly solves the problem that the projection of a partial area is abnormal due to the design, production and installation deviation of a windshield or an optical lens, and the first display area and the second display area have certain inner and outer surrounding structures.

In an optional implementation manner of the first aspect, the first display element does not display the distortion-prone graph includes:

the distortion-prone pattern is removed in the first display element.

According to the above description, the alternative embodiment directly disappears the graphic element which is prone to ghost and blur in the first display area, so that it is not affected by display instability in the first display area. Alternatively, distortion tendency patterns conforming to the definition standard may be stored in advance, and when the distortion tendency patterns are present in the display element and in the first display area, the distortion tendency patterns are recognized and hidden for display.

The distortion-prone pattern is converted into a distortion-free-prone pattern.

In an alternative embodiment of the first aspect, said converting said distortion prone pattern into a distortion free prone pattern comprises:

at least one of thickening, amplifying, filling and distributing the distortion trend pattern is converted into a distortion trend-free pattern.

According to the above description, the alternative embodiment converts the distortion-prone pattern into the distortion-free-prone pattern by the pattern processing so that no projection abnormality such as ghost or blur is generated by being affected by the first display area. Alternatively, the distortion-prone image is distorted in the projection process due to the small lines or small size, so that the distortion-prone image can be thickened, enlarged, or the pattern of the distortion-prone image can be filled, distributed and recombined to be wider or thicker.

In an optional implementation manner of the first aspect, the displaying the first display element in the display area includes:

in response to the first display element moving from the second display area to the first display area, the distortion-prone pattern in the first display element is gradually not displayed or is gradually converted into a corresponding distortion-free-prone pattern according to the moving speed of the first display element; or (b)

In response to the first display element moving from the first display area to the second display area, the distortion tendency pattern configured by the first display element is gradually displayed or gradually restored from the corresponding distortion tendency-free pattern to the distortion tendency pattern according to the moving speed of the first display element.

According to the description, the jump feeling generated by the content change of the display element is solved by the alternative implementation mode through the animation transition mode, and the viewing experience of a user is improved.

the first display element moves in the display area according to a first track;

in response to the first trajectory including a trajectory that passes through the first display region, the first trajectory is re-planned to reduce or avoid time to pass through the first display region.

According to the above description, the display element in the alternative embodiment moves according to a certain track, for example, the warning icon moves according to the position of the vehicle in front, and the display time of the display element in the first display area is avoided as much as possible through the re-planning of the track, so that the time occupation ratio of abnormal display of the display element can be reduced, and the corresponding abnormal display problem can be easily ignored by the user during watching.

the number of display elements distributed in the second display area is greater than the number of display elements distributed in the first display area.

According to the description, the optional implementation manner performs overall layout planning on the projection display content according to the first display area and the second display area, so that the display elements are displayed preferentially in the second display area to the maximum extent, and unnecessary abnormal display problems are reduced.

In a second aspect, the present application provides a display device comprising a memory, a processor and a computer program stored on the memory and running on the processor, the processor implementing the steps of the display method of the first aspect when executing the computer program.

In a third aspect, the present application provides a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the display method of the first aspect.

In a fourth aspect, the present application provides a vehicle comprising the display device of the second aspect or the computer readable storage medium of the third aspect.

Compared with the prior art, the display area projected on the transparent surface is divided into the first display area easy to cause display problems and the second display area free from display problems, and different display strategies are adopted for display elements in the first display area and the second display area respectively so as to avoid abnormal display of the display elements, such as double images, blurring and the like. According to the method and the device, the problem that display effects are affected due to the fact that display elements are double-image, fuzzy and the like can be avoided, and viewing experience of a user is improved.

Drawings

In order to more clearly illustrate the technical solutions of the present application, the drawings that are used in the description of the technical solutions will be briefly described below. It is obvious that the drawings in the following description are only some examples described in the present application, and that other drawings may be obtained from these drawings without inventive work for a person of ordinary skill in the art.

Fig. 1 is a schematic view of a HUD projection display in some examples of the present application.

Fig. 2 is a schematic view of a display area projected on a transparent surface in some examples of the present application.

Fig. 3 is a schematic diagram of positions of a first display area and a second display area in some examples of the present application.

Fig. 4 is a schematic diagram of positions of a first display area and a second display area in some examples of the present application.

Fig. 5 is a schematic diagram of positions of a first display area and a second display area in some examples of the present application.

FIG. 6 is a schematic diagram of display problems occurring with display elements in some examples of the present application.

FIG. 7 is a schematic diagram of display problems occurring with display elements in some examples of the present application.

FIG. 8 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

Fig. 9 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

FIG. 10 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

FIG. 11 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

FIG. 12 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

Fig. 13 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

Fig. 14 is a schematic diagram of distortion-prone graphics processing in display elements in some examples of the present application.

Fig. 15 is a schematic diagram of display element movement variation in some examples of the present application.

Fig. 16 is a schematic diagram showing element movement variation in some examples of the present application.

Fig. 17 is a schematic diagram of display element movement variation in some examples of the present application.

Fig. 18 is a schematic diagram showing element movement variation in some examples of the present application.

Fig. 19 is a schematic diagram of a HUD display device module in some examples of the present application.

Fig. 20 is a schematic structural diagram of a HUD display device in some examples of the present application.

Fig. 21 is a schematic diagram showing the composition of a HUD display device in some examples of the present application.

Fig. 22 is a schematic view of a projected display in a vehicle in some examples of the present application.

Description of the embodiments

The present application will be described in detail below with reference to the attached drawings, but the descriptions are only examples described in the present application and are not limiting, and all changes in structure, method or function etc. made by those of ordinary skill in the art based on these examples are included in the protection scope of the present application.

It should be noted that in different examples, the same reference numerals or labels may be used, but these do not represent absolute relationships in terms of structure or function. Also, the references to "first," "second," etc. in the examples are for descriptive convenience only and do not represent absolute distinguishing relationships between structures or functions, nor should they be construed as indicating or implying a relative importance or number of corresponding objects. Unless specifically stated otherwise, reference to "at least one" in the description may refer to one or more than one, and "a plurality" refers to two or more than two.

In addition, in representing the feature, the character "/" may represent a relationship in which the front-rear related objects exist or exist, for example, a head-up display/head-up display may be represented as a head-up display or a head-up display. In the expression operation, the character "/" may indicate that there is a division relationship between the front and rear related objects, for example, the magnification m=l/P may be expressed as L (virtual image size) divided by P (image source size). Also, "and/or" in different examples is merely to describe the association relationship of the front and rear association objects, and such association relationship may include three cases, for example, a concave mirror and/or a convex mirror, and may be expressed as the presence of a concave mirror alone, the presence of a convex mirror alone, and the presence of both concave and convex mirrors.

The HUD projection display mainly uses an optical reflection principle, imaging light to be displayed is reflected by a transparent surface to enter human eyes of viewers, the human eyes can observe virtual image information along the opposite direction of the light, correspondingly, the transparent surface can be a windshield of a vehicle, and the windshield serves as a display screen to display navigation information, vehicle speed and the like of the vehicle. As shown in fig. 1, the HUD display device may include at least an optical engine 1, a first mirror 2, a second mirror 3, and the like, wherein the optical engine 1 includes a backlight source and an image source (not shown), the backlight source is used for providing illumination light and adjusting brightness of the illumination light according to control, and for example, the backlight source may be an LED (Light Emitting Diode ), a laser, and the like. The image source adjusts the corresponding display content according to the control under the illumination light provided by the backlight source and projects the display light from the surface of the image source, for example, the image source can be an LCD (Liquid Crystal Display ), a DMD (Digital Micromirror Devices, digital micromirror device), a MEMS (Micro-Electro-Mechanical System, micro Electro-mechanical system) micromirror, an LCOS (Liquid Crystal on silicon ) or the like. The first reflecting mirror 2 and the second reflecting mirror 3 can project the display light projected by the optical machine 1 on the windshield 4, so that the light path customization is realized in a smaller space, different projection display requirements are met, the first reflecting mirror 2 and the second reflecting mirror 3 can be set into concave mirrors, convex mirrors, concave lenses, convex lenses and the like according to the requirements of optical planning, and the surface type of the lens can adopt free curved surfaces. Optionally, at least one of the first mirror 2 and the second mirror 3 may be further adjusted in angle to a certain extent, so as to change the projection position of the display light on the windshield 4, so as to meet viewers with different heights. The display light of the light machine 1 is finally reflected on the windshield 4 of the vehicle to form a virtual image 5, and when the virtual image 5 is observed against the windshield 4, the human eye 6 can feel a certain depth feeling, and the virtual image 5 can be navigation information, vehicle speed and the like as mentioned above just like a real object at a specific distance outside the windshield. It is to be added that the HUD display device may also be provided with a diffuser for the characteristics of the different optotypes, and in some examples fresnel lenses, waveguide optics, diffractive optics, holographic optics, tapered fibers etc. may also be included in the HUD display device.

As shown in fig. 2, the display area 50 is a projection area formed on a transparent surface (such as a front windshield of a vehicle) by a corresponding HUD display device, and display information provided to a viewer may be displayed in the display area 50, and specifically, the display information may include vehicle status information such as a vehicle speed (17 Km/h), a gear (D), and navigation instruction information such as a road speed limit (30), an alert icon (an alert front icon with an exclamation mark), and the like. The display element 501 is located at the upper part of the display area 50, and moves in the display area 50 as required, and a plurality of display elements 502 are located at the lower part of the display area 50, wherein the positions of the display elements 502 are relatively fixed, but the numerical value may change along with the state of the vehicle. With the upgrade of HUD projection display technology, the area of the display area is also increasing, so that more information display content can be carried on the windshield. However, the increase in the display area is associated with optical difficulties, particularly with large variations in the curvature of the partial windshield over the projection range, and the complexity of the optical path transmission results in the inability to take care of the projected display performance at each corner of the display area. In light of the past optical design ideas, there is a need to improve the design of the optical system to eliminate the projection problem existing in the display area, however, the increase of the display area makes it difficult to balance the projection abnormality of the local area by the design adjustment of the whole optical system, and often there is a contradictory occasion in which each other is encountered during the design adjustment. Thus, rather than increasing the difficulty of optical design, taking too long design development time, a solution is sought from the standpoint of display control, and in some examples, the problem of projection anomalies is addressed by controlling the image content in the display elements and the display position in the display area, as will be described below.

As shown in fig. 3 to 5, in the display region 50 formed by projecting the HUD display device onto the windshield, display abnormalities such as double images and blurring are unavoidable due to the design of the internal optical system of the display device and the surface shape of the windshield to be projected. However, from analysis of the results of internal actual development, the position of the projection abnormality tends to be substantially determined after the display device is produced and installed, and the position of the projection abnormality tends to be concentrated in the same area. Correspondingly, the area in which the projection is abnormally concentrated is defined as a first display area, the area in which the designed optical system supports normal display is defined as a second display area, and the first display area and the second display area can be specifically determined through actual detection calibration, and optionally, the optical lens surface type parameter and the projected windshield surface type parameter in the optical system can be comprehensively analyzed. Referring to fig. 3, the display area 50 includes a first display area 51 and a second display area 52, and the first display area 51 and the second display area 52 are vertically distributed, that is, the upper portion of the display area 50 is more prone to display abnormality, for example, may be due to a large change of curvature of the windshield at the upper portion or a deviation between the production and the manufacturing processes corresponding to the optical lens surface type at the upper portion. Alternatively, the first display area 51 may be located at a lower position of the second display area 52. Referring to fig. 4, the first display area 51 and the second display area 52 are distributed laterally, and in this example, the first display area 51 is located at the left side of the second display area 52, that is, projection abnormality is likely to occur when a display element is displayed in the left area of the display area 50. Alternatively, the first display area 51 may be positioned to the right of the second display area 52. Referring to fig. 5, the first display area 51 and the second display area 52 are not uniformly distributed as in the above example, and the position of the first display area 51 in the display area 50 is more random, which may be caused by various deviations from design, production, installation, etc. of a windshield or an optical lens. In this example, the first display area 51 is located at a specific position in the middle of the display area 50, such as the lower left corner and the upper right corner, and the areas of the display area 50 other than the first display area 51 are the second display area 52, and the first display area 51 and the second display area 52 have an inner and outer surrounding structure. Alternatively, the first display area 51 may be a circle around the periphery of the display area 50, and the second display area 52 is entirely located in the middle of the area surrounded by the first display area 51.

Secondly, since the analysis of the results of the actual development is performed internally, projection abnormality is likely to occur not only because the display is performed in the first display area as described above but also because the display element itself constitutes a figure. Accordingly, the graphics composing the display element are divided into a distortion-prone type graphics and a distortion-free type graphics, and the distortion-prone type graphics are different from the distortion-free type graphics in that the graphic elements of the distortion-prone type graphics tend to be finer and the pixels continuously display structures with smaller sizes, such as broken lines, smaller identification symbols, and the like, which may be because the influence proportion of fine information loss in optical transmission on the distortion-prone type graphics is larger, the displayed distortion effect is more obvious. The distortion-free inclined graph can be a structure with large line width and continuously occupies more pixels, such as a solid line, bold large fonts and the like, is not easy to cause abnormal display problems in the projection process, can be also called as a robust graph, has high reliability of graph elements and is little influenced by the outside. The distortion trend type graph and the distortion trend-free graph can be determined in advance according to test results and design experience, the distortion trend type graph contained in the distortion trend type graph can be marked when the display element is configured, and corresponding materials of the display element can have corresponding distortion trend type graph data when the materials are stored in the display equipment and are used for being searched when the display element is called for display. Accordingly, although the first display region is a region in which projection abnormality is likely to occur, no display abnormality occurs in the first display region for the distortion-free tendency pattern, only the distortion-tendency pattern causes display abnormality in the first display region, and the distortion-tendency pattern generally does not cause display abnormality in the second display region. As shown in fig. 6, a circular frame formed by a broken line belongs to a distortion tendency type graphic, and as described above, if displayed in the first display area, a blurring situation shown on the right side easily occurs, which affects the viewing experience of the user, and if important information is displayed in a blurring manner, specific contents cannot be recognized. As shown in fig. 7, in some examples, a circular frame formed by dotted lines is displayed in the first display area, and there is a possibility that display ghost occurs, that is, a circular frame that is originally displayed singly appears when two circular frames are superimposed together, which also affects the viewing experience of the user.

Based on the above-described projection display characteristics, it is possible to control the time at which the distortion-prone pattern does not appear or appears in the first display region. In some examples, to enhance the viewing experience of the user, it may be possible to identify whether a distortion-prone graphic is present in the display element as it is projected to be displayed in the display area, and if a distortion-prone graphic is present and has a significant effect on the presentation and/or content of the display element, it may not be displayed at all, in which case the corresponding display element may be controlled to be displayed in its entirety in the second display area, while in the first display area the distortion-prone graphic may be processed. Accordingly, when the first display element is required to be displayed in the display area according to the display logic of the display device, the position of the first display element in the display area is determined, specifically, the position of the first display element displayed on the image source can be determined according to the relation between the image source display and the projection display, if the first display element is configured to have a distortion tendency pattern and is in the first display area, the distortion tendency pattern in the first display element is processed at this time, so that the first display element does not have the distortion tendency pattern in the first display area. If the first display element moves from the first display area to the second display area or needs to be displayed in the second display area, the first display element completely displays the distortion tendency type graph, and the complete display content of the first display element is maintained.

It will be appreciated that the respective display element has two different display modes in the first display area and the second display area, respectively. As shown in fig. 8, it is assumed that the first display element is an alert icon for prompting the vehicle ahead, and the alert icon is displayed at a corresponding position of the display area following the position of the vehicle ahead. The first display element has a two-part pattern, the exclamation mark part is thicker in the whole part, and belongs to a distortion-free trend pattern, and a triangle frame formed by broken lines is a distortion trend pattern. As described above, when the first display element is in the first display area, the first display element is displayed in the right form, and the triangle frame is hidden from direct display, so that the first display element sees only one clear exclamation mark in the first display area. When the first display element is displayed in the second display area, the first display element can be displayed in a left form, and has an exclamation mark and a triangle frame, so that the whole display effect is very clear and a complete prompt is given to a user.

In some examples, as shown in fig. 9, the first display element is also exemplified by an exclamation mark with a broken triangle frame, and another processing mode is adopted for the graph which does not display distortion tendency in this example. Accordingly, referring to the display form on the right in the figure, when the first display element is displayed in the first display area, the triangle frame of the broken line is not directly removed, but is processed, on one hand, the broken line is filled into a solid line, and on the other hand, the triangle frame of the solid line is further thickened until the requirement of the distortion-free trend type graph is met, namely, the distortion-free trend type graph in the first display element is converted into the distortion-free trend type graph, so that all graph elements of the first display element are not affected by display abnormality in the first display area. And when the first display element is displayed in the second display area, the first display element is still displayed in a left form in the figure, and normal display can be realized according to the display characteristics of the second display area.

In some examples, as shown in fig. 10, the first display element is composed of two parts, a circular frame at the outer periphery and a rectangular frame within the circular frame, respectively, the rectangular frame belonging to the distortion-prone pattern and the circular frame belonging to the distortion-free-prone pattern according to the recognized standard. Therefore, when the first display element is in the first display area, the rectangular frame needs to be processed, in this example, the rectangular frame is individually subjected to the filling processing, and the rectangular frame is filled with the color, which may be a bright-line color such as red or the like, with reference to the display form on the right in the drawing. When the first display element is in the second display area, the rectangular frame is restored to the original hollow frame, such as the left display form in the figure, so as to meet the viewing habit of the user standard.

In some examples, as shown in fig. 11, the first display element is composed of two parts, namely a circular frame on the periphery and a "P" character mark in the circular frame, and accordingly, the circular frame is suitable in size and thickness, and belongs to a distortion-free trend type graph, while the font size of the "P" character mark is slightly smaller, and belongs to a distortion-prone type graph. In this example, referring to the display form on the right in the figure, when the first display element appears in the first display area, the "P" character mark is enlarged so as to be almost filled in the circular frame, and is made to conform to the requirement of the distortion-free trend graph, so that the display of the "P" character mark in the first display area does not occur in the case of abnormal display. While the first display element is displayed in the second display area, the first display element may be displayed in a left form in the figure, and the "P" character is displayed in a standard size.

In some examples, as shown in fig. 12, the first display element represents a navigation indication line attached to a road ahead, and the navigation indication lines are generally displayed in a relatively thin manner, mainly to satisfy the style of navigation, but the entire navigation indication line belongs to a distortion tendency type graph due to the fact that the line is too thin. Accordingly, when the first display element indicates that the road corresponding to the first display area is indicated by a road, the navigation instruction line is thickened in order to reduce the distortion effect of the first display area on the navigation instruction line, and the display form on the right in the figure is referred to. When the road in front of the vehicle is changed along with the running of the vehicle, the navigation indication line is required to be shifted to the second display area, the road corresponding to the second display area is attached to display, at the moment, the first display element can be switched to the left display running in the figure, the navigation indication line is changed back to thinner display, and at the moment, the navigation indication line is consistent with the original style requirement of navigation.

In some examples, as shown in fig. 13, the first display element may also be a virtual guideboard where the vehicle is driven to a specific position, where the virtual guideboard includes corresponding hinting characters, in this example, a rectangular frame imitating the outline of the real guideboard belongs to a distortion-free trend type graph, and the characters displayed on the virtual guideboard are smaller in fonts and belong to distortion-prone type graphs. When the virtual guideboard is required to be positioned on the corresponding road, the virtual guideboard is displayed in the first display area or the second display area, and virtual-real fit is realized with the corresponding road outside the windshield, so that a viewer feels that the virtual guideboard is positioned on the corresponding road like a real guideboard. At this time, the virtual guideboard may be displayed in the first display area, and accordingly, the distortion tendency type graph needs to be processed, and the processing manner may include distribution processing, for example, content summarizing is performed on the hinting characters and then redistribution is performed, and hints with different numbers of characters are displayed, for example, the "front construction slow-down line" is directly converted into the "construction-! And amplifying the corresponding fonts to fill the rectangular frames, so that the prompting characters are converted from the distortion tendency type images to the distortion-free tendency type images, and normal display in the first display area, particularly the display form on the right side in the figure, is realized. If the virtual guideboard is required to be displayed at the road position corresponding to the second display area, the virtual guideboard is displayed in a form of the left side in the figure, and the complete characters are displayed in the corresponding virtual guideboard, so that the prompting content can be more clear. In some examples, the distribution process may also include other forms, such as using different arrangements of graphics or text, or recombining multiple distortion prone graphics into a complete distortion free prone graphics, with reference to the above examples, where the first display element in the second display area uses the default graphical element and the first display element in the first display area uses the distributed graphical element.

In some examples, the first display element is configured with a plurality of distortion trend patterns, the first part of distortion trend patterns are converted into distortion trend-free patterns by adopting a hidden display mode, the second part of distortion trend patterns are processed by combining two different types of modes, and optionally, the second part of distortion trend patterns are also converted into distortion trend-free patterns in different forms by adopting different conversion modes, so that the change of the first display element is fully consistent with the display practice. As shown in fig. 14, the first display element includes two parts of display contents, one part is a circular frame and the other part is a letter, but both of these parts have a problem of size and thus belong to distortion-prone graphics. When the first display element is in the first display area, the two-part distortion-prone graphics are not displayed, respectively, but if both are displayed in a hidden manner, the entire first display element is not present in the first display area. In this example, a hidden display is adopted for the circular frame, and the "stop" word in the circular frame is enlarged to be changed into a distortion-free trend graph, so that the first display element displays a large "stop" word in the first display area as a prompt, such as a display form on the right side of the figure. When the first display element is displayed in the second display area, the display is performed in a form of the left side in the drawing, that is, a conventional signboard display mode.

In the above examples, different graphics elements are mainly displayed at different positions around the display element to satisfy the same display purpose, specifically, the display element displays only the distortion-free graphics in the first display area, does not display the distortion-free graphics, and can simultaneously display the distortion-free graphics and the distortion-free graphics in the second display area. However, the mode of not displaying the distortion-prone pattern, in particular, the mode of converting the distortion-prone pattern into the distortion-free pattern is not limited to the above example, and other modes and arrangements may be adopted. Since the nature of the distortion-free pattern is to use a specific pattern structure to resist the influence in optical transmission, it is within the scope of the present application if the display requirements of the distortion-free pattern can be satisfied in addition to the thickening, amplifying, filling and distribution processes.

In some examples, the first display element is not statically displayed within the display area, but dynamically moves within the display area, i.e., the first display element is not fixedly displayed in the first display area or the second display area, and it is possible to continuously switch between the first display area and the second display area, such as an alarm icon for prompting a vehicle ahead, the distance between the host vehicle and the vehicle ahead determines the position of the first display element, and the position of the first display element is continuously changed along with the running of the vehicle. It is therefore necessary to constantly determine where the first display element is located, for example, to obtain a movement track of the first display element in the display device, which may be related to a specific functional application. Accordingly, based on the movement track of the first display element, not only the current position and the predicted position of the first display element but also the movement speed of the first display element can be obtained, and further, the movement trend of the first display element in the display area can be predicted.

In the example in which the first display element is continuously moved in the display area, the distortion tendency pattern in the first display element is not displayed once the first display element is in the first display area, and the distortion tendency pattern in the first display element is redisplayed once the first display element is switched to the second display area. Accordingly, the display device constantly responds to the position change of the corresponding display element in the projection display process, and the graphic element in the corresponding display element is also switched between different display forms. In some examples, to reduce the abrupt sense of switching the first display element between the first display region and the second display region, the switching display and the switching hidden display of the distortion-prone pattern, the switching between the distortion-prone pattern and the distortion-free pattern, are not jumped, but rather an animation of the transition between the two display forms is used to compensate for the intermediate display form of the switching process. As shown in fig. 15 to 17, taking the example that the first display area 51 is at the upper portion of the display area 50 and the second display area 52 is at the lower portion of the display area 50, the warning icon 503 is displayed on the transparent surface within the range of the display area 50 by projection, and the warning icon 503 is configured to mark a vehicle in front. As described above, in the alert icon 503, the outer broken triangle frame is a distortion tendency pattern, and the middle exclamation mark is a distortion tendency-free pattern, so that the virtual triangle frame is abnormal in display in the first display area 51, and the exclamation mark can be normally displayed in both the first display area 51 and the second display area 52. In this example, the alert icon 503 would move from the second display area 52 to the first display area 51 in accordance with the first trajectory 504, and the alert icon 503 would display the complete graphical element in the second display area 52. As shown in fig. 16, as the alert icon 503 gradually enters the first display area 51 from the second display area 52, the portion entering the first display area 51 will first hide the corresponding triangle frame, and the portion still in the second display area 52 will still retain the display of the triangle frame. As shown in fig. 17, when the warning icon 503 is completely entered into the first display area 51, the triangle frame corresponding to the distortion tendency pattern is completely hidden. Therefore, the display element can be ensured to have no display abnormality on the premise of meeting the display purpose, and the display element can be ensured to smoothly convert the display form in the moving process. Further, the removal speed of the triangle frame is determined according to the moving speed of the warning icon 503 along the first track 504, so that the part entering the first display area 51 can be ensured to be just hidden and displayed, and the rhythm of the whole display is consistent. Alternatively, when the alert icon 503 needs to be moved from the first display area 51 to the second display area 52 according to the first track 504, the reverse process described above may be adopted, and the alert icon 503 may gradually display a triangle frame hidden before according to the moving speed.

In some examples, as shown in fig. 18, in order to improve the dynamic effect of distortion-prone graphic display or hidden display, an additional animation is added in the whole process, for example, a spraying point is arranged in the figure, and rays connected with the spraying point follow the line path of the display or hidden display, so that the actual effect of laser printing or removal is simulated, and the experience feeling of a user is improved. Optionally, the progressive manner of the corresponding display element is not limited to the progressive display or the progressive hidden display in the display or hidden display process, and can be realized by adopting a field entering and exiting manner of transition animation such as fade-in fade-out, random lines and the like according to the moving speed of the display element.

In some examples, the entry of the corresponding display element from the second display region into the first display region may cause the distortion-prone pattern in the display element to be thickened, enlarged, filled, distributed, etc., into a distortion-prone pattern, while the entry of the display element from the first display region into the second display region may instead cause the distortion-prone pattern to be transformed into a distortion-prone pattern. The transition between the distortion-prone and distortion-free graphics can also be demonstrated in an animated transition, and in particular can change from one shape to another over time using shape-filling, while also synchronizing the positions of the corresponding display elements in the first and second display regions.

Since the display performance of the first display area 51 and the adjacent area of the second display area 52 often does not have a large jump, that is, there is a possibility that there is a display abnormality in the position of the second display area adjacent to the first display area, when the corresponding display element moves from the second display area 52 to the first display area 51, the distortion tendency pattern in the display element can be processed in advance, that is, the display element starts to perform the operation of hiding the display or the operation of converting the distortion tendency pattern before moving to the first display area in the second display area, and at this time, the display element does not display the distortion tendency pattern in a part of the second display area. However, the overall change rhythm follows the movement speed of the display element, and the boundary between the first display area and the second display area is basically used as the execution basis of the transitional animation.

In some examples, according to the display characteristics of the first display area and the second display area, the display performance of the second display area is higher than that of the first display area, which means that the whole optical system supports the display of the second display area, so when the display device projects the information to be displayed on the transparent surface, the information to be displayed can be projected on the second display area as much as possible, that is, the number of display elements distributed in the second display area is greater than that of display elements distributed in the first display area, for example, no display elements are projected in the first display area, and all display elements are projected in the second display area. Optionally, in the display control, the distribution of the display elements is further arranged according to the position and the area of the second display area, so that more display elements are arranged as much as possible without feeling crowding. For the display element that has to appear in the first display area, the distortion tendency pattern in the display element may be processed in the manner of the above example, ensuring that normal display can be achieved in the first display area. In some examples, the distortion-prone graphics of the display element may be processed, such as hidden display, by only partially in the first display region, even if the related distortion-prone graphics are still partially in the second display region, or the distortion-prone graphics may be converted into distortion-free-prone graphics, and the processing changes of the corresponding distortion-prone graphics may be supplemented with reference to the transition animation described above.

As described above, for the display elements of static display, as many display elements as possible may be planned into the second display area directly through layout design, in some examples, for the display elements of dynamic movement, the movement track of the display elements may be optimized according to the specific situations of the first display area and the second display area, so that the display elements may not reside in the first display area as much as possible, which may reduce the risk of abnormal display, and may not draw attention of the user when the time occupation ratio is small. Specifically, the first display element moves in the display area according to the first track, then when the first track comprises a track passing through the first display area, the first track is re-planned to be a second track, and the first display element moves in the display area according to the second track, so that the time for the first display element to pass through the first display area is reduced or avoided. It should be noted that, taking the alert icon in the above example as an example, the first track is related to the display function corresponding to the first display element, and the corresponding first track is the positional relationship of the front vehicle relative to the windshield, for example, the navigation indication line, and the corresponding first track is the indication information of the next road segment direction determined according to the navigation information. In this example, the planning of the first track is not only dependent on the attribute of the display application function, but also considers the situation of the first display area and the second display area, that is, the part of the first track passing through the first display area is modified on the premise of not affecting the display application function, the modified second track can not pass through the first display area, or the path passing through the first display area is shorter, for example, an alarm icon can be attached to a vehicle body corresponding to the second display area, and then, for example, the shape contour of the navigation indication line is modified on the premise of not changing the navigation direction so as not to pass through the first display area as much as possible.

As shown in fig. 19, the HUD display device implementing the display method is applied to a vehicle, and can greatly enrich the expression form of the vehicle display and improve the stability of the display. The HUD display device may be powered by the car machine 92 and data, or may be powered by the HUD display device itself and generate data. The HUD display device may specifically include a processor 91, an ethernet interface 901, a CAN (Controller Area Network ) interface 902, a power management module 903, a run memory 904, a storage memory 905, a temperature monitor 906, a motor 907, a backlight 908, an image source 909, a positioning module 910, a radar 911, a camera 912, and the like.

It should be noted that the various modules listed in fig. 19 are merely exemplary descriptions and not limiting in any way, and in some examples, the HUD display device may also include other modules. In addition, the modules described above may be implemented in one or more hardware in different examples, or a single module may be implemented by a combination of a plurality of hardware.

The processor 91 serves as a control center of the HUD display device and includes one or more processing units of any type, including but not limited to a micro control unit, a microcontroller, a DSP (Digital Signal Processor, digital signal control unit), or any combination thereof. The processor 91 is configured to generate an operation control signal according to a computer program, implement control of other modules, and cooperate with the corresponding modules to process acquired or own data, instructions, and the like.

The ethernet interface 901 is a network data connection port for lan communication, and defines a series of software and hardware standards, through which a plurality of electronic devices may be connected together through the ethernet interface 901, and in this example, the processor 91 may interact with the vehicle 92 through the ethernet interface 901, such as sending data to the vehicle 92 or receiving data sent by the vehicle 92.

The CAN interface 902 is a network data connection port of the controller area network, provides a standard bus for a control system and an embedded industrial control in the automobile, and realizes communication interaction between the control nodes, in this example, the processor 91 CAN also interact information with the automobile 92 through the CAN interface 902, and optionally, the processor 91 CAN also connect with other external devices through the CAN interface 902. In some examples, processor 91 may also be provided with a GPIO (General purpose input/output) interface to improve the compatibility of peripheral connections.

The power management module 903 is connected with the vehicle machine 92, and can receive the power provided by the vehicle machine 92, and provide a regulated power supply for each module of the HUD display device, so as to ensure that the processor 91 and each module work under normal voltage supply, and avoid damage under overvoltage.

The running Memory 904 is used for storing computer programs executed by the processor 91, temporarily stored operation data, data exchanged with a storage Memory, and the like, and the running Memory 904 may be a Memory such as an SDRAM (Synchronous Dynamic Random-access Memory).

The storage memory 905 is used for storing resources such as related display content of the HUD display device, and long-term stored running programs and data, and the storage memory 905 may be a memory such as Flash (Flash memory). In some examples, the processor 91 may also provide an interface to access external memory.

The temperature detection 906 is configured to monitor the temperature inside the HUD display device, and may specifically include a plurality of temperature sensors, and since the temperature sensors change with a change in the resistance value along with a change in the temperature, the processor 91 may determine, at a fixed power supply voltage, the resistance value of each temperature sensor at the corresponding temperature according to a voltage change between each temperature sensor and the voltage dividing resistor, so as to reversely push out the temperature at the position where the temperature sensor is located. In some examples, the processor 91 may control a plurality of temperature sensors through the GPIO interface, the plurality of temperature sensors may be disposed at different positions inside the HUD display device, and the processor 91 may respectively obtain temperature values fed back by the plurality of temperature sensors by using a time-sharing detection manner.

And a motor 907 for driving the optical lens in the HUD display device to rotate under the control of the processor 91, so as to change the corresponding light path, for example, when the sunlight flows backward to cause the temperature rise on the image source surface, the motor can drive the optical lens to make external sunlight unable to reach the image source surface. In some examples, the processor 91 may also drive a fan provided on the HUD display device by the motor 907 to increase the speed of the exchange of outside air within the HUD display device to achieve heat dissipation.

A backlight 908 for providing illumination light and adjusting the brightness of the illumination light according to the control of the processor 91 to adjust the projection display brightness of the entire HUD display device. The backlight 908 and the image source 909 cooperate to realize the main functions of the optical projection display, and the backlight 908 may be an LED (Light Emitting Diode ), a laser, or the like.

The image source 909 is configured to display an image of the corresponding content and project display light corresponding to the image according to control of the processor 91, and the image source 909 may be an LCD (Liquid Crystal Display ), a DMD (Digital Micromirror Devices, digital micromirror device), a MEMS (Micro-Electro-Mechanical System, micro Electro mechanical system) micromirror, an LCOS (Liquid Crystal on silicon ), or the like.

The positioning module 910 is configured to monitor the HUD display device and the position of the corresponding vehicle, where the positioning module 910 may be a global navigation satellite system such as a GPS (Global Positioning System ), a beidou satellite navigation system, and the like, and determine corresponding position and orientation by measuring distances between satellites and receivers on the positioning module 910 at different positions. In some examples, the positioning module 910 may also include an inertial navigation system based on newton's law of mechanics that integrates the acceleration of the positioning module 910 in the inertial reference frame over time and transforms it into the navigation coordinate system to obtain data such as speed, yaw angle, and position in the navigation coordinate system. Alternatively, the inertial navigation system may assist the global navigation satellite system in achieving a more accurate position fix, providing corresponding position information to the processor 91.

Radar 911 is used to determine the position of a target object by electromagnetic waves, and it is generally possible to determine the distance of the target object from the vehicle in which radar 911 is located.

The camera 912 includes a body camera and an in-vehicle camera, where the body camera is used to determine a position of a target object through visual recognition, the body camera may be a monocular camera or a binocular camera, and the biggest difference between the monocular camera and the binocular camera is that the binocular camera may capture images under two different viewing angles, so that distance information in a three-dimensional space may be obtained. The in-vehicle camera is used for identifying the behavior states of drivers and passengers in the vehicle, including fatigue detection, distraction detection, expression recognition, gesture recognition, sight tracking and the like.

In some examples, the positioning module 910, the radar 911 and the camera 912 may also be directly connected to the vehicle 92, and not directly connected to the processor 91 of the HUD display device, for example, the vehicle 92 itself is integrated with a positioning module for position tracking and a radar and camera for automatic driving, and the HUD display device may acquire the acquired data of the positioning module, the radar and the camera in real time through communication with the vehicle 92.

In some examples, the HUD display device may include a rear-loading type and a front-loading type, the rear-loading type HUD display device being purchased separately according to a projection display requirement of a user after the user purchases the vehicle, and the corresponding HUD display device being directly placed on a surface of a console in the vehicle for use. The front-loading HUD display device is directly embedded in the center console, and needs to be installed in a space reserved by design in the vehicle production process. As shown in fig. 20, in the HUD display device 100 integrated in the vehicle center console, the body thereof is enveloped by the housing 101, and the optical machine 1, the first mirror 2, and the second mirror 3 are accommodated in the inner space of the housing 101, and are stably fixed to the inside of the housing 101 by a bracket or the like, in addition to the optical machine 1, the first mirror 2, and the second mirror 3. Referring to fig. 1, the optical engine 1, the first mirror 2, and the second mirror 3 cooperate with each other to achieve a certain light path planning in the housing 101, and finally, display light is projected out through a projection window 102 formed in the housing 101. When the HUD display device 100 is embedded in a center console of an automobile, the projection window 102 on the housing 101 faces the vehicle windshield above the center console, and accordingly, display light projected from the projection window 102 is reflected on the windshield to form a virtual image that can be seen by the human eye.

Further, in order to improve the stability of displaying the virtual image on the windshield and reduce abnormal display of the display element corresponding to the virtual image in the first display area as described above, as shown in fig. 21, the display device may specifically include a processor 2101, a memory 2102, an input device 2103 and an output device 2104, where the input device 2103 may include a key on a console, a touch screen and the like, and the display device may receive input control instructions and data through the input device 2103. The output devices 2104 may include a backlight, an image source, etc. of the display device, which may output corresponding instructions or data to the output devices 2104. The memory 2102 stores a computer program running on the processor 2101, and the processor 2101 executes the computer program to implement the display method described above. In some examples, the display area projected by the display device includes a first display area and a second display area, where information of the first display area and the second display area is acquired through a detection calibration in advance and stored in the display device, for example, the memory 2102 stores information of the first display area and the second display area for calling. The further display device also stores distortion-prone graphics and distortion-free-prone graphics information in various display elements, and can also store the distortion-prone graphics and distortion-free-prone graphics information in the memory 2102, so that fractal display of the display elements in different display areas can be realized through the data.

In some examples, a computer readable storage medium stores a computer program that when executed by a processor implements the display method described above.

As shown in fig. 22, in some examples, the vehicle may be provided with the above-described HUD display device, in particular, integrated inside the center console 10, such as at a front position of the steering wheel. The corresponding display light is projected onto the facing vehicle windshield 4 through the projection window 102 of the HUD display device, the effect of the viewer looking at the windshield 4 from within the cockpit being to see the corresponding virtual image 5 directly, for example: the virtual image 5 may include a vehicle speed (60 Km/h), navigation information (forward arrow), and the like. The driver as the viewer can check the corresponding vehicle state without lowering his head when driving, thereby improving the driving safety. More importantly, different display elements adopt different display forms in different display areas, and particularly in a first display area, distortion trend patterns in the display elements are processed, so that display abnormality is reduced. In some examples, the vehicle may also distribute the program that obtains the respective display methods through the computer-readable storage medium described above. The vehicle is not limited to a car as a transportation means, and may include a bus, a truck, an excavator, a motorcycle, a train, a high-speed rail, a ship, a yacht, an airplane, a spacecraft, and the like. The projected windshield is not limited to the front windshield of the automobile, and may be a transparent surface in other positions.

In connection with the above examples, the aspects referred to herein may be embodied directly in hardware, in a software module executed by a control unit, or in a combination of the two, i.e., in one or more steps and/or in a combination of one or more steps, in a computer program flow, or in a combination of hardware, such as an ASIC (Application Specific Integrated Circuit ), an FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or any suitable combination thereof. For convenience of description, the above description is described as functionally divided into various modules, and of course, the functions of each module may be implemented in the same or multiple pieces of software and/or hardware when implementing the present application.

From the above description of examples, it will be apparent to those skilled in the art that the present application may be implemented in software plus the necessary general hardware platform. Based on such understanding, the technical solutions referred to in this application may be embodied essentially or in part in the form of a software product that contributes to the prior art. The software is executed by the micro-control unit and may include any type of one or more micro-control units, including but not limited to micro-control unit 8, a microcontroller, a DSP (Digital Signal Processor, digital signal control unit), or any combination thereof, depending on the desired configuration. The software is stored in a memory, such as a volatile memory (e.g., random access memory, etc.), a non-volatile memory (e.g., read only memory, flash memory, etc.), or any combination thereof.

In summary, the display area projected on the transparent surface is divided into a first display area in which a display problem is easy to occur and a second display area in which the display problem is not likely to occur, and different display strategies are respectively adopted for display elements in the first display area and the second display area so as to avoid abnormal display of the display elements, such as double images, blurring and the like. According to the method and the device, the problem that display effects are affected due to the fact that display elements are double-image, fuzzy and the like can be avoided, and viewing experience of a user is improved.

It should be understood that while this specification includes examples, any of these examples does not include only a single embodiment, and that this depiction of the specification is for clarity only. Those skilled in the art will recognize that the embodiments of the present invention may be combined as appropriate with one another to form other embodiments as would be apparent to one of ordinary skill in the art.

The above list of detailed descriptions is only specific to possible embodiments of the present application, they are not intended to limit the scope of the present application, and all equivalent embodiments or modifications that do not depart from the teachings of the present application are intended to be included in the scope of the present application.

Claims

1. A display method, comprising:

2. The display method according to claim 1, characterized in that the display method further comprises:

3. The display method according to claim 1, wherein the first display element does not display the distortion-prone graph includes:

the distortion-prone pattern is removed in the first display element.

4. The display method according to claim 1, wherein the first display element does not display the distortion-prone graph includes:

The distortion-prone pattern is converted into a distortion-free-prone pattern.

5. The display method of claim 2, wherein the displaying the first display element in the display area comprises:

6. The display method of claim 1, wherein the displaying the first display element in the display area comprises:

the first display element moves in the display area according to a first track;

7. The display method according to claim 1, characterized in that the display method further comprises:

8. A display device comprising a memory, a processor and a computer program stored on the memory and running on the processor, the processor implementing the steps of the display method according to any one of claims 1-7 when the computer program is executed by the processor.

9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the steps of the display method of any of claims 1-7.

10. A vehicle comprising the display device of claim 8 or the computer-readable storage medium of claim 9.