DE102014219575A1 - Improved 3-dimensional (3-D) navigation - Google Patents

Abstract

One or more embodiments of three-dimensional (3-D) navigation techniques or systems are provided herein. A heads-up display (HUD) component can project, render, display or present graphic elements on focal planes around an environment surrounding a vehicle. The HUD component may cause these graphics to appear volumetric or three-dimensional by moving or adjusting a distance between a focal plane and the vehicle. Objects within the environment are tracked, identified, and corresponding graphics elements can be projected onto, near, or around respective objects. For example, the HUD component may project graphic elements or pointers to pedestrians to alert the driver or operator of the vehicle of their presence. These hands can "stick" to the pedestrian as he or she walks around. Metadata related to objects may be presented, such as address information, ratings, phone numbers, logos, etc.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on a "continuation-in-part (CIP)" of pending US Non-Provisional Patent Application No. 14 / 041,614 (Attorney Docket No. 107745.54CIP1) entitled "3-Dimensional (3-D) Navigation" filed Sep. 30, 2013, which is a continuation-in-part (CIP) of pending US Non-Provisional Patent Application No. 13 / 832,918 (Attorney Docket No. HRA-36332.01) entitled "Volumetric Dynamic focal plane heads-up display "filed March 15, 2013. The entirety of said application is incorporated herein by reference.

BACKGROUND

To enhance driver comfort, a vehicle may be equipped with a heads-up display (HUD) that displays information to the driver. The information displayed by the HUD may be projected onto the windshield of the vehicle to display the information in the driver's field of vision while the driver is driving. By displaying the information in the field of vision of the driver, the driver does not have to look away from the windshield (eg toward an instrument panel on a central dashboard) while driving to see the information presented.

The HUD may represent vehicle information typically displayed in the vehicle's central dashboard, such as information regarding the speed of the vehicle, fuel level, engine temperature, etc. In addition, the HUD may provide the driver with map information and communication events (e.g. B. navigation instructions, driving instructions, warnings, alarms, etc.) present. The vehicle HUD may display the information to the driver in a similar manner as used by the vehicle dashboard, such as displaying gauges and text boxes that appear on the windshield as graphical elements. In addition, the vehicle HUD may present augmented reality (augmented reality) graphics elements that augment a physical environment surrounding the vehicle with real-time information.

However, existing HUD devices used in vehicles are incapable of presenting augmented reality graphics elements with consistent depth of space. Accordingly, augmented reality graphics presented by existing vehicle HUDs can only be presented as superficial overlays.

SUMMARY

This brief description is intended to introduce a selection of concepts in a simplified form, which will be described later in the detailed description. This summary is not intended to be an exhaustive review of the claimed subject matter, to identify key factors or essential features of the claimed subject matter, or to be used to limit the scope of the claimed subject matter.

In one aspect, a vehicle head-up display device for displaying graphic elements in a field of view of a driver of a vehicle includes a first projector and a first actuator. The first projector may be configured to project a first graphic element onto a first focal plane in the driver's field of view. The first focal plane may be oriented substantially perpendicular to the line of sight of the driver and a distance away from the vehicle. The first projector may be mounted on the first actuator. The first actuator may be configured to linearly move the first projector. The linear movement of the first projector may cause the first focal plane of the first graphic element to move in a direction of the line of sight of the driver.

In another aspect, a vehicle heads-up display system includes a vehicle heads-up display device and a controller. The vehicle heads-up display device displays graphic elements in the field of view of a driver of a vehicle and includes a first projector and a second projector. The first projector may be configured to project a first graphic element onto a first focal plane in the driver's field of view. The first focal plane may be oriented substantially perpendicular to a line of sight of the driver. The first projector may be configured to move the first focal plane in a direction of the driver's line of sight. The second projector may be configured to project a second graphic element onto a second focal plane in the driver's field of view. The second focal plane may be oriented statically and substantially parallel to a background surface. The controller may be configured to communicate with one or more associated vehicle control systems and to control the vehicle heads-up display device therefor based on the first and second graphical elements Communicate with one or more of the associated vehicle control systems.

In yet another aspect, a method of presenting augmented reality graphics in a vehicle heads-up display comprises projecting a first graphics element onto a first focal plane in the field of vision of a driver and a second graphical element onto a second focal plane in the field of view of a driver , The first focal plane may be oriented substantially perpendicular to a line of sight of the driver, and the second focal plane may be oriented statically and substantially parallel to a background surface. The method may include moving or adjusting the first focal plane in a direction of the driver's line of sight.

One or more embodiments of three-dimensional (3-D) navigation techniques or systems are provided herein. For example, a 3-D navigation system may project a graphic element or avatar that appears to be moving in the field of view of an occupant of a vehicle. In one or more embodiments, a heads-up display component (HUD component) may be configured to project the graphic element or avatar onto one or more focal planes in an environment surrounding a vehicle. In other words, the HUD component may project graphics elements or avatars at adjustable distances or at adjustable focal planes to give an occupant of a vehicle the impression that an avatar or graphic element is moving, flying, animating, etc.

As an example, the HUD component may be configured to "animate" or provide motion for an avatar by sequentially projecting the avatar onto one or more different focal planes. The projection onto these focal planes can be accomplished by using an actuator to, for example, move a projector of the HUD component. As a result, space depth values such as accommodation and vergence associated with a graphic element or an avatar are generally retained. When a route is generated from a first position to a second position, the HUD component may generate one or more graphic elements for a driver or occupant of a vehicle to "follow". Because the HUD component can project on multiple focal planes or move projected graphics from one focal plane to another, graphic elements or projected images may appear much "more real", similar to an image seen in a mirror.

When an occupant of a vehicle requests navigation guidance, a graphic element such as an avatar may be provided. The avatar may appear to be moving, gliding, flying, etc. in front of the vehicle, similar to what an occupant or driver would, for example, see following a friend's vehicle. In addition, the avatar may seemingly navigate around obstructions, obstacles, pedestrians, debris, potholes, etc., as a real vehicle would. In one or more embodiments, the avatar could "drive", move, seemingly move in real time according to traffic, etc. For example, the avatar may stop at train tracks when a road guides a driver or vehicle over the train tracks when a train is driving Road crosses. As another example, the avatar may change the lane so that the avatar does not seem to "hit" another vehicle or otherwise intervene in the traffic.

In one or more embodiments, a sensor component may track or detect one or more objects or information related to the environment in which the vehicle is moving. This information may be passed to the vehicle control component. The vehicle control component may accumulate, collect, or receive information about the environment around the vehicle from various sources. A control component may use this information to make decisions as to whether or not to project a graphic element at a position or focal plane, and attributes or models to be used when rendering the graphic element. A HUD component can render or project the graphic element based on the decision of the control component.

For example, when a sensor component detects a pedestrian on a pedestrian crossing over a road section located on a route including turning the vehicle into this road section, the control component instructing or commanding the HUD component may include a graphic element or to project around the pedestrian to alert a driver or passenger of the vehicle to the presence of the pedestrian. Further, the sensor component may actively track the pedestrian such that the HUD component can project graphic elements, such as pointers, that follow or track the pedestrian in real time as he traverses the pedestrian crossing. In addition, the control component may identify or recognize when the pedestrian crosses or walk on a sidewalk and tell the HUD component to stop projecting graphic elements for the pedestrian.

A 3-D navigation system may allow identification or projection of early warning graphics. For example, when driving from a first road section to a second road section (for example, turning left or turning right from one road to another), information received from the vehicle control component, such as environmental information, may be received or traffic condition information from the control component may be used to make a determination that an early warning graphic element should be rendered to an occupant or driver of the vehicle. In other words, the control component may instruct or instruct the HUD component to render a graphic element that points to an object (eg, a hazard, a road condition, etc.) that need not necessarily be in the driver's field of view , Hereby, when looking through the windshield of the vehicle, the driver may not see a danger to his left, for example. However, the HUD component may project a graphic element that directs the driver's attention to the left (eg, outside the windshield or out of the driver's field of vision). In this way, security can be increased by providing drivers or occupants of a vehicle with an early indication of objects within an environment.

In addition, the HUD component can project or render details related to objects within the environment, such as a business name, address markers, destination markers, park graphics, ratings, etc.

The following description and appended drawings illustrate illustrative aspects and implementations. These show just a few of the many ways in which one or more aspects can be implemented. Other aspects, advantages, or novel features of the disclosure will become apparent from the following detailed description when considered in conjunction with the appended drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

Aspects of the disclosure will be understood from the following detailed description when read in conjunction with the accompanying drawings. Elements, structures, etc. of the drawings are not necessarily drawn to scale. Accordingly, the dimensions thereof may be arbitrarily increased or decreased, for example, for clarity of discussion.

1 FIG. 10 is an illustration of an exemplary schematic diagram of a vehicle head-up display system, according to one or more embodiments.

2 FIG. 10 is an illustration of an exemplary schematic diagram of a vehicle provided in a vehicle heads-up display system, according to one or more embodiments. FIG.

3 13 is an illustration of an exemplary side view of a vehicle and four focal planes onto which graphic elements are projected from a vehicle heads-up display system, according to one or more embodiments.

4 FIG. 10 is an illustration of an exemplary field of view of a driver while driving a vehicle while looking through a windshield of the vehicle and exemplary graphics projected by a vehicle heads-up display system, according to one or more embodiments.

5 FIG. 3 is an illustration of an example component diagram of a 3-D navigation system according to one or more embodiments. FIG.

6 FIG. 10 is an illustration of an exemplary flowchart of a method for 3-D navigation, according to one or more embodiments.

7A FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

7B FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

8A FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

8B FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

9A FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

9B FIG. 10 is an illustration of an exemplary avatar for 3D navigation in accordance with one or more embodiments.

10A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

10B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

11A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

11B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

12A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

12B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

13A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

13B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

14A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

14B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

15 FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

16A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

16B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

17A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

17B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

18A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

18B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

19A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

19B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

20A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

20B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG.

21 FIG. 10 is an illustration of an exemplary flowchart of a method for 3-D navigation, according to one or more embodiments.

22 13 is an illustration of an exemplary computer-readable medium or computer-readable device comprising processor-executable instructions configured to perform one or more of the measures presented herein, according to one or more embodiments.

23 FIG. 10 is an illustration of an example computer environment in which one or more of the measures presented herein are implemented, according to one or more embodiments.

Embodiments or examples illustrated in the drawings will be explained below using specific language. It should be understood, however, that the embodiments or examples are not to be construed as limiting. Any changes or modifications in the disclosed embodiments, and any other applications of the principles disclosed herein, are to be understood to those of ordinary skill in the art.

For one or more of the figures shown here are one or more boundary lines, such as the boundary line 116 in 2 or the boundary line 1030 in 10B are drawn with different heights, widths, outlines, aspect ratios, shapes, etc. relative to each other for illustrative purposes only, and are not necessarily drawn to scale. For example, because dashed or dotted lines are used to represent different boundary lines when the dotted and dashed lines are drawn on top of each other, they would not be distinguishable in the figures, and thus they would be in one or more of the figures with different dimensions or slightly different offset drawn so that they are distinguishable from each other. As another example, where a boundary line is associated with an irregular shape, etc., the boundary line such as a box in one or more examples does not necessarily encompass an entire component. On the other hand, a drawn box does not necessarily encompass only an associated component but, in one or more examples, may also enclose a portion of one or more other components.

Graphic elements that are visually placed on environmental elements in the driver's direct field of view through a vehicle HUD are often called contact analog or conformal augmented reality graphics elements. Presenting contact-analog augmented reality graphics to the driver of a vehicle successfully may depend on the ability of the vehicle HUD device to correctly reproduce room depth values. These spatial depth values may include accommodation and vergence. The accommodation is a room depth value in which the eye actively changes the optical power in order to set the focal point at different distances. Vergence is the simultaneous or coincidental inward rotation of the eyes toward one another to obtain a single binocular image when viewing an object.

While examples described herein may refer to a driver of a vehicle, graphic elements in the field of view may be projected, deployed, rendered, etc., by one or more occupants of a vehicle, such as passengers, etc. Therefore, these examples are not to be considered as limiting and are merely disclosed to illustrate one or more exemplary aspects of the present application.

When an HUD device displays a graphic element on a windshield of a vehicle, the accommodation may cause the human eye to jump between environmental elements and elements displayed by the HUD device. Vergence causes the eye to cause points behind the windshield to converge with the environment, which can give the impression of a duplicate image of the HUD graphic element displayed on the windshield. Accordingly, to render contact analog augmented reality graphics elements with correctly reproduced depth of space, graphics elements should be rendered in the same space as the real environment (eg, at corresponding focal planes) rather than on the vehicle windshield.

A head-up display device for a vehicle for displaying graphic elements in the field of view of a driver of a vehicle while the driver is looking at an environment through a windshield is provided. The heads-up display device may include one or more projectors projecting a graphic element onto a front focal plane in the field of view of the driver while the driver is viewing the environment through the windshield and one or more projectors placing a graphic element on the one Project the ground parallel focal plane in the field of view of the driver while the driver views the environment through the windshield. The projector that projects the graphic element to the front focal plane may be mounted on an actuator that linearly moves the projector to cause the front focal plane to move in a direction of a line of sight of the driver. The projector, which projects the focal plane parallel to the ground, can be arranged so firmly that the focal plane parallel to the ground is static.

With reference to 1 is a volumetric heads-up display system 100 for a vehicle ("HUD system 100 ") Or (" HUD component 100 "), Which is capable of correctly rendering volumetric contact-analogue augmented-reality graphics elements (eg, 3-dimensional or" 3-D "graphic elements rendered in the same space as the real environment) render reproduced room depth values. The HUD system 100 includes a vehicle heads-up display device 102 ( "HUD device 102 ") And a control element 104 (or "Control component 104 "). With reference to 2 can the HUD system 100 in a vehicle 106 be provided with a driver's seat 108 , a dashboard housing 110 and a windshield 112 includes.

The configuration of the vehicle 106 regarding the relative positioning of, for example, the driver's seat 108 , the dashboard housing 110 and the windshield 112 can be conventional be. To the HUD system described herein 100 to record defines the dashboard housing 110 a housing space in which the HUD system 100 is housed. Furthermore, the dashboard housing 110 a HUD exit port 114 which is defined by an upper surface thereof. The HUD system 100 in the dashboard housing 110 graphic elements, such as contact analog augmented reality graphics, project through the HUD exit port 114 on the windshield 112 acting as a display screen for the HUD system 100 can be used. As described in detail below, the augmented reality graphic elements may be rendered to the driver as if they were in the same room as the real environment.

A driver of the vehicle 106 the vehicle drives 106 while in the driver's seat 108 sitting. Accordingly, the driver can move from one position to a sitting position in the driver's seat 108 inside the vehicle 106 to be disabled. Given this position constraint, the HUD system can 100 be adapted to use the assumption that the driver's field of vision of an eye box 116 inside the vehicle. The eye box 116 may be assumed to be a range of an interior of the vehicle 106 in which the driver's eyes are located while the driver is in the driver's seat 108 sitting.

The eye box 116 may be sized to accommodate all possible head positions of the driver regardless of a position and position of the driver's seat 108 encloses, or the HUD system 100 may be adapted to the position and position of the driver's seat 108 to detect and a position and size of the eye box 116 to adjust based on it. In one or more embodiments, the HUD system 100 be designed to assume that the eye box 116 has a fixed size and is in a fixed position. For example, the eye box may have the following dimensions: 20 cm × 10 cm × 10 cm. In any case, the HUD system 100 be configured to present the contact-analog augmented reality graphics to the driver when the driver's eyes are within the eye box 116 are and the driver in a direction forward through the windshield 112 of the vehicle 106 looks / looks. Although the eye box 116 in 2 for the driver of the vehicle 106 illustrated, the eye box can 116 be designed so that it includes one or more other occupants of the vehicle. In one or more embodiments, additional eye boxes or HUD devices may be provided to passengers or other occupants, for example.

The HUD device 102 shows one or more graphic elements in the field of vision of the driver of the vehicle 106 while the driver is driving through the windshield 112 of the vehicle 106 considered. Any graphic or environmental element that the driver through the windshield 112 looks while the driver's eyes in the eye box 116 are and the driver in the direction forward through the windshield 112 looks / looks, can be considered as being in the driver's field of vision. As the term is used herein, it is contemplated that the field of vision of the driver of the vehicle 106 while the driver has an environment through the windshield 112 of the vehicle 106 considered to include an area passing through the windshield 112 Considered being dashboard displays that are inside the vehicle 106 lie, are excluded. In other words, the HUD device presents 102 the graphic elements such that the driver can see the graphic elements without having to look away from the road.

Back referring to 1 includes the HUD device 102 of the HUD system 100 a first projector 118 , a second projector 120 , a third projector 122 and a fourth projector 124 , The first projector 118 and the third projector 122 share a first beam splitter 126 and a first lens lens 128 while the second projector 120 and the fourth projector 124 a second beam splitter 130 and a second lens lens 132 share. Consequently, the output of the first projector 118 and the third projector 122 in the first beam splitter 126 can be obtained and combined into a single output on (and through) the first lens lens 128 is directed. Similarly, the output of the second projector 120 and the fourth projector 124 in the second beam splitter 130 can be obtained and combined into a single output on (and through) the second lens lens 132 is directed.

The HUD device 102 further comprises a third beam splitter 134 , which is downstream from the first and second lens lenses 128 . 132 is arranged and adapted to the output from the first and the second lens lens 128 . 132 to obtain. The outputs of the first and second lens lenses 128 . 132 can at the third beam splitter 134 combined into a single output, which is a combination of the output of each of the first, second, third and fourth projectors 118 . 120 . 122 . 124 can be and on (and through) a third lens lens 136 and an eyepiece lens 138 may be directed before leaving the HUD exit port 114 out on the windshield 112 which serves as the display screen for the HUD system 100 can be used.

Everyone from the first projector 118 , the second projector 120 , the third projector 122 and the fourth projector 124 includes a projector unit 140 . 142 . 144 . 146 and a diffuser disk 148 . 150 . 152 . 154 fixed at a certain distance from the projector unit 140 . 142 . 144 . 146 attached and relative to the projector unit 140 . 142 . 144 . 146 are arranged such that of the projector unit 140 . 142 . 144 . 146 emitted light through the diffuser disc 148 . 150 . 152 . 154 running. The projector units 140 . 142 . 144 . 146 may be light-emitting units that project an image or graphic element through the associated diffuser disk 148 . 150 . 152 . 154 running. The diffuser discs 148 . 150 . 152 . 154 serve as a luminous image source (or object) for the rest of the optical system of the HUD device 102 and make sure that a lot of the light that the diffuser discs 148 . 150 . 152 . 154 leaves on the diffuser discs 148 . 150 . 152 . 154 following optical elements (eg the first beam splitter 126 , the first lens lens 128 , the second beam splitter 130 , the second lens lens 132 , the third beam splitter 134 , the third lens lens 136 and the eyepiece lens 138 ), while the light is scattered in such a way that it is ultimately the eye box 116 fills so that a brightness of the image or of the graphic element or the graphic elements remains constant when the driver's head within the eye box 116 emotional. Accordingly, the use of the diffuser discs prevents 148 . 150 . 152 . 154 essentially, that different parts of the image or graphic element (s) from different points within the eye box 116 are visible, thus substantially preventing the appearance of various visual behaviors in light head movements.

The projector units 140 . 142 . 144 . 146 may take the form of any suitable light-emitting unit for the use described herein. The projector units 140 . 142 . 144 . 146 may take the form of any light-emitting unit capable of projecting an image or graphic element according to the use described herein or the uses described herein. Similarly, the diffuser discs 148 . 150 . 152 . 154 take the form of any light-diffusing disc suitable for the use described herein or the uses described herein.

The first projector 118 can be on a first actuator 156 in the HUD device 102 be mounted. The first actuator 156 may be a linear actuator that is capable of the first projector 118 in a linear direction to the first beam splitter 126 to move to and from him. In addition, the third projector 122 on a second actuator 158 in the HUD device 102 be mounted. The second actuator 158 may be a linear actuator capable of the third projector 122 in a linear direction to the first beam splitter 126 to move to or from him. The first and the second actuator 156 . 158 may take the form of any linear actuator suitable for the use described herein. The ability of the first projector 118 and the third projector 122 to move linearly allows the first projector 118 and the third projector 122 to project graphic elements onto dynamic or movable focal planes. Unlike the first and the third projector 118 . 122 can the second and the fourth projector 120 . 124 stuck in the HUD device 102 be arranged and thus project graphic elements on static focal planes.

By using the first, second, third and fourth projectors 118 . 120 . 122 . 124 can the HUD device 102 Graphic elements (contact-analog augmented reality graphics or the like) in four specific focal planes in the driver's by the windshield 112 render the environment in question. In this regard, the first projector 118 be set up to a first graphic element 160 in a first focal plane 162 to project the second projector 120 can be set up a second graphic element 164 in a second focal plane 166 to project the third projector 122 can be set up a third graphic element 168 in a third focal plane 170 to project, and the fourth projector 124 can be set up a fourth graphic element 172 in a fourth focal plane 174 to project (as with reference to 3 and 4 will be described). All of the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 and its associated first, second, third and fourth focal planes 162 . 166 . 170 . 174 can be rendered in the environment in the driver's field of vision when the driver is driving the vehicle 106 drives and the eyes of the driver in the eye box 116 are while the driver is in a forward direction through the windshield 112 looks.

With reference to 3 and 4 become the projection of the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 on the first, second, third and fourth focal plane 162 . 166 . 170 . 174 with reference to a background surface 176 and a line of sight 178 described by the driver. In this regard, the underground area 176 a surface of a road in front of the vehicle 106 , For the purposes of the present description it is assumed that the background surface 176 is a substantially flat surface. The line of sight 178 The driver's line is essentially parallel to the ground surface 176 from the eye box 116 extends in the forward direction. As the term is used herein, a direction is the line of sight 178 a direction that is towards the driver and the vehicle 106 and away from them along the line of sight 178 extends.

The first focal plane 162 is a frontal focal plane that is substantially perpendicular to the line of sight 178 the driver can be oriented. The third focal plane 170 is also a frontal focal plane that is substantially perpendicular to the line of sight 178 the driver can be oriented. The first and the third focal plane 162 . 170 can be dynamic focal planes that are in the direction of the line of sight 178 are movable, both in the forward direction (away from the vehicle 106 ) as well as in a reverse direction (on the vehicle 106 to). The second focal plane 166 is a focal plane parallel to the ground, which is substantially parallel to the ground surface 176 can be oriented, and she can do so on the underground surface 176 be arranged that the second focal plane 166 a basic focal plane is. The fourth focal plane 174 is also a focal plane parallel to the ground, which is substantially parallel to the ground surface 176 can be oriented, and it is above the ground surface 176 arranged. The fourth focal plane 174 can be above the background surface 176 and the line of sight 178 be arranged by the driver and be a sky or ceiling focal plane. Consequently, the second and fourth focal planes can 166 . 174 be static focal planes.

With reference to 4 can be the first, second, third and fourth graphic element 160 . 164 . 168 . 172 used to present various information to the driver. The exact type of the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 displayed information may vary. For example, the first graphic element 160 and the third graphic element 168 present a warning to the driver instructing the driver to react to a hazard or an obstacle, or they may provide navigation instructions or driving instructions related to the rules of the road (eg a stop sign, a right of way) Sign etc.), present. The second graphic element 164 and the fourth graphic element 172 can present navigation instructions to the driver as a graphics overlay on the background surface 176 or may present a vehicle surrounding display to the driver. The first, second, third and fourth graphic elements 160 . 164 . 168 . 172 may present to the driver information or graphic elements other than those described herein and a subset of the first, second, third, and fourth graphics elements 160 . 164 . 168 . 172 can be presented.

Back referring to 1 can the control element 104 include one or more computers, (eg, arithmetic) processors, or any other devices capable of having one or more vehicle control systems 180 to communicate and the HUD device 102 to control. One or more of the vehicle control systems 180 (hereinafter "vehicle control system 180 "Or" vehicle control component 180 ") Can take the form of any vehicle control system 180 which is used to actively or passively control the vehicle 106 to facilitate. The vehicle control system 180 may include or communicate with one or more sensors (not shown), driving and environmental conditions associated with the operation of the vehicle 106 detect.

With general reference to the operation of the HUD system 100 communicates the control element 104 with the vehicle control system 180 and based on the communication with the vehicle control system 180 It determines the type and position of graphic elements that the driver of the vehicle 106 should be presented. The control element 104 determines the type of graphic element used as the first, second, third, and fourth graphics element 160 . 164 . 168 . 172 from the first, second, third and fourth projectors 118 . 120 . 122 . 124 is presented and controls / regulates the first, second, third and fourth projector 118 . 120 . 122 . 124 to the first, second, third and fourth graphic element 160 . 164 . 168 . 172 to project as the particular graphic element. The control element 104 may determine a target position of the first graphic element and a target position of the third graphic element as target positions at which the first and third graphic elements 160 . 168 in the environment for the driver to be rendered. The control element 104 then controls / regulates the first and second actuators 156 . 158 to the first and the third projector 118 . 122 to move linearly such that the first and the third focal plane 162 . 170 are each moved to the desired position of the first and the third graphic element.

Accordingly, the first projector projects 118 the first graphic element 160 on the first focal plane 162 that may be oriented substantially perpendicular to the line of sight of the driver and to the vehicle 106 towards and away from him in the direction of the line of sight 178 of the driver by a linear movement of the first projector 118 through the first actuator 156 can be movable. The second projector 120 projects the second graphic element 164 on the second focal plane 166 that are static and parallel to the ground surface 176 oriented and on the underground surface 176 is arranged. The third projector 122 projects the third graphic element 168 at the third focal plane 170 that may be oriented substantially perpendicular to the line of sight of the driver and to the vehicle 106 to or away from it in the direction of the line of sight 178 of the driver by a linear movement of the third projector 122 through the second actuator 158 can be movable or adjustable. The fourth projector 124 projects the fourth graphic element 172 at the fourth focal plane 174 that are static parallel to the ground surface 176 is oriented and above the line of sight 178 the driver can be arranged. The control element 104 controls / regulates the first and second actuators 156 . 158 to the first and the third projector 118 . 122 to move to the first and third focal plane 162 . 170 to move.

By the first and the third projector 118 . 122 the first and the second graphic element 160 . 168 on the movable first and third focal plane 162 . 170 project that is substantially perpendicular to the line of sight 178 The driver's focus may be on objects at different distances from the vehicle 106 be adjusted. This may include providing the driver with correct depth of field values for the first and third graphics elements 160 . 168 simplify, especially if the HUD system 100 a vehicle application is where the vehicle 106 serves as a moving platform.

While the second and fourth projectors 120 . 124 the second and fourth graphic elements 164 . 172 on the static second and fourth focal plane 166 . 174 can project the second and the fourth focal plane 166 . 174 be continuous. Around the second and the fourth focal plane 166 . 174 parallel with the ground surface 176 Align the diffuser discs 150 . 154 of the second and fourth projectors 120 . 124 be tilted. As the optical system of the HUD device 102 has very low distortion and is nearly telecentric for images in a ground plane parallel to the ground, light rays are nearly parallel with the optical axis, which is the projected second and fourth graphics elements 164 . 172 allowed to be projected or rendered without distortion or change in magnification, while the second and fourth focal plane 166 . 174 are tilted. The resulting second and fourth graphics element 164 . 172 therefore appear in a continuous focal plane (the second and fourth focal planes 166 . 174 ) parallel to the background surface 176 , In this regard, the second and fourth graphic elements 164 . 172 are rendered with an actual 3-dimensional (3-D) volumetric shape rather than line segments to add monocular elements to enhance the depth impression.

The continuous static second and fourth focal plane 166 . 174 facilitate a deep perception of the driver with respect to the second and fourth graphic elements 164 . 172 , The continuous static second and fourth focal plane 166 . 174 allow correct generation of real images or graphic elements through the forward-backward direction in 3-D space (eg, the direction of the line of sight 178 the driver), which allows to generate proper motion parallax values. Accordingly, when the driver's head is moving from side to side or from top to bottom, the second and fourth graphic elements appear 164 . 172 the driver firmly in their position in the environment rather than moving around. Consequently, the HUD system is needed 100 no head-tracking function to compensate for movements of the driver's head.

With respect to the previously listed examples of information that may be presented to the driver, the vehicle control system may 180 include processing or sensors capable of performing the following functions: hazard or obstacle detection; Navigation; Navigation instructions and monitoring of the environment of the vehicle (eg the blind spot). The vehicle control system 180 may include processing and sensors capable of performing other control functions of the vehicle (eg, highway lock-in assistant, etc.) that alternatively or additionally with the driver using the HUD system 100 related information. Regardless of the vehicle control system 180 performed functions can be the precise way of operating the vehicle control system 180 when performing the functions, including associated sensors and processing, irrelevant to the operation of the HUD system 100 be.

The control element 104 communicates with the vehicle control system 180 and receives therefrom input regarding the operation of the vehicle 106 and in connection with the above listed (and other) functions. The control element 104 then controls / regulates the HUD device 102 based on the vehicle control system 180 received inputs. In this regard, one or both of the control element may 104 and the vehicle control system 180 determine: the type of graphic element that is the first, second, third, and fourth graphic element 160 . 164 . 168 . 172 to be displayed; the position of the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 ; and which of the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 to be displayed. These provisions may be on or based on multiple vehicle functions used by the driver, such as whether the driver is using the navigation function.

Regardless of whether the control element 104 or the vehicle control system 180 used to perform these determinations controls the control element 104 the HUD device 102 To display the appropriate graphic elements at appropriate locations. This may be controlling the first, second, third and fourth projectors 118 . 120 . 122 . 124 for projecting the appropriate first, second, third and fourth graphic elements 160 . 164 . 168 . 172 include. This may be controlling the first and second actuators 156 . 158 include to the first and the third projector 118 . 122 move linearly to the first and third focal planes 162 . 170 to move into the appropriate positions (ie the target positions). For example, one or more actuators, such as 156 . 158 be configured to one or more focal planes, such as 162 . 170 to move. For example, with reference to the third focal plane 170 a distance between the third focal plane 170 and a windshield of the vehicle 106 (eg at 302 ) by adjusting the distance 170 ' be adjusted. Similarly, the distance 162 ' adapted to a nominal position for the focal plane 162 adapt.

With regard to the above-given exemplary information in connection with the first, second, third and fourth graphic elements 160 . 164 . 168 . 172 becomes the operation of the HUD system 100 with reference to the vehicle 106 described the vehicle control system 180 which allows the following functions: a hazard or obstacle detection and warning function; a navigation function; a navigation instruction function and a monitoring function for the environment of the vehicle (eg, a blind spot). Again, the vehicle can 106 have a subset of these functions or additional functions, and the HUD system 100 can be used by reference to the subgroup or additional functions. The description of the HUD system 100 with reference to these functions is merely exemplary and intended to provide the description of the HUD system 100 to simplify. Although one or both of the control element 104 and the vehicle control system 180 Provisions related to the operation of the HUD system 100 is the control element 104 so described that it is set to provisions based on the vehicle control system 180 made inputs.

Information regarding obstacle detection and warning function may be presented to the driver as a contact-analog augmented reality graphic element from the first projector 118 the HUD device 102 is projected. In this regard, the vehicle control system 180 Various obstacles on the road detect the vehicle 106 emotional. For example, the obstacles may include pedestrians crossing the road, other vehicles, animals, street debris, potholes, etc. The detection of these obstacles can be done by processing information from the environment detected by sensors (not shown) in the vehicle 106 are provided. Furthermore, an obstacle detection can also be performed in any other way.

When an obstacle is detected, the vehicle control system issues 180 the obstacle information to the control element 104 further. The control element 104 gets the obstacle information from the vehicle control system 180 and determines the type of graphic element that is the first graphic element 160 should be presented, and the target position of the first graphic element based on the obtained obstacle information. While various types of graphic elements may be used, such as flashing symbols, other characters, etc., the examples will be described herein with reference to a "YIELD" character (right-of-way sign) that is presented when an obstacle is detected.

With reference to 4 This can be done by the vehicle control system 180 detected obstacle a pedestrian 182 be who crosses the street on which the vehicle 106 moves. In the exemplary field of vision of the driver in 4 the vehicle is moving 106 on a street leading from the pedestrian 182 is crossed. Accordingly, the vehicle control system 180 Obstacle information related to the pedestrian 182 to the control element 104 send. Based on the obstacle information, the control element may 104 determine the type of graphic element that is considered the first graphic element 160 to be displayed; in this case, for example, the graphic element may be a "YIELD" character, although other graphics may be used. The control element 104 can determine the desired position of the first graphic element such that the first graphic element 160 is projected and rendered such that it is perceived by the driver as if it is at the same depth (eg, focal plane) as the pedestrian 182 , Furthermore, the control element 104 be adapted to adjust the target position of the first graphic element such that the first graphic element 160 the pedestrian "tracks" or "follows" him, for example when the pedestrian 182 running.

Then controls the control 104 the first projector 118 so that this the "YIELD" character as the first graphic element 160 projects and controls the first actuator 156 so that the first projector 118 is moved linearly such that the first graphic element 160 so it can be projected and rendered by the driver (eg while the driver's eyes in the eye box 116 and the driver in the forward direction through the windshield 112 looks) is perceived as if it is in the same depth as the pedestrian 182 is. The first actuator 156 can be controlled / regulated so that the first graphic element 160 on the first focal plane 162 can be projected, which can be positioned at the desired position of the first graphic element and substantially perpendicular to the line of sight 178 can be oriented.

Because the vehicle 106 and the pedestrian 182 moving on the street, the relative distance between the two will change. This change in distance may be to the controller 104 from the vehicle control element 180 can be changed, the target position of the first graphic element can be changed accordingly, and the first actuator 156 can be from the control 104 be controlled / regulated so that the first focal plane 162 at the (eg changed / changing) target position of the first graphic element remains. Accordingly, by adding the first graphic element 160 on the first focal plane 162 is projected in the direction of the line of sight 178 The driver may be movable to the first graphic element 160 assigned depth of space can be correctly reproduced so that the driver accurately the position of the first graphic element 160 (eg the detected obstacle) can estimate.

In addition, information related to the navigation function may be presented to the driver as a contact-analog augmented reality graphic element provided by the second projector 120 the HUD device 102 is projected. In this regard, the vehicle control system 180 upon receiving a navigation instruction from the driver (eg, entering a desired location), generate a navigation route for the driver to follow to arrive at the desired location. The navigation route includes a series of driving instructions to be followed by the driver, including instructions to turn on the route to the desired location in streets. The navigation function can be executed in any way. When the navigation function is activated, the vehicle control system can 180 the driving instructions related to the navigation function to the control element 104 pass on.

The control element 104 can the driving instructions from the vehicle control system 180 and determine the type of graphic element that is considered the second graphic element 164 should be presented.

The types of graphic elements associated with the navigation function may include graphic elements instructing the driver to continue on the current road (eg, a straight line or a straight arrow), turning left or right at the next intersection (e.g. an arrow to the left / right or a line running in the appropriate direction), to drive on a freeway, to board or leave (eg a line or an arrow indicating the corresponding route), etc The control element 104 selects the appropriate graphic element to make it the second graphic element 164 based on the vehicle control system 180 present passed driving direction.

With reference to the exemplary field of view of the driver in FIG 4 includes the driving direction for that of the navigation function of the vehicle control system 180 certain driving route turn left onto a nearer road. Accordingly, the control element controls 104 the second projector 120 to make a left turn graphic element as the second graphic element 164 and at the second focal plane 166 to project. As in 4 shown, the second focal plane 166 parallel to the underground surface 176 be and on the underground surface 176 be arranged. As mentioned above, the second projector 120 stuck in the HUD device 102 be arranged so that the second focal plane 166 is static. As mentioned above, the second focal plane 166 be continuous, making the second graphic element 164 for the driver with suitable room depth can be rendered as a 3-D image.

Similarly, information associated with the navigation instruction function may be presented to the driver as a contact-analog augmented reality graphic element that is from the third projector 122 the HUD device 102 is projected. In this regard, the vehicle control system 180 Use sensors or information stored in a database and associated with a map to monitor the road on which the vehicle is parked 106 drives and to identify upcoming navigation instructions related to driving on this road. For example, the vehicle control / control system 180 imminent necessary stop, grant a "give way" or other condition (hereinafter collectively referred to as "road condition") on the road on which the vehicle is traveling 106 moves. The vehicle control system 180 may determine a navigation instruction associated with the detected road condition (eg, a stop instruction associated with a stop road condition, etc.). The navigation instruction function can be executed in any manner, the specifics of which for the operation of the HUD system 100 are not relevant. In addition, the road conditions may include, but are not limited to, traffic on a road section, closures, obstacles, weather conditions, a road surface finish, speed limits associated with a portion of a road or a roadway, and so on. In other words, road conditions may generally include reasons for accelerating, decelerating, turning, stopping, being cautious, etc., during driving, for example.

The vehicle control system 180 indicates the road condition or the navigation instructions related to the road condition, as well as information related to a position of the road condition to the control unit 104 further. The control unit 104 can the third projector 122 control, making this the third graphic element 168 projected to pass on information related to the road condition or related navigation instructions to the driver. The control element 104 may indicate the road condition or navigation instruction information as well as the position information from the vehicle control system 180 and determine the type of graphic element that is considered the third graphic element 168 should be presented, as well as a target position of the third graphic element.

Various types of graphic elements may be used in conjunction with navigation instruction functions, for example: a STOP sign, a YIELD sign, a "ONE WAY" sign, a "NO TURN ON RED "sign (" red light not turn right "sign) etc. The type of graphic element can be selected to communicate the navigation instruction related to the road condition. Regardless of which type of graphic element the control element 104 as the third graphic element to be used 168 determined, this graphic element can be projected to appear at the position of the driving state. In this regard, the desired position of the third graphic element may be determined as a position at which the third graphic element 168 is to be rendered in the driver's field of vision based on the position of the detected road condition relative to the vehicle 106 ,

The control element 104 can be set up the third projector 122 so to control that he has the appropriate graphic element as the third graphic element 168 projected. The control element may be the second actuator 158 so control that he has the third projector 122 moved linearly such that the third graphic element 168 is projected and rendered so that it is the driver (eg, while the driver's eyes in the eye box 116 and the driver is heading forwards through the windshield 112 gazing) as if it is at the same depth (eg, having the same focal plane) as the road state. The second actuator 158 can be controlled / regulated so that the third graphic element 168 on the third focal plane 170 which is positioned at the target position of the third graphic element and substantially perpendicular to the line of sight 178 can be oriented. The control element 104 can be the second actuator 158 so control that he has the third projector 122 moved linearly, so that the third focal plane 170 moves when there is a gap between the vehicle 106 and the detected road condition (eg, the target position of the third graphic element) changes (as is the case of the vehicle control system) 180 detected and to the control element 104 passed), for example, as a result, that the vehicle 106 to the detected road condition moves to.

In the exemplary view from the perspective of the driver in 4 the vehicle is approaching 106 a four-road intersection where the vehicle is 106 should stop. Accordingly, the vehicle control system detects 180 the stop-road state at a position of entrance of the intersection, and determines that the navigation instruction related to the stop-road state is a stop instruction. The stop-road state or the stop-instruction as well as the position of the stop-road state may be sent to the control element 104 to be passed, which determines that a stop sign as the third element of the graphic 168 should be presented. The control element 104 can determine that the third graphic element 168 (eg the STOP sign) should appear at the position of the entrance of the four-road intersection. The position of the entrance of the intersection can thus be determined as the desired position of the third graphic element.

The control element 104 can the third projector 122 So control that he uses the STOP sign as the third graphic element 168 projected, and the second actuator 158 so control / fix that third projector 122 is moved so that the third graphic element 168 projected and rendered (eg while the driver's eyes are in the eye box 116 and the driver is heading forwards through the windshield 112 looks) that it is in the same depth as the entrance of the four-road intersection. The second actuator 158 can be controlled / regulated so that the third graphic element 168 on the third focal plane 170 which is positioned at the target position of the third graphic element and substantially perpendicular to the line of sight 178 is oriented. If the vehicle 106 Driving on the road will increase the relative distance between the vehicle 106 and change the driveway of the four-road intersection. This change in distance may be from the vehicle control system 180 to the control element 104 can be passed, the target position of the third graphic element can be changed accordingly and the second actuator 158 can be from the control 104 be controlled / regulated so that it is the third focal plane 170 moved so that it remains at the (eg changed / changing) target position of the third graphic element. Accordingly, by the third graphic element 168 on the third focal plane 170 is projected in the direction of the line of sight 178 The driver may be movable to the third graphic element 168 assigned depth of space values are thus correctly reproduced, so that the driver accurately the position of the third graphic element 168 (eg the detected road condition).

Information related to the monitoring function for the environment of the vehicle (eg, a blind spot) may be given to the driver by the fourth projector 124 the HUD device 102 to get presented. In this regard, the vehicle control system 180 the presence of other vehicles in an area immediately around the vehicle 106 around or around the vehicle 106 detect around. The detection of the other vehicles immediately around the vehicle 106 can be around by processing information regarding the environment of the vehicle 106 carried out on the vehicle 106 provided sensors (not shown) are detected. The determination of the environment of the vehicle can be carried out in any way.

The information regarding the surroundings of the vehicle may be provided by the vehicle control system 180 be determined and to the control element 104 be passed on. The control element 104 receives the information regarding the surroundings of the vehicle from the vehicle control system 180 and determines how, if any, on the fourth focal plane 174 projected fourth graphic element 172 should be modified. In this regard, the graphic element may be considered the fourth graphic element 172 In order to facilitate the monitoring function of the environment of the vehicle (eg, a blind spot), it may be a vehicle environment indicator as shown in FIG 4 is shown.

The vehicle environment indicator includes a central mark that the vehicle 106 represents and eight environmental markers, the positions immediately around the vehicle 106 represent around. The vehicle control system 180 gives information about the positions of vehicles in the immediate vicinity of the vehicle 106 Next, and the control element 104 controls / regulates the fourth projector 124 so that the fourth graphic element 172 is changed so that one or more of the eight associated environment markers are emphasized. Emphasizing the eight environmental markers shows the driver the position of other vehicles in the immediate vicinity of the vehicle 106 at.

In 4 can be the fourth graphic element 172 on the fourth focal plane 174 be projected parallel to the background surface 176 oriented and above the ground surface 176 and the line of sight 178 can be arranged. As mentioned above, the fourth projector 124 stuck in the HUD device 102 be arranged so that the fourth focal plane 174 is static. As mentioned above, the fourth focal plane 174 be continuous, making the fourth graphic element 172 can be rendered to the driver with appropriate depth of space values as a 3-D image.

The fourth graphic element 172 may be in one of the vehicle's environment markings 4 different form will be presented. Anyway, the fourth graphic element 172 on the fourth focal plane 174 be projected parallel to the background surface 176 It can be oriented and it can be above the ground surface 176 and the line of sight 178 be arranged by the driver. Accordingly, the fourth graphic element 172 provided at a sky focal plane, which may be appropriate since that of the fourth graphic element 172 not interact with the environment.

The HUD system described above 100 can project graphic elements, some of them as contact-analog augmented-reality graphics elements, with continuously varying focal distances, and in background-parallel focal planes with continuously changing focus from back to front in the direction of the line of sight 178 the driver. Accordingly, depth perception values can be improved to facilitate focusing and attention increase, which the driver at the same time or incidentally (or almost simultaneously) gives the environment. This allows the driver to observe information presented by the graphic elements as well as the surroundings. In this regard, the inventors have determined through experimentation that spatial perception may be strongly influenced by focus values, and that the focal plane adaptability as well as the capability of the HUD system described herein 100 To show graphic elements on continuous, static, to the ground parallel focal planes, which improves spatial perception. Therefore, a greater enhancement of spatial perception is observed when adjusting the focus values as described herein than can be observed when adjusting a size of a graphic element.

The configuration of the HUD device 102 including the use of the beam splitter 126 . 130 . 134 and lenses 128 . 132 . 136 . 138 allows the HUD device 102 has a relatively compact size. Furthermore, the lenses allow it 128 . 132 . 136 . 138 in that a depth range of a few meters in front of the vehicle to infinity within that for the optics of the HUD device 102 extending physical space extends. Furthermore, the beam splitters 126 . 130 . 134 are used as optical combiners to detect all separate amounts of projected beams from the first, second, third and fourth projectors 118 . 1120 . 122 . 124 through the lenses 128 . 132 . 136 . 138 to combine separate images of the first, second, third and fourth projectors 118 . 120 . 122 . 124 to combine into a unified image (or, for example, a graphic element) that is projected in the driver's field of view.

In one or more embodiments, some of the above-disclosed and other features and functions or alternatives or modifications thereof, preferably to many other various systems or applications may be combined. In addition, various alternatives, modifications or improvements not heretofore contemplated or contemplated may be subsequently made by those skilled in the art, and it is intended that the same be covered by the following claims.

For example, in the HUD system 100 fewer or more projectors are used to project fewer or more graphics elements. Furthermore, although the HUD system 100 has been described as having two projectors projecting graphic elements on frontal focal planes and having two projectors projecting focal plane graphic elements parallel to the ground, the ratio of frontal to ground parallel focal planes are changed. The vehicle functions described above in connection with the HUD system are exemplary and can be changed or modified.

Further, the mechanism by which the front focal planes are moved may be modified from that described above. For example, instead of moving the entire projector (for example, the first and third projectors 118 . 122 using the first and second actuators 156 . 158 ) only the diffuser discs (eg the diffuser discs 148 . 152 of the first and third projectors 118 . 122 ) relative to the respective projector units (eg the projector units 140 . 144 ) are moved.

In addition, although the HUD system 100 with reference to the vehicle 106 which may be a four-wheel automobile for outdoor use, the HUD system 100 be used in different vehicle types. For example, the HUD system may be used in a watercraft (eg, a boat), an aircraft (eg, an airplane or jet), or a vehicle intended for use in indoor spaces (e.g. Dolly, a vehicle intended for moving objects, such as a forklift, etc.).

5 is an illustration of an example component diagram of a system 500 for 3-D navigation according to one or more embodiments. The system 500 can be a HUD component 100 , a vehicle control component 180 , a control component 104 , a navigation component 540 , a depth map component 550 , a depth buffer component 560 , one or more sensor components 570 and one or more control area networks (CANs - Controller Area Network) 580 include. The HUD component 100 may be a vehicle HUD system, such as the HUD system 1 and components described above include. In one or more embodiments, the HUD component 100 among others, a 3-D HUD, a variable-distance HUD, an augmented-reality HUD (AR-HUD), etc.

The navigation component 540 may be configured to obtain or identify a home position (eg, point A) and one or more target locations (eg, point B). The navigation component 540 may be arranged to determine, for example, one or more routes from point A to point B. In general, the navigation component 540 assigned to a vehicle. For example, the navigation component 540 mounted in the vehicle, in one integrated with one or more systems or one or more components of the vehicle, be housed within the vehicle, be connected to one or more components of the vehicle or communicatively coupled, or be disposed within the vehicle, etc. In any case, the navigation component 540 get or identify the starting position and the target position. In one or more embodiments, the navigation component 540 comprise a telematics component (not shown) that may be configured to determine a current location or position of the vehicle.

Additionally, the navigation component 540 be configured to generate one or more routes from the home position to one or more of the destination locations. In one or more embodiments, the navigation component 540 be configured to generate one or more of the routes from a current location or a current location of the vehicle to one or more of the destination locations. A route of the one or more routes may include one or more sections or one or more route sections. For example, one or more portions of the route may include one or more navigation instructions or maneuvers associated with one or more road sections or one or more intersections of road sections. In other words, one or more portions of the route may include one or more direction changes, navigation maneuvers, road sections, intersections, landmarks, or other elements along the route. The navigation component 540 may be configured to identify one or more of these direction changes, navigation maneuvers, landmarks, etc., and output one or more navigation instructions or one or more navigation instructions, for example, to a driver of the vehicle.

The navigation component 540 may issue one or more of the navigation instructions or navigation instructions by means of audio output, visual output, tactile output, etc. For example, the navigation component 540 cooperate with one or more peripheral components (not shown) by communicating one or more outputs over one or more Control Area Networks (CANs). 580 be transmitted. The navigation component 540 may play an audible instruction, such as "turn left on the main street" or flash a light on the left portion of a display, vibrate the steering wheel, etc., to indicate to the driver that a drive action is to be performed. The navigation component 540 may cooperate with one or more other components to facilitate transmission or delivery of one or more driving instructions.

For example, the HUD component 100 be configured to project one or more navigation instructions or one or more navigation maneuvers as one or more graphic elements or avatars in the field of view of an occupant or driver of the vehicle. These navigation instructions may be from the navigation component 540 (eg directly or indirectly). The HUD component 100 may be configured to project an avatar on successive focal planes such that the avatar emerges from the eye box for an occupant, such as a driver 2 looks out, seems to move. That way, the HUD component can 100 allow a driver to perceive a volumetric image in the driver's field of vision, which volumetric image may serve as a "virtual" guidance vehicle for the driver of the vehicle to follow. In other words, the driver of the vehicle may feel that he or she only has to follow a leader vehicle to a target position, for example. Additionally, one or more navigation instructions or navigation instructions may be projected as a volumetric wildcard, marker or flagpole, as will be described herein.

The HUD component 100 may be configured to project one or more graphics elements, which may be augmented reality analogue graphics, conformal augmented reality graphics, avatars, characters, etc. These graphic elements can be from the HUD component 100 be projected volumetrically. As a result, one or more visual values or one or more spatial depth values associated with the graphics elements may be substantially maintained. Maintaining one or more of these visual values or depths of space may be accomplished by projecting graphics elements onto a dynamic focal plane or a movable focal plane. That is, the HUD component 100 be configured to project or render one or more graphics elements on a movable or customizable focal plane. A dynamic focal plane or a movable focal plane may be moved or adjusted along a path or line, such as a line of sight of an occupant of a vehicle, such as with reference to FIG 1 and 3 has been discussed. In other words, the dynamic focal plane may be movable toward or away from a vehicle or windshield of a vehicle.

In one or more embodiments, a focal plane may be due to movement of projectors or screens of the HUD component 100 be dynamic, such as through the use of actuators. That is, one or more projectors of the HUD component 100 may be configured to move linearly, thereby allowing the respective projectors to project one or more graphics elements onto a dynamic, movable or adaptable focal plane that will move as the projectors move. In other embodiments, one or more other means or alternative means may be used for the adjustments.

In other words, when a graphic element is projected onto a dynamic, movable or adaptable focal plane, the graphic element can be projected onto a focal plane, with a distance (eg, distance 162 ' or distance 170 ' out 3 ) is adjusted between the focal plane and the vehicle. Because projectors of a HUD component 100 Projecting or rendering graphical elements on movable focal planes allows the focus to be adjusted by graphical elements projected at various distances from the vehicle. As mentioned, one or more of the focal planes may be oriented substantially perpendicular or substantially parallel to a line of sight of an occupant of the vehicle. In other words, a focal plane may be parallel to the ground or perpendicular to the ground. Additionally, one or more of the focal planes may be movable or static with respect to the line of sight of the occupant or the ground. This allows room depth values associated with the graphics elements to be correctly presented to occupants of the vehicle, such as the driver, as the vehicle moves or travels (eg, when it serves as a moving platform).

The HUD component 100 out 5 may be configured to project or render volumetric contact analog augmented reality graphics. This means that these graphic elements can be projected to appear at different intervals. In other words, the HUD component 100 Project graphic elements on different focal planes or in a customizable way. Stated another way, focal planes of graphic elements derived from the HUD component 100 be projected at distances that extend beyond the windshield, for example, to the vicinity of a pedestrian on the sidewalk, thereby allowing an occupant to focus on the operating environment or driving environment rather than the focus their eyes between the windshield or the dashboard of the vehicle and the driving environment to adjust. In this way, driving safety through the system 500 be improved for a 3-D navigation.

Accordingly, graphics elements may be projected or visually placed in an immediate field of view of an occupant (eg, by the HUD component 100 ). This means that graphic elements can be rendered in the same room as the real environment rather than being reproduced in an accurate or correct manner on the windshield, which allows depth of space values associated with the graphics elements. As a result, graphic elements can be projected onto the same focal planes as objects from the real world (eg, the road) so that, for example, an occupant of the vehicle can view the graphic elements without looking away from the road.

These multiple focal planes or customizable focal planes can be achieved as if projectors of the HUD component 100 can be transformed or changed so that a projected graphic element or virtual object may appear farther than the windshield or may have a focal plane that is not on the windshield. That is, for example, the projected graphic element or virtual object may have similar firing properties as a real object (eg, a pedestrian, a vehicle, a sign, etc.) that is far away (eg, ten meters). As light rays are reflected away from the glass of the windshield, outgoing light rays dissipate, creating a "reflected" image or image that can be projected as a graphic element.

Because the light rays are reflected away from the windshield rather than being emitted from or appearing on the windshield (eg, as by special coatings), rendering of a graphic element is not necessary when an occupant moves his head. For example, the continuous, static focal planes allow 3 in that the forward-backward direction in 3-dimensional space (e.g., the direction of an occupant's line of sight) produces optically "correct" or real images, thereby making it possible to generate appropriate motion parallax values. Accordingly, as the occupant's head moves, graphic elements associated with that focal plane may appear as if their position in the environment were fixed instead of moving around. As mentioned this means that the HUD component 100 no tracking functionality for the head needed to compensate for the movement of the head of an occupant.

The HUD component 100 can be raster-based rather than vector-based. That means that from the HUD component 100 projected graphic elements may be a bitmap, may have a matrix dot structure, or may be a rectangular pixel grid. Additionally, the HUD component 100 be configured to project one or more sections of one or more graphic elements having different shades, transparency levels, colors, brightnesses, etc.

Thus, the HUD component may be configured to render or project graphic elements or avatars having different degrees of freedom. That is, the accommodation can be maintained so that the eyes of an occupant can actively change an optical power to focus on a graphic element projected onto a focal plane. Similarly, vergence may be maintained so that the occupant may have a simultaneous inward rotation of a graphic element as the graphic element is projected to "come closer" (eg, by projecting onto successive focal planes).

In one or more embodiments, the HUD component 100 Project a graphic element as an avatar or moving avatar for a driver or occupant of a vehicle, which he or she may follow as a navigation instruction, maneuver, or command. For example, the HUD component 100 be configured to project or render one or more of the graphic elements as a moving avatar, a wildcard, an identifier, a flagpole, a marker, etc. These graphics elements may be projected onto one or more focal planes around an environment surrounding the vehicle and may be projected in the field of view of an occupant of the vehicle. An avatar or graphic element created by the HUD component 100 can project a driver of a vehicle through one or more sections of a route and avoid collisions with obstacles, blockages, or road conditions by projecting to dodge, navigate, move, or drive around those obstacles. A sensor component 570 may be configured to detect one or more obstacles or road conditions, and a control component 104 can be the HUD component 100 to direct the graphic element to project such that the graphic element travels around or bypasses the road state, for example by changing lanes or avoiding bottlenecks for traffic.

In one or more embodiments, the sensor component 570 be configured to identify or detect one or more road conditions in an environment around the vehicle or surrounding the vehicle. The sensor component 570 may include road sections, walkways, objects, pedestrians, other vehicles, closures, obstacles, debris, potholes, road surface conditions (eg, ice, rain, sand, gravel, etc.), traffic conditions, traffic signs (eg, red lights, Detect or identify speed limit signs, stop signs, level crossings, trains, etc.). These road states may be sent to the control component 104 or the vehicle control component 180 be transmitted. For example, one or more of the CANs 580 used to communicate between the sensor component 570 and the control component 104 or the vehicle control component 180 to facilitate. In one or more embodiments, the sensor component 570 include one or more image capture devices, a microphone, a blind spot monitor, a parking sensor, a proximity sensor, a presence sensor, an infrared sensor, a motion sensor, etc.

As the term is used herein, a traffic condition may include an intersection, a vehicle such as a vehicle sharing a road with a vehicle equipped with a 3-D navigation system, a road junction, a red traffic light include a stretch of road, walkway, stop sign, right of way sign, road sign, train, etc. As the term is used herein, a road condition may include debris, gravel, potholes, a road surface condition, sand, fallen trees, spills, oil puddles, weather conditions such as ice or rain, etc. Further, an "object" may include substantially any traffic condition, road condition, weather condition, etc. Examples of objects may include, but are not limited to, other vehicles, shops, buildings, landmarks, obstacles on a road, road sections, intersections, pedestrians, etc. Objects may be found, detected or assigned in connection with a path, one or more road sections, etc., along a route on which the vehicle is traveling or is expected to travel along.

In more detail, the sensor component 570 Receive, detect, or detect information (eg, objects, traffic conditions, road conditions, weather conditions, etc.) from an environment such as a driving environment, an operating environment, or an environment surround a vehicle. From the sensor component 570 Information collected by the control panel network 580 and from the tax component 104 be analyzed, or via one of the navigation component 540 provided telematics channel and analyzed by a (not shown) remote server. In any case, from the sensor component 570 information obtained or collected has cause to exercise caution, a cause to decelerate (for example, due to a speed limit indication or a speed limit sign), speed up a reason, stop a ground, turn a reason, etc. for to show a driver. In other words, those of the sensor component 570 collected information from the control component 104 or a remote server and translated into one or more suggested driving actions for a driver. These proposed driving actions can be done by the HUD component 100 as visual objects or graphical elements based on the vehicle control component 180 collected information and from the control component 104 be projected.

In one or more embodiments, the sensor component 570 detect or detect one or more objects, one or more traffic conditions, one or more road conditions, one or more weather conditions, etc. For example, a proximity sensor (eg, one of the sensor components 570 ) on a vehicle detect a pedestrian crossing a pedestrian crossing. In addition, other components may receive information related to the environment, driving environment or operating environment. For example, the vehicle control component 180 similar information (eg using one of the navigation component 540 provided telematics channel or from the sensor component 570 via the control area network 580 ) receive. In this way, the vehicle control component can 180 Collect information from one or more sources. In other words, the vehicle control component 180 Get information, traffic condition information, road condition information, weather condition information, etc.

The sensor component 570 can collect information directly from the environment while the vehicle control component 180 Collect information from various sources that may not necessarily be located in the vehicle. For example, the vehicle control component 180 Traffic information along an estimated route for the vehicle obtained from a traffic database or a news source. In any case, the vehicle control component 180 Accumulate information about the environment, such as the environment around a vehicle, or environmental information associated with a prospective route for the vehicle (eg, environmental information at a location that a vehicle is likely to pass while traveling along a vehicle predetermined route goes).

Regardless, the vehicle control component may 180 be configured to access data associated with one or more of the road conditions or data associated with an environment surrounding the vehicle (eg, an operating environment, a driving environment, the surrounding environment, etc.) receive. In one or more embodiments, the vehicle control component may 180 one or more of the road conditions from the sensor component 570 receive. In addition, the vehicle control component 180 receive one or more road states from one or more other sources, such as a server (not shown) or a database (not shown). The vehicle control component 180 may be communicatively coupled to the server, a third party vendor, a database, or other device via a telematics channel initialized by a telematics component (not shown). In this way, the vehicle control component can 180 Collecting information related to one or more portions of a route from a home position to a destination location.

For example, the vehicle control component 180 Obtain road condition information that includes traffic information of a road section (eg, whether the traffic is jamming, if there was an accident on the road, etc.). In addition, the vehicle control component 180 Speed limit information obtained in connection with one or more road sections of a route. This information can be used to determine how to project one or more graphic elements for a driver or occupant of a vehicle. That is, when a road section has a speed limit of 65 miles per hour and a momentary (eg, from the sensor component 570 detected) speed of the vehicle is 25 miles per hour, the vehicle control component 180 the HUD component 100 instruct to project an avatar so that the avatar appears to accelerate as it enters the stretch of road.

As another example, the vehicle control component 180 if the sensor component 570 detects a traffic obstruction on a lane on which the vehicle is currently running, obtains this information, and determines that a navigation instruction for changing the current lane from the HUD component 100 should be displayed. This instruction can be over one or more CANs 580 to the HUD component 100 which may project, render or animate an avatar or graphic element that changes lane or changes position in response to the detected traffic obstruction. In other words, the HUD component 100 projecting an avatar or symbol that appears to evade or navigate around the traffic obstruction, with the avatar or symbol positioned in front of the vehicle in the operating environment around the vehicle. Likewise, the vehicle control component 180 be set up to the HUD component 100 cause a flashing signal to be projected on the avatar since a real vehicle would flash when it changes lane. Furthermore, the vehicle control component 180 Adjust a perceived speed for the avatar when the avatar approaches the traffic obstruction. This can be achieved by projecting the avatar or graphic element on increasingly near focal planes, or by adjusting a dynamic focal plane of the graphic element so as to reduce the distance between the dynamic focal plane and the vehicle or windshield of the vehicle. (In contrast, if it is desired that the avatar be projected as if accelerating, the dynamic focal plane may be adjusted to increase the distance between the dynamic focal plane and the vehicle or windshield therefrom).

In other words, the vehicle control component 180 be configured to obtain one or more road conditions, wherein a road state of the one or more road states comprises traffic information of one or more of the road sections or speed limit information associated with one or more of the road sections. Furthermore, the vehicle control component 180 be set up to the HUD component 100 to project one or more graphics elements based on one or more of the road conditions, such as a speed limit of a road section and a current speed of the vehicle. In this way, the vehicle control system can 180 One or more appropriate actions (such as stopping, accelerating, lane change, deceleration, etc.) or navigation instructions determined by the HUD component 100 to be projected.

In one or more embodiments, the system may 500 A visual field management component (not shown) comprising one or more aspects of the one or more of the HUD component 100 manages projected graphic elements. In one or more embodiments, the control component 104 be adapted to one or more of these aspects or functionalities related to the vehicle control component 180 manage. For example, the control component 104 be adapted to receive one or more road conditions.

The control component 104 may be configured to determine a type of graphic element that is from the HUD component 100 displayed, projected, animated, rendered, etc. As an example, the control component 104 when a vehicle travels along one or more portions of a route that includes relatively straight road sections, projecting a graphic element as an avatar. The avatar may appear or be projected as a vehicle or a lead vehicle. In a scenario in which a vehicle travels along one or more portions of a route that includes one or more turnarounds or other navigational maneuvers, the control component may 104 the HUD component 100 instructing to project a graphic element as a marker at a position associated with one or more of the turn operations. For example, when a route includes turning right from a first road to a second road, the control component may be 104 the HUD component 100 instruct a marker or identifier to, to, etc. project the intersection of the first street and the second street. In this way, the control component can 104 be adapted to determine one or more types (eg, markers, identifications, flagpoles, guide avatars, etc.) of graphics to be displayed.

In addition, the control component 104 be adapted to determine one or more positions at which a graphic element will be projected. In other words, the control component 104 Decide when and where a graphic element will be projected or how the graphic element will be displayed. For example, a position of a graphics element may include a focal plane, a focal plane distance from the vehicle or windshield thereof, x coordinates, y coordinates, z coordinates, etc. along an x, y, or z axis. This position can be used as the target position for one or several of the graphic elements are called. In one or more embodiments, the control component 104 be configured to adjust a distance between one or more of the focal planes of one or more of the graphical elements and the vehicle (or eg the windshield of the vehicle) based on one or more road conditions associated with one or more portions of the route , a current position of the vehicle, a current speed of the vehicle, etc. adapt.

That is, when there is a speed limit of 65 miles per hour (eg, a road condition) on a road section (eg, a section of a road on which a vehicle is located or positioned), and a current speed (eg from the sensor component 570 detected) of the vehicle is 25 miles per hour (eg, the instantaneous speed of the vehicle), the control component 104 may be configured to the HUD component 100 To instruct to project an avatar or graphic element that seems to be traveling at a speed of about 65 miles per hour. In one or more embodiments, the avatar may be projected in a manner that demonstrates a gradual acceleration from 25 miles per hour to 65 miles per hour. This means that a distance between the focal plane of the avatar and the vehicle can be adjusted accordingly. For example, in a scenario where the vehicle is accelerating at about the same rate, the distance between the focal plane and the vehicle may remain approximately the same. As the vehicle accelerates at a slower rate than the avatar, this distance between the focal plane and the vehicle may be so from the control component 104 be adjusted so that it increases. In either case, this adjustment may be based on a current position of the vehicle or a current speed of the vehicle, as well as road conditions of the associated route.

In addition, the control component 104 be configured to a size of a graphic element according to or based on a distance of the focal plane of the graphic element of the vehicle with the HUD component 100 to determine. That is, the control component 104 can adjust a height, size, width, depth, etc. of a graphic element, guide, or avatar based on a desired perception. For example, the control component 104 to make the avatar accelerate, adjust the size of the avatar to shrink or reduce as the avatar is projected onto increasingly distant focal planes or a dynamic focal plane is adjusted to move further and further away from the vehicle is.

In one or more embodiments, the size of the graphic element may be used as an indicator of an importance level of a navigation instruction or message. In other words, the more important the message or navigation instruction is, the larger the avatar, icon, or graphic element is projected.

The control component 104 may be set up to perform one or more actions on one or more of the HUD component 100 to determine the graphic elements to be projected. For example, the control component 104 the HUD component 100 instruct to project the avatar to accelerate, decelerate, stop, change lane, activate a flashing signal before a lane change, illuminate, flash, change an avatar's orientation or angle, change an avatar's color, etc Furthermore, the control component 104 Adjust target positions for one or more of the graphical elements based on road conditions, a current position of the vehicle, a current speed of the vehicle, or other attributes, characteristics, or measurements. In one or more embodiments, the control component 104 with the navigation component 540 via one or more CANs 580 interact or communicate.

The control component 104 may be configured to mitigate disability, distractions, or other aspects that could affect a driver or occupant of a vehicle. In one or more embodiments, the control component 104 be adapted to a position of the horizon, for example, from a sensor component 570 and to project graphic element above the horizon or a sky plane, etc. The control component may be configured to determine color, transparency, or shade of one or more graphics elements based on a time of day, traffic associated with the route, knowledge of the driver of the route, etc.

The depth map component 550 may be configured to create or maintain a depth map of an environment around the vehicle or surrounding the vehicle. The HUD component 100 can use the depth map to project one or more graphic elements accordingly. This means that when an avatar turns and is "behind" a building (eg, a building is between the line of sight of an occupant of the vehicle and a perceived position or target position of the graphic element or avatar), the HUD component 100 a projection of one or more sections of the avatar or graphic element according to what is to be seen, activated or deactivated.

The depth map component 550 may be configured to receive a depth map from a server or a third-party server. For example, the depth map component 550 Download a depth map via a telematics channel that is initialized using a telematics component (not shown). In other embodiments, the sensor component 570 be adapted to detect depth information that can be used to the depth map using the depth map component 550 to create. That is, the depth map component 550 interact or interact with one or more sensors to create the depth map or obtain a pre-created depth map from a database. In any case, the depth map component 550 create or get a depth map based on depth information. The depth map may indicate distances from one or more surfaces, objects, obstacles, geometries, etc. in the environment or area around the vehicle.

The depth map can be sent to the control component 104 passed on or transmitted to the HUD component 100 instruct you to render one or more of the graphic elements accordingly. For example, the HUD component 100 Project or render graphical elements based on a height of an eyebox in association with an occupant of a vehicle, a position of the vehicle, and a depth map of the area that can be actively detected or obtained from a database. The HUD component 100 may thus project one or more of the graphics elements based on the depth map to account for a perspective of one or more occupants of the vehicle.

The depth buffer component 560 may be configured to provide perspective management for one or more occupants of the vehicle using the depth map component 550 simplified or obtained depth map. That is, the depth buffering component may be configured to facilitate rendering of graphic elements such that the graphic elements appear visually "correct" to an occupant. For example, if a graphic element is to be projected behind a real-world object, the depth buffer component 560 to "hide" a portion of the graphic element from an occupant by not projecting or rendering that portion of the graphic element. In other words, the depth buffer component 560 manage which sections (eg, pixels) of a graphic element are drawn, projected or rendered, and which sections are not. This allows the depth buffer component 560 be configured to turn on or off rendering of one or more portions of one or more graphics based on the depth map.

In addition, the depth buffer component 560 be designed to obscure objects of the real world, thereby influencing what an occupant of a vehicle can see. For example, the depth buffer component 560 the HUD component 100 to direct a white graphic element such that the graphic element is a real-world object, such as a billboard (eg, detected by the sensor component 570 ) obscured. Consequently, an occupant can not see the billboard or he has a blind view of the billboard. In this way, the depth buffering component may be configured to prevent distractions to a driver or occupant of a vehicle by providing graphic elements that facilitate diminished reality.

Examples of navigation instructions provided by the HUD component 100 projecting may include: following a leading vehicle, accelerating (eg, changing the dynamic focal plane to have an increased distance from the focal plane to the vehicle, thereby adapting a near-far perception of a driver or occupant, which it could have from the graphic element), to decelerate (eg, adjust the distance between a focal plane to reduce it), to change a lane (eg, adjust a target position for a graphic element) around obstacles navigate, turn around, reach the destination, mark a position, etc. For example, the control component 104 the HUD component 100 instruct to project an avatar to "decelerate" when a pedestrian steps on the road section, road, crosswalk, etc. As another example, the control element 104 the HUD component 100 instructing to project braking based on a turning angle, a speed limit associated with a road section, road conditions such as ice, etc. This means that if there is ice on the road surface, the control element can 104 the HUD component 100 instruct to project an avatar that moves slower than if there were no ice on the road surface.

In one or more embodiments, the control component 100 mark an upcoming curve or intersection with a marker, a flagpole, a flagpole, an identification, etc. For example, the HUD component 100 render or project a placeholder or mark according to the perspective of the occupant of the vehicle. The depth map component 550 may be configured to provide a depth map such that real-world objects such as buildings, trees, etc. act as line-of-sight blocks for one or more portions of the wildcard. For example, if a placeholder has a perceived height of 100 feet and a 50 foot tall building is in front of the placeholder, the depth buffer component may 560 compensate for the line of sight being blocked by not rendering or projecting a lower portion of the placeholder graphic element, thereby projecting the placeholder according to the perspective of the driver or occupant.

In one or more embodiments, one or more graphics elements are projected in the field of view of an occupant of the vehicle based on the route (eg, a "follow a leader vehicle mode"). In one or more embodiments, the graphic element may be projected as an avatar or other guide symbol. The avatar may appear to be flying and being projected around the vehicle around a real-world environment. The avatar can move, drive or "fly" in 3-D space or in three dimensions. Therefore, the avatar or the graphic element may appear to move in 3-D, giving rise to a more intuitive feeling or feeling for an occupant or driver following the avatar. For example, an avatar, a graphic element, or a guidance icon may be projected to appear to change in height or size based on a perceived distance from an occupant of the vehicle. The avatar can be animated by projecting the moving avatar sequentially onto one or more different focal planes. In addition, the avatar may appear as navigating around barriers, obstacles, pedestrians, rubbish, potholes, etc., as a real-world vehicle would. In one or more embodiments, the avatar may "drive", move, appear as if moving according to real-time traffic, etc. The avatar may change the lane so that the avatar does not "hit" or otherwise join other vehicles seems to interfere with traffic. As another example, when a route guides a driver or a vehicle over train rails, the avatar may stop at the train rails when a train crosses the road. In other embodiments, the HUD component 100 be configured to project the avatar or graphic element to stop at stop signs, red lights, or traffic rules. Upon arrival at a destination position, the HUD component may 100 be configured to render or project an avatar, for example, in a rest pose.

That way the system can 500 For 3-D navigation, generate an intuitive message, instruction or command for an occupant of a vehicle, such as a driver. The instruction may be based on one or more aspects relating to a perspective as provided by the ability of the HUD component to project or render volumetric 3-D graphics along one or more focal planes. For example, the 3-D effect may be determined based on a distance, a perspective, a perceived distance, road conditions, etc.

6 is an illustration of an exemplary flowchart of a method 600 for 3-D navigation according to one or more embodiments. at 602 a route can be generated from a starting position to a destination position. In one or more embodiments, the home position or the target position may be obtained via a telematics channel, such as from a Global Positioning System (GPS) unit. at 604 For example, one or more graphics elements may be projected onto one or more focal planes in the field of view of an occupant of a vehicle. Here graphic elements can be displayed as avatars, pictures, symbols, identifications, markers etc. In addition, these graphic elements may be based on one or more sections of the route. That is, these graphical elements may be projected at different distances depending on the portion of the route a vehicle may be located on (eg, a current position of the vehicle).

at 606 For example, a distance between a focal plane and the vehicle may be adjusted based on road conditions associated with one or more portions of the route. Further, the distance may also be adjusted based on a current speed of the vehicle. For example, when a vehicle travels along a portion of a route associated with a "65 mph speed limit and the current speed of the vehicle is 25 mph, the distance between the focal plane of a projected graphics element or avatar may be increased (eg to indicate to the driver or an occupant that he should accelerate). In other words, the graphic element can be projected to be appears as if it is driving about 65 mph fast, causing the occupant or driver to accelerate and "catch up" the avatar (eg, similar or simulated to following a leader vehicle).

7A is an illustration of an exemplary avatar 700 for 3-D navigation according to one or more embodiments. The avatar 700 out 7A can appear in front of a vehicle and fly around, glide, move, maneuver, etc. around elements, obstacles, traffic, road conditions, etc. 7B is an illustration of an exemplary avatar 710 for 3-D navigation according to one or more embodiments. The avatar or the avatars 710 out 7B are shown from an elevated view, such as a bird's-eye view just behind the avatar or avatars 710 , It can be recognized that one or more of the avatars 710 are projected onto one or more different focal planes or target positions, thereby creating the perception that a driver or occupant is following a real vehicle.

8A is an illustration of an exemplary avatar 800 for 3-D navigation according to one or more embodiments. The avatar 800 out 8A is turned counterclockwise to indicate a turn to the left. 8B is an illustration of an exemplary avatar 810 for 3-D navigation according to one or more embodiments. In one or more embodiments, the avatar may be 810 out 8B indicate a turn to the left by a flashing, flashing, a color change, etc. For example, the left wing of the paper airplane avatar 810 light up or change an intensity to indicate the upcoming turn to the left. In one or more embodiments, an avatar may be projected onto focal planes that are closer to the vehicle such that it appears as if the avatar is "decelerating" before turning.

9A is an illustration of an exemplary avatar 900 for 3-D navigation according to one or more embodiments. 9B is an illustration of an exemplary avatar 910 for 3-D navigation according to one or more embodiments. The avatar 900 out 9A may be projected as a navigation instruction for a driver of a vehicle for braking, for example. In 9B becomes the avatar 910 projected above the horizon or a sky-plane, leaving the avatar 910 does not prevent the driver or occupant from viewing one or more portions of the environment around the vehicle.

10 - 20 will be described with reference to one or more of the previous figures, such as the system 500 for 3-D navigation 5 or the side view 300 or focal planes 3 ,

10A is an illustration of an exemplary scenario 1000 in the context of 3-D navigation according to one or more embodiments. In 10A For example, an occupant, driver, passenger, operator, etc. of a vehicle may enter an instruction to one or more components of the vehicle, such as the sensor component 570 out 5 , In one or more embodiments, the sensor component 570 one or more peripheral components, one or more peripheral devices, one or more interfaces, one or more interface components, such as a touch screen, a keyboard, one or more buttons, an interface, a microphone, one or more image capture devices, a gesture recognition device, etc. For example, a vehicle may be provided with a touch screen interface, or buttons on a faucet may be used as an interface with a menu. In any case, one or more components or the sensor component 570 Capture or receive instructions given or input by an occupant of a vehicle.

For example, a driver may provide navigation instructions to the vehicle, such as "How do I get to downtown Sunnyvale?". In this example, the sensor component includes 570 a microphone that receives the verbal or spoken instruction from the occupant or driver and the instruction through a control area network 580 to a control component 104 or a navigation component 540 passes. In other embodiments, when a mobile device is communicatively coupled to a vehicle, an occupant may include a microphone of the mobile device, a touch screen of the mobile device, a keyboard or keypad of the mobile device, etc. as an interface to the system 500 use for 3-D navigation. The control component 104 can perform speech recognition of the instruction by using an on-board voice recognition module to convert the voice-to-text (STT) instruction. Another option is the navigation component 540 Use a telematics channel to communicate with a remote server where STT processing can be performed.

In one or more embodiments, the HUD component, such as the HUD component or system 100 out 1 or the HUD component 100 out 5 a Project, present, render or display the acknowledgment of a statement or command. In other words, the HUD component 100 serve as a display component or supplement other display components of a vehicle. To sample the "How to get to downtown Sunnyvale?" 10A can continue if a statement or command from the control component 104 is received, the control component 104 Based on environmental information, determine whether or not confirmation of the instruction is projected by the sensor component 570 has been provided or detected. This may be because the sensor component 570 does not detect vehicles, pedestrians or other obstacles, the control component 104 Make a determination that confirms the instruction from the HUD component 100 should be projected. In addition, the control component 104 determine a size, a shape, a model, a transparency, a color scheme, a height, a width, a depth, a target position, a focal plane, etc. for a corresponding graphic element. Thus, an acknowledgment of the instruction from the HUD component 100 be projected in a text box, as in 1004 you can see.

In one or more embodiments, the control component 104 instruct the HUD component to have a graphic element as an avatar 1002 to project, which may appear as a guide symbol. In 10A can the graphic element as an avatar 1002 be projected with a shape or appearance of an aircraft, which slides easily along a route in front of a driver or occupant of the vehicle. To enhance attention, the tax component can 104 the HUD component 100 induce the avatar 1002 to animate that, the avatar 1002 floats or is constantly in motion. In other words, this allows the avatar 1002 easier to see is the control component 104 the HUD component 100 to induce the avatar 1002 periodically assign a movement. For example, the HUD component 100 the avatar 1002 project so that it appears as if it floats in water, teeters, hovers, etc. In this way, the driver's attention can be increased.

10B is an illustration of an exemplary scenario 1010 associated with 3-D navigation, according to one or more embodiments. When a statement or command, such as a navigation command, from the control component 104 can receive the control component 104 forward the instruction or command to the appropriate component or module. In this example, the control component 104 identify the statement or command as a navigation command and the navigation command to the navigation component 540 pass on. Accordingly, the navigation component 540 determine an initial position for the vehicle (eg, a current position) and the target position, and calculate a route from the home position to the target position. As discussed above, the route may include one or more route sections along one or more road sections and / or one or more navigation actions or maneuvers.

The navigation component 540 can be the route, route sections or route information of the control component 104 which can determine whether or not or / and how the route information should be rendered. For example, since the vehicle is in 10B is not in motion (eg when parking) or moving at a low speed (eg below one via the control area network) 580 detected or provided threshold), the control component 104 determine that a top view 1030 the route for the HUD component may be suitable for projecting. Accordingly, the control component 104 cause the HUD component to be the top view 1030 to project such that the top view 1030 occupy a larger area within the environment. In other words, the control may be a size for a graphic element or whether the graphic element should be projected or not based on a speed of the vehicle. In contrast, when the vehicle is in motion or moving above a threshold speed, the control component may be 104 make a determination that a smaller version should be projected or that the HUD component 100 the top view 1030 not projected at this time.

In 10B The HUD component can be a top view 1030 project a map that has a route 1032 from a starting position to a target position along one or more road sections. The HUD component 100 can a compass 1034 , Road section identifiers 1036 , Traffic information, estimated arrival times, estimated driving times, a current position of the vehicle, etc. project. In one or more embodiments, the HUD component 100 different aspects of the top view 1030 project using one or more color schemes. For example, the HUD component 100 project the route in such a way that the route 1032 is rendered using a first color, and other road sections, such as the one with 1036 Marked Road section, rendered using a second color.

In one or more embodiments, the sensor component 570 Include image capture devices or other sensors that help determine a color palette or color scheme for displaying or projecting graphic elements. For example, in 10B to see that there are one or more trees in the background or the environment that make a green harder to see or visualize.

Accordingly, the control component 104 Choose a color scheme to project one or more graphic elements that use colors that contrast with green, such as yellow. As another example, for example, during the daytime of the sensor component 570 it can be detected that the sky is blue, while at night the sky can appear black. In other words, the sensor component 570 Obtain, acquire, capture, or detect color information related to the environment that can be used to contrast graphic elements. The control component 104 can use this information to determine colors for which the HUD component 100 can project one or more graphic elements. This can be the control component 104 determine that red is an option during the day while blue is an option at night. In this way, the control component may determine color schemes or a color for a graphic element or avatar based on a time of day or color information associated with the environment (eg, received or detected by the sensor component) 570 ).

In one or more embodiments, the HUD component 100 one or more aspects of the plan view 1030 animate. For example, the HUD component 100 the route 1032 Animate along one or more road sections such that or as if the route 1032 would be drawn from the starting position to the target position with a continuous stroke of the pen. In other words, the HUD component 100 an animation that represents driving along the route, serpentine from the starting position to the destination position render.

The HUD component 100 can be graphic elements or avatars, such as the avatar 1002 out 10A Project using different camera angles, camera angles or different views. Furthermore, the HUD component 100 move between these views in an animated or gradual way. For example, the HUD component 100 the camera angle or the camera angle from a bird's eye view, such as the top view 1030 out 10B into a first-person view or a third-person view, as in 10A shown. The HUD component can be explained differently 100 Gradually adjust the camera angle to transition from bird's-eye view, layout view, overhead view, zoomed out view, or third person view to zoomed in view, first person view, street level view, and so on.

For example, the HUD component 100 use a camera angle or a camera angle that seems to stop zooming or transitioning to a street level view that coincides with the view of the real world or the same view of the environment that an occupant or driver would have sitting in his vehicle and looking outside through the windshield into the real world. In other words, the street level view may be a view that an occupant has while inside an eye box and looking in a forward direction through a windshield of the vehicle. In other words, the zoom animation or the transition to rendering only an avatar or graphic element may result in the driver's field of vision, such as the avatar 1002 out 10A , 11A is an illustration of an exemplary scenario 1100 in the context of 3-D navigation in accordance with one or more embodiments. It can be seen that the view of the avatar 1002 that in this exemplary scenario 1100 is a transitional view that is between a bird's-eye view or a top view 1030 out 10B and the third-person view 10A is reached.

In one or more embodiments, the HUD component 100 provide a zoom animation in reverse order (ie, from a third-person view to a bird's-eye view) when an occupant requests a view of a map or when the occupant initiates a map view statement. In this scenario, the HUD component may be 100 a third person view of an avatar (eg 1002 out 10A project and zoom out or away in a bird's eye view (eg the top view 1030 out 10B ) fly. Furthermore, the HUD component 100 adjust an orientation of the route, map or view based on a direction or orientation of the vehicle. In other words, the HUD component 100 orient the map or view such that the direction of movement along a current road section appears to be up or forward, for example.

11B is an illustration of an exemplary scenario 1110 in the context of 3-D navigation in accordance with one or more embodiments. In one or more embodiments, the HUD component 100 provide navigation instructions or suggested navigation maneuvers to a driver of a vehicle. For example, the navigation component 540 generate a list of navigation instructions for a route from a home position to a destination location. The control component 104 can be the HUD component 100 to initiate respective navigation instructions into the environment, such as 1130 to project. Navigation instructions can be directions for a driver such as turning right, turning left, right lane, left lane, grant right of way, stop, slow down, increase speed, speed, etc. Further, navigation instructions do not necessarily require a driver to direct an action perform. For example, navigation instructions may alert a driver of a vehicle that no red light turn is allowed.

In one or more embodiments, the control component 104 Use a color scheme or the HUD component 100 cause one or more of the graphic elements or avatars to be projected using different colors to represent one or more navigation actions. For example, if the HUD component 100 an avatar, such as the avatar 1002A . 1002B or 1002C out 11B Green projected, indicating that there are no objects, obstacles or oncoming traffic from the sensor component 570 be detected. As another example, the HUD component 100 one or more of the avatars 1002A . 1002B or 1002C Project red to indicate to the driver that it is not yet safe to turn off. Here, the HUD component 100 For example, projecting a "grant right of way" sign as a navigation instruction rather than a "right turn" project.

As in 11B can be seen, the HUD component 100 several avatars 1002A . 1002B and 1002C project. In this example, the avatar 1002A projected onto a first focal plane, the avatar 1002B can be projected onto a second focal plane and the avatar 1002C may be projected to a third focal plane with the first focal plane closest to the vehicle, followed by the second focal plane, then the third focal plane, thereby creating the appearance of the avatar 1002C farthest from the vehicle. Because the HUD component 100 is capable of multiple avatars 1002A . 1002B and 1002C Projecting to different focal planes allows the system to do this 500 for 3-D navigation, providing a projected route, path or predetermined route for a driver to follow.

In one or more embodiments, the HUD component 100 one or more of the avatars 1002A . 1002B or 1002C project such that respective avatars maintain focal planes that are static relative to the current position of the vehicle. In other words, the HUD component 100 Project avatars or graphic elements such that the distance between the vehicle and focal planes for respective avatars decreases as the vehicle "approaches" an avatar. In other words, the HUD component 100 an avatar, such as one 1002A . 1002B or 1002C projecting as an object stationary with respect to the vehicle, thereby making it appear to a driver or occupant, as if an avatar is passing in front of the vehicle at one time or waiting for the vehicle to "catch up" at a later time. In these embodiments, the HUD component 100 projecting additional avatars as a route progresses and a person or driver of a vehicle "passes" the stationary or static avatars.

In one or more embodiments, the HUD component 100 one or more of the avatars 1002A . 1002B or 1002C such that respective avatars have focal planes that are dynamically adjusted to the current position of the vehicle, or that have a constant or fixed distance from the vehicle. In other words, the HUD component may project avatars or graphic elements such that the distance between the vehicle and focal planes for respective avatars remains constant as the vehicle is moving. In other words, the HUD component can project avatars as stationary objects that seem to move together with the vehicle. In one or more embodiments, the HUD component 100 between projecting avatars as objects stationary with respect to the vehicle and projecting avatars as objects that appear to be moving with the vehicle.

In any case, the HUD component 100 project any one of a plurality of graphics or avatars as an animation by adjusting focal planes on which to project one or more of the graphic elements or avatars. For example, avatars can be positioned 1002A . 1002B and 1002C be achieved by a single avatar, such as the avatar 1002 out 11A or 10A is extended. In other words, one or more avatars (or graphic elements) may be extended from a first avatar, and respective avatars may be grouped into a single avatar. In other words, multiple avatars may fly apart, separate, advance, or in front of a first avatar from the HUD component 100 be projected, for example, to facilitate animate a route navigation or navigation instructions.

In one or more embodiments, the HUD component 100 Projecting one or more graphic elements as hands that alert a driver or occupant of a vehicle about one or more objects, obstacles, road conditions, etc. The control component 104 may select a pointer type based on a speed of the vehicle and a speed of an object. For example, when the vehicle is stationary, oncoming traffic (or other objects, for example) may be identified by projecting a graphic element that rotates in a manner indicative of traffic, danger, or moving object while the object is navigating Vehicle is approaching or away from the vehicle.

12A is an illustration of an exemplary scenario 1200 in the context of 3-D navigation according to one or more embodiments. Here, the sensor component 570 passing traffic or another vehicle 1214 detect. Because the trajectory or the path of the other vehicle 1214 on a collision course with the proposed, from the avatar 1002B navigation action displayed is the control component 104 the HUD component 100 to project navigation instructions that alert the driver that he is at 1130 should grant the right of way. In other words, the sensor component 570 the position of the other vehicle 1214 follow. This information can be sent to the control component 104 which can determine that the pointer graphic element is from the HUD component 100 at 1002A should be projected. The HUD component 100 thus can the pointer graphic element 1002A so project that it is the other vehicle 1214 followed or followed him 1212A ,

12B is an illustration of an exemplary scenario 1210 in the context of 3-D navigation according to one or more embodiments. Continuing with the example 12A you can see that the other vehicle 1214 passed the vehicle that was stationary. The HUD component 100 can continue the right of way grant instruction 1130 project, as well as the next navigation instruction or action (eg right turn) 1002B , Because the sensor component 570 the other vehicle 1214 detected, the HUD component 100 the avatar 1002B in a corresponding color, such as red, project. In other words, the control component 104 Select a color for a graphic element from the HUD component 100 based on object information or environmental information (eg from the sensor component 570 collected or detected) is to be projected. The pointer 1002A out 12B can continue on the vehicle 1214 show or track it by rotating along a z-axis in a manner corresponding to a tracked object. In other words, the control component 104 a yaw of the pointer graphic element 1002A to adjust.

13A is an illustration of an exemplary scenario 1300 in the context of 3-D navigation according to one or more embodiments. While a person or a driver drives a vehicle, the navigation component may 540 determine a current position of a vehicle and / or corresponding coordinates. Using this information, the navigation component 540 or the control component 104 determine a street name and the HUD component 100 cause to project the street name on a focal plane corresponding to a surface of the road or the road section, as in 1330 you can see. As discussed herein, the projection of the graphics element onto the road surface may be performed in a manner that appears stationary with respect to the vehicle or in a manner that appears to be moving with the vehicle. In one or more embodiments, the HUD component 100 the street name 1330 in response to a request from an occupant of the vehicle, for example, "Which road am I on?". In addition, other graphic elements, information or highlighting can be projected onto landmarks, objects, etc.

In 13A For example, various graphic elements or avatars are projected from the HUD component and can be animated, summarized, expanded, etc., as previously discussed. That way the avatars can 1002A . 1002B and 1002C be provided to a driver of a vehicle or other occupant along a route to a destination. 13B is an illustration of an exemplary scenario 1310 in the context of 3-D navigation according to one or more embodiments. Here it can be seen that the avatars 1002A and 1002B be projected with varying pitch angles, roll angles and yaw angles. The control component may be a pitch, roll or yaw angle for an avatar or a graphic element based on a trajectory of a path, a Select or adjust the radius of an upcoming curve, a current speed of a vehicle, a speed limit associated with an upcoming turn, a proposed navigation action, information from the environment, a distance to the next navigation instruction or action, etc.

Here, in this example, since a proposed route causes the vehicle to take an upcoming exit having a circular road shape or road section, the control component 104 the HUD component to induce the avatar 1002B with a greater roll or yaw angle than the avatar 1002A projecting, thereby providing a perception that a curve follows to the right. In addition, the control component 104 a shorter distance between the focal planes for the avatars 1002A and 1002B Select to see how tight a curve can be. In other embodiments, the control component 104 select a color, such as money or orange, for one or more of the avatars to indicate an upcoming turn and / or a corresponding reason for a driver to, for example, decelerate.

14A is an illustration of an exemplary scenario 1400 in the context of 3-D navigation according to one or more embodiments. A driver or occupant can use a system 500 for 3-D navigation, provide an instruction or command while navigating from a home position to a destination position. In other words, the navigation component 540 assisting in adding one or more waypoints between the home position and the target position such that navigation to the target position is not interrupted in a manner that requires retuning navigation to the target position. In other words, when a waypoint is inserted, the navigation component may be used 540 calculate a revised route from the current position of the vehicle to the waypoint and from the waypoint to the destination position (which was previously determined). In 14A is a navigation from a starting position to a target position in progress, as of the avatar 1002 is displayed, which instructs the driver of the vehicle to drive straight on the current intersection. at 1404 An acknowledgment of the instruction or command can be projected in a text box. In one or more embodiments, the control component must 104 not the HUD component 100 induce the textbox 1404 to project, for example, when there are multiple obstacles from the sensor component 570 detected, the vehicle is moving above a threshold speed, or based on preferences of the user.

In one or more embodiments, the system may 500 interfacing with one or more components, servers, other systems, such as a mobile device or remote servers, for determining one or more of the waypoints. For example, a driver can use the system 500 instruct him to "take him to the nearest gas station", "the cheapest gas station nearby" or "a gas station on the way home". According to these instructions, the control component 104 with the navigation component 540 work together to determine an instantaneous position for the vehicle, a target position, a route between the current position and the target position, or a gasoline price application, such as an application on a mobile device, etc., to determine a price, a position, or other criteria.

14B is an illustration of an exemplary scenario 1410 in the context of 3-D navigation according to one or more embodiments. The control component 104 may determine a position of a waypoint or a suitable waypoint from one or more available waypoints in cooperation with the navigation component 540 choose. The navigation component 540 may compute or create a new route to guide the vehicle to the waypoint as the current target position and set the current target position as the next target position. The navigation component 540 can calculate additional travel time in connection with the waypoint. In this context, the HUD component 100 this information (eg redirection, which will add about 8 minutes extra travel time) in a text box 1430A project. As discussed herein, the HUD component 100 Navigation Instructions 1130 and an avatar 1002 deploy or project at one or more focal planes in the environment. Furthermore, the navigation component 540 use a telematics channel to obtain or download metadata or information related to a waypoint or a destination. For example, the navigation component 540 get a logo related to the waypoint, such as a logo for a store or gas station, etc. The HUD component 100 May include this logo or other related information 1430b project. Furthermore, the HUD component 100 one or more aspects, such as folding the logo 1430b in a flat shape or otherwise reshaping the logo 1430b in the avatar 1002 or animate another graphic element. The HUD component 100 can essentially animate, reshape, transform, etc., virtually any graphic element into essentially any other graphic element.

15 is an illustration of an exemplary scenario 1500 in the context of 3-D navigation according to one or more embodiments. The HUD component 100 can navigation instructions in a textbox 1130 and one or more avatars 1002A . 1002B . 1002C . 1002D . 1002E project, etc. Additionally, the HUD component 100 highlight a route or path that passes through respective avatars 1002A . 1002B . 1002C . 1002D or 1002E is provided, for example, by the avatars flashing sequentially. The HUD component 100 Can one or more of the avatars 1002A . 1002B . 1002C . 1002D or 1002E so project them around other objects, by the sensor component 570 be detected, such as dangers, road conditions or other vehicles, to navigate, drive or seem to move around. The logo 1430b out 14B can be animated to shrink into a "L" logo the size of a character, as in 15 shown. For example, the control component 104 determine a period of time while the logo 1430b displayed in a first size or a full size. After the expiration of this time period, the HUD component 100 project the "L" logo in a smaller size, one character size, or one second size. The control component 104 may determine the time period for the logo based on the distance to the respective object (for example, a restaurant, shop or waymark, etc.).

In one or more embodiments, early warning detection may be provided for one or more obstacles or objects that are not yet in the field of view or range of an occupant of a vehicle, such as when the occupant is looking forward out of the vehicle through the windshield. 16A is an illustration of an exemplary scenario 1600 in the context of 3-D navigation according to one or more embodiments. In this example, traffic condition information may be from the vehicle control component 180 for one or more traffic conditions along a route on which a vehicle is moving or is expected to move. Here, the vehicle control component can 180 Receive traffic condition information indicating construction work along one or more route sections in front of the vehicle. In other words, construction works take place along a road section which the vehicle will take if the navigation instructions are followed. In other words, occurrence of this construction site may be by the vehicle control component 180 be received before the vehicle arrives at the construction site.

The HUD component 100 can navigation instructions 1130 project, which may include text, arrows, flashing arrows, etc. Avatars 1002A and 1002B can also be projected. In one or more embodiments, the control component 104 determine a stopping point or stopping line where a driver should stop the vehicle. For example, the control component 104 determine the stopping point based on a position of another vehicle, an obstacle in the environment, other environment information, etc. The control component 104 can be the HUD component 100 induce this as a horizontal line 1630 project to promote safe driving. In other embodiments, the HUD component 100 projecting a vertical line or other graphic element that indicates a safe sequence distance between the driver's vehicle and, for example, another vehicle ahead.

Accordingly, the control component 104 identify this obstacle (eg object) or this traffic condition and the HUD component 100 cause a notification in advance or an early warning graphic element 1602 to project. This allows the system 500 to alert a driver or occupant of a vehicle about one or more objects, hazards, obstacles, traffic conditions, etc., even if. corresponding objects are not directly visible when looking or looking out of the windshield of the vehicle. 16B is an illustration of an exemplary scenario 1610 in the context of 3-D navigation according to one or more embodiments. It is in 16B to see that the traffic condition or disability related 1602 is far ahead in the distance and a driver of a vehicle does not have to be visible. Accordingly, the HUD component 100 identify the hazard, site, or object (eg, obtained from the vehicle control component) 180 ) by adding an alert element 1602 which points to the construction site relative to the vehicle and identifies it. For example, in 16A because the construction site is to the left of the vehicle, the pointer or tail associated with the pre-warning graphic element 1602 point outside the windshield privacy area, thereby alerting a driver or other occupant of the vehicle that a construction site is ahead.

The control component 104 can determine one or more target positions, and a target position for one or more graphic elements that from the HUD component 100 be projected to update or customize. For example, the control component 104 a target position for the alert element 1602 on the basis of a distance of the vehicle from the object to select that with the pre-warning graphic element 1602 is related to or shown by him. This can be the control component 104 Determine that the job site (such as the object) associated with the alert element 1602 is greater than a threshold distance away from the vehicle (eg, by the navigation component 540 is used to determine a current GPS position for the vehicle for comparison with site coordinates, that of the vehicle control component 180 to be provided). Since it is determined that the jobsite is located farther away than the threshold distance, the HUD component may 100 the forewarning element 1602 projecting into the sky, using a pointer of a length greater than a threshold length, rather than projecting a graphic element near, in, or adjacent to the job site.

17A is an illustration of an exemplary scenario 1700 in the context of 3-D navigation according to one or more embodiments. When a vehicle approaches an object, such as the one through the alert element 1602 displayed construction site, may be the control component 104 the position or target position of the respective graphic element (eg 1602 ) to adjust. In addition, the control component 104 Change the type of graphic element to display. For example, as in 17A shown the forewarning graphic element 1602 not a pointer, as he was previously in 16A or 16B has been used. Here, since the proximity between the vehicle and the object (eg, the construction site) is smaller than a threshold distance, the control component 104 determine that the pointer is omitted. Here, the HUD component 100 the avatar 1002 , the forewarning graphic element 1602 and a danger graphic element 1704A project.

For example, if the vehicle control component 180 or the sensor component 540 identifies an object that is a hazard, obstruction, obstacle, or otherwise impassable, such as a road section being built on, etc., the control component 104 the HUD component 100 cause to project a hazard graphic element, such as the danger graphic element 1704A in a way that overshadows the danger. The depth buffer component 560 For example, hiding one or more portions of the danger may enable the real world or the environment to obscure the danger from the field of view of an occupant, operator or driver of the vehicle. In other words, the HUD component 100 Project graphic elements that are opaque or have different degrees of transparency. If the control component 104 determines that on or about an area, a hazard or an object should not be driven, the HUD component 100 Project danger graphic elements so that they "fill up" such areas accordingly.

17B is an illustration of an exemplary scenario 1710 in the context of 3-D navigation according to one or more embodiments. In 17B It can be seen that the vehicle has approached the danger or construction site, which in 17A shown, and the HUD component 100 has the perspective of danger graphic element 1704B adjusted accordingly. For example, since the vehicle is located closer to the construction site, the danger graphic element is 1704B out 17B larger in size than the danger graphic element 1704A out 17A , From the sensor component 540 or the vehicle control component 180 Information obtained in relation to or associated with the hazard, site or objects in the environment may be obtained from the control component 104 used to determine a size, shape, a model (eg, leader, avatar, cover, transparency, color), height, width, depth, focal plane, color, target position for a graphic element, or an overlap between graphic elements or Identify depth map information. In other words, these attributes may be based on object information or environment information provided by the vehicle control component 180 or the sensor component 570 to be obtained. In one or more embodiments, the controller may select or change colors of graphics elements based on oncoming traffic, time of day, colors of surrounding objects, traffic rules, etc.

The depth map component 550 can manage or create a depth map of the environment or surrounding objects around a vehicle. The control component 104 may use the depth map to determine whether or not an object should be visible, transparent, opaque, etc. with respect to a graphic element. For example, the construction site (under danger graphic elements 1704A or 1704B hidden) include traffic tons, traffic pylons, garbage, potholes, trenching, non-drivable road surfaces, etc. In this example, the control component has 104 a Determination carried out that these aspects under the danger graphic elements 1704A and 1704B should be hidden. However, other objects in the environment do not necessarily have to be under the hazard graphics elements 1704A and 1704B be hidden or layered. For example, when a pedestrian crosses the construction site, the control component may 104 Determine that the pedestrian is an object that should not be obscured and cause the HUD component to display the hazard graphic element 1704B to project in such a way that the danger graphic element 1704B does not hide the pedestrian from the driver's field of vision (eg, when the pedestrian "through" the hazard graphic element 1704B running). In other words, the control component 104 determine a visibility, layering, transparency (level, opacity level, etc.) of a graphic element based on movement of an object within an environment or other data, that of the sensor component 540 or the vehicle control component 180 can be obtained, such as an identity of an object, an object type, an object size, etc. In this way, depth map information can be obtained from the control component 104 or the HUD component 100 be used to provide a vehicle occupant, operator or driver with a realistic perception of one or more graphic elements relating to the surrounding environment or the real world.

18A is an illustration of an exemplary scenario 1800 in the context of 3-D navigation according to one or more embodiments. When it is detected (eg from the sensor component 570 ) that one or more objects are on a path of a vehicle or along a designated route (eg, by the vehicle control device) 180 received environmental information) may be the control component 100 highlight or track respective objects with graphic elements and / or pointers. For example, when a vehicle is approaching a turn to the right, this may be due to navigation instructions 1130 and the avatars 1002A . 1002B and 1002C is displayed, the sensor component 570 a pedestrian 1832 Detect near a road section on which the vehicle is to turn. As a result, the control component 104 the HUD component 100 to guide the graphic element 1834 on the pedestrian 1832 to project. In one or more embodiments, the HUD component 100 a graphic element about the pedestrian 1832 project. Furthermore, the HUD component 100 a graphic element 1804 Projecting a signal that a pedestrian crosses the street.

While the vehicle and the pedestrian 1832 moving along the road section, the relative distance between the two may change (eg, the pedestrian 1832 move, the vehicle can move, or both the pedestrian 1832 as well as the vehicle can move, etc.). The sensor component 570 can detect this change in the distance and the change to the control component 104 or the vehicle control component 180 transfer or update. The control component 104 can hold positions for one or more of the graphic elements (eg 1832 or 1834 ) update, change or track. In other words, the control component 104 customize one or more focal planes for one or more of the graphic elements based on object information or environment information. As previously discussed, an actuator may be associated with projecting a graphics element onto a focal plane from the control component 104 be controlled to move, adjust or change the focal plane (eg, to move the focal plane along a direction of the line of sight of a driver or occupant, such as the line of sight 178 out 3 ).

18B is an illustration of an exemplary scenario 1810 in the context of 3-D navigation according to one or more embodiments. In 18 can be the HUD component 100 several graphic elements 1834 and 1844 each for several pedestrians 1832 and 1842 project. Additionally, the HUD component 100 Project one or more graphic elements as an indicator, such as in 1802 or 1804 ,

19A FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG. In one or more embodiments, the system may be for 3-D navigation 500 allow an occupant of a vehicle to interact with the vehicle with respect to objects in the environment. In other words, an inmate can ask questions ("What's that?", "That looks good") or leave comments (eg, verbally or via text input) and get graphic element projections as answers. For example, the sensor component 570 accept one or more queries, requests or commands from a user, occupant or driver of a vehicle. Here, an occupant of the vehicle asked "What's that right there?". The HUD component 100 can display an acknowledgment or retry the query, or use a textbox graphic element 1904 Request. In one or more embodiments, queries or instructions may be activated during navigation, such as by the avatar 1002 to see. One or more other components can be used to facilitate the fulfillment of one or more of the instructions or commands. For example, if a mobile device communicates with the system 500 coupled, the control component 104 prompt the mobile device to dial a phone number of a store when instructed to "call the restaurant right there". As another example, the control component 104 collaborate with a restaurant reservation application installed on the mobile device or in the vehicle in response to "Reserve in Restaurant X". Other commands or instructions may use vehicle audio systems, such as "read the menu".

19B FIG. 10 is an illustration of an example scenario associated with 3-D navigation in accordance with one or more embodiments. FIG. The control component 104 can process the statement or statement associated with it 1904 to the navigation component 540 route to objects near the vehicle, such as shops, restaurants, etc. The control component 104 may receive information related to an object such as a restaurant from a map application, a remote server, etc. This information may include metadata related to the object, such as opening hours, a logo, a status, reviews for the store, contact information, a telephone number, a menu, etc. This may be the HUD component 100 a logo graphic element 1430b , Information 1930 (eg, a telephone number, a status, opening hours, etc.) and a highlighting graphic element 1932 project that can draw attention to the position of the object (eg a restaurant or business).

20A is an illustration of an exemplary scenario 2000 in the context of 3-D navigation according to one or more embodiments. In one or more embodiments, the navigation component 540 provide metadata to the vehicle control system associated with one or more objects in the environment. For example, one or more objects in the environment may be buildings or businesses. The navigation component 540 can download address information for each building or business as graphic elements from the HUD component 100 can be projected. For example, addresses for the buildings 2002 . 2004 and 2006 from the HUD component 100 to get presented. In one or more embodiments, the control component 104 enabling presentation of address graphic elements, for example when a vehicle is within a threshold distance from a target position, or at the direction of a user. In other embodiments, address information may be projected during the navigation mode, for example, when directions from the navigation component 540 be provided, as by the avatar 1002 displayed.

20B is an illustration of an exemplary scenario 2010 in the context of 3-D navigation according to one or more embodiments. Here, in this example, the sensor component 570 or the navigation component 540 identify one or more parking spaces. As a result, the control component 104 the HUD component 100 to induce a graphic element 2030 to project a parking space in the field of view of an occupant of the vehicle. The graphic element 2030 may appear as an alert element including a pointer, may have one or more transparency attributes, color, shape, size, etc., or object metadata (eg, parking cost, time limit, etc.) as herein described.

21 is an illustration of an exemplary flowchart of a method 2100 for 3-D navigation according to one or more embodiments. at 2102 the procedure begins 2100 , at 2104 One or more objects may be tracked, or metadata associated with respective objects may be obtained. Additionally, information relating to an environment or route may be obtained from a home position to a destination location. at 2106 For example, one or more focal planes or updated focal planes may be calculated for graphical elements to be projected in association with one or more of the objects. at 2108 For example, one or more graphics may be rendered or projected on one or more of the focal planes or one or more respective objects. at 2110 For example, a determination may be made as to whether or not to continue to trace or project the graphic elements associated with one or more of the objects. If it is determined that additional tracking is desired, the method returns 2104 back. If no additional tracking is desired, the method can be used 2112 end up.

Another embodiment includes a computer-readable medium comprising processor-executable instructions configured to implement one or more embodiments of the techniques presented herein. One embodiment of a computer-readable medium or computer-readable device constructed in this manner is shown in FIG 22 illustrated, an implementation 2200 a computer-readable medium 2208 , such as a CD-R, DVD-R, a flash drive, a disk of a hard disk, etc. encodes computer-readable data 2206 available. This computer-readable data 2206 , such as binary data, as in 2206 comprising a plurality of zeros or ones, in turn, comprise a set of computer instructions 2204 which are adapted to operate in accordance with one or more of the principles presented herein. In such an embodiment 2200 are the processor-executable computer instructions 2204 set up a procedure 2202 such as the method 600 out 6 or the procedure 2100 out 21 perform. In another embodiment, the processor executable instructions are 2204 set up a system, such as the system 500 out 5 to implement. Many such computer-readable media are known to those skilled in the art, who are adapted to operate in accordance with the techniques presented herein.

As used in this application, the terms "component", "module", "system", "interface" and the like are generally intended to refer to a computer-related functional unit, either hardware, a combination of hardware and software, software or software in their execution. For example, a component may be, but is not limited to, a process running on a processor, a processor, an object, an executable program, an execution thread, a program, or a computer. To illustrate this, both an application running on a controller and the controller itself may be a component. One or more components residing within a process or execution thread, and also a component, may reside on a computer or distributed between two or more computers.

Furthermore, the claimed subject matter is implemented as a method, apparatus, or manufacturing article using conventional programming or engineering techniques to fabricate software, firmware, hardware, or any combination thereof for controlling a computer to the disclosed subject matter to implement. The term "article of manufacture" as used herein is intended to encompass a computer program accessible from any computer readable device, carrier or medium. Of course, many modifications may be made to this configuration without departing from the scope or spirit of the claimed subject matter.

23 and the following discussion provide a description of a suitable computing environment to implement an embodiment of one or more of the devices described herein. The operating environment off 23 is merely an example of a suitable operating environment and is not intended to limit the scope of use or functionality of the operating environment. Exemplary computer devices include, but are not limited to, personal computers, server computers, handheld or laptop units, mobile devices such as cell phones, personal digital assistants (PDAs), media players and the like, mainframe computers, distributed computers Environments comprising any of the above systems or devices and the like.

In general, embodiments are performed in the general context of "computer-readable instructions" from one or more computing devices. Computer readable instructions are distributed by computer readable media as described below. Computer-readable instructions are implemented as program modules, such as functions, objects, application programming interfaces (APIs), data structures, and the like, that perform one or more tasks or implement one or more abstract data types. Typically, the functionality of the computer-readable instructions are combined or distributed as desired in different environments.

23 illustrates a system 2300 comprising a computer device 2312 adapted to implement one or more of the embodiments provided herein. In one configuration, the computing device includes 2312 one or more processing units 2316 and memory 2318 , Depending on the exact configuration and the type of computer device, the memory can 2318 be volatile, such as RAM, non-volatile, such as ROM, flash memory, etc., or a combination of the two. This configuration is in 23 by a dashed line 2314 illustrated.

In other embodiments, the device comprises 2312 additional features or functionalities. For example, the device 2312 additional storage, such as removable storage or non-removable storage, including but not limited to magnetic storage, optical storage, and the like. Such additional memory is in 23 through memory 2320 illustrated. In one or more embodiments, the computer-readable instructions are for implementing one or more embodiments provided herein in the memory 2320 , The memory 2320 may store other computer-readable instructions for implementing an operating system, application program, and the like. Computer-readable instructions are stored in the memory 2318 loaded, for example, by the processing unit 2316 to be executed.

The term "computer-readable medium" as used herein includes computer storage media. Computer storage media include volatile and nonvolatile, removable and non-removable media that are implemented in any method or technology for storing information, such as computer-readable instructions or other data. Memory 2318 and memory 2320 are examples of computer storage media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other storage technologies, CD-ROMs, Digital Versatile Disks (DVDs) or other optical storage, magnetic cassettes, magnetic tapes, magnetic disk storage, or other magnetic storage Storage devices or any other medium that can be used to store the desired information and that of the device 2312 can be accessed. Each of these computer storage media may be part of the device 2312 be.

The term "computer-readable medium" includes communication media. Communication media typically embodies computer readable instructions or other data in a "modulated data signal", such as a carrier wave or other transport mechanisms, and includes all information delivery media. The term "modulated data signal" includes a signal that has one or more of its characteristics set or changed such that information in the signal is encoded.

The device 2312 includes an input device or input devices 2324 such as a keyboard, mouse, pen, voice input device, touch input device, infrared cameras, video input devices or any other input device. The dispenser or dispensers 2322 such as one or more displays, speakers, printers or any other output devices may be present in the device 2312 be provided. The input device (s) 2324 and output device (s) 2322 are with the device 2312 by means of a wired connection, wireless connection or any combination thereof. In one or more embodiments, an input device or output device is used by another computing device as input device (s). 2324 or output device (s) 2322 for the computer device 2312 used. The device 2312 can be a communication connection or communication connections 2326 to facilitate communication with one or more other devices.

In one or more aspects, a system for 3-dimensional (3-D) navigation is provided, comprising a navigation component configured to obtain a home position and a destination location. The navigation component may be associated with a vehicle and configured to generate a route from the home position to the destination location. One or more portions of the route may include one or more navigation instructions associated with one or more road sections or one or more intersections of the road sections. The system may include a heads-up display (HUD) component configured to project one or more graphics elements onto one or more focal planes about an environment surrounding the vehicle. The HUD component may be configured to project one or more of the graphic elements into a field of view of an occupant of the vehicle based on the route. The system may include a control component configured to adjust a distance between one or more of the focal planes of one or more of the graphical elements and the vehicle based on one or more road conditions associated with one or more portions of the road and to adapt to a current position of the vehicle.

In one or more embodiments, the control component may be configured to adjust a desired position for one or more of the graphical elements based on one or more of the road conditions and the current position of the vehicle. The system may include a vehicle control component configured to receive one or more of the road conditions. In addition, the system may include a sensor component configured to detect one or more of the road conditions. A road state of the one or more road conditions may include traffic information about one or more of the road sections or speed limit information associated with one or more of the road sections. In addition, road conditions may include, for example, a blockage, an obstacle, a pedestrian, debris, or a pothole.

The system may include a depth map component configured to generate a depth map of the environment surrounding the vehicle. The HUD component may be configured to project one or more of the graphic elements based on the depth map of the environment. The depth map component may be configured to generate the depth map based on depth information. In one or more embodiments, the system may include a sensor component configured to detect depth information from the environment surrounding the vehicle. The depth map component may be configured to receive the depth map based on a telematics channel. The system may include a depth buffering component configured to enable or disable rendering of one or more portions of one or more of the graphics elements based on the depth map.

The HUD component may be configured to project one or more graphic elements as a moving avatar or as a wildcard, such as a flagpole, a marker, an identifier, etc.

In one or more aspects, a method for 3-dimensional (3-D) navigation is provided including generating a route from a home position to a destination location for a vehicle. One or more portions of the route may include one or more navigation instructions associated with one or more road sections or one or more intersections of the road sections. The method may include projecting one or more graphics elements onto one or more focal planes around an environment surrounding the vehicle. One or more of the graphic elements may be projected in a field of view of an occupant of the vehicle based on the route. The method may include adjusting a distance between one or more of the focal planes of one or more of the graphical elements and the vehicle based on one or more road conditions associated with one or more portions of the route and a current position of the vehicle. One or more portions of the method may be implemented by a processing unit.

The method may include adjusting a desired position for one or more of the graphical elements based on one or more of the road conditions and the current position of the vehicle. The method may include obtaining or detecting one or more road conditions. A road condition of the one or more road conditions may include traffic information about one or more of the road sections, speed limit information associated with one or more of the road sections, a lock, an obstacle, a pedestrian, debris, or a pothole.

The method may include generating a depth map of the environment surrounding the vehicle, projecting one or more of the graphical elements based on the depth map of the environment, detecting depth information from the environment surrounding the vehicle, generating the depth map based on the detected depth information, activating or deactivating a rendering of one or more portions of one or more of the graphic elements based on the depth map.

In one or more aspects, a computer-readable storage medium comprising computer-executable instructions which, when executed by a processing unit, performs actions including generating a route from a home position to a destination position for a vehicle or multiple sections of the route include one or more navigation instructions associated with one or more road sections or one or more intersections of the road sections, projecting one or more graphics elements onto one or more focal planes around an environment surrounding the vehicle, wherein one or more of the directions a plurality of the graphic elements are projected into a field of view of an occupant of the vehicle based on the route, or a distance between one or more of the focal planes of one or more of the graphic elements and the vehicle based on one or more road conditions in combination adapted with one or more sections of the route and a current position of the vehicle.

In one or more embodiments, raster-based graphics are used in projecting one or more of the graphic elements. In addition, one or more of the embodiments may provide one or more navigational instructions by projecting one or more of the graphic elements as a moving avatar or animating the moving avatar by sequentially projecting the moving avatar onto one or more different focal planes include.

In one or more aspects, a system for three-dimensional (3-D) navigation is provided, comprising a sensor component, a heads-up display (HUD) component and a control component. The sensor component may track one or more objects in an environment surrounding the vehicle and tracking one or more corresponding coordinates for corresponding objects relative to the vehicle. The HUD component may project, render, present, or display one or more graphics elements on one or more focal planes corresponding to one or more of the objects, wherein one or more of the graphic elements are projected in a field of view of an occupant of the vehicle. The control component may calculate one or more updated focal planes for one or more of the graphical elements based on one or more of the coordinates for respective objects.

In one or more embodiments, the HUD component may project one or more of the graphics elements onto one or more of the updated focal planes for one or more of the objects. In addition, the HUD component may terminate projecting one or more of the graphics elements on one or more of the focal planes toward projecting on one or more of the updated focal planes. One or more of the graphic elements may include a pointer having information associated with one or more of the objects onto which one or more of the graphic elements are projected. One or more of the objects may be a blockage, an obstacle, a pedestrian, a construction site, a landmark, a building, a shop, or a parking lot.

The system may include a vehicle control component that determines a size, a shape, a model, a color, or one or more attributes for one or more of the graphic elements. The vehicle control component may manage an overlap between one or more of the graphic elements. The system may include a navigation component that generates a route from a home position to a destination location and a vehicle control component that receives information associated with one or more of the objects along the route, wherein one or more of the objects Shops are. The HUD component may project one or more of the graphic elements as a logo associated with one or more of the stores. In one or more embodiments, the sensor component may include a navigation component or use telematics.

In one or more aspects, a system for three-dimensional (3-D) navigation is provided, comprising a navigation component, a control component, and a heads-up display (HUD) component. The navigation component may receive metadata associated with one or more objects in an environment surrounding a vehicle, a layout for respective objects within the environment, and an instantaneous position of the vehicle relative to the layout. The control component may calculate one or more focal planes for one or more graphics elements based on the layout of one or more of the objects and the current position of the vehicle. The HUD component may project, render, present, or display one or more of the graphic elements on one or more of the focal planes corresponding to one or more of the objects, wherein one or more of the graphic elements are projected in a field of view of an occupant of the vehicle.

One or more of the graphical elements may include a pointer presenting at least a portion of the metadata associated with one or more of the objects onto which one or more of the graphic elements is projected. The metadata may include a telephone number, an address, a rating, a name of a business, opening hours, or a status associated with an object. The HUD component may project one or more of the graphical elements based on the layout of one or more of the objects and the current position of the vehicle. Additionally, the HUD component may transition from projecting a layout view or a bird's-eye view to projecting a first-person view or a third-person view.

The system may include a sensor component that receives a query from the occupant associated with one or more of the objects, wherein the HUD component reacts one or more portions of corresponding metadata for one or more of the objects associated with the query projected onto the query. The navigation component may generate a route from a home position to a destination location, wherein the HUD component renders one or more of the graphic elements as an avatar that guides the occupants along the route. The control component may calculate a pitch angle, roll angle, yaw angle, or speed for the avatar (or other graphic elements). The HUD component may present, display or render one or more of the graphic elements as a street name based on the metadata and the current location of the vehicle.

In one or more aspects, a method for three-dimensional (3-D) navigation is provided, comprising tracking one or more objects in an environment surrounding a vehicle, and determining one or more corresponding coordinates for respective objects relative to the vehicle, calculating one or more focal planes for one or more graphic elements based on one or more of the coordinates for respective objects, and rendering one or more of the graphic elements on one or more of the focal planes corresponding to one or more of the objects one or more of the graphic elements are projected in a field of view of an occupant of the vehicle. The tracking, computing or rendering may be implemented by a processing unit.

Although the subject matter has been described in language specific to structural features or methodological acts, it should be understood that the subject matter of the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and operations have been described as exemplary embodiments.

Various modes of operation of embodiments are provided herein. The order in which one or more or all of the operating forms are described should not be construed as necessarily being order-dependent. Alternative arrangements will be understood based on this description. Further, not necessarily all modes of operation are present in each embodiment provided herein.

As used in this application, "or" is intended to refer to an inclusive "or" rather than an exclusive "or". In addition, "a" and "an" as used in this application are generally intended to refer to "one or more" unless they are otherwise stated or clearly understood from the context of the present invention Singular form are addressed. In addition, at least one of A and B and / or the like generally means A or B or both A and B. Further, "include", "have", "have", "with" or variations thereof in the specification and the specification Claims used such that such terms are to be understood in a similar manner as the term "comprising" inclusive.

Further, unless otherwise indicated, "first," "second," or the like is not intended to refer to a temporal aspect, a spatial aspect, an order, etc. Rather, such terms are used only as identifications, names, etc. for features, elements, objects, etc. For example, a first channel and a second channel generally correspond to one channel A and one channel B or two different or two identical channels or the same channel.

While this disclosure has been shown and described with respect to one or more implementations, equivalent changes and modifications will occur based on a reading and understanding of this specification and the appended claims. The disclosure includes all such modifications and changes, and is limited only by the scope of the following claims.

One or more embodiments of three-dimensional (3-D) navigation techniques or systems are provided herein. A heads-up display (HUD) component can project, render, display or present graphic elements on focal planes around an environment surrounding a vehicle. The HUD component may cause these graphics to appear volumetric or three-dimensional by moving or adjusting a distance between a focal plane and the vehicle. Objects within the environment are tracked, identified, and corresponding graphics elements can be projected onto, near, or around respective objects. For example, the HUD component may project graphic elements or pointers to pedestrians to alert the driver or operator of the vehicle of their presence. These hands can "stick" to the pedestrian as he or she walks around. Metadata related to objects may be presented, such as address information, ratings, phone numbers, logos, etc.

Claims (20)

System for three-dimensional (3-D) navigation, comprising: a sensor component tracking one or more objects in an environment surrounding a vehicle and one or more corresponding coordinates for respective objects relative to the vehicle; a heads-up display (HUD) component that projects one or more graphics elements onto one or more focal planes corresponding to one or more of the objects, wherein one or more of the graphic elements are projected in the field of view of an occupant of the vehicle; and a control component that calculates one or more updated focal planes for one or more of the graphical elements based on one or more of the coordinates for respective objects. The system of claim 1, wherein the HUD component comprises one or more of the graphic elements project one or more of the updated focal planes for one or more of the objects. The system of claim 2, wherein the HUD component finishes projecting one or more of the graphics elements onto one or more of the focal planes upon projecting onto one or more of the updated focal planes. The system of claim 1, wherein one or more of the graphic elements comprises a pointer having information associated with one or more of the objects onto which one or more of the graphic elements is projected. The system of claim 1, wherein one or more of the objects is a lock, an obstacle, a pedestrian, a construction site, a landmark, a building, a shop, or a parking lot. The system of claim 1, comprising a vehicle control component that determines a size, a shape, a model, a color, or one or more attributes for one or more of the graphic elements. The system of claim 1, comprising a vehicle control component that manages an overlap between two or more of the graphic elements. The system of claim 1, comprising a navigation component that generates a route from a home position to a destination location. The system of claim 8, comprising a vehicle control component receiving information associated with one or more of the objects along the route, wherein one or more of the objects are shops. The system of claim 9, wherein the HUD component projects one or more of the graphic elements as a logo associated with one or more of the stores. System for three-dimensional (3-D) navigation, comprising: a navigation component that receives metadata related to one or more objects in an environment surrounding a vehicle, a layout for respective objects within the environment, and an instantaneous position of the vehicle relative to the layout; a control component that calculates one or more focal planes for one or more graphics elements based on the layout of one or more of the objects and the current position of the vehicle; and a heads-up display (HUD) component that projects one or more of the graphic elements onto one or more of the focal planes corresponding to one or more of the objects, wherein one or more of the graphic elements are projected in a field of view of an occupant of the vehicle. The system of claim 11, wherein one or more of the graphical elements includes a pointer that projects at least a portion of the metadata associated with one or more of the objects onto which one or more of the graphic elements are projected. The system of claim 11, wherein the metadata includes a telephone number, an address, a rating, a name of a store, opening hours, or a status associated with an object. The system of claim 11, wherein the HUD component projects one or more of the graphical elements based on the layout of one or more of the objects and the current position of the vehicle. The system of claim 14, wherein the HUD component transitions from projecting a layout view to projecting a first-person view or a third-person view. The system of claim 11, comprising a sensor component receiving a query from the occupant of the vehicle associated with one or more of the objects, wherein the HUD component includes one or more portions of corresponding metadata for one or more of the objects associated with the query is projected in response to the query. The system of claim 11, wherein the navigation component generates a route from a home position to a destination location, wherein the HUD component renders one or more of the graphic elements as an avatar that guides the occupants along the route. The system of claim 17, wherein the control component calculates a pitch angle, roll angle, yaw angle or velocity for the avatar. The system of claim 11, wherein the HUD component renders one or more of the graphic elements as a street name based on the metadata and the current position of the vehicle. Method for three-dimensional (3-D) navigation, comprising: Tracking one or more objects in an environment surrounding a vehicle and determining one or more corresponding coordinates for respective objects relative to the vehicle; Calculating one or more focal planes for one or more graphics based on one or more of the coordinates for respective objects; and rendering one or more of the graphic elements onto one or more of the focal planes corresponding to one or more of the objects, wherein one or more of the graphic elements are projected in a field of view of an occupant of the vehicle, wherein the tracking, computing, or rendering is performed by means of a processing engine. Unit is implemented.

Images