CN112346245A

CN112346245A - AR-HUD device near and far view light path switching method, terminal device and storage medium

Info

Publication number: CN112346245A
Application number: CN201910734349.0A
Authority: CN
Inventors: 姚亮; 何展然; 黄睿欣
Original assignee: Xiamen Yaxon Networks Co Ltd
Current assignee: Xiamen Yaxon Networks Co Ltd
Priority date: 2019-08-09
Filing date: 2019-08-09
Publication date: 2021-02-09
Anticipated expiration: 2039-08-09
Also published as: CN112346245B

Abstract

The invention relates to a near-far view optical path switching method of AR-HUD equipment, terminal equipment and a storage medium, wherein the method comprises the following steps: whether a long-range light path is started or not is judged according to the relation between the current vehicle speed and the vehicle speed threshold value and the relation between the current vehicle speed and the distance of the moving target right ahead, and whether a short-range light path is started or not is judged according to the switching state of the viewing light path, whether the viewing light path is in the navigation process and the distance from the next intersection. The invention can independently control the display logics of the close-range light path and the distant-range light path, ensure the visual effect and prevent the interference of the sight of a driver.

Description

AR-HUD device near and far view light path switching method, terminal device and storage medium

Technical Field

The invention relates to the technical field of head-up displays, in particular to a method for switching near and far scenes of AR-HUD equipment, terminal equipment and a storage medium.

Background

In view of its good visual experience, as well as its assistance in safe driving, HUD (head up display) products are now becoming more and more widely used in the automotive industry, especially, with the development of AR (augmented reality) concept in recent two years, many manufacturers have introduced HUDs based on AR technology, namely AR-HUD, on the basis of keeping the optical path structure (within 10 inches of imaging area and 2-3 meters of imaging distance) of the traditional HUD, in addition, a set of augmented reality light path structures is added, images can be projected to a farther place (beyond 7 meters) in a larger area (more than 40 inches), the projected image (such as the arrow of navigation/the sign of preceding car position etc.) can laminate with actual road surface condition, reaches augmented reality's display effect, has promoted HUD's practicality greatly.

The 'augmented reality head-up display' of patent application No. 201710077032.5 refers to an AR-HUD with a dual optical path structure, in which the close-range optical path is responsible for displaying the instant speed and the car navigation information 2-3 meters in front of the driver, and the far-range optical path is responsible for displaying the augmented reality symbol information 7-15 meters in front of the driver. Similar structures are also mentioned in the patent with the application number of 201710571838.X, the patent with the application number of 201811199649.5, the patent with the application number of 201880000985.4, the HUD system, the method for generating the HUD image and the like, and double-image-plane double-imaging distance display can be realized. By adopting the HUD light path structure with the idea, two sets of images with different depths of field and different visual senses can be generated and are respectively used for displaying different contents, so that real augmented reality display is realized.

However, none of the above patents solves the other problem of controlling the alternate display of the two sets of HUD lightpaths (i.e., the near and far lightpaths, or conventional lightpaths and AR lightpaths). In practical application, the two sets of HUD optical paths have their applicable scenes, and it is not necessary to activate all of the two sets of optical paths at all times. If let two sets of light paths work simultaneously all the time, not only can cause information redundancy, extravagant electric power, if control is improper moreover, can bring uncomfortable experience for the user on the contrary, influence normal use even.

For example, in the navigation process of a complex intersection, the distant view light path can draw the navigation arrow on the corresponding route very intuitively to guide the driver to drive correctly. At this time, the close-range light path is not necessary to be displayed, otherwise the effect of the far-range light path is interfered, and even the view of the driver is influenced.

For another example, when driving on a road in a city, the distances between the front and rear vehicles are often relatively short, and particularly when waiting for a traffic light, the distances are often only 3-5 meters. And the long-range light path can project the image of the HUD to a distance of 7-15 meters, so that the illusion that the image penetrates through the front vehicle is brought to people, and the user experience is influenced. Meanwhile, if the navigation is in the process of navigation, the long-range light path may be playing a navigation guide arrow, and the drawn arrow is not superimposed on the actual road surface/lane line, but is superimposed on the vehicle in front, even penetrates into the vehicle, so that visual illusion is caused, and even a driver is misguided in a serious case.

Disclosure of Invention

In order to solve the above problems, the present invention provides an AR-HUD device near-distant view optical path switching method, a terminal device, and a storage medium.

The specific scheme is as follows:

a near-distant view optical path switching method for AR-HUD equipment comprises the following steps:

s1: initially setting a long-range light path and a short-range light path to be in an open state;

s2: collecting the current vehicle speed, judging whether the current vehicle speed is less than a vehicle speed threshold value, and if so, entering S3; otherwise, go to S5;

s3: acquiring front target information of the vehicle, judging whether a moving target exists in front of the vehicle according to the front target information, and if so, entering S4; otherwise, go to S5;

s4: judging whether the distance between the vehicle and the front target is smaller than a first distance threshold value or not, if so, closing the long-range light path, opening the short-range light path, transferring all contents to be displayed to the short-range light path for display, and returning to S2 for the next judgment; otherwise, go to S5;

s5: opening a long-range light path and recovering the display content in the long-range light path;

s6: judging whether the navigation device is in the navigation state currently, if so, entering S7; otherwise, go to S8;

s7: judging whether the distance between the current position of the vehicle and the next intersection is smaller than a second distance threshold value, if so, closing the close-range light path, transferring all contents to be displayed to the distant-range light path for display, and returning to S2 for the next round of judgment; otherwise, go to S8;

s8: and opening the close shot light path, reasonably distributing the content to be displayed to the close shot light path and the distant shot light path for displaying, and returning to S2 for the next round of judgment.

Further, the opening and closing of the long-range light path and the short-range light path are realized by controlling the angles of the reflectors of the long-range light path and the short-range light path.

Further, the control of the opening and closing of the long-range light path and the short-range light path is as follows: the long-range light path and the short-range light path are respectively provided with corresponding display devices, and when the display devices are turned on or off, the corresponding display devices are respectively turned on or off.

An AR-HUD device near-far view optical path switching terminal device includes a processor, a memory, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method described above in the embodiments of the present invention when executing the computer program.

A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to an embodiment of the invention as described above.

By adopting the technical scheme, the display logics of the close-range light path and the far-range light path can be independently controlled, display is carried out when display is needed, and display is not carried out when display is not needed. On one hand, the power consumption of the whole machine is reduced, and unnecessary electric quantity loss is avoided. The most important is that the visual effect is ensured, and the visual line of the driver is prevented from being interfered, for example, when the road is congested, the speed is slow, and the distance from the front vehicle is very close, the long-range light path is closed, only the short-range light path is opened, all necessary information is transferred to the short-range light path system for display, the image projected by the long-range light path is prevented from penetrating into the front vehicle for display to bring uncomfortable experience to the driver, and the problem that the driver is misled or even the driving of the driver is influenced is avoided.

Drawings

FIG. 1 is a schematic diagram illustrating the operation of the AR-HUD according to an embodiment of the present invention.

Fig. 2 is a flow chart showing switching of the telescopic optical path in this embodiment.

Fig. 3 is a flow chart showing the switching of the close-range optical path in this embodiment.

Detailed Description

To further illustrate the various embodiments, the invention provides the accompanying drawings. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the embodiments. Those skilled in the art will appreciate still other possible embodiments and advantages of the present invention with reference to these figures.

The invention will now be further described with reference to the accompanying drawings and detailed description.

The first embodiment is as follows:

the embodiment of the invention provides a near-far view optical path switching method of an AR-HUD device.

Working Process of AR-HUD

As shown in fig. 1, the AR-HUD device receives data from a navigation module, an ADAS (advanced driving assistance system) module, and an ECU (on-board computer) module on a vehicle through a bus, wherein:

(1) acquiring navigation data from a navigation module, wherein the navigation data comprises a name of a road which is currently running, a name and a type of a next intersection, a distance to the next intersection, a running direction, a road congestion state and the like, wherein the name of the road, the name and the type of the next intersection, the distance to the next intersection, the running direction and the road congestion state are all the same as the name of the road which is currently;

(2) acquiring ADAS related data from an ADAS module, wherein the ADAS related data at least comprises lane line position coordinates of a current lane, whether a vehicle runs off a lane line, whether the front in the lane has the vehicle and the distance thereof, whether the front in a next lane has the vehicle and the distance thereof, whether a driver has the vehicle and the distance thereof in a blind area of sight, and the like;

(3) the method comprises the steps of obtaining vehicle condition data of a current vehicle from an ECU module, wherein the vehicle condition data at least comprise vehicle running speed, vehicle gear state, engine rotating speed value, instantaneous oil consumption value, average oil consumption value, vehicle endurance mileage and the like.

After the AR-HUD equipment acquires the data, extracting the data according to the preset processing logic of the AR-HUD equipment, and respectively synthesizing the image of the near view light path part and the image of the far view light path part for final display.

Control of near and distant view lightpaths by AR-HUD

This embodiment includes two control schemes:

the first scheme is as follows: by controlling the position of the lens of the respective optical path.

In this embodiment, a micro motor is mounted on each of the mirrors of the near view path and the far view path in the AR-HUD device. At ordinary times, the motor does not work, the reflector is in a closed state, and the light path cannot be imaged. When the corresponding optical path system is to be opened, the motor is controlled to rotate to the designated position, so that imaging can be realized. In other embodiments, other implementations may be employed.

Scheme II: and controlling the display state of the display screen of the corresponding light path.

In this embodiment, a separate display screen is respectively provided for the close-range light path and the distant-range light path, and when the close-range light path is to be opened, the display screen corresponding to the close-range light path is lighted; and when the distant view light path is to be opened, the display screen corresponding to the distant view light path is lightened. In other embodiments, other implementations may be employed.

It should be noted that the short-range light path and the long-range light path are only for the light path system, and are not specific to the displayed content. In other words, the short-range light path and the long-range light path may be used to display vehicle driving data, navigation guidance information, ADAS assistance information, and other prompting information. They differ most in the distance between the imaged areas.

3. Process for near-far view optical path switching

(1) As shown in fig. 2, the switching of the distant view optical path includes the steps of:

step one, initially setting a long-range light path and a short-range light path to be in an open state, and collecting the current vehicle speed.

Step two, judging whether the current vehicle speed is less than a vehicle speed threshold value Q (set as 10km/h in the embodiment), and if so, entering the step three; otherwise, go to step six.

And step three, acquiring the front target information of the vehicle, judging whether a moving target exists in the front of the vehicle according to the front target information, if so, entering step four, and otherwise, entering step six.

And step four, judging whether the distance between the vehicle and the front target is smaller than a distance threshold value K (7 m in the embodiment), if so, entering step five, and otherwise, entering step six.

And step five, closing the distant view light path, transferring the content to be displayed to the close view light path for displaying, and returning to the step two for the next round of judgment.

And step six, opening the long-range light path, recovering the display content in the long-range light path, and returning to the step two to perform the next round of judgment.

(2) As shown in fig. 3, the switching of the close-range optical path includes the following steps:

step one, acquiring the on-off state of the long-range light path, namely opening or closing, judging whether the long-range light path is closed, and if so, entering step four; otherwise, entering the step two.

Step two, judging whether the navigation is currently in the navigation process, if so, entering step three; otherwise, go to step four.

Step three, judging whether the distance between the current position of the vehicle and the next intersection is smaller than a distance threshold value T (in the embodiment, 15 meters is set), if so, closing the close-range light path, transferring the content to be displayed to a distant-range light path for displaying, and returning to the step one to perform the next round of judgment; otherwise, go to step four.

And step four, opening the close shot light path, recovering the display content therein, and returning to the step one to perform the next round of judgment.

The first embodiment of the invention can respectively and independently control the display logics of the close-range light path and the far-range light path, display when the display is needed, and display is not needed. On one hand, the power consumption of the whole machine is reduced, and unnecessary electric quantity loss is avoided. The most important is that the visual effect is ensured, and the visual line of the driver is prevented from being interfered, for example, when the road is congested, the speed is slow, and the distance from the front vehicle is very close, the long-range light path is closed, only the short-range light path is opened, all necessary information is transferred to the short-range light path system for display, the image projected by the long-range light path is prevented from penetrating into the front vehicle for display to bring uncomfortable experience to the driver, and the problem that the driver is misled or even the driving of the driver is influenced is avoided.

Example two:

the invention further provides an AR-HUD device near-far view optical path switching terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps in the above-mentioned method embodiment of the first embodiment of the present invention.

Further, as an executable scheme, the AR-HUD device near-distant view optical path switching terminal device may be a vehicle-mounted computer, a cloud server, or other computing devices. The near-far view optical path switching terminal device of the AR-HUD device can comprise, but is not limited to, a processor and a memory. Those skilled in the art will understand that the above-mentioned composition structure of the near-far view optical path switching terminal device of the AR-HUD device is only an example of the near-far view optical path switching terminal device of the AR-HUD device, and does not constitute a limitation on the near-far view optical path switching terminal device of the AR-HUD device, and may include more or less components than the above, or combine some components, or different components, for example, the near-far view optical path switching terminal device of the AR-HUD device may further include an input-output device, a network access device, a bus, and the like, which is not limited in this embodiment of the present invention.

Further, as an executable solution, the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, and the like. The general processor may be a microprocessor or the processor may be any conventional processor, and the processor is a control center of the near-far view optical path switching terminal device of the AR-HUD device, and various interfaces and lines are used to connect various parts of the whole near-far view optical path switching terminal device of the AR-HUD device.

The memory may be configured to store the computer program and/or the module, and the processor may implement various functions of the AR-HUD device near-far view optical path switching terminal device by running or executing the computer program and/or the module stored in the memory and calling data stored in the memory. The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to the use of the mobile phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.

The invention also provides a computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the above-mentioned method of an embodiment of the invention.

The module/unit integrated with the near-far view optical path switching terminal device of the AR-HUD device may be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as an independent product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM ), Random Access Memory (RAM), software distribution medium, and the like.

While the invention has been particularly shown and described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1.A near-distant view optical path switching method for an AR-HUD device is characterized by comprising the following steps:

2. The method of claim 1, wherein: the opening and closing of the long-range light path and the short-range light path are realized by controlling the angles of the reflectors of the long-range light path and the short-range light path.

3. The method of claim 1, wherein: the control of the opening and closing of the long-range light path and the short-range light path is as follows: the long-range light path and the short-range light path are respectively provided with corresponding display devices, and when the display devices are turned on or off, the corresponding display devices are respectively turned on or off.

4. The utility model provides a near-distant view light path switching terminal equipment of AR-HUD equipment which characterized in that: comprising a processor, a memory and a computer program stored in the memory and running on the processor, the processor implementing the steps of the method according to any one of claims 1 to 3 when executing the computer program.

5. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 3.