CN118042094A

CN118042094A - Projection method and device based on windshield and computer readable storage medium

Info

Publication number: CN118042094A
Application number: CN202410156519.2A
Authority: CN
Inventors: 马松; 胡俊; 黄洪; 梁洪
Original assignee: Chongqing Selis Phoenix Intelligent Innovation Technology Co ltd
Current assignee: Chongqing Selis Phoenix Intelligent Innovation Technology Co ltd
Priority date: 2024-02-02
Filing date: 2024-02-02
Publication date: 2024-05-14

Abstract

The application relates to the technical field of intelligent cabins, and provides a projection method and device based on a windshield and a computer readable storage medium. The method is applied to a control host in a projection system and comprises the following steps: determining a corresponding vision free position on a windshield projection screen based on the road condition image acquired by the image sensor; receiving projection information, determining the road condition complexity of the current road condition based on the road condition image, and judging whether the position to be projected on the projection screen of the windshield is in the range of the vision free position when the road condition complexity is not more than a preset road condition complexity threshold; when the position to be projected is not in the range of the free position of the visual field, adjusting the position to be projected of the projection information to the free position of the visual field according to a preset adjustment mode; and when the position to be projected is in the vision free position, projecting the position to be projected to a windshield projection screen according to the position to be projected. The projection method based on the windshield, provided by the application, realizes intelligent projection experience and ensures driving safety.

Description

Projection method and device based on windshield and computer readable storage medium

Technical Field

The application relates to the technical field of intelligent cabins, in particular to a projection method and device based on a windshield and a computer readable storage medium.

Background

In the prior art, the cabin of the vehicle can be used for more and more diversified functions, a projection film can be stuck on the windshield glass of the vehicle, information is projected onto the fixed projection film through a projector, interaction is carried out between the user and the vehicle, wherein interaction content comprises greeting information, vehicle information, weather information, augmented reality make-up and messages and the like, however, the projection film is not transparent, so that a driver cannot watch the windshield region stuck with the projection film for a long time when driving the vehicle, interaction cannot be carried out, and driving convenience cannot be brought to the driver.

In another prior art, a Head-Up Display (HUD) system may be further included in the cabin of the vehicle, so that a driver can see driving information, such as speed per hour, navigation, remaining energy consumption, etc., on a multifunctional instrument panel without lowering the Head or turning the Head.

Disclosure of Invention

In view of the above, embodiments of the present application provide a projection method, apparatus and computer readable storage medium based on a windshield, so as to solve the problem that in the prior art, a main driver cannot flexibly use other functions in a cabin, including playing music, inquiring weather, viewing road conditions, etc.

In a first aspect of an embodiment of the present application, a projection method based on a windshield is provided, which is applied to a control host in a projection system, and includes:

determining a corresponding vision free position on a windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor;

receiving projection information, and determining the road condition complexity of the current road condition based on the road condition image, wherein the road condition complexity is used for representing the influence degree of the projection information on the current road condition judged by a driver;

When the road condition complexity is not greater than a preset road condition complexity threshold, judging whether the position to be projected corresponding to the projection information projected on the windshield projection screen is in the range of the vision free position or not;

When the position to be projected is not in the range of the free position of the visual field, adjusting the position to be projected of the projection information to the free position of the visual field according to a preset adjustment mode;

And when the position to be projected is in the vision free position, projecting the projection information to the windshield projection screen according to the position to be projected.

In a second aspect of the embodiment of the present application, there is provided a projection apparatus based on a windshield, which is applied to a control host in a projection system, including:

the acquisition module is configured to determine a corresponding vision free position on a windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor;

the processing module is configured to receive the projection information, determine the road condition complexity of the current road condition based on the road condition image, and the road condition complexity is used for representing the influence degree of the projection information on the judgment of the current road condition by a driver;

The judging module is configured to judge whether the position to be projected corresponding to the projection information projected on the windshield projection screen is in the range of the vision free position or not when the road condition complexity is not greater than a preset road condition complexity threshold;

The adjusting module is configured to adjust the position to be projected of the projection information to the free position of the visual field according to a preset adjusting mode when the position to be projected is not in the free position range of the visual field;

And the projection module is configured to project the projection information to the windshield projection screen according to the position to be projected when the position to be projected is in the free position of the visual field.

In a third aspect of the embodiments of the present application, there is provided an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.

In a fourth aspect of the embodiments of the present application, there is provided a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the above method.

Compared with the prior art, the embodiment of the application has the beneficial effects that: the embodiment of the application is applied to a control host in a projection system, the control host determines the corresponding vision free position on a windshield projection screen of a current vehicle according to road condition images acquired by an image sensor, receives projection information, determines the road condition complexity of the current road condition based on the road condition images, judges whether the position to be projected corresponding to the projection information on the windshield projection screen is in the vision free position range or not when the road condition complexity is not greater than a preset road condition complexity threshold, wherein the road condition complexity is used for representing the influence degree of the projection information on the current road condition, adjusts the position to be projected of the projection information to the vision free position according to a preset adjustment mode when the position to be projected is not in the vision free position range, projects the projection information to the windshield projection screen according to the position to be projected, and further ensures that the position to be projected on the windshield projection screen is in the vision free position range when the road condition complexity is not greater than the preset road condition complexity threshold, and further ensures that the position to be projected on the windshield projection screen is not influenced by the projection information to the driver, thereby realizing the intelligent viewing of the vehicle, and realizing the intelligent viewing of the projection information.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic view of an application scenario according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of a projection method based on a windshield according to an embodiment of the present application;

Fig. 3 is a schematic view of an application scenario of a projection method based on a windshield according to an embodiment of the present application;

FIG. 4 is a schematic view of a windshield-based projection apparatus according to an embodiment of the present application;

Fig. 5 is a schematic diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

A display control method and apparatus according to embodiments of the present application will be described in detail with reference to the accompanying drawings.

Fig. 1 is a schematic view of an application scenario according to an embodiment of the present application. The application scenario may include a first terminal device 101, a second terminal device 102, and a third terminal device 103, a server 104, and a network 105.

The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be hardware or software. When the first, second, and third terminal devices 101, 102, 103 are hardware, they may be various electronic devices having a display screen and supporting communication with the server 104, including, but not limited to, on-board computers, on-board processors, on-board computers, smartphones, tablets, laptop and desktop computers, and the like; when the first terminal apparatus 101, the second terminal apparatus 102, and the third terminal apparatus 103 are software, they may be installed in the electronic apparatus as described above. The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be implemented as a plurality of software or software modules, or may be implemented as a single software or software module, which is not limited in this embodiment of the present application. Further, various applications, such as a data processing application, an instant messaging tool, social platform software, a search class application, a shopping class application, and the like, may be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.

The server 104 may be a server that provides various services, for example, a background server that receives a request transmitted from a terminal device with which communication connection is established, and the background server may perform processing such as receiving and analyzing the request transmitted from the terminal device and generate a processing result. The server 104 may be a server, a server cluster formed by a plurality of servers, or a cloud computing service center, which is not limited in this embodiment of the present application.

The server 104 may be hardware or software. When the server 104 is hardware, it may be various electronic devices that provide various services to the first terminal device 101, the second terminal device 102, and the third terminal device 103. When the server 104 is software, it may be a plurality of software or software modules providing various services to the first terminal device 101, the second terminal device 102, and the third terminal device 103, or may be a single software or software module providing various services to the first terminal device 101, the second terminal device 102, and the third terminal device 103, which is not limited in this embodiment of the present application.

The network 105 may be a wired network using coaxial cable, twisted pair wire, and optical fiber connection, or may be a wireless network that can implement interconnection of various Communication devices without wiring, for example, bluetooth (Bluetooth), near Field Communication (NFC), infrared (Infrared), etc., which are not limited by the embodiment of the present application.

It should be noted that the specific types, numbers and combinations of the first terminal device 101, the second terminal device 102, the third terminal device 103, the server 104 and the network 105 may be adjusted according to the actual requirements of the application scenario, which is not limited in the embodiment of the present application.

In an exemplary embodiment of the present application, a projection system based on a windshield is provided, where the projection system based on a windshield includes a windshield projection screen, a control host and a projector, where the windshield projection screen is disposed in a front windshield, and the front windshield is provided with optical elements, including a lens, a reflector, a beam splitter prism, etc., where the size of the windshield projection screen is larger due to the larger overall size and area of the front windshield, and light can be focused by selecting a larger reflector, a lens, etc., or an optical element suitable for the size of the front windshield can be prepared by adding an assembly, etc., and the front windshield is directly used as the windshield projection screen to receive information sent by the control host for projection.

Furthermore, a windshield projection screen which does not block the sight and can receive and display projection information can be arranged on the front windshield, and a projector or projection equipment is additionally arranged on the roof of the vehicle cabin so as to meet the requirement of projection functions. The windshield projection screen has good reflection performance, can effectively reflect light, and meets the requirements of reflection uniformity, brightness, uniform color distribution degree and reflectivity.

The above embodiments provided by the present application can be understood as follows: the windshield projection screen is arranged in the front windshield, can directly receive and display information sent by the control host of the projection system, and can also finish the display of projection information on the front windshield through the projection of the reflection projector.

The projection information is displayed in a one-time display or carousel mode, for example, when part of traffic projection information is displayed in a carousel mode, so that the traffic projection information can be displayed to a user as much as possible while occupying a smaller area of a display screen of the windshield.

Wherein, control host computer and projecting apparatus among the projecting system are connected through high definition multimedia interface (High Definition Multimedia Interface, HDMI) and LAN, and the projecting apparatus still includes the adjustment function, and the adjustment function can include projection picture zoom function, projecting apparatus position correction function, projecting apparatus heat dissipation function, projecting apparatus anti-shake function etc. projecting apparatus position correction function can adjust projecting apparatus imaging position to the slope of prevention projection imaging.

Fig. 2 is a schematic flow chart of a projection method based on a windshield according to an embodiment of the present application. As shown in fig. 2, the windshield-based projection method is applied to a control host in a projection system, and includes the following steps:

S201, determining a corresponding vision free position on a windshield projection screen of a current vehicle based on a road condition image acquired by an image sensor;

S202, receiving projection information, and determining the road condition complexity of the current road condition based on the road condition image;

s203, judging whether a position to be projected corresponding to projection information projected on a projection screen of the windshield is in a range of a vision free position when the road condition complexity is not greater than a preset road condition complexity threshold;

s204, when the position to be projected is not in the range of the free position of the visual field, adjusting the position to be projected of the projection information to the free position of the visual field according to a preset adjustment mode;

And S205, when the position to be projected is in the free position of the visual field, projecting the projection information to a windshield projection screen according to the position to be projected.

The road condition complexity is used for representing the influence degree of projection information on the current road condition judged by the driver.

The windshield-based projection method of fig. 2 may be performed by any one of the first terminal device, the second terminal device, or the third terminal device provided in fig. 1, including the control host, and the projection information may be transferred from the terminal device including the control host to the projector by the server provided in fig. 1, and the projector and the control host may also complete projection of the projection information through the high-definition multimedia interface HDMI.

In an exemplary embodiment of the application, according to the road condition image collected by the image sensor, useful information is extracted from the road condition image through an image processing technology or a visual algorithm, and the corresponding vision free position on the windshield projection screen of the current vehicle is determined.

Receiving projection information, and determining the road condition complexity of the current road condition according to the road condition image, wherein the road condition complexity is used for reflecting the influence degree of the projection information on the judgment of the current road condition by the driver, and if the road condition complexity exceeds a preset road condition complexity threshold value, the autonomous judgment of the current road condition by the driver can be interfered.

When the road condition complexity is not greater than a preset road condition complexity threshold, performing a projection operation of projecting projection information onto a windshield projection screen, the projection operation including: judging whether the position to be projected corresponding to the projection information is in the range of the free position of the visual field or not on the projection screen of the windshield, and if the position to be projected is not in the range of the free position of the visual field, adjusting the position to be projected corresponding to the current projection information to the free position of the visual field according to a preset adjustment mode, so that the projection information on the projection screen of the windshield can be ensured not to interfere the sight of a driver and the judgment of the road condition by the driver.

The method for realizing the preset adjustment mode can be as follows: and determining projection information to be adjusted and the current corresponding position to be projected, finding out the relevant code file of the application program corresponding to the projection information, wherein the code file is usually a file ending with java or xml, finding out the code relevant to the projection information to be adjusted in the code file, and adjusting the position and typesetting of the icon by using a corresponding method or attribute according to the programming language and the framework to be used. For Android applications, the layout parameters (LayoutParams) may be used to set the position of the view object, and if a linear layout LinearLayout, a relative layout RelativeLayout, or a constraint layout ConstraintLayout is used, the position and layout of the projection information to be adjusted are adjusted by modifying the corresponding layout parameters (such as boundary marking, filling and alignment, etc.).

And if all the positions to be projected are in the range of the free positions of the visual field, projecting the projection information to a windshield projection screen according to the positions to be projected.

According to the technical scheme provided by the embodiment of the application, the vision free position and the road condition complexity can be effectively determined, and the position to be projected corresponding to the projection information is determined to be in the vision free position range, so that the projection information can be ensured to be clearly displayed on the windshield and meanwhile the sight and road condition judgment of a driver are not interfered, the driving requirement, driving safety and driving experience of the driver are comprehensively considered, the comfort level of watching the projection information is improved, the intelligent projection experience is realized, and the driving safety is ensured.

In some embodiments, determining a corresponding field of view free position on a windshield projection screen of a current vehicle based on a road condition image acquired by an image sensor includes:

acquiring road condition images in a preset distance range by taking the current vehicle running direction as an acquisition direction based on an image sensor;

Carrying out image recognition on the road condition image to obtain a road condition recognition result; the road condition recognition result comprises one or more recognition objects, wherein the recognition objects comprise other vehicles except vehicles, signal lamps, crosswalk, zebra stripes and traffic marks;

the projection of each recognition object on the windshield projection screen is taken as a target view position on the windshield projection screen, and the position outside the target view position on the windshield projection screen is taken as a view free position.

The image sensor takes the running direction of the current vehicle as the collecting direction for collecting real-time road conditions, and collects road condition images within a preset distance range, wherein the preset distance range can be set according to the running speed of the vehicle and the sight range of a driver so as to ensure that sufficiently detailed and accurate road condition information is obtained.

And carrying out image recognition on the acquired road condition images, wherein the image recognition can be to recognize one or more recognition objects from the acquired road condition images through an image recognition algorithm, the recognition objects comprise other vehicles except the current vehicle, signal lamps, crosswalk, zebra stripes, traffic marks and the like, and the recognition objects have significance for judging road conditions of drivers.

The projection of each recognition object on the windshield projection screen is taken as a target view position, and the target view position is equivalent to the position simulating the view angle of the driver to observe the recognition object, so that the recognition object cannot be blocked, and the judgment of the driver on the road condition is ensured.

The position outside the target view position on the windshield projection screen is regarded as a view free position, and the view free position is a region occupied by an unrecognized object and can be used for displaying other information or projection information, so that the sight of a driver is not disturbed or the judgment of road conditions is not influenced.

According to the technical scheme provided by the embodiment of the application, the corresponding vision free position on the projection screen of the windshield of the current vehicle can be accurately determined according to the road condition image, and the projection information is projected to the vision free position, so that the judgment capability of a driver on the current road condition is ensured not to be influenced.

In some embodiments, determining the road condition complexity of the current road condition based on the road condition image includes:

Acquiring real-time positioning information of a vehicle, and uploading the real-time positioning information to a cloud end so that the cloud end can determine the traffic safety rate of the current vehicle position based on the real-time positioning information and send the traffic safety rate to the vehicle, wherein the traffic safety rate comprises the accident rate of traffic accidents and the rule violation rate;

Based on the road condition recognition result, traffic information corresponding to the current road condition is determined, wherein the traffic information comprises traffic flow, road layout, road signs and the number of signal lamps;

and determining the complexity of the current road condition based on the traffic safety rate and the traffic information.

The method comprises the steps of obtaining real-time positioning information of a vehicle, wherein the real-time positioning information possibly comprises longitude, latitude, running direction and the like of the vehicle, and the real-time positioning information can be obtained through a global satellite positioning technology or other positioning technologies and uploaded to a cloud end, so that the cloud end can determine traffic safety rate of the current vehicle position according to the real-time positioning information, and accuracy and reliability of positioning can be further improved through a vehicle-mounted sensor and map data, for example, through synchronous positioning and map construction technology.

The traffic safety rate comprises an accident rate and a violation rate, the accident rate is calculated based on historical data and traffic accident records near the current position, and the violation rate is determined according to traffic rules and monitoring data.

And after the cloud end determines the traffic safety rate of the current vehicle position according to the real-time positioning information, the traffic safety rate is sent to the vehicle, and the vehicle receives the traffic safety rate.

Meanwhile, the current traffic environment is comprehensively analyzed by combining the road condition image and the real-time positioning information to determine the complexity of the current road condition, the comprehensive analysis mode can be obtained through algorithm processing, the complexity influencing factors can comprise, for example, the current traffic flow, pedestrian flow, vehicle speed, road construction mode, road layout and the like, and the factors are comprehensively calculated through an algorithm to determine the road condition complexity of the current road condition.

And comparing the calculated complexity with a preset complexity threshold, if the complexity of the current road condition is lower than or equal to the preset complexity threshold, the method means that a driver can process the information without excessive interference and can consider the current road condition without being influenced by projection information to judge, a projection technology can be executed, and the projection information is displayed to the driver through a windshield projection screen so as to improve the driving experience of the driver. The preset complexity threshold may be set according to a security standard, user experience optimization, and a length required for calculating complexity.

If the complexity of the current road condition is greater than the preset complexity threshold, it means that displaying the projection information on the windshield projection screen may cause shielding of the view of the driver, influence the judgment of the driver on the current road condition, and have potential safety hazards, so that the projection information is not displayed when the complexity is greater than the preset complexity threshold.

According to the technical scheme provided by the embodiment of the application, the road condition complexity of the current road condition can be determined according to the road condition image, and the acquisition of real-time positioning information, the calculation of traffic safety rate, the extraction of traffic information and the road condition complexity are related, so that an accurate and real-time road condition complexity assessment can be obtained, the decision making of a driver and a traffic management department can be better served, the projection information can be projected according to the application display instruction, and the driving convenience and comfort level can be improved.

In some embodiments, before determining whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the free position range of the field of view, the method further includes:

determining projection information categories corresponding to the projection information, wherein the projection information categories comprise a statistical projection category, a simulation projection category and a common projection category;

When the projection information category is a statistical projection category, carrying out statistical analysis on the projection information to obtain a statistical analysis result, updating the projection information according to a chart form by the statistical analysis result, and determining a position to be projected corresponding to the updated projection information;

When the projection information category is a simulated projection category, performing simulated analysis processing on the projection information to obtain a simulated display analysis result, updating the projection information according to a simulated view form by the simulated display analysis result, and determining a position to be projected corresponding to the updated projection information;

and when the projection information category is a common projection category, determining the position to be projected corresponding to the current projection information.

Before judging whether the position to be projected of the corresponding projection information on the windshield projection screen is within the range of the free position of the visual field, in order to ensure the accuracy and the effectiveness of the information, the projection information is further subdivided into different projection information categories according to the content of the projection information, and a corresponding processing mode is adopted according to the categories. The projection information category comprises a statistical projection category, a simulation projection category and a common projection category.

The statistical projection type mainly provides projection information of statistical data about traffic flow, speed, accident rate, violation rate and the like, and the data of the statistical projection type can help a driver to know the whole condition of the current road condition, wherein the projection information of the statistical projection type can be obtained by analyzing and processing road condition images, and can also be obtained by analyzing and processing real-time positioning information and road condition images to obtain a statistical analysis result;

The simulated projection type is projection information displayed in a simulated image or animation form, such as traffic light state, pedestrian crossing road, road composition mode, road layout and the like, and the data of the simulated projection type can provide more visual road condition feedback for a driver, wherein the projection information of the simulated projection type can be obtained by analyzing and processing real-time positioning information, namely fixed projection information can be determined according to the real-time positioning information, such as road composition mode, and when the information of the pedestrian crossing road and the like needing to be updated in real time is displayed, the simulated analysis processing is required to be carried out according to the real-time positioning information and the road condition information, so that a simulated display analysis result is obtained;

and (3) projecting the projection information of the common projection type directly.

The information is converted and presented in different ways depending on the category of the projected information. For example, for the statistical projection category, corresponding projection information, such as a statistical chart, a histogram, a line chart, a statistics number and the like, can be displayed in a chart or a data report form according to the statistical analysis result, and projected to a corresponding position to be projected according to each projection information category, so as to complete projection of the statistical projection category;

For the simulation projection category, the simulation projection category can be displayed through more visual animation or three-dimensional model images, navigation information can be guided in a mode similar to augmented reality display, and a simulation display analysis result is projected to a corresponding position to be projected according to the projection information category in a simulation view form, wherein the simulation view form comprises the animation and the three-dimensional model images. For example, the road layout can directly acquire a corresponding three-dimensional model image of the road layout according to the real-time positioning information, and when navigation information exists, the navigation information corresponding to the real-time position information can be directly displayed on the three-dimensional model image of the road layout, and a correct driving road is displayed, so that more convenient and more visual navigation guidance is provided for a driver.

According to different categories of projection information, the projection information is projected to the position to be projected corresponding to the windshield projection screen, so that a driver can acquire and understand the information more conveniently. For example, an edge portion of the statistical projection category projected into the free view position range may be set, and a position where traffic simulation information such as navigation information, road layout, or the like is projected into the free view position range and closer to the driver may be set.

Further, the projection information may further include navigation instructions, phone notifications, and the like, which respectively determine the corresponding positions to be projected according to different projection information categories.

According to the technical scheme provided by the embodiment of the application, a driver can better grasp the road condition and the vehicle state in the process of driving the vehicle, and the driving safety and convenience are improved.

In some embodiments, after projecting the projection information onto the windshield projection screen according to the position to be projected, further comprising:

Receiving an adjustment instruction of projection information;

based on the adjustment instruction, the projection transparency of the projection information on the windshield projection screen is adjusted.

The adjustment instruction can adapt to different driving environments and driver demands, and the driver can send the adjustment instruction of the projection information to the system through a vehicle control panel, a voice instruction or an intelligent gesture and the like, wherein the adjustment instruction comprises the adjustment of the transparency, the size, the position and the like of the projection information.

According to the received adjusting instruction, the transparency of the projection information on the projection screen of the windshield is adjusted, the driver can be helped to better observe the road conditions by adjusting the transparency, and particularly when the projection information is overlapped with the road conditions, the driver can observe the road conditions and the obstacles in front more clearly by reducing the transparency of the projection information. The transparency can be adjusted according to the preference and driving habit of the driver, so as to meet the requirements of different drivers.

Further, the driving state of the driver and the ambient brightness of the windshield projection screen are monitored in real time to optimize the transparency and contrast of the projected information. For example, driving at night or in low light conditions, an automatic increase in the brightness or transparency of the projected information may be provided to ensure that the information is clearly visible to the driver. And in daytime or high light environment, the brightness or transparency can be automatically reduced so as to prevent the projection information from being too bright or reflective to interfere with the sight of a driver.

Fig. 3 is a schematic view of an application scenario of a projection method based on a windshield, where, as shown in fig. 3, a projection screen of the windshield displays a calendar interface in a full screen display manner, which affects a driver to observe current traffic information, the driver can select a month module to be checked through voice selection or mechanical knob fluctuation on a driver's desk/steering wheel, a calendar interface corresponding to the month is reserved on the projection screen of the windshield, and transparency of the calendar interface except the calendar interface corresponding to the month is adjusted to be the highest, that is, to be completely transparent. The transparency adjusting method may be:

Taking the calendar interface module of January as an example, find the relevant code file of the calendar application, the code file is usually a file ending in. Java or. Xml. In the code file, a code related to a portion for which transparency is desired to be adjusted is found, and transparency is set using a corresponding method or attribute according to the programming language and framework used. For an Android application, the transparency corresponding to the control may be adjusted using the set control transparency setAlpha () method, e.g., for a view object view, the transparency may be set to 50% using view. Setalpha (0.5 f).

According to the technical scheme provided by the embodiment of the application, more humanized, intelligent and personalized driving auxiliary information can be provided, so that a driver can obtain and utilize the information more comfortably and safely in the driving process. Meanwhile, the self-adaptive adjustment capability of the system further improves the driving safety and convenience.

In some embodiments, before determining the corresponding view free position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor, the method further comprises:

acquiring the motion state of the current vehicle, wherein the motion state comprises a driving state and a parking state;

when the vehicle is in a parking state, projecting projection information to a corresponding position to be projected, and when the vehicle receives a screen cleaning instruction, executing a step of determining a corresponding vision free position on a windshield projection screen of the current vehicle based on road condition images acquired by an image sensor;

And the step of determining the corresponding vision vacant position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor is executed when the movement state is monitored to be updated from the parking state to the running state.

The method comprises the steps that the motion state of a current vehicle is obtained, wherein the motion state comprises a driving state and a parking state, and when the vehicle is in the driving state, a driver needs to concentrate on observing road conditions, so that projection information projected on a projection screen of the windshield is located in a range of a free position of a visual field of the projection screen of the windshield, and the interference of the visual field of the driver is avoided.

When the vehicle is in a parking state, for various reasons, for example, the user needs to relax or be bored, and the user does not need to consider whether the projection information blocks the sight of the driver, and can perform full-screen projection of the windshield projection screen, and the application projection information can still be projected in the range of the free position of the visual field of the windshield projection screen according to the selection of the user. The parking state is that the current speed of the vehicle is detected to be 0 and the vehicle is in a parking gear.

Further, if the vehicle in a parking state receives a screen clearing instruction, a step of determining a corresponding vision free position on a windshield projection screen of the current vehicle according to the road condition image acquired by the image sensor is executed.

When the motion state of the vehicle is monitored to be updated from the parking state to the running state, namely the vehicle is started, the driver starts to drive the vehicle, the control host machine executes operations including re-acquiring, updating projection information, adjusting projection setting and the like, and executes the step of determining the corresponding vision free position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor.

In an exemplary embodiment of the present application, taking an example that projection information already occupies a projection screen of a windshield, an application program corresponding to the projection information is a music player, an exemplary description is given:

When a user searches through the music player, the useful part of the user is an input frame at the left upper part of the windshield projection screen and an input keyboard at the lower part of the windshield projection screen, and the current projection information is not in the range of the free position of the visual field, so that the driver is influenced to observe the current road condition, and the useful part in the interface of the music player is automatically subjected to position adjustment, combined into a smaller module to be projected on the windshield projection screen for the user.

The specific adjustment method comprises the following steps: determining the part to be moved in the music player interface and its current location, finding the relevant code file of the application, typically a file ending in java or xml, in which code file the relevant code of the part to be moved is found, which may relate to the location of the layout file or view object, adjusting the location using the corresponding method or attribute depending on the programming language and framework used, for Android applications the location of the view object may be set using the layout parameters (LayoutParams), e.g. the new location of the view object may be set using the set X-axis setX () and set Y-axis setY () methods; if a layout such as LinearLayout, relativeLayout or ConstrainLayout is used, the position of the view object in the layout can be adjusted by changing the corresponding layout parameters (e.g., margin, padding, alignment, etc.).

According to the technical scheme provided by the embodiment of the application, corresponding response can be made according to the motion state of the vehicle, so that the driver can safely and effectively acquire and utilize the projection information in the driving process, the projection information can be displayed in a more comfortable mode when the vehicle is in a parking state, and the experience of the driver is improved. Meanwhile, through judgment and adjustment of the position to be projected, the system can also avoid interference with the sight of a driver, and the driving safety is further improved.

Detecting that the projection information is updated, and updating the position to be projected based on the updated projection information;

and executing the step of determining the corresponding vision free position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor.

And receiving the content of the projection information in real time, and when the projection information is detected to be updated, namely new projection information needs to be projected onto the windshield projection screen, in order to ensure the validity and accuracy of the projection information, the updated projection information needs to be projected onto the windshield projection screen in time, so that the position to be projected is reevaluated according to the updated projection information.

For example, the updated projection information includes a navigation instruction, and the position to be projected of the navigation instruction needs to be repositioned, so that the position to be projected is ensured to be clearly visible and not to interfere with the driving field of view of the driver, so that the projection position is ensured to be adjusted in real time according to the dynamic change of the projection information, and more accurate and effective information display is provided.

And if the updated projection information exists, judging whether the position to be projected corresponding to the projection information is in the range of the free position of the visual field or not again. The above-mentioned judging method is repeatedly carried out, and every time the projection information is updated, in particular, when the projection information is updated, a judgment is carried out once so as to ensure that a timely response can be made according to the real-time road condition and the vehicle state.

If the position to be projected is judged not to be in the range of the free position of the visual field, the position to be projected is adjusted according to a preset adjustment mode, and the projection information is ensured not to influence the road condition observed by a driver through a windshield all the time.

According to the technical scheme provided by the embodiment of the application, the accuracy and the effectiveness of the projection information can be ensured, the projection position can be dynamically adjusted according to the requirement in the driving process, clear and safe driving auxiliary information is provided, the cognition of a driver on road conditions and vehicle states is improved, and the driving safety and convenience are further enhanced.

It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present application.

Any combination of the above optional solutions may be adopted to form an optional embodiment of the present application, which is not described herein.

The following are examples of the apparatus of the present application that may be used to perform the method embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the present application.

Fig. 4 is a schematic view of a projection device based on a windshield according to an embodiment of the present application. As shown in fig. 4, the windshield-based projection device is applied to a control host in a projection system, and includes: the device comprises an acquisition module 401, a processing module 402, a judging module 403, an adjusting module 404 and a projection module 405, wherein:

the acquisition module 401 is configured to determine a corresponding vision free position on a windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor;

the processing module 402 is configured to receive the projection information, determine a road condition complexity of the current road condition based on the road condition image, and the road condition complexity is used for representing the influence degree of the projection information on the driver to judge the current road condition;

The judging module 403 is configured to judge whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field when the road condition complexity is not greater than the preset road condition complexity threshold;

The adjusting module 404 is configured to adjust the position to be projected of the projection information to the free position of the field of view according to a preset adjusting mode when the position to be projected is not in the free position range of the field of view;

The projection module 405 is configured to project the projection information onto the windshield projection screen according to the position to be projected when the position to be projected is within the free position of the field of view.

In some embodiments, the acquisition module 401 is configured to determine a corresponding field of view free position on a windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor for:

In some embodiments, the determining module 402 is configured to determine a road condition complexity of the current road condition based on the road condition image for:

In some embodiments, the determining module 402 is configured to determine whether a position to be projected corresponding to the projected projection information on the windshield projection screen is within a free position range of the field of view, and is further configured to:

In some embodiments, the projection module 405 is configured to, after projecting the projection information onto the windshield projection screen according to the position to be projected, further to:

Receiving an adjustment instruction of projection information;

In some embodiments, the acquisition module 401 is configured to, prior to determining the corresponding field of view free position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor, further to:

Fig. 5 is a schematic diagram of an electronic device 5 according to an embodiment of the present application. As shown in fig. 5, the electronic apparatus 5 of this embodiment includes: a processor 501, a memory 502 and a computer program 503 stored in the memory 502 and executable on the processor 501. The steps of the various method embodiments described above are implemented by processor 501 when executing computer program 503. Or the processor 501 when executing the computer program 503 performs the functions of the modules/units in the above-described apparatus embodiments.

The electronic device 5 may be a desktop computer, a notebook computer, a palm computer, a cloud server, or the like. The electronic device 5 may include, but is not limited to, a processor 501 and a memory 502. It will be appreciated by those skilled in the art that fig. 5 is merely an example of the electronic device 5 and is not limiting of the electronic device 5 and may include more or fewer components than shown, or different components.

The Processor 501 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

The memory 502 may be an internal storage unit of the electronic device 5, for example, a hard disk or a memory of the electronic device 5. The memory 502 may also be an external storage device of the electronic device 5, such as a plug-in hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD) or the like, which are provided on the electronic device 5. Memory 502 may also include both internal storage units and external storage devices of electronic device 5. The memory 502 is used to store computer programs and other programs and data required by the electronic device.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-readable storage medium (e.g., a computer-readable storage medium). Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, and the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. The computer program may comprise computer program code, which may be in source code form, object code form, executable file or in some intermediate form, etc. The computer readable storage medium may include: any entity or device capable of carrying computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims

1. A windshield-based projection method, applied to a control host in a projection system, comprising:

Receiving projection information, and determining the road condition complexity of the current road condition based on the road condition image, wherein the road condition complexity is used for representing the influence degree of projection of the projection information on the current road condition judgment of a driver;

when the road condition complexity is not greater than a preset road condition complexity threshold, judging whether a position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the vision free position;

2. The method of claim 1, wherein determining a corresponding field of view free location on a windshield projection screen of the current vehicle based on the road condition image captured by the image sensor comprises:

Acquiring the road condition image in a preset distance range by taking the current vehicle running direction as an acquisition direction based on the image sensor;

And taking the projection of each identification object on a windshield projection screen as a target view position on the windshield projection screen, and taking the position outside the target view position on the windshield projection screen as the view vacant position.

3. The method of claim 1, wherein determining the road condition complexity of the current road condition based on the road condition image comprises:

Acquiring real-time positioning information of a vehicle, and uploading the real-time positioning information to a cloud end so that the cloud end can determine the traffic safety rate of the current vehicle position based on the real-time positioning information and send the traffic safety rate to the vehicle, wherein the traffic safety rate comprises the accident rate of the traffic accident and the rule violation rate;

based on the road condition recognition result, determining traffic information corresponding to the current road condition, wherein the traffic information comprises traffic flow, road layout, road signs and the number of signal lamps;

4. The method of claim 1, wherein determining whether a position to be projected corresponding to projecting the projection information on the windshield projection screen is within the field of view free position range further comprises:

determining a projection information category corresponding to the projection information, wherein the projection information category comprises a statistical projection category, a simulation projection category and a common projection category;

When the projection information category is the statistical projection category, carrying out statistical analysis on the projection information to obtain a statistical analysis result, updating the projection information according to a chart form by the statistical analysis result, and determining the position to be projected corresponding to the updated projection information;

when the projection information category is the simulated projection category, performing simulated analysis processing on the projection information to obtain a simulated display analysis result, updating the projection information according to a simulated view form by the simulated display analysis result, and determining the position to be projected corresponding to the updated projection information;

And when the projection information category is the common projection category, determining the position to be projected corresponding to the current projection information.

5. The method of claim 1, further comprising, after projecting the projection information onto the windshield projection screen in accordance with the location to be projected:

Receiving an adjustment instruction of the projection information;

and adjusting the projection transparency of the projection information on the windshield projection screen based on the adjustment instruction.

6. The method of claim 1, further comprising, prior to determining the corresponding field of view free position on a windshield projection screen of the current vehicle based on the road condition image captured by the image sensor:

acquiring the current motion state of the vehicle, wherein the motion state comprises a running state and a parking state;

When the vehicle is in the parking state, projecting the projection information to the corresponding position to be projected, and when the vehicle receives a screen cleaning instruction, executing the step of determining the corresponding vision free position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor;

And the step of determining the corresponding vision vacant position on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor is executed after the movement state is monitored to be updated from the parking state to the running state.

7. The method according to any one of claims 1 to 6, further comprising, after projecting the projection information onto the windshield projection screen in accordance with the position to be projected:

8. A windshield-based projection device, characterized by a control host applied in a projection system, comprising:

The processing module is configured to receive the projection information, determine the road condition complexity of the current road condition based on the road condition image, and the road condition complexity is used for representing the influence degree of projection of the projection information on the current road condition judged by a driver;

The judging module is configured to judge whether a position to be projected corresponding to the projection information projected on the windshield projection screen is within the visual field free position range or not when the road condition complexity is not greater than a preset road condition complexity threshold;

and the projection module is configured to project the projection information to the windshield projection screen according to the position to be projected when the position to be projected is in the vision free position.

9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when the computer program is executed.

10. A computer readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 7.