CN118042094A - Projection method and device based on windshield and computer readable storage medium - Google Patents

Abstract

The present application relates to the field of intelligent cockpit technology, and provides a windshield-based projection method, device and computer-readable storage medium. The method is applied to a control host in a projection system, and includes: determining the corresponding free position of vision on the windshield projection screen based on a road condition image collected by an image sensor; receiving projection information, determining the road condition complexity of the current road condition based on the road condition image, and when the road condition complexity is not greater than a preset road condition complexity threshold, judging whether the position to be projected on the windshield projection screen is within the free position of vision; when the position to be projected is not within the free position of vision, adjusting the position to be projected of the projection information to the free position of vision according to a preset adjustment method; when the position to be projected is within the free position of vision, projecting it onto the windshield projection screen according to the position to be projected. The windshield-based projection method provided by the present application realizes an intelligent projection experience and ensures driving safety.

Description

Windshield-based projection method, device and computer-readable storage medium

Technical Field

The present application relates to the technical field of smart cockpits, and in particular to a windshield-based projection method, device, and computer-readable storage medium.

Background technique

In the prior art, the functions that can be applied to the vehicle's cabin are becoming more and more diverse. A projection film can be pasted on the vehicle's windshield, and information can be projected onto the fixed projection film through a projector to interact with the user. The interactive content includes greeting information, vehicle information, weather information, augmented reality beauty and messages, etc. However, the projection film is not transparent, so the driver cannot stare at the windshield area with the projection film for a long time while driving the vehicle, resulting in the inability to interact and the inability to bring driving convenience to the driver.

In another prior art, the interior of the vehicle's cabin may also include a Head-Up Display (HUD), which allows the driver to see driving information on the multi-function instrument panel without lowering or turning his head, such as speed, navigation, remaining energy consumption, etc. However, the HUD system can only display relevant parameters of the vehicle itself, such as speed, navigation, remaining energy consumption, etc., and cannot allow the main driver to flexibly use other functions in the cabin, including playing music, asking about the weather, checking road conditions, etc., which brings inconvenience to the driver.

Summary of the invention

In view of this, the embodiments of the present application provide a windshield-based projection method, device and computer-readable storage medium to solve the problem in the prior art that the main driver cannot flexibly use other functions in the cockpit, including playing music, asking about the weather, checking road conditions, etc.

In a first aspect of an embodiment of the present application, a windshield-based projection method is provided, which is applied to a control host in a projection system, comprising:

Determine the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor;

Receiving projection information, and determining the road condition complexity of the current road condition based on the road condition image, where the road condition complexity is used to characterize the degree of influence of the projection information on the driver's judgment of the current road condition;

When the road condition complexity is not greater than a preset road condition complexity threshold, determining whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within a range of free positions in the field of vision;

When the position to be projected is not within the range of the free position in the visual field, the position to be projected of the projection information is adjusted to the free position in the visual field according to a preset adjustment method;

When the position to be projected is within the free position of the visual field, the projection information is projected onto the windshield projection screen according to the position to be projected.

A second aspect of an embodiment of the present application provides a windshield-based projection device, which is applied to a control host in a projection system, including:

A collection module, configured to determine a corresponding free position of vision on a windshield projection screen of a current vehicle based on a road condition image collected by an image sensor;

A processing module is configured to receive the projection information and determine the road condition complexity of the current road condition based on the road condition image, wherein the road condition complexity is used to characterize the degree of influence of the projection information on the driver's judgment of the current road condition;

A judgment module is configured to judge whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field when the road condition complexity is not greater than a preset road condition complexity threshold;

An adjustment module is configured to adjust the position of the projection information to be projected to the free position in the visual field according to a preset adjustment method when the position to be projected is not within the free position range of the visual field;

The projection module is configured to project the projection information onto the windshield projection screen according to the position to be projected when the position to be projected is within the free position of the visual field.

According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.

According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

Compared with the prior art, the embodiments of the present application have the following beneficial effects: the embodiments of the present application are applied to a control host in a projection system, the control host determines the corresponding free position in the field of view on the windshield projection screen of the current vehicle according to the road condition image collected by the image sensor, receives projection information, determines the road condition complexity of the current road condition based on the road condition image, and when the road condition complexity is not greater than a preset road condition complexity threshold, determines whether the position to be projected corresponding to the projection information on the windshield projection screen is within the range of free positions in the field of view, wherein the road condition complexity is used to characterize the degree of influence of the projection information on the driver's judgment of the current road condition, and when the position to be projected is not within the range of free positions in the field of view, the projection information is adjusted in a preset manner. The position to be projected of the projection information is adjusted to the free position in the field of vision. When the position to be projected is within the free position in the field of vision, the projection information is projected onto the windshield projection screen according to the position to be projected. Thus, when the complexity of the road condition is not greater than the preset road condition complexity threshold, the projection information can be displayed on the windshield projection screen through the projection system, and the position to be projected of the projection information on the windshield projection screen is determined to be within the range of the free position in the field of vision, thereby ensuring that the projection information will not affect the driver's judgment of the current road condition, and enabling the user of the vehicle to simultaneously view the road condition and the projection information through the windshield projection screen, thereby improving the comfort of viewing the projection information, realizing an intelligent projection experience, and ensuring driving safety.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

FIG1 is a schematic diagram of an application scenario of an embodiment of the present application;

FIG2 is a schematic flow chart of a windshield-based projection method provided in an embodiment of the present application;

FIG3 is a schematic diagram of an application scenario of a windshield-based projection method provided in an embodiment of the present application;

FIG4 is a schematic diagram of a windshield-based projection device provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of an electronic device provided in an embodiment of the present application.

Detailed ways

In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

A display control method and device according to an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

1 is a schematic diagram of an application scenario of an embodiment of the present application. The application scenario may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a server 104, and a network 105.

The first terminal device 101, the second terminal device 102 and the third terminal device 103 can be hardware or software. When the first terminal device 101, the second terminal device 102 and the third terminal device 103 are hardware, they can be various electronic devices with display screens and supporting communication with the server 104, including but not limited to vehicle-mounted computers, vehicle-mounted processors, vehicle-mounted computers, smart phones, tablet computers, laptop portable computers and desktop computers, etc.; when the first terminal device 101, the second terminal device 102 and the third terminal device 103 are software, they can be installed in the electronic devices described above. The first terminal device 101, the second terminal device 102 and the third terminal device 103 can be implemented as multiple software or software modules, or as a single software or software module, which is not limited in the embodiment of the present application. Further, various applications can be installed on the first terminal device 101, the second terminal device 102 and the third terminal device 103, such as data processing applications, instant messaging tools, social platform software, search applications, shopping applications, etc.

The server 104 may be a server that provides various services, for example, a background server that receives a request sent by a terminal device that establishes a communication connection with the server, and the background server may receive and analyze the request sent by the terminal device, and generate a processing result. The server 104 may be a single server, or a server cluster composed of several servers, or a cloud computing service center, which is not limited in the present embodiment of the application.

It should be noted that the server 104 can be hardware or software. When the server 104 is hardware, it can be various electronic devices that provide various services for the first terminal device 101, the second terminal device 102, and the third terminal device 103. When the server 104 is software, it can be multiple software or software modules that provide various services for the first terminal device 101, the second terminal device 102, and the third terminal device 103, or it can be a single software or software module that provides various services for the first terminal device 101, the second terminal device 102, and the third terminal device 103, and the embodiment of the present application does not limit this.

The network 105 can be a wired network connected by coaxial cable, twisted pair and optical fiber, or it can be a wireless network that can interconnect various communication devices without wiring, such as Bluetooth, Near Field Communication (NFC), infrared, etc., which is not limited in the embodiments of the present application.

It should be noted that the specific types, quantities and combinations of the first terminal device 101, the second terminal device 102 and the third terminal device 103, the server 104 and the network 105 can be adjusted according to the actual needs of the application scenario, and the embodiments of the present application do not limit this.

In an exemplary embodiment provided by the present application, a windshield-based projection system is provided, wherein the windshield-based projection system includes a windshield projection screen, a control host and a projector, wherein the windshield projection screen is arranged in the front windshield, and the front windshield is provided with optical elements, and the optical elements include lenses, reflectors and dichroic prisms, etc., wherein, since the overall size and area of the front windshield are large, the size of the windshield projection screen is large, and light can be focused by selecting larger reflectors and lenses, etc., or optical elements suitable for the size of the front windshield can be prepared by adding components, etc., and the front windshield is directly used as a windshield projection screen to receive information sent by the control host for projection.

Furthermore, a windshield projection screen that does not block the view and can receive and display projection information can also be installed on the front windshield, and a projector or projection equipment can be installed on the roof inside the vehicle cabin to meet the projection function requirements. Among them, the windshield projection screen should have good reflection performance, be able to effectively reflect light, and meet the requirements of reflection uniformity, brightness, color uniformity and reflectivity.

The above-mentioned embodiments provided in the present application can be understood as follows: the windshield projection screen is arranged in the front windshield, and can directly receive and display the information sent by the control host of the projection system, or can display the projection information on the front windshield by reflecting the projection of the projector.

The projection information is displayed once or in a carousel format. For example, when part of the traffic projection information is displayed, it is displayed in a carousel format, so that the traffic projection information can be displayed to the user as much as possible while occupying a smaller area of the windshield display screen.

Among them, the control host and the projector in the projection system are connected through a high-definition multimedia interface (HDMI) and a local area network. The projector also includes an adjustment function, which may include a projection screen zoom function, a projector orientation correction function, a projector heat dissipation function, a projector anti-shake function, etc. The projector orientation correction function can adjust the projector imaging orientation to prevent the projection imaging from tilting.

FIG2 is a schematic flow chart of a windshield-based projection method provided in an embodiment of the present application. As shown in FIG2 , the windshield-based projection method is applied to a control host in a projection system, and the windshield-based projection method includes the following steps:

S201, determining a corresponding free position in the field of view on the windshield projection screen of the current vehicle based on a road condition image acquired by an image sensor;

S202, receiving projection information, and determining the complexity of the current road condition based on the road condition image;

S203, when the road condition complexity is not greater than the preset road condition complexity threshold, determining whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field;

S204, when the position to be projected is not within the range of the free position in the visual field, adjusting the position to be projected of the projection information to the free position in the visual field according to a preset adjustment method;

S205: When the position to be projected is within the free position in the field of vision, the projection information is projected onto the windshield projection screen according to the position to be projected.

The road condition complexity is used to characterize the influence of the projected information on the driver's judgment of the current road condition.

The windshield-based projection method of Figure 2 can be executed by any terminal device including a control host, including the first terminal device, the second terminal device or the third terminal device provided in Figure 1. The projection information can be transmitted from the terminal device including the control host to the projector by the server provided in Figure 1. The projector and the control host can also complete the projection of the projection information through a high-definition multimedia interface HDMI.

In an exemplary embodiment of the present application, an image sensor collects road condition images, and useful information is extracted from the road condition images through image processing technology or visual algorithms to determine the corresponding free position in the field of view on the windshield projection screen of the current vehicle.

Receive projection information and determine the complexity of the current road condition based on the road condition image, where the complexity of the road condition is used to reflect the influence of the projection information on the driver's judgment of the current road condition. If the complexity of the road condition exceeds a preset road condition complexity threshold, it may interfere with the driver's autonomous judgment of the current road condition.

When the complexity of the road condition is not greater than a preset road condition complexity threshold, a projection operation is performed to project the projection information onto the windshield projection screen. The projection operation includes: determining whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free positions in the field of vision; if the position to be projected is not within the range of the free positions in the field of vision, adjusting the position to be projected corresponding to the current projection information to the free position in the field of vision according to a preset adjustment method, thereby ensuring that the projection information on the windshield projection screen will not interfere with the driver's line of sight, nor affect the driver's judgment of the road conditions.

Among them, the method for implementing the preset adjustment method can be: determine the projection information that needs to be adjusted and the projection positions to be projected that they currently correspond to, find the relevant code files of the application corresponding to the projection information, the above code files are usually files ending with .java or .xml, find the code related to the projection information that needs to be adjusted in the code files, and use the corresponding methods or properties to adjust the position and layout of the icons according to the programming language and framework used. For Android applications, you can use layout parameters (LayoutParams) to set the position of the view object. If you use a linear layout LinearLayout, a relative layout RelativeLayout, or a constraint layout ConstraintLayout, etc., you can adjust the position and layout of the projection information that needs to be adjusted by modifying the corresponding layout parameters (such as margin, padding, alignment, etc.).

If all the positions to be projected are within the range of free positions in the field of vision, the projection information is projected onto the windshield projection screen according to the positions to be projected.

According to the technical solution provided in the embodiment of the present application, it is possible to effectively determine the free position in the field of vision and the complexity of the road condition, and determine that the position to be projected corresponding to the projection information is within the range of the free position in the field of vision, thereby ensuring that the projection information can be clearly displayed on the windshield without interfering with the driver's line of sight and road condition judgment. The driver's driving needs, driving safety and driving experience are comprehensively considered, the comfort of viewing the projection information is improved, an intelligent projection experience is realized, and driving safety is guaranteed.

In some embodiments, determining the corresponding free position of the field of view on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor includes:

Based on the image sensor, the image of the road condition within the preset distance range is collected with the current vehicle driving direction as the collection direction;

Performing image recognition on the road condition image to obtain a road condition recognition result; the road condition recognition result includes one or more recognition objects, and the recognition objects include other vehicles other than the vehicle, traffic lights, pedestrian crossings, zebra crossings, and traffic signs;

The projection of each recognition object on the windshield projection screen is used as the target visual field position on the windshield projection screen, and the position outside the target visual field position on the windshield projection screen is used as the visual field free position.

The image sensor uses the current vehicle's driving direction as the direction for collecting real-time road conditions, and collects road condition images within a preset distance range. The preset distance range can be set based on the vehicle's driving speed and the driver's field of vision to ensure that sufficiently detailed and accurate road condition information is obtained.

Perform image recognition on the collected road condition images, wherein image recognition can be performed by using an image recognition algorithm to identify one or more identification objects from the collected road condition images. The identification objects include other vehicles other than the current vehicle, traffic lights, crosswalks, zebra crossings, and traffic signs, etc. The identification objects are of great significance for the driver to judge the road conditions.

The projection of each identified object on the windshield projection screen is used as the target field of view position. The target field of view position is equivalent to simulating the position of the identified object observed by the driver, so it cannot be blocked to ensure the driver's judgment of the current road conditions.

The position outside the target field of view on the windshield projection screen is regarded as a free field of view position. It can be seen that the free field of view position is an area not occupied by the recognized object and can be used to display other information or project information, so as not to interfere with the driver's line of sight or affect his judgment of the road conditions.

According to the technical solution provided in the embodiment of the present application, the corresponding free field of vision position on the current vehicle windshield projection screen can be accurately determined based on the road condition image, and the projection information can be projected to the free field of vision position to ensure that it does not affect the driver's ability to judge the current road condition.

In some embodiments, determining the traffic complexity of the current traffic condition based on the traffic image includes:

Obtaining the real-time positioning information of the vehicle, and uploading the real-time positioning information to the cloud, so that the cloud can determine the traffic safety rate of the current vehicle location based on the real-time positioning information and send it to the vehicle, the traffic safety rate includes the accident rate of traffic accidents and the violation rate of violations of rules;

Based on the road condition recognition results, determine the traffic information corresponding to the current road condition, which includes traffic volume, road layout, road signs and the number of traffic lights;

Based on the traffic safety rate and traffic information, determine the complexity of the current road conditions.

Acquire the real-time positioning information of the vehicle, where the real-time positioning information may include the longitude, latitude, driving direction, etc. of the vehicle, which can be obtained through global satellite positioning technology or other positioning technologies, and upload the real-time positioning information to the cloud, so that the cloud can determine the traffic safety rate of the current vehicle position based on the real-time positioning information. The accuracy and reliability of positioning can also be further improved through on-board sensors and map data, such as through simultaneous positioning and map building technology.

Among them, the traffic safety rate includes the accident rate and the violation rate. The accident rate is calculated based on historical data and traffic accident records near the current location, while the violation rate is determined based on traffic rules and monitoring data.

After the cloud determines the traffic safety rate of the current vehicle location based on the real-time positioning information, it sends the traffic safety rate to the vehicle, and the vehicle receives the traffic safety rate.

At the same time, combined with road condition images and real-time positioning information, a comprehensive analysis of the current traffic environment is conducted to determine the complexity of the current road conditions. The comprehensive analysis can be obtained through algorithm processing. Factors affecting the complexity may include, for example, current vehicle flow, pedestrian flow, vehicle speed, road construction method and road layout, etc. The above factors are comprehensively calculated through the algorithm to determine the complexity of the current road conditions.

The calculated complexity is compared with the preset complexity threshold. If the complexity of the current road condition is lower than or equal to the preset complexity threshold, it means that the driver can process this information without too much interference and can take into account the current road condition, and will not be affected by the projection information. The projection technology can be executed to display the projection information to the driver through the windshield projection screen to enhance the driver's driving experience. The preset complexity threshold can be set according to safety standards, user experience optimization and the time required for calculating complexity.

If the complexity of the current road conditions is greater than the preset complexity threshold, it means that displaying the projection information on the windshield projection screen may block the driver's field of vision, affect the driver's judgment of the current road conditions, and pose a safety hazard. Therefore, the projection information will not be displayed when the complexity is greater than the preset complexity threshold.

According to the technical solution provided in the embodiment of the present application, the road condition complexity of the current road condition can be determined based on the road condition image, which involves the acquisition of real-time positioning information, the calculation of traffic safety rate, the extraction of traffic information and the complexity of road conditions, so that an accurate and real-time road condition complexity assessment can be obtained to better serve the decision-making of drivers and traffic management departments. It is also possible to project information according to application display instructions to improve driving convenience and comfort.

In some embodiments, before determining whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position in the field of view, the method further includes:

Determine the projection information category corresponding to the projection information, the projection information category including a statistical projection category, a simulated projection category and a common projection category;

When the projection information category is a statistical projection category, statistical analysis is performed on the projection information to obtain statistical analysis results, the projection information is updated according to the statistical analysis results in a chart form, and a projection position corresponding to the updated projection information is determined;

When the projection information category is a simulated projection category, the projection information is simulated analyzed and processed to obtain a simulated display analysis result, the projection information is updated according to the simulated view form using the simulated display analysis result, and a to-be-projected position corresponding to the updated projection information is determined;

When the projection information category is a common projection category, the to-be-projected position corresponding to the current projection information is determined.

Before determining whether the projection position of the corresponding projection information projected on the windshield projection screen is within the range of the free position of the field of view, in order to ensure the accuracy and effectiveness of the information, the projection information is further subdivided into different projection information categories according to its content, and corresponding processing methods are adopted according to the categories. Among them, the projection information categories include statistical projection categories, simulated projection categories and ordinary projection categories.

The statistical projection category mainly refers to the projection information that provides statistical data on traffic flow, speed, accident rate, violation rate, etc. The data of the statistical projection category can help drivers understand the overall status of the current road conditions. Among them, the projection information of the statistical projection category can be obtained by analyzing and processing the road condition image, or by analyzing and processing the real-time positioning information and the road condition image to obtain the statistical analysis results;

The simulated projection category refers to projection information displayed in the form of simulated diagrams or animations, such as traffic light status, pedestrians crossing the road, road composition, road layout, etc. The data of the simulated projection category can provide drivers with more intuitive feedback on road conditions. Among them, the projection information of the simulated projection category can be obtained by analyzing and processing real-time positioning information, that is, fixed projection information can be determined based on real-time positioning information, such as road composition. When displaying information that needs to be updated in real time, such as pedestrians crossing the road, it is necessary to perform simulation analysis and processing based on real-time positioning information and road condition information to obtain simulated display analysis results;

For the projection information of the common projection category, you can directly project it.

According to different projection information categories, the information is converted and presented in different ways. For example, for statistical projection categories, the corresponding projection information can be presented in the form of charts or data reports according to the statistical analysis results, such as statistical charts, histograms, line graphs, statistical figures, etc., and projected to the corresponding projection position according to each projection information category to complete the projection of the statistical projection category;

For the simulation projection category, it can be displayed through a more vivid animation or three-dimensional model image. For navigation information, it can be guided in a manner similar to augmented reality display, and the simulation display analysis results are projected to the corresponding projection position in the form of a simulation view according to the projection information category, wherein the simulation view form includes animation and three-dimensional model images. For example, the road layout can directly obtain the corresponding three-dimensional model image of the road layout according to the real-time positioning information. When there is navigation information, the navigation information corresponding to the real-time position information can be directly displayed on the three-dimensional model image of the road layout, and the correct driving road can be displayed to provide the driver with more convenient and intuitive navigation guidance.

According to different types of projection information, the projection information is projected to the projection position corresponding to the windshield projection screen, so that the driver can more conveniently obtain and understand the information. For example, the projection of the statistical projection category can be set to the edge part within the free visual position range, and the traffic simulation information such as navigation information and road layout can be set to be projected within the free visual position and closer to the driver.

Furthermore, the projection information may also include navigation instructions, telephone notifications, etc., which are respectively used to determine corresponding positions to be projected according to different types of projection information.

According to the technical solution provided in the embodiment of the present application, the driver can better understand the road conditions and vehicle status while driving the vehicle, thereby improving driving safety and convenience.

In some embodiments, after projecting the projection information onto the windshield projection screen according to the projection position, the method further includes:

Accept adjustment instructions for projection information;

Based on the adjustment instruction, the projection transparency of the projection information on the windshield projection screen is adjusted.

Adjustment instructions can adapt to different driving environments and driver needs. The driver can send adjustment instructions for the projection information to the system through the in-vehicle control panel, voice commands or smart gestures. The adjustment instructions include adjusting the transparency, size, position, etc. of the projection information.

According to the received adjustment instructions, the transparency of the projection information on the windshield projection screen is adjusted. Adjusting the transparency can help the driver better observe the road conditions, especially when the projection information overlaps with the road conditions, the road conditions and obstacles ahead can be observed more clearly by reducing the transparency of the projection information. The transparency adjustment can also be personalized according to the driver's preferences and driving habits to meet the needs of different drivers.

Furthermore, the driver's driving status and the ambient brightness of the windshield projection screen are monitored in real time to optimize the transparency and contrast of the projected information. For example, when driving at night or in low-light environments, the brightness or transparency of the projected information can be automatically increased to ensure that the driver can see the information clearly. In the daytime or in high-light environments, the brightness or transparency can be automatically reduced to prevent the projected information from being too bright or reflective and interfering with the driver's vision.

FIG3 is a schematic diagram of an application scenario of a windshield-based projection method provided by an embodiment of the present application. As shown in FIG3 , the windshield projection screen displays a calendar interface in full-screen display mode, which affects the driver's observation of current traffic information. The driver can select the month module he wants to view through voice selection or the mechanical knob fluctuation on the driving console/steering wheel, and retain the calendar interface corresponding to the month on the windshield projection screen. The transparency of the calendar interface other than the calendar interface corresponding to the month is adjusted to the highest, that is, adjusted to be completely transparent. Among them, the method of adjusting the transparency can be:

Take the calendar interface module for January as an example, and find the relevant code files of the calendar application. The code files usually end with .java or .xml. In the code files, find the relevant code for the part where you want to adjust the transparency. According to the programming language and framework used, use the corresponding method or property to set the transparency. For Android applications, you can use the setAlpha() method to adjust the transparency of the control. For example, for a view object, you can use view.setAlpha(0.5f) to set the transparency to 50%.

According to the technical solution provided by the embodiment of the present application, it is possible to provide more humane, intelligent and personalized driving assistance information, so that the driver can obtain and use the information more comfortably and safely during driving. At the same time, the adaptive adjustment capability of the system also further improves the safety and convenience of driving.

In some embodiments, before determining the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor, the method further includes:

Get the current vehicle's motion state, which includes driving state and parking state;

When the vehicle is in a parking state, the projection information is projected to the corresponding position to be projected, and when the vehicle receives a screen clearing instruction, the step of determining the corresponding free position of the field of view on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is executed;

When it is detected that the motion state is updated from the parking state to the driving state, a step of determining a corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor is executed.

The current motion state of the vehicle is obtained. The motion state includes the driving state and the parking state. When the vehicle is in the driving state, the driver needs to concentrate on observing the road conditions. Therefore, the projection information projected on the windshield projection screen should be within the free position of the windshield projection screen to avoid interfering with the driver's field of view.

When the vehicle is parked, the user may, for various reasons, such as needing to relax or being bored, project the full screen of the windshield projection screen without considering whether the projection information blocks the driver's line of sight. Alternatively, the application projection information may be projected within the free position of the windshield projection screen according to the user's choice. The parking state is when the vehicle is detected to be at a current speed of 0 and in the parking gear.

Furthermore, if the vehicle in the parked state receives a screen clearing instruction, a step of determining a corresponding free position in the field of view on the windshield projection screen of the current vehicle according to the road condition image collected by the image sensor is executed.

When it is monitored that the vehicle's motion state is updated from a parking state to a driving state, that is, the vehicle is started and the driver starts to drive the vehicle, the control host executes operations including re-acquisition, updating projection information and adjusting projection settings, and executes steps to determine the corresponding free field of view position on the windshield projection screen of the current vehicle based on the road condition image captured by the image sensor.

In an exemplary embodiment of the present application, an example is given in which the projection information has occupied the windshield projection screen and the application corresponding to the projection information is a music player.

When the user searches through the music player, the useful parts for the user are the input box in the upper left corner of the windshield projection screen and the input keyboard below the windshield projection screen, and the current projection information is not within the free field of vision, which affects the driver's observation of the current road conditions. The useful parts of the music player interface are automatically adjusted and combined into smaller modules and projected onto the windshield projection screen for user use.

The specific adjustment method is: determine the part of the music player interface that you want to move and its current position, find the relevant code file of the application, usually a file ending with .java or .xml, and in the code file, find the code related to the part you want to move, which may involve the layout file or the position of the view object. According to the programming language and framework used, use the corresponding method or property to adjust the position. For Android applications, you can use layout parameters (LayoutParams) to set the position of the view object. For example, you can use the setX() and setY() methods to set the new position of the view object. If you are using a layout such as LinearLayout, RelativeLayout, or ConstrainLayout, you can adjust the position of the view object in the layout by changing the corresponding layout parameters (such as margin, padding, alignment, etc.).

According to the technical solution provided by the embodiment of the present application, it is possible to respond accordingly according to the motion state of the vehicle, ensuring that the driver can safely and effectively obtain and use the projection information during driving, and it is also possible to display the projection information in a more comfortable way when the vehicle is parked, thereby improving the driver's experience. At the same time, by judging and adjusting the position to be projected, the system can also avoid interfering with the driver's line of sight, further improving driving safety.

In some embodiments, after projecting the projection information onto the windshield projection screen according to the projection position, the method further includes:

Detecting that the projection information has been updated, and updating the position to be projected based on the updated projection information;

The step of determining a corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is performed.

The content of the projection information is received in real time. When it is detected that the projection information has been updated, that is, there is new projection information that needs to be projected onto the windshield projection screen, in order to ensure the validity and accuracy of the projection information, the updated projection information needs to be projected onto the windshield projection screen in a timely manner, so the projection position is re-evaluated according to the updated projection information.

For example, the updated projection information contains navigation instructions, and the projection position of the navigation instructions needs to be repositioned to ensure that they are clearly visible and do not interfere with the driver's driving field of vision, so as to ensure that the projection position is adjusted in real time according to the dynamic changes of the projection information, providing more accurate and effective information display.

In addition to updating the position to be projected based on the updated projection information, if there is updated projection information, it is determined again whether the position to be projected corresponding to the projection information is within the range of the free position in the field of view. The above determination method is repeated, and a determination is performed every time the projection information is updated, especially when the projection information is updated, to ensure that a timely response can be made according to the real-time road conditions and vehicle status.

If it is determined that the projection position is not within the free field of view, adjustments are made according to a preset adjustment method to ensure that the projection information will never affect the driver's observation of road conditions through the windshield.

According to the technical solution provided in the embodiment of the present application, it is possible to ensure the accuracy and effectiveness of the projection information, and dynamically adjust the projection position as needed during driving, provide clear and safe driving assistance information, and improve the driver's awareness of road conditions and vehicle status, thereby further enhancing driving safety and convenience.

It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present application, which will not be described one by one here.

The following are device embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

FIG4 is a schematic diagram of a windshield-based projection device provided in an embodiment of the present application. As shown in FIG4 , the windshield-based projection device is applied to a control host in a projection system, including: an acquisition module 401, a processing module 402, a judgment module 403, an adjustment module 404, and a projection module 405, wherein:

The acquisition module 401 is configured to determine the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor;

The processing module 402 is configured to receive the projection information and determine the road condition complexity of the current road condition based on the road condition image, where the road condition complexity is used to characterize the degree of influence of the projection information on the driver's judgment of the current road condition;

The judgment module 403 is configured to judge whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field when the road condition complexity is not greater than the preset road condition complexity threshold;

The adjustment module 404 is configured to adjust the position of the projection information to be projected to the free position of the visual field according to a preset adjustment method when the position to be projected is not within the free position range of the visual field;

The projection module 405 is configured to project the projection information onto the windshield projection screen according to the position to be projected when the position to be projected is within the free position of the visual field.

In some embodiments, the acquisition module 401 is configured to determine the corresponding free position of the field of view on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor, for:

Based on the image sensor, the image of the road condition within the preset distance range is collected with the current vehicle driving direction as the collection direction;

Performing image recognition on the road condition image to obtain a road condition recognition result; the road condition recognition result includes one or more recognition objects, and the recognition objects include other vehicles other than the vehicle, traffic lights, pedestrian crossings, zebra crossings, and traffic signs;

The projection of each recognition object on the windshield projection screen is used as the target visual field position on the windshield projection screen, and the position outside the target visual field position on the windshield projection screen is used as the visual field free position.

In some embodiments, the determination module 402 is configured to determine the traffic complexity of the current traffic condition based on the traffic image, for:

Obtaining the real-time positioning information of the vehicle, and uploading the real-time positioning information to the cloud, so that the cloud can determine the traffic safety rate of the current vehicle location based on the real-time positioning information and send it to the vehicle, the traffic safety rate includes the accident rate of traffic accidents and the violation rate of violations of rules;

Based on the road condition recognition results, determine the traffic information corresponding to the current road condition, which includes traffic volume, road layout, road signs and the number of traffic lights;

Based on the traffic safety rate and traffic information, determine the complexity of the current road conditions.

In some embodiments, the determination module 402 is configured to determine whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field before:

Determine the projection information category corresponding to the projection information, the projection information category including a statistical projection category, a simulated projection category and a common projection category;

When the projection information category is a statistical projection category, statistical analysis is performed on the projection information to obtain statistical analysis results, the projection information is updated according to the statistical analysis results in a chart form, and a projection position corresponding to the updated projection information is determined;

When the projection information category is a simulated projection category, the projection information is simulated analyzed and processed to obtain a simulated display analysis result, the projection information is updated according to the simulated view form using the simulated display analysis result, and a to-be-projected position corresponding to the updated projection information is determined;

When the projection information category is a common projection category, the to-be-projected position corresponding to the current projection information is determined.

In some embodiments, the projection module 405 is configured to project the projection information onto the windshield projection screen according to the projection position, and further to:

Accept adjustment instructions for projection information;

Based on the adjustment instruction, the projection transparency of the projection information on the windshield projection screen is adjusted.

In some embodiments, the acquisition module 401 is configured to, before determining the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor, further be used to:

Get the current vehicle's motion state, which includes driving state and parking state;

When the vehicle is in a parking state, the projection information is projected to the corresponding position to be projected, and when the vehicle receives a screen clearing instruction, the step of determining the corresponding free position of the field of view on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is executed;

When it is detected that the motion state is updated from the parking state to the driving state, a step of determining a corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor is executed.

In some embodiments, the projection module 405 is configured to project the projection information onto the windshield projection screen according to the projection position, and further to:

Detecting that the projection information has been updated, and updating the position to be projected based on the updated projection information;

The step of determining a corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is performed.

FIG5 is a schematic diagram of an electronic device 5 provided in an embodiment of the present application. As shown in FIG5 , the electronic device 5 of this embodiment includes: a processor 501, a memory 502, and a computer program 503 stored in the memory 502 and executable on the processor 501. When the processor 501 executes the computer program 503, the steps in the above-mentioned various method embodiments are implemented. Alternatively, when the processor 501 executes the computer program 503, the functions of each module/unit in the above-mentioned various device embodiments are implemented.

The electronic device 5 may be a desktop computer, a notebook, a PDA, a cloud server, or other electronic device. The electronic device 5 may include, but is not limited to, a processor 501 and a memory 502. Those skilled in the art will appreciate that FIG. 5 is merely an example of the electronic device 5 and does not limit the electronic device 5, and may include more or fewer components than shown in the figure, or different components.

The processor 501 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

The memory 502 may be an internal storage unit of the electronic device 5, for example, a hard disk or memory of the electronic device 5. The memory 502 may also be an external storage device of the electronic device 5, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 5. The memory 502 may also include both an internal storage unit of the electronic device 5 and an external storage device. The memory 502 is used to store computer programs and other programs and data required by the electronic device.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units.

If the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium (e.g., a computer-readable storage medium). Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying a computer program code, a recording medium, a U disk, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.

The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims (10)

1. A windshield-based projection method, characterized in that a control host applied to a projection system comprises: Determine the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor; receiving projection information, and determining the road condition complexity of the current road condition based on the road condition image, wherein the road condition complexity is used to characterize the degree of influence of projecting the projection information on the driver's judgment of the current road condition; When the road condition complexity is not greater than a preset road condition complexity threshold, determining whether the to-be-projected position corresponding to the projection information projected on the windshield projection screen is within the range of the free position in the field of vision; When the position to be projected is not within the range of the free position in the field of view, adjusting the position to be projected of the projection information to the free position in the field of view according to a preset adjustment method; When the position to be projected is within the free position in the field of vision, the projection information is projected onto the windshield projection screen according to the position to be projected. 2. The method according to claim 1, characterized in that determining the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor comprises: The image sensor collects the road condition image within a preset distance range with the current vehicle driving direction as the collection direction; Performing image recognition on the road condition image to obtain a road condition recognition result; the road condition recognition result includes one or more recognition objects, and the recognition objects include other vehicles other than the vehicle, traffic lights, pedestrian crossings, zebra crossings, and traffic signs; The projection of each recognition object on the windshield projection screen is used as the target visual field position on the windshield projection screen, and the position outside the target visual field position on the windshield projection screen is used as the visual field free position. 3. The method according to claim 1, characterized in that determining the traffic complexity of the current traffic condition based on the traffic image comprises: Acquire real-time positioning information of the vehicle, upload the real-time positioning information to the cloud, so that the cloud determines the traffic safety rate of the current position of the vehicle based on the real-time positioning information and sends it to the vehicle, wherein the traffic safety rate includes the accident rate of traffic accidents and the violation rate of violations of rules; Based on the road condition recognition result, determine the traffic information corresponding to the current road condition, the traffic information including the traffic volume, road layout, road signs and the number of traffic lights; Based on the traffic safety rate and the traffic information, the complexity of the current road condition is determined. 4. The method according to claim 1, characterized in that before determining whether the projection position corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field, it further comprises: Determine a projection information category corresponding to the projection information, wherein the projection information category includes a statistical projection category, a simulated projection category, and a common projection category; When the projection information category is the statistical projection category, statistical analysis is performed on the projection information to obtain statistical analysis results, the projection information is updated according to the statistical analysis results in a chart form, and the to-be-projected position corresponding to the updated projection information is determined; When the projection information category is the simulated projection category, performing simulation analysis processing on the projection information to obtain a simulated display analysis result, updating the projection information with the simulated display analysis result in a simulated view form, and determining the to-be-projected position corresponding to the updated projection information; When the projection information category is the common projection category, the to-be-projected position corresponding to the current projection information is determined. 5. The method according to claim 1, characterized in that after projecting the projection information onto the windshield projection screen according to the position to be projected, it further comprises: Accepting an adjustment instruction of the projection information; Based on the adjustment instruction, the projection transparency of the projection information on the windshield projection screen is adjusted. 6. The method according to claim 1, characterized in that before determining the corresponding free position of the visual field on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor, it also includes: Acquiring the current motion state of the vehicle, wherein the motion state includes a driving state and a parking state; When the vehicle is in the parking state, the projection information is projected to the corresponding position to be projected, and when the vehicle receives a screen clearing instruction, the step of determining the corresponding free position of the field of view on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is executed; When it is monitored that the motion state is updated from the parking state to the driving state, the step of determining the corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image acquired by the image sensor is executed. 7. The method according to any one of claims 1 to 6, characterized in that after projecting the projection information onto the windshield projection screen according to the position to be projected, it further comprises: detecting that the projection information has been updated, and updating the to-be-projected position based on the updated projection information; The step of determining the corresponding free position in the field of vision on the windshield projection screen of the current vehicle based on the road condition image collected by the image sensor is performed. 8. A windshield-based projection device, characterized in that the control host used in the projection system comprises: A collection module, configured to determine a corresponding free position of vision on a windshield projection screen of a current vehicle based on a road condition image collected by an image sensor; A processing module is configured to receive the projection information and determine the road condition complexity of the current road condition based on the road condition image, wherein the road condition complexity is used to characterize the degree of influence of projecting the projection information on the driver's judgment of the current road condition; A judgment module is configured to judge whether the position to be projected corresponding to the projection information projected on the windshield projection screen is within the range of the free position of the visual field when the complexity of the road condition is not greater than a preset road condition complexity threshold; an adjustment module, configured to adjust the position to be projected of the projection information to the free position in the visual field according to a preset adjustment method when the position to be projected is not within the range of the free position in the visual field; The projection module is configured to project the projection information onto the windshield projection screen according to the position to be projected when the position to be projected is within the free position of the visual field. 9. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1 to 7 when executing the computer program. 10. A computer-readable storage medium storing a computer program, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when executed by a processor.