CN118132021A - Automobile head-up display control method, computer device and storage medium - Google Patents

Abstract

The invention discloses an automobile head-up display control method, a computer device and a storage medium. The invention can meet the requirements of people on the aspects of driving experience pleasure, driving informatization, intellectualization and the like, reduces the information redundancy of the pictures to be displayed, has higher information transmission efficiency, is convenient to check in a driving environment, is beneficial to reducing the interference on the visual field of a driver when head-up display is carried out, and ensures the driving safety. The invention is widely applied to the technical field of automobiles.

Description

Automobile head-up display control method, computer device and storage medium

Technical Field

The invention relates to the technical field of automobiles, in particular to an automobile head-up display control method, a computer device and a storage medium.

Background

Head-up display (Head-Up Dsiplay, HUD) is also called Head-up display system, and important driving information such as speed per hour, navigation and the like is projected onto a windshield in front of a driver or a special reflector, so that the driver can know the driving information without looking at a meter at low Head, and driving safety is guaranteed.

In the existing automobile head-up display technology, in the first aspect, the projected display effect contains less information, and the requirements of people on the aspects of driving experience pleasure, driving informatization, intellectualization and the like are gradually not met; in the second aspect, the information transmission efficiency is low because less information is projected; in the third aspect, the head-up display technology utilizes the reflected light of the windshield to realize the display effect, and inevitably needs to occupy a certain visual field, which can cause interference to the driver for observing the environment outside the vehicle through the windshield, and affects the driving safety.

Disclosure of Invention

Aiming at the technical problems of small information quantity, low information transmission efficiency, influence on driving safety and the like in the existing automobile head-up display control technology, the invention aims to provide an automobile head-up display control method, a computer device and a storage medium.

In one aspect, an embodiment of the present invention includes an automotive head-up display control method, where the automotive head-up display control method includes the following steps:

acquiring first screen projection information sent by first mobile equipment;

extracting a plurality of first display content units from the first screen projection information;

Determining respective display parameters of each first display content unit;

And calling the automobile head-up display equipment, and respectively carrying out head-up display on each first display content unit according to the display parameters corresponding to the automobile head-up display equipment.

Further, the extracting a plurality of first display content units from the first screen projection information includes:

converting the first screen projection information to obtain a first screen projection picture;

Performing content identification on the first screen projection picture, and determining a plurality of first content areas in the first screen projection picture;

Cutting each first content area from the first screen projection picture;

Detecting road condition information;

screening each first content area according to the road condition information;

and respectively forming a corresponding first display content unit with each screened first content area.

Further, the screening the first content areas according to the road condition information includes:

detecting the dynamic change degree of the picture of the road condition information to obtain the dynamic change degree of the road condition picture;

Detecting the dynamic change degree of the picture of each first content area to obtain the dynamic change degree of the content picture corresponding to each first content area;

And screening out the first content area with the corresponding content picture dynamic change degree smaller than the road condition picture dynamic change degree.

Further, the extracting a plurality of first display content units from the first screen projection information further includes:

Detecting the picture complexity of each first content area to obtain the picture complexity corresponding to each first content area;

And when the picture complexity corresponding to any one of the first content areas is greater than a threshold value, simplifying the content of the first content area.

Further, the determining the respective display parameters of each of the first display content units includes:

Classifying each first display content unit, and determining category information corresponding to each first display content unit;

determining display parameters corresponding to the first display content unit according to the corresponding category information;

Detecting automobile environment information;

and according to the automobile environment information, matching and adjusting the respective display parameters of the first display content units.

Further, the determining the respective display parameters of each of the first display content units respectively further includes:

Detecting road condition information;

and according to the road condition information, matching and adjusting the respective display parameters of the first display content units.

Further, the automobile head-up display control method further comprises the following steps:

Acquiring first screen throwing information sent by second mobile equipment;

Extracting a plurality of second display content units from the second screen projection information;

And calling the automobile head-up display equipment to simultaneously perform head-up display on each first display content unit and each second display content unit.

Further, the extracting a plurality of second display content units from the second screen projection information includes:

converting the second screen projection information to obtain a second screen projection picture;

performing content identification on the second screen projection picture, and determining a plurality of second content areas in the second screen projection picture;

Cutting each second content area from the second screen projection picture;

Privacy filtering is carried out on each cut second content area;

collecting personnel interaction information from the inside of the automobile;

identifying the interaction information to obtain topic information;

acquiring the association degree between each second content area and the topic information;

screening each second content area according to the association degree;

and respectively forming a corresponding second display content unit according to each screened second content area.

On the other hand, the embodiment of the invention also comprises a computer device, which comprises a memory and a processor, wherein the memory is used for storing at least one program, and the processor is used for loading the at least one program to execute the automobile head-up display control method in the embodiment.

In another aspect, an embodiment of the present invention further includes a computer-readable storage medium in which a program executable by a processor is stored, which when executed by the processor is configured to perform the head-up display control method in the embodiment.

The beneficial effects of the invention are as follows: according to the automobile head-up display control method, firstly, content to be displayed by the first mobile equipment can be displayed in a head-up display mode, and as the functions of the first mobile equipment are rich, the projected display effect contains rich information, and an onboard person can check the content to be displayed by the mobile equipment without operating the mobile equipment, so that the mobile equipment is convenient to use, the possibility of distraction of a driver due to operation such as mobile phone playing is reduced, driving safety is guaranteed, and requirements of people on the aspects of driving experience pleasure, driving informatization, intellectualization and the like can be met; according to the second aspect, the first display content unit is extracted from the first screen projection information, and head-up display is carried out according to respective corresponding display parameters, so that the decomposition and arrangement of pictures to be displayed of the mobile equipment are realized, the information redundancy of the pictures to be displayed is reduced, the information transmission efficiency is high, and the mobile equipment is convenient to check in a driving environment; in a third aspect, each first display content unit is given appropriate display parameters, and these display parameters can enable each first display content unit to perform head-up display on the windshield with appropriate brightness, color, projection position, magnification, font, refresh rate, and the like, so that interference to the field of view of a driver during head-up display is reduced, and driving safety is ensured.

Drawings

FIG. 1 is a schematic diagram of an automotive system to which an automotive head-up display control method may be applied in an embodiment;

FIG. 2 is a schematic diagram illustrating steps of a method for controlling head-up display of an automobile according to an embodiment;

Fig. 3 (a), 3 (b) and 3 (c) are schematic diagrams of step S2 in the embodiment;

fig. 4 (a), fig. 4 (b) and fig. 4 (c) are schematic diagrams of step S6 in the embodiment.

Detailed Description

In this embodiment, the method for controlling head-up display of the vehicle may be applied to the vehicle-to-vehicle system shown in fig. 1. Referring to fig. 1, the car system includes a control module, a head-up display module, a communication module, an environment sensing module, an off-car camera, an in-car camera, and a microphone. The control module has the functions of data acquisition, processing, output, control and the like; the head-up display module is arranged at the position of the central console, receives the display signal sent by the control module, sends out light rays with corresponding contents according to the display signal, projects the light rays to the windshield, and reflects the light rays to eyes of a driver or a passenger and other personnel on the vehicle to form images, so that the personnel on the vehicle can see the display effect on the windshield; the communication module can communicate with external equipment through protocols such as Wifi, bluetooth, 5G wireless communication and the like; the environment sensing module comprises a temperature sensor, a humidity sensor, a brightness sensor and the like; the vehicle exterior camera is arranged at the positions of the roof or the outside of the windshield and the like and is used for shooting the vehicle exterior; the inner camera and the outer camera are arranged in the vehicle roof or the windshield and the like and are used for shooting the interior of the passenger cabin; the microphone is arranged at the positions of the roof in the vehicle or the inside of the windshield, and the like and is used for collecting sound in the passenger cabin.

In this embodiment, each step in the vehicle head-up display control method may be executed by a control module in the vehicle-mounted system, and when the control module performs some steps in the vehicle-mounted system, the control module may call devices such as an environmental sensing module, an external camera, an internal camera, and a microphone when some steps in the control module need to collect data and output data or perform some operations.

In this embodiment, an application scenario of the automobile head-up display control method is: the automobile is provided with personnel on the automobile such as a driver, an occupant and the like, wherein the driver carries a first mobile device (such as a mobile phone), one occupant carries a second mobile device (such as a tablet personal computer), and the first mobile device and the second mobile device both have a screen throwing function, namely, screen contents to be displayed on a screen of the automobile are packaged into screen signals to be sent out, and the screen signals are received by other devices, so that the other devices and the mobile devices synchronously play the same screen contents; the driver wishes to view the content displayed by the first mobile device carried by the driver during driving, and the driver discusses topics with the passenger and wishes to view the content displayed by the second mobile device carried by the passenger.

In this embodiment, the control module is connected to the first mobile device and the second mobile device through the communication module, and has obtained authorization of the users of the first mobile device and the second mobile device, and the first mobile device and the second mobile device throw screens to the control module. Specifically, the first mobile device generates first screen throwing information according to the picture content to be displayed on the screen of the first mobile device, the first screen throwing information is sent to the control module through the communication module, the control module analyzes the first screen throwing information, and a picture which is the same as the content to be displayed on the screen of the first mobile device can be obtained; similarly, the second mobile device generates second screen throwing information according to the picture content to be displayed on the screen of the second mobile device, the second screen throwing information is sent to the control module through the communication module, the control module analyzes the second screen throwing information, and the picture which is the same as the picture content to be displayed on the screen of the second mobile device can be obtained.

In this embodiment, referring to fig. 2, the method for controlling head-up display of an automobile includes the following steps:

S1, acquiring first screen throwing information sent by first mobile equipment;

S2, extracting a plurality of first display content units from the first screen projection information;

s3, respectively determining respective display parameters of each first display content unit;

S4, calling the automobile head-up display equipment, and respectively carrying out head-up display on each first display content unit according to the corresponding display parameters.

In step S1, the control module receives, through the communication module, first screen information sent by the first mobile device, where the first screen information may include a complete screen displayed on a screen of the first mobile device itself, or may include only a partial screen displayed on the screen of the first mobile device itself. For example, the first mobile device may cut the screen displayed on its own screen into several parts, and only some of the parts allowing the screen to be projected are packaged into the first screen projection information, where these parts are the first display content units in step S2, and the control module may directly parse the first screen projection information to obtain several first display content units when executing step S2.

If the first screen capturing information may be a complete screen including a screen of the first mobile device, the control module may specifically execute the following steps when executing step S2, that is, when extracting a plurality of first display content units from the first screen capturing information:

S201, converting the first screen projection information to obtain a first screen projection picture;

S202, carrying out content identification on a first screen projection picture, and determining a plurality of first content areas in the first screen projection picture;

s203, cutting out each first content area from the first screen projection picture to serve as each first display content unit.

In step S201, the visualization result of the first screen information, that is, the first screen image obtained by converting the first screen information is shown in fig. 3 (a), and as can be seen from fig. 3 (a), the first mobile device is running an instant messaging APP and a video conference APP.

In step S202, the control module performs content recognition on the first screen, and as shown in fig. 3 (b), recognizes each of the first content areas, such as the first content area 1 and the first content area 2, in the first screen. Each first content area contains some content with practical meaning, such as chat text in the instant messaging APP, icons or pictures displayed by the mobile phone system or APP, and video played. The content in each first content region has integrity and the content in different first content regions has mutual independence. For example, in fig. 3 (b), the text content contained in the first content area 2 is independent of the text content contained in the first content area 3 in terms of display position, meaning, and the like.

In step S203, the control module cuts each first content area shown in fig. 3 (b) from the whole first screen, and each cut first content area may be used as a first display content unit obtained by executing step S2.

After the execution of steps S201 to S203, the execution of step S2 is ended, and then step S3 is executed.

In step S3, the control module determines respective display parameters of each first display content unit. In particular, the display parameters include brightness, color, projection position on the windshield, magnification, font, refresh rate, etc.

In step S4, the control module sends each first display content unit and the corresponding display parameters to the head-up display device, that is, the head-up display module, and the head-up display module projects corresponding light to the windshield according to each first display content unit and the corresponding display parameters, and the windshield reflects the light to the personnel on the vehicle, so that the personnel on the vehicle can observe the display effect of each first display content unit on the windshield, and the display effect is shown in fig. 3 (c).

Referring to fig. 3 (c), by executing steps S1 to S4, the first mobile device performs first screen projection information sent by screen projection, is divided into a plurality of first display content units, and is respectively given display parameters such as appropriate brightness, color, projection position on the windshield, magnification, font, refresh rate, and the like, and finally performs head-up display on the windshield. By executing the steps S1-S4, on the first aspect, the content to be displayed by the first mobile equipment can be displayed in a head-up display mode, and as the functions of the first mobile equipment are rich, the projected display effect contains rich information, and an onboard person can check the content to be displayed by the mobile equipment without operating the mobile equipment, so that the mobile equipment is convenient to use, the possibility of distraction of a driver due to operation such as mobile phone playing is reduced, the driving safety is ensured, and the requirements of people on the aspects of driving experience fun, driving informatization, intellectualization and the like can be met; according to the second aspect, the first display content unit is extracted from the first screen projection information, and head-up display is carried out according to respective corresponding display parameters, so that the decomposition, arrangement and recombination of the content of the picture to be displayed of the mobile equipment are realized, the information redundancy of the picture to be displayed is reduced, the information transmission efficiency is high, and the mobile equipment is convenient to check in a driving environment; in a third aspect, each first display content unit is given appropriate display parameters, and these display parameters can enable each first display content unit to perform head-up display on the windshield with appropriate brightness, color, projection position, magnification, font, refresh rate, and the like, so that interference to the field of view of a driver during head-up display is reduced, and driving safety is ensured.

The control module, when executing step S2, may further execute the following steps on the basis of executing steps S201 to S203:

S204, detecting road condition information;

s205, screening each first content area according to road condition information;

S206, forming a corresponding first display content unit respectively according to each first content area which is screened out;

s207, detecting the picture complexity of each first content area to obtain the picture complexity corresponding to each first content area;

s208, when the picture complexity corresponding to any first content area is greater than a threshold value, simplifying the content of the first content area.

In step S204, the road condition information is information reflecting the current driving environment type (e.g. expressway, national road, provincial road or pavement-free road), road condition (e.g. intersection, zebra crossing, lane in-out, front school village, front accident, front construction, turning radius, pedestrian density, etc.), weather condition (e.g. rainy or snowy day, foggy day, etc.), and congestion degree, and the road condition information may be expressed as a time series composed of the above information at each time. When executing step S204, the control module may directly call the communication module to access the internet, query the road condition information of the location, and call the camera outside the vehicle to shoot the outside environment, so as to obtain the video stream of the environment outside the vehicle as the road condition information.

If the control module takes the environmental type, road condition, weather condition, congestion degree and the like as road condition information, the data type of the road condition information is a time sequence, wherein each moment corresponds to the information of the environmental type, the road condition, the weather condition, the congestion degree and the like, and the information difference value corresponding to two adjacent moments can be calculated and used as the dynamic change degree of the road condition picture.

If the control module calls the camera outside the vehicle to shoot the video stream of the environment outside the vehicle as the road condition information, the data type of the road condition information is the video stream, the image dynamic change degree detection can be carried out on the road condition information, and the obtained road condition image dynamic change degree represents the image change intensity degree of each frame of image switching of the road condition information. Specifically, frequency domain analysis can be performed on each frame of image in the road condition information, and the obtained frequency domain distribution is used as the dynamic change degree of the road condition image, wherein the more high-frequency components (which can be calculated according to a proportion) are, the greater the dynamic change degree of the road condition image is, which indicates that the more severe the image change is when each frame of image of the road condition information is switched; or the pixel difference value of each pair of adjacent two-frame images in the road condition information can be calculated and used as the dynamic change degree of the road condition picture.

Similarly, since the first mobile device continuously uploads the first screen information, the first content area obtained by extracting the first screen information may be represented as a video stream, or the picture dynamic change degree detection may be performed on each first content area, and the obtained picture dynamic change degree of the obtained content represents the picture change intensity degree of each frame of image of the first content area when switching.

In step S205, the dynamic change degree of the content picture corresponding to each first content area is compared with the dynamic change degree of the road condition picture corresponding to the road condition information.

In step S206, for any one of the first content areas, if the dynamic change degree of the content picture corresponding to the first content area is smaller than the dynamic change degree of the road condition picture, the first content area is filtered out and used as a corresponding first display content unit; if the dynamic change degree of the content picture corresponding to the first content area is greater than or equal to the dynamic change degree of the road condition picture, the first content area is not screened out, and the first content area is not used as the first display content unit.

In this embodiment, the principle of performing steps S204 to S206 is that: the dynamic change degree of the road condition picture indicates the change intensity of a scene seen by a driver when driving the automobile through a windshield, and the dynamic change degree of the content picture corresponding to the first content area indicates that if a first display content unit formed by the first content area is displayed on the windshield in a head-up mode, the driver observes the change intensity of the head-up display content on the windshield, and the first content area with the dynamic change degree of the corresponding content picture smaller than the dynamic change degree of the road condition picture is screened out and used as the first display content unit for head-up display, so that the change of the effect of head-up display can be avoided to be more intense than the scene change of the environment outside the automobile, the driver can pay more attention to observe the environment outside the automobile in the driving process, the possibility of distraction caused by observing the head-up display effect is reduced, and driving safety is ensured.

In step S207, the control module may operate to perform picture complexity detection on each first content area, so as to obtain picture complexity corresponding to each first content area. For example, the control module may perform connected domain analysis on each first content area, obtain connected domains in each frame of picture corresponding to each first content area, and use the number of connected domains or the area ratio of the largest connected domain as the picture complexity corresponding to the first content area. For example, for any one of the first content areas, the number of connected domains corresponding to the first content area may be used as the complexity of the screen, where the more connected domains, the more complex the content of the first content area is; for any one of the first content areas, the area ratio of the area of the corresponding maximum connected domain to the first content area may be used as the screen complexity, and the smaller the area ratio is, the more complex the content of the first content area is.

In step S208, a unified threshold may be set, and the complexity of the frames corresponding to each of the first content areas may be compared with the threshold. For any one of the first content areas, if the corresponding picture complexity is greater than a threshold, content simplification is performed on the first content area.

For example, for fig. 3 (b), where the complexity of the screen corresponding to the first content area 5 is likely to be greater than the threshold, the first content area 5 may be content-simplified, and specifically, the person in the first content area 5 may be deleted; or the first content area 5 is subjected to face feature recognition, and corresponding virtual character images are generated according to the recognized face features so as to replace real characters in the first content area 5; or converts the character content in the first content area 5 into a corresponding contour or the like.

After steps S207 to S208 are performed, the content in the first content area is simplified, and when S3 to S4 are performed subsequently, head-up display is performed on the first display content unit corresponding to the first content area after the content is simplified.

In this embodiment, the principle of performing steps S207-S208 is that: through carrying out the content simplification to the first content area that the content is too complicated, can make the content of the first display content unit that the new line shows more succinct, improve information transfer efficiency, be favorable to the driver to concentrate on observing the car external environment, concentrate on driving the car, guarantee traffic safety.

In this embodiment, when step S3, that is, the step of determining the respective display parameters of each first display content unit, is performed, the following steps may be specifically performed:

s301, classifying each first display content unit, and determining category information corresponding to each first display content unit;

s302, determining display parameters corresponding to the first display content unit according to the corresponding category information;

S303, detecting automobile environment information;

s304, according to the automobile environment information, matching and adjusting respective display parameters of each first display content unit;

s305, detecting road condition information;

s306, according to the road condition information, matching and adjusting the respective display parameters of each first display content unit.

In step S301, referring to fig. 3 (b), content recognition may be performed on each first display content unit using an artificial intelligence model, so as to recognize that the content in each first display content unit is a picture, a text, a video, and the like, and each first display content unit is marked as category information such as a picture category, a text category, a video category, and the like.

In step S302, the control module determines display parameters such as brightness, color, projection position, magnification, font, refresh rate, etc. corresponding to the first display content units according to the category information corresponding to each first display content unit. For example, for a first display content unit such as a picture type and a video type, a projection position at the edge of the windshield with a higher brightness and a higher refresh rate may be set; for a first display content unit such as text, a color having a lower brightness, a high saturation, a projection position closer to the driver, and a lower refresh rate can be set.

By executing steps S301 to S302, appropriate display parameters can be selected for head-up display according to the category of the content to be displayed of the first display content unit, so that information transmission efficiency is improved.

In step S303, the control module may invoke the environment sensing module to detect the vehicle environment information. For example, the control module may invoke a brightness sensor to detect the brightness of light in front of the host vehicle as the vehicle environment information.

In step S304, the control module performs matching adjustment on the respective display parameters of each first display content unit according to the automobile environment information. For example, the higher the brightness detected by the brightness sensor, the control module increases the brightness in the respective display parameters of each first display content unit based on step S302.

By executing steps S303 to S304, the display parameters can be adjusted according to the external environment, so as to improve the readability of the head-up display effect of each first display content unit and improve the information transmission efficiency.

The principle of step S305 is the same as that of step S204. In step S306, according to the road condition information, the respective display parameters of the first display content units are adjusted in a matching manner.

Specifically, referring to step S204, if the control module uses the environmental type, road condition, weather condition, congestion degree, and the like as the road condition information, when the road condition is a non-paved road surface, the weather condition is a sunny day, the congestion degree is a low-speed driving scenario or good condition such as moderate congestion or severe congestion, the projection position of each first display content unit may be adjusted to be closer to the driver, and the magnification of each first display content unit may be adjusted to be increased, so that the driver may more easily view the head-up display effect of the first display content unit; in contrast, when the road condition is a highway, the weather condition is a rainy or snowy day, and the congestion degree is a smooth or bad driving situation, the projection positions of the first display content units may be adjusted to be farther away from the driver, and the magnification of the first display content units may be adjusted, so that the driver may concentrate on driving, and the traffic safety may be ensured.

Specifically, referring to step S204, if the control module calls the external camera to capture the external environment video stream as the road condition information, the control module may map each frame of image in the external environment video stream with the entire projection area (the inner side of the entire windshield) of the head-up display module, the control module analyzes each frame of image in the external environment video stream, identifies positions of pedestrians, vehicles, obstacles and the like therein, maps the positions to the corresponding projection area of the head-up display module, the projection area mapped to the head-up display module is the no-projection area of the first display content unit, and the projection area not mapped to the head-up display module is the projectable area of the first display content unit, so that the display effect of each first display content unit can avoid positions of pedestrians, vehicles, obstacles and the like outside the vehicle when the head-up display is performed in step S302, and the driver is reduced, and the driver has a good visual field of view when the head-up display is performed in step S302.

In this embodiment, the control module in the vehicle-mounted system further executes the following steps:

S5, acquiring first screen throwing information sent by the second mobile equipment;

s6, extracting a plurality of second display content units from the second screen projection information;

S7, calling automobile head-up display equipment, and simultaneously carrying out head-up display on each first display content unit and each second display content unit.

The principle of steps S5-S6 is the same as steps S1-S2.

In this embodiment, when executing step S6, that is, the step of extracting a plurality of second display content units from the second screen projection information, the control module may specifically execute the following steps:

S601, converting the second screen projection information to obtain a second screen projection picture;

S602, carrying out content identification on a second screen projection picture, and determining a plurality of second content areas in the second screen projection picture;

S603, cutting out each second content area from the second screen projection picture;

s604, performing privacy filtering on each cut second content area;

s605, collecting personnel interaction information from the inside of the automobile;

S606, identifying the interaction information to obtain topic information;

s607, acquiring the association degree between each second content area and topic information;

S608, screening each second content area according to the association degree;

S609, forming a corresponding second display content unit with each second content area which is screened out.

In step S601, the visualization result of the second screen information, that is, the second screen image obtained by converting the second screen information is shown in fig. 4 (a), and as can be seen from fig. 4 (a), the second mobile device is running an instant messaging APP and a live game APP.

In step S602, the control module performs content recognition on the second screen, and as shown in fig. 4 (b), recognizes each of the second content areas, such as the second content area 1 and the second content area 2, in the second screen. Each second content area contains some content with practical meaning, such as chat text in the instant messaging APP, icons or pictures displayed by the mobile phone system or APP, and video played. The content in each second content region has integrity and the content in different second content regions has mutual independence. For example, in fig. 4 (b), the text content contained in the second content area 2 is independent of the text content contained in the second content area 3 in terms of display position, meaning, and the like.

In step S603, the control module cuts each second content area shown in fig. 4 (b) from the whole second projection screen, and each cut second content area may be used as a second display content unit obtained by executing step S7.

In step S604, by performing content identification on each second content area, if it is identified that personal privacy information is included therein, the corresponding second content area may be filtered out, and steps S605 to S609 are not performed on the filtered out second content area.

In step S605, the control module may call the in-vehicle camera to shoot the passenger cabin after calling the interaction module to inform the personnel on the vehicle and obtaining the authorization of the personnel on the vehicle, obtain the in-vehicle image, and call the microphone to record the passenger cabin to obtain the recording information. The in-car image and the recording information record the interaction information of personnel on the car, so that the interaction information is formed.

In step S606, the control module executes an expression recognition algorithm and a limb recognition algorithm to recognize the in-vehicle image in the interactive information, so as to obtain expression meaning information and limb action meaning information; the control module executes a voice recognition algorithm to recognize recording information in the interactive information, so as to obtain semantic information; the expression meaning information, the limb action meaning information and the semantic information can represent topics related to interaction of on-board personnel to form topic information.

For example, fig. 3 (a) -3 (c) and fig. 4 (a) -4 (c) describe such a scenario: the friend A of the driver informs the driver that the driver and family members of the driver take the role of the driver through communication software, the driver knows the event through observing head-up display and communicates with passengers (family members of the driver) on the vehicle, for example, the driver is instructed to take the passenger to a reservation position of a hot pot store, the interaction process of the driver and the passenger is identified by a control module to obtain topic information, and the content of the topic information can be a text of a hot pot and a reservation position; after hearing the driver's instructions, the passenger operates the communication software in the second mobile device to communicate with A, and confirms the things of the hotpot reservation position.

In step S607, the control module calculates the degree of association with each second content area according to the topic information obtained in step S606. As shown in fig. 4 (b), the text content in the second content area 3 and the second content area 6 has the highest association degree (or is higher than the threshold value) with the topic information "hot pot, reservation position", so in step S608, the control module screens out the second content area 3 and the second content area 6, and in step S609, the control module generates a second display content unit from the screened second content area 3 and the second content area 6.

After step S6 is performed, step S7 is performed. The control module sends each first display content unit and corresponding display parameters, each second display content unit and corresponding display parameters to the automobile head-up display device, namely the head-up display module, the head-up display module projects corresponding light rays to the windshield according to each first display content unit, each second display content unit and corresponding display parameters, and the windshield reflects the light rays to an onboard person, so that the onboard person can observe the display effects of each first display content unit and each second display content unit on the windshield, and the display effects are shown in fig. 4 (c).

In the embodiment, by executing the steps S5 to S7, the screen display contents of a plurality of mobile devices can be displayed in a screen-throwing manner by head-up display, so that the effect of assisting the personnel on the vehicle in communication and communication is achieved, and the information transmission efficiency is improved; by executing steps S601 to S609 when executing step S6, a second content area related to the discussion topic of the person on the vehicle can be screened out from the second content area of the second mobile device, and a second display content unit is formed for head-up display, so that the user of the second mobile device can be helped to more smoothly express information of the second mobile device, and the user of the first mobile device can be helped to more intuitively know information expressed by the user of the second mobile device, and the information transmission efficiency is improved.

The same technical effects as those of the vehicle head-up display control method in the embodiment can be achieved by writing a computer program for executing the vehicle head-up display control method in the embodiment, writing the computer program into a computer device or a storage medium, and executing the vehicle head-up display control method in the embodiment when the computer program is read out for operation.

It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly or indirectly fixed or connected to the other feature. Further, the descriptions of the upper, lower, left, right, etc. used in this disclosure are merely with respect to the mutual positional relationship of the various components of this disclosure in the drawings. As used in this disclosure, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. In addition, unless defined otherwise, all technical and scientific terms used in this example have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description of the embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used in this embodiment includes any combination of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could also be termed a second element, and, similarly, a second element could also be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language (e.g., "such as") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.

It should be appreciated that embodiments of the invention may be implemented or realized by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer readable storage medium configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, in accordance with the methods and drawings described in the specific embodiments. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.

Furthermore, the operations of the processes described in the present embodiments may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes (or variations and/or combinations thereof) described in this embodiment may be performed under control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications), by hardware, or combinations thereof, that collectively execute on one or more processors. The computer program includes a plurality of instructions executable by one or more processors.

Further, the method may be implemented in any type of computing platform operatively connected to a suitable computing platform, including, but not limited to, a personal computer, mini-computer, mainframe, workstation, network or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and so forth. Aspects of the invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and/or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer, which when read by a computer, is operable to configure and operate the computer to perform the processes described herein. Further, the machine readable code, or portions thereof, may be transmitted over a wired or wireless network. When such media includes instructions or programs that, in conjunction with a microprocessor or other data processor, implement the above steps, the invention of this embodiment includes these and other different types of non-transitory computer-readable storage media. The invention also includes the computer itself when programmed according to the methods and techniques of the invention.

The computer program can be applied to the input data to perform the functions of the present embodiment, thereby converting the input data to generate output data that is stored to the non-volatile memory. The output information may also be applied to one or more output devices such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects produced on a display.

The present invention is not limited to the above embodiments, but can be modified, equivalent, improved, etc. by the same means to achieve the technical effects of the present invention without departing from the spirit and principle of the present invention. Various modifications and variations are possible in the technical solution and/or in the embodiments within the scope of the invention.

Claims (10)

1. The automobile head-up display control method is characterized by comprising the following steps of:

acquiring first screen projection information sent by first mobile equipment;

extracting a plurality of first display content units from the first screen projection information;

Determining respective display parameters of each first display content unit;

And calling the automobile head-up display equipment, and respectively carrying out head-up display on each first display content unit according to the display parameters corresponding to the automobile head-up display equipment.

2. The method for controlling head-up display of an automobile according to claim 1, wherein the extracting a plurality of first display content units from the first screen projection information comprises:

converting the first screen projection information to obtain a first screen projection picture;

Performing content identification on the first screen projection picture, and determining a plurality of first content areas in the first screen projection picture;

Cutting each first content area from the first screen projection picture;

Detecting road condition information;

screening each first content area according to the road condition information;

and respectively forming a corresponding first display content unit with each screened first content area.

3. The method for controlling head-up display of an automobile according to claim 2, wherein said screening each of said first content areas according to said traffic information comprises:

detecting the dynamic change degree of the picture of the road condition information to obtain the dynamic change degree of the road condition picture;

Detecting the dynamic change degree of the picture of each first content area to obtain the dynamic change degree of the content picture corresponding to each first content area;

And screening out the first content area with the corresponding content picture dynamic change degree smaller than the road condition picture dynamic change degree.

4. The method for controlling head-up display of an automobile according to claim 2, wherein the extracting a plurality of first display content units from the first screen projection information further comprises:

Detecting the picture complexity of each first content area to obtain the picture complexity corresponding to each first content area;

And when the picture complexity corresponding to any one of the first content areas is greater than a threshold value, simplifying the content of the first content area.

5. The method for controlling head-up display of an automobile according to claim 1, wherein said determining the respective display parameters of each of the first display content units, respectively, comprises:

Classifying each first display content unit, and determining category information corresponding to each first display content unit;

determining display parameters corresponding to the first display content unit according to the corresponding category information;

Detecting automobile environment information;

and according to the automobile environment information, matching and adjusting the respective display parameters of the first display content units.

6. The method for controlling head-up display of an automobile according to claim 5, wherein said determining the respective display parameters of each of said first display content units, respectively, further comprises:

Detecting road condition information;

and according to the road condition information, matching and adjusting the respective display parameters of the first display content units.

7. The automotive head-up display control method according to any one of claims 1 to 6, characterized in that the automotive head-up display control method further comprises:

Acquiring first screen throwing information sent by second mobile equipment;

Extracting a plurality of second display content units from the second screen projection information;

And calling the automobile head-up display equipment to simultaneously perform head-up display on each first display content unit and each second display content unit.

8. The method for controlling head-up display of an automobile according to claim 7, wherein the extracting a plurality of second display content units from the second projection information comprises:

converting the second screen projection information to obtain a second screen projection picture;

performing content identification on the second screen projection picture, and determining a plurality of second content areas in the second screen projection picture;

Cutting each second content area from the second screen projection picture;

Privacy filtering is carried out on each cut second content area;

collecting personnel interaction information from the inside of the automobile;

identifying the interaction information to obtain topic information;

acquiring the association degree between each second content area and the topic information;

screening each second content area according to the association degree;

and respectively forming a corresponding second display content unit according to each screened second content area.

9. A computer device comprising a memory for storing at least one program and a processor for loading the at least one program to perform the automotive head-up display control method according to any one of claims 1 to 8.

10. A computer-readable storage medium in which a processor-executable program is stored, characterized in that the processor-executable program is for performing the automotive head-up display control method according to any one of claims 1 to 8 when being executed by a processor.