CN114454718A

CN114454718A - Information display method and device, electronic equipment and storage medium

Info

Publication number: CN114454718A
Application number: CN202210077333.9A
Authority: CN
Inventors: 拉玛图洛耶夫·唿斯拉夫绍
Original assignee: Beijing Horizon Robotics Technology Research and Development Co Ltd
Current assignee: Beijing Horizon Robotics Technology Research and Development Co Ltd
Priority date: 2022-01-21
Filing date: 2022-01-21
Publication date: 2022-05-10

Abstract

The embodiment of the disclosure discloses an information display method and device, electronic equipment and a storage medium, wherein the method comprises the following steps: when the vehicle is detected to be in a running state, if the vehicle is determined to be in a dangerous state based on the current driving environment information of the vehicle, acquiring a target dangerous type and a corresponding target dangerous grade of the vehicle; determining corresponding target information display content and target display control parameters according to the target danger type and the corresponding target danger level; sending the target information display content and the target display control parameter to the display equipment so that the display equipment displays the target information display content on the display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield of the vehicle. The embodiment of the disclosure can realize accurate and effective reminding aiming at different dangerous conditions under the condition of not influencing the attention of the driver, so that the driver can timely and accurately take corresponding evasive measures, and the safety is improved.

Description

Information display method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to computer vision technologies, and in particular, to an information display method and apparatus, an electronic device, and a storage medium.

Background

In the driving process, the vehicle may encounter various emergency situations, such as an obstacle, or dangerous vehicles such as a large truck and the like around the vehicle in the driving process, and the like, and the driver needs to keep high attention, in the related technology, the reminding information is usually displayed through the vehicle central control screen to remind the driver of paying attention to the related situations, but the driver needs to be reminded by the central control screen to transfer the attention from the road in front to the central control screen, so that the driver can not find the reminding information in time easily, or the attention of the driver is dispersed due to the fact that the reminding information is checked, and potential safety hazards are brought to the vehicle driving; in order to solve this problem, HUD (Head Up Display) screen is used gradually to the vehicle on, but the HUD screen mainly adopts the projected mode to present the image on the windshield, and is more sensitive to ambient light etc. and the Display content is comparatively fixed, is difficult to provide accurate effectual warning for the user to the dangerous condition of various differences.

Disclosure of Invention

The disclosure is provided for solving the technical problem that it is difficult to provide accurate and effective reminding for users aiming at various dangerous situations. The embodiment of the disclosure provides an information display method and device, an electronic device and a storage medium.

According to an aspect of an embodiment of the present disclosure, there is provided an information display method including: when a vehicle is detected to be in a running state, acquiring current driving environment information of the vehicle; if the vehicle is determined to be in a dangerous state based on the current driving environment information, acquiring a target danger type and a corresponding target danger level of the vehicle; determining corresponding target information display content and target display control parameters according to the target danger types and the corresponding target danger levels; sending the target information display content and the target display control parameter to a display device so that the display device displays the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield on the vehicle.

According to another aspect of the embodiments of the present disclosure, there is provided an information display apparatus including: the device comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring current driving environment information of a vehicle when the vehicle is detected to be in a driving state; the first processing module is used for acquiring a target danger type and a corresponding target danger level of the vehicle if the vehicle is determined to be in a dangerous state based on the current driving environment information; the second processing module is used for determining corresponding target information display content and target display control parameters according to the target danger types and the corresponding target danger levels; the first sending module is used for sending the target information display content and the target display control parameter to a display device so that the display device can display the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield on the vehicle.

According to still another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the information display method according to any one of the above-mentioned embodiments of the present disclosure.

According to still another aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; the processor is configured to read the executable instruction from the memory and execute the instruction to implement the information display method according to any of the above embodiments of the present disclosure.

According to still another aspect of the embodiments of the present disclosure, there is provided an in-vehicle display system including: the vehicle-mounted computing platform is connected with the at least one camera and used for acquiring the current driving environment information of the vehicle based on the at least one camera so as to realize the information display method in any one of the embodiments; the display equipment is connected with the vehicle-mounted computing platform and used for receiving and displaying the display content sent by the vehicle-mounted computing platform; the display device at least comprises a control module and a display screen, and the display screen is installed on a front windshield of the vehicle.

Based on the information display method and device, the electronic device and the storage medium provided by the embodiment of the disclosure, the current danger type and the corresponding danger level of the vehicle are determined based on the current driving environment information of the vehicle, the target information display content for reminding the driver and the corresponding display control parameter are further determined according to the current danger type and the corresponding danger level and are sent to the display device, and the display device displays the target information display content on a rear-mounted display screen arranged on the front windshield of the vehicle according to the display control parameter, so that accurate and effective reminding for different danger conditions is realized under the condition of not influencing the attention of the driver, the driver can timely and accurately know what danger exists at present, and corresponding evasive measures are taken in time, and the safety is improved.

The technical solution of the present disclosure is further described in detail by the accompanying drawings and examples.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing in more detail embodiments of the present disclosure with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. In the drawings, like reference numbers generally represent like parts or steps.

FIG. 1 is an exemplary application scenario of the information display method provided by the present disclosure;

FIG. 2 is a schematic flow chart diagram of an information display method provided by an exemplary embodiment of the present disclosure;

FIG. 3 is a schematic flow chart diagram of an information display method provided by another exemplary embodiment of the present disclosure;

FIG. 4 is a schematic flow chart diagram of an information display method provided by yet another exemplary embodiment of the present disclosure;

fig. 5 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure;

FIG. 6 is a flow chart diagram of an information display method provided by yet another exemplary embodiment of the present disclosure;

FIG. 7 is a flowchart of step 203 provided by an exemplary embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a display provided by an exemplary embodiment of the present disclosure;

FIG. 9 is a schematic illustration of another display provided by an exemplary embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of an information display device provided in an exemplary embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of a first processing module 502 according to an exemplary embodiment of the disclosure;

fig. 12 is a schematic structural view of an information display device provided in another exemplary embodiment of the present disclosure;

fig. 13 is a schematic structural diagram of a second processing module 503 according to an exemplary embodiment of the disclosure;

FIG. 14 is a schematic structural diagram of an in-vehicle display system provided in an exemplary embodiment of the present disclosure;

fig. 15 is a schematic structural diagram of an application embodiment of the electronic device of the present disclosure.

Detailed Description

Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a subset of the embodiments of the present disclosure and not all embodiments of the present disclosure, with the understanding that the present disclosure is not limited to the example embodiments described herein.

It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

It will be understood by those of skill in the art that the terms "first," "second," and the like in the embodiments of the present disclosure are used merely to distinguish one element from another, and are not intended to imply any particular technical meaning, nor is the necessary logical order between them.

It is also understood that in embodiments of the present disclosure, "a plurality" may refer to two or more than two, and "at least one" may refer to one, two or more than two.

It is also to be understood that any reference to any component, data, or structure in the embodiments of the disclosure, may be generally understood as one or more, unless explicitly defined otherwise or stated otherwise.

In addition, the term "and/or" in the present disclosure is only one kind of association relationship describing an associated object, and means that three kinds of relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.

It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and the same or similar parts may be referred to each other, so that the descriptions thereof are omitted for brevity.

Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

The disclosed embodiments may be applied to electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with electronic devices, such as terminal devices, computer systems, servers, and the like, include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, networked personal computers, minicomputer systems, mainframe computer systems, distributed cloud computing environments that include any of the above, and the like.

Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. The computer system/server may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.

Summary of the disclosure

In the process of realizing the present disclosure, the inventor finds that, in the driving process, the vehicle may encounter various emergency situations, such as an obstacle, or dangerous vehicles such as a large truck around the vehicle in the driving process, and the like, and the driver needs to keep paying high attention to the dangerous vehicles.

Brief description of the drawings

Fig. 1 is an exemplary application scenario of the information display method provided by the present disclosure.

When the vehicle is in a driving state, the surrounding environment information and the internal environment information of the vehicle can be collected through various sensors mounted on the vehicle and used as the current driving environment information of the vehicle. The sensor can include one or more cameras, can also include other types of sensors such as laser radar, millimeter wave radar, and specifically can set up according to actual need. In fig. 1, taking 6 cameras as an example, by using the information display method provided by the embodiment of the present disclosure, classification and classification can be performed in advance according to dangers that a vehicle may encounter, when the vehicle is in a driving state, a target danger type and a corresponding target danger level when the vehicle is in a dangerous state can be determined based on current driving environment information of the vehicle, and then corresponding target information display content and target display control parameters are determined according to the target danger type and the corresponding target danger level and are sent to a safety display device to display the corresponding target information display content on a display screen installed on a front windshield, since classification and classification are performed for dangers, different reminding contents can be displayed for different types of dangers of different levels, thereby improving the accurate effectiveness of danger reminding, and enabling a driver to timely and accurately know the current danger situation, in order to in time take corresponding risk-avoiding measure to effectively improve driving safety, on the other hand shows through the back screen of installing on preceding windshield, for HUD screen effective reduce cost, and be difficult to receive ambient light influence, further improve warning information display quality under the circumstances of guaranteeing driver's attention.

Exemplary method

Fig. 2 is a flowchart illustrating an information display method according to an exemplary embodiment of the present disclosure. The embodiment can be applied to an electronic device, specifically, for example, a vehicle-mounted computing platform, as shown in fig. 2, and includes the following steps:

in step 201, when it is detected that the vehicle is in a running state, current driving environment information of the vehicle is acquired.

The driving state of the vehicle may be detected and obtained according to any implementable manner, such as speed information detected by a speed sensor, vehicle speed information determined by a visual sensor, acceleration information detected by an acceleration sensor, and the like, which may be specifically set according to actual requirements, and the disclosure is not limited. The current driving environment information may be acquired by a vision sensor, which may include a camera. The current driving environment information can be obtained by data fusion through data acquired by a visual sensor and other types of sensors, and can be specifically set according to actual requirements, and the method is not limited in the disclosure.

Alternatively, the current driving environment information may include at least one of vehicle external driving environment information and vehicle internal driving environment information. The external driving environment information comprises surrounding environment information of the front, the back, the left, the right and the like of the vehicle, and the internal driving environment information comprises driving state information and other related information of a driver in the vehicle.

Step 202, if the vehicle is determined to be in a dangerous state based on the current driving environment information, the target dangerous type and the corresponding target dangerous level of the vehicle are obtained.

Optionally, the manner of determining whether the vehicle is in a dangerous state based on the current driving environment information is to analyze and recognize the acquired current driving environment information, and determine whether the vehicle is in a dangerous state according to a recognition result, for example, the current driving state information is an environment image acquired by a camera, and perform target recognition on the acquired environment image based on a recognition model obtained by pre-training, where the target recognition result may include various recognized obstacle objects and position areas of the obstacle objects in the image, where the obstacle objects may include road edges, surrounding vehicles, pedestrians, buildings, road barriers, and other objects that may affect the vehicle driving, and the specific recognizable content may be set according to actual requirements. Whether the vehicle is in a dangerous state is judged based on the identified position relation between the obstacle object and the vehicle. For example, for the recognized surrounding vehicle, the distance between the surrounding vehicle and the vehicle itself may be calculated from the image, and when the distance between the surrounding vehicle and the vehicle is less than a certain distance, it may be determined that the vehicle is in a dangerous state. After the vehicle is determined to be in the dangerous state, the target dangerous type and the corresponding target dangerous level of the vehicle at present can be determined according to the preset dangerous type and dangerous level division rule.

Optionally, for the danger type, for example, the danger type may be divided into surrounding vehicles (which may be further divided into a left rear vehicle, a left side vehicle, a left front vehicle, a right rear vehicle, a right side vehicle, a right front vehicle, and the like, and may be specifically set according to actual requirements), a front obstacle, a dangerous vehicle, a blind zone pedestrian, and the like, and the specific type may be set according to actual requirements, where the surrounding vehicles may refer to general vehicles approaching themselves, the dangerous vehicle may refer to vehicles that detect that there is a certain danger such as a large truck, and the blind zone pedestrian may refer to that there is a pedestrian detected in a blind zone, and the front obstacle refers to that there is an obstacle that needs to be noticed within a certain distance ahead of driving.

Optionally, for each danger type, multiple danger levels may be classified according to actual needs, for example, the danger levels may be classified according to distance, a first distance threshold > a second distance threshold > a third distance threshold, and so on, the distance is classified into ranges, when the distance between the obstacle object and the vehicle is less than the first distance threshold and greater than the second distance threshold, the danger state is entered, the primary danger may be set, when the distance between the obstacle object and the vehicle is less than the second distance threshold and greater than the third distance threshold, the intermediate danger is entered, and when the distance between the obstacle object and the vehicle is less than the third distance threshold, the high-level danger is entered.

Optionally, different distance threshold levels may be set for different obstacle objects, and may specifically be set according to actual requirements.

Optionally, the risk level division is not limited to distance-based division, and may be set to any possible division manner according to the actual demand, and the number of levels of the risk level may also be set to 2 levels, 3 levels, 4 levels, and so on according to the actual demand.

Step 203, determining corresponding target information display content and target display control parameters according to the target danger type and the corresponding target danger level.

The target information display content is a prompting content which needs to be displayed according to the current target danger type and the target danger level, the target display control parameter is a display screen control parameter which is needed for displaying the target information display content, and the display control parameter is used for generating a display control instruction of a display screen by the display equipment according to the target display control parameter, so that the display screen is controlled to display the target information display content, and specific control principles of the display screen are not repeated herein.

Optionally, corresponding information display contents may be set for each danger level of each danger type, and the information display contents corresponding to different danger levels of different danger types are different, so as to provide accurate danger reminding information for the driver.

Step 204, sending the target information display content and the target display control parameter to the display device, so that the display device displays the target information display content on the display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield of the vehicle.

The display screen of the display device is installed on the front windshield and can be any display screen which can be implemented as long as the front sight of a driver is not influenced, for example, the display screen is a flexible transparent display screen, specifically, for example, a flexible transparent OLED display screen, and the display screen can be specifically set according to actual requirements. And after the target information display content and the target display control parameters are determined, sending the target information display content and the target display control parameters to the display equipment, and generating a display control instruction of the display screen by the display equipment according to the target display control parameters so as to control the display screen to display the target information display content.

Optionally, the display device including the flexible transparent OLED display screen is connected to a vehicle computing platform, and the flexible transparent OLED display screen array substrate and the substrate of the encapsulation substrate are both made of flexible materials and can be attached to a front windshield of a vehicle by using an adhesive. The specific installation method is not limited.

Optionally, the size of the flexible transparent display screen may be set according to actual requirements, for example, a user may perform personalized selection according to requirements such as budget and preference of the user, and the size of the flexible transparent display screen may be the size covering the whole front windshield, or may be small size, medium size, and the like.

The information display method provided by the embodiment is classified and graded according to dangers, different reminding contents can be displayed according to different types and grades of dangers, so that the accuracy and effectiveness of danger reminding are improved, a driver can timely and accurately know the current dangerous situation, and corresponding danger avoiding measures are taken in time, so that the driving safety is effectively improved, on the other hand, the dangerous situation is displayed through a rear screen installed on a front windshield, the cost is effectively reduced relative to a HUD (head Up display) screen, the influence of ambient light is not easy to occur, and the reminding information display quality is further improved under the condition that the attention of the driver is ensured.

Fig. 3 is a flowchart illustrating an information display method according to another exemplary embodiment of the present disclosure.

In an alternative example, the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, and the internal driving environment information includes driving state information of the driver, and accordingly, the step 202 may specifically include the following steps:

step 2021, if it is determined that the vehicle is in a dangerous state based on the current driving environment information, determining a target danger type and a corresponding target danger level of the vehicle based on at least one of the external driving environment information and the internal driving environment information.

The driver state information may include information related to a sight line state, a hand state, and the like of the driver.

In an optional example, the step 2021 may specifically include: if at least one risk factor of dangerous vehicles, illegal driving vehicles and other obstacles influencing driving exists outside the vehicle based on the external driving environment information, acquiring the state information of the at least one risk factor based on the external driving environment information; determining a target danger type and a corresponding target danger level of the vehicle according to the state information of at least one danger factor; and if the driver is determined to have dangerous actions based on the internal driving environment information, determining the target dangerous type and the corresponding target dangerous grade of the vehicle according to the dangerous actions of the driver.

The illegally driven vehicle refers to a vehicle which does not drive according to the traffic laws and regulations, for example, a right front vehicle does not drive according to a lane line, a rear vehicle runs at an overspeed, and the like. The dangerous actions of the driver can include the driver leaving the steering wheel by hands, the driver leaving the front by sight, the driver being in a poor position, the driver being in close position, etc., and can be specifically set according to actual requirements. The driving state information of the driver can be obtained by shooting an in-vehicle driving environment image of the driver based on a camera installed in the vehicle, the driving state of the driver can be sensed by identifying the in-vehicle driving environment image, and whether dangerous actions exist in the driver is further analyzed. Various recognition models can be obtained through training for recognition, any implementable model can be adopted for the specific recognition model, the method is not limited in the disclosure, for example, an eye image of a driver is obtained through semantic segmentation, and then the sight direction of the driver is determined based on the trained sight direction recognition model or other sight direction determination modes, so that whether the sight of the driver gazes at the front road condition or not can be determined. For another example, whether the driver's hand is away from the steering wheel is determined by recognizing the positional relationship between the driver's hand and the steering wheel. The method can also be used for analyzing the behavior images of the driver including the face and the arm of the driver in a certain time period to acquire the eye-opening duration proportion so as to judge whether the driver is in a stubborn state.

The danger type and the danger level for the driver state can be set according to actual requirements, for example, the danger type can include hand-off steering wheel, fool, abnormal sight line and the like, the danger level can be determined according to the duration of the dangerous action, for example, when the driver is initially judged to be in the hand-off steering wheel state, the primary danger is entered, timing is started, when the duration of the hand-off steering wheel state exceeds a first time threshold, the intermediate danger is entered, and when the duration of the hand-off steering wheel state exceeds a second time threshold, the high-level danger is entered.

This openly both can remind the dangerous condition outside the car, can also remind driver's dangerous action in the car to can provide abundanter comprehensive dangerous warning for the driver, so that the driver in time takes safety measure, further improves and drives the security.

And for the danger reminding content, reminding is started from the primary level according to the detected target danger type and the target danger level, if the danger is not eliminated and the danger enters the intermediate level danger, the corresponding reminding content is upgraded to the intermediate level danger reminding, and by analogy, the reminding is gradually carried out from the low level danger to the high level danger until the danger is eliminated, so that the condition that the danger is caused by suddenly carrying out high-risk reminding to scare the driver can be avoided, and the driving safety is further improved.

Fig. 4 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

In an optional example, before sending the target information display content and the target display control parameter to the display device in step 204, the method of the present disclosure further includes:

step 3011, obtain the sight height information of the driver.

And step 3012, determining target display area information corresponding to the driver according to the sight height information.

The sight height information of the driver can be determined through the driver image collected by the camera in the vehicle. For example, after the installation position of the camera is determined, the corresponding relation between the area in the image shot by the camera and the actual space height can be determined according to the installation position of the camera, so that the sight height of the driver can be determined according to the eye height of the driver in the image. The sight height of the driver can also be obtained by other implementable manners, and is not limited in particular. After the sight height information of the driver is determined, the target display area information corresponding to the driver can be determined according to the sight height information, and the target display area information corresponds to part or all of display areas on the display screen and is used for providing a viewing area more suitable for the driver, so that the driver can view information display contents more conveniently. For example, when the size of the display screen is large, such as covering the whole front windshield, a large area is obtained, the display areas which are convenient to view by the drivers at different sight heights are different, namely the size of the display area is related to the sight coverage of the drivers, but the road sight cannot be shielded, so that for different drivers, a proper personalized target display area can be determined according to the sight heights of the drivers, information display contents are displayed for the drivers, and the driver experience is effectively improved.

Correspondingly, step 204 specifically includes:

step 2041, sending the target information display content, the target display control parameter and the target display area information to the display device, so that the display device displays the target information display content in the target display area corresponding to the target display area information according to the target display control parameter.

According to the method and the device, the appropriate personalized target display area is determined according to the sight heights of different drivers, so that information display contents are displayed for the drivers in the target display area, and other areas are completely transparent and do not display the contents, so that the driver experience is effectively improved.

Fig. 5 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

In one optional example, the method of the present disclosure further comprises:

step 401, when the vehicle is detected to be in a non-driving state, detecting the current posture of the driver.

For the detection of whether the vehicle is in the driving state, referring to the foregoing embodiment, the current posture of the driver may include states, actions, and the like of various parts of the body of the driver, such as the driver watching a mobile phone, being in a state of being in a state of being in a state of being in a state.

Step 402, if the driver is determined to be in the leisure state according to the current posture of the driver, obtaining the first entertainment content and the corresponding first display control parameter and first display area information, and sending the first entertainment content and the corresponding first display control parameter and first display area information to the display device, so that the display device displays the first entertainment content in the first display area corresponding to the first display area information according to the first display control parameter.

For example, when the current posture of the driver is watching a mobile phone or is slow down, the driver is in a wear-out time state, and the driver is determined to be in the leisure state. The first entertainment content may be preset entertainment content, and may be specifically set according to actual requirements. The function and determination principle of the first display control parameter are similar to those of the target display control parameter, and are not described herein again. The first display area information is a display area for displaying the first entertainment content determined for the driver according to the driver's sight height.

It should be noted that steps 401-402 are not in sequence with step 201-204.

The method and the device for automatically playing the entertainment content for the driver further improve the experience of the driver by automatically playing the entertainment content for the driver when the driver is detected to be in a leisure state.

In an alternative example, the obtaining the first entertainment content in step 402 specifically includes: acquiring first entertainment content according to the viewing history of a driver; or acquiring the first entertainment content according to an entertainment program preset by the driver.

Optionally, the viewing history of the driver may be obtained according to the authorization of the driver, and then the first entertainment content is obtained for the driver according to the viewing history and played for the driver on the display screen.

Optionally, a setting entrance may be provided for the driver, and the entertainment list is preset by the driver, so that when it is detected that the driver is in a leisure state, the first entertainment content may be acquired according to the entertainment list preset by the driver, and displayed and played on the display screen for the driver.

The present disclosure further improves driver experience by automatically playing entertainment for the driver based on driver viewing history or driver customized entertainment listings.

step 3021, in response to a navigation request of a user or when it is determined that navigation is needed based on the current driving environment information, acquiring navigation information and corresponding second display control parameters and second display area information, and sending the navigation information and the corresponding second display control parameters and second display area information to the display device, so that the display device displays the navigation information in a second display area corresponding to the second display area information according to the second display control parameters.

The user may refer to a driver user or a co-driver user, and is not limited specifically. The method and the device can automatically start the danger reminding function when detecting that the vehicle is in a dangerous state, display reminding content on a display screen on a front windshield, and respond to a navigation request of a user to display navigation information when the user has a navigation demand. Optionally, the navigation information display function may also be automatically started when it is determined that navigation is required according to the current driving environment information, and may specifically be set according to actual requirements. The second display control parameter corresponding to the navigation information is used for controlling the display of the navigation information on the display screen, and the specific principle is not repeated. The second display area information may be determined according to the height of the line of sight of the user, and optionally, the second display area information may also be obtained according to a preset setting, for example, which types of information content are preset to be displayed in which area, which is not limited specifically.

Optionally, the user may issue the navigation request through a voice command or other possible manners, which is not limited in particular.

Optionally, step 3021 is not sequenced with step 201-204.

This is disclosed through show navigation information when needing on front windshield's display screen, and the user of being convenient for looks over the route condition, further promotes user experience. And the non-emergency reminding information of the navigation information is displayed only when needed, so that lower energy consumption and less interference are ensured.

Optionally, the display may be omitted when there is no danger alert to reduce energy consumption and driver distraction.

Fig. 6 is a flowchart illustrating an information display method according to still another exemplary embodiment of the present disclosure.

step 3031, detecting the current state and sight height information of the pilot driver user.

Specifically, the image information of the assistant driving user can be acquired through user authorization, and the current state and sight height information of the assistant driving user are detected according to the image information of the assistant driving user, wherein the specific detection mode is similar to the detection of the driver, and is not described again.

Step 3032, if the rider is determined to be in the leisure state according to the current state of the rider, obtaining second entertainment content, a third display control parameter and third display area information corresponding to the second entertainment content, and sending the second entertainment content to the display device, so that the display device displays the second entertainment content in a third display area corresponding to the third display area information according to the third display control parameter.

The judgment of the leisure state of the assistant driver is similar to that of the driver, and is not described herein again. The second entertainment content may be the same as the first entertainment content or different from the first entertainment content, and may be set according to actual requirements. The third display control parameter is similar to the various display control parameters described above, and is not described herein again, and the third display area information may be a display area suitable for the secondary driving user, which is determined according to the sight height of the secondary driving user, so that the display device controls the display device to display the second entertainment content in the display area corresponding to the third display area information of the display screen.

According to the method and the device, when the driving assistant user is detected to be in the leisure state, the corresponding entertainment content is played in the display area corresponding to the driving assistant user, and the user experience is further improved.

In an optional example, when it is detected that the driver or the assistant driver user is in a leisure state, the driver or the assistant driver user may be further asked whether the entertainment content needs to be played through voice interaction, and the name of the entertainment content input by the driver or the assistant driver user through voice may be received, so that the corresponding entertainment content is obtained and displayed in the corresponding display area, and user experience is further improved.

In an alternative example, fig. 7 is a flowchart of step 203 provided by an exemplary embodiment of the present disclosure. In this example, step 203 specifically includes:

step 2031, determining target information display content according to the target risk type, the target risk level and the first preset corresponding relation; the first preset corresponding relation comprises corresponding relations of different danger types, different danger levels and information display contents.

Step 2032, determining target display control parameters according to the target information display content and the second preset corresponding relation; the second preset corresponding relationship comprises a corresponding relationship between information display content and display control parameters.

The corresponding relation between different danger types, different danger levels and information display contents in the first preset corresponding relation can be set according to actual requirements, for example, when a vehicle approaches to the right side of the danger type, the danger level is primary, a vehicle icon is displayed on a corresponding level line on the right side of the display area, or the vehicle icon is displayed on the right side, and an indicator lamp at the corresponding danger level flickers, and a specific display mode can be set according to actual requirements. For another example, when the danger type is that a pedestrian is present in the blind area, the person icon may be displayed in the corresponding direction of the blind area where the pedestrian is present in the display area.

Illustratively, fig. 8 is a schematic diagram of a display content provided by an exemplary embodiment of the present disclosure. In this example, the current speed, the current temperature, and the danger level indicator lights (two left and right groups) of the vehicle are displayed, the vehicle icon on the right side is displayed, and the vehicle approaching level on the right side is the middle level (the middle light of the right indicator light flashes or lights).

Illustratively, fig. 9 is a schematic diagram of another display content provided by an exemplary embodiment of the present disclosure. In this example, the left and right curves are used to represent a left lane line and a right lane line, respectively, and the vehicle icon on the lower right lane line indicates that the rear right vehicle is not traveling along the lane lines.

Optionally, the specific information display contents and display modes corresponding to different danger types and different danger levels may be set according to actual requirements, and are not limited to the above illustrated contents.

The information display method provided by the embodiment of the disclosure can enable a user to personally select the size of the display screen based on the flexibly configured flexible transparent display screen, improve the display convenience, sense various types and various grades of dangers based on various movably arranged sensors on a vehicle, adaptively provide accurate and effective danger reminding for the user, and adaptively provide different services aiming at various different states of driving and co-driving, thereby improving the user experience.

Any of the information display methods provided by the embodiments of the present disclosure may be performed by any suitable device having data processing capabilities, including but not limited to: terminal equipment, a server and the like. Alternatively, any of the information display methods provided by the embodiments of the present disclosure may be executed by a processor, for example, the processor may execute any of the information display methods mentioned in the embodiments of the present disclosure by calling a corresponding instruction stored in a memory. And will not be described in detail below.

Exemplary devices

Fig. 10 is a schematic structural diagram of an information display device according to an exemplary embodiment of the present disclosure. The apparatus of this embodiment can be used to implement the corresponding method embodiment of the present disclosure, and the apparatus shown in fig. 10 includes: a first obtaining module 501, a first processing module 502, a second processing module 503 and a first sending module 504.

The first obtaining module 501 is configured to obtain current driving environment information of a vehicle when it is detected that the vehicle is in a driving state.

The first processing module 502 is configured to, if it is determined that the vehicle is in a dangerous state based on the current driving environment information acquired by the first acquiring module 501, acquire a target danger type and a corresponding target danger level of the vehicle.

The second processing module 503 is configured to determine corresponding target information display content and target display control parameters according to the target risk type and the corresponding target risk level obtained by the first processing module 502.

A first sending module 504, configured to send the target information display content and the target display control parameter obtained by the second processing module 503 to a display device, so that the display device displays the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield of the vehicle.

In one optional example, the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, the internal driving environment information including driving state information of the driver; the first processing module 502 is specifically configured to: and if the vehicle is determined to be in a dangerous state based on the current driving environment information, determining a target danger type and a corresponding target danger level of the vehicle based on at least one of the external driving environment information and the internal driving environment information.

In an alternative example, fig. 11 is a schematic structural diagram of a first processing module 502 according to an exemplary embodiment of the disclosure. In this example, the first processing module 502 includes: a first processing unit 5021 and a second processing unit 5022. The first processing unit 5021 is used for acquiring state information of at least one dangerous factor based on the external driving environment information if it is determined that at least one dangerous factor of a dangerous vehicle, an illegally-running vehicle and other obstacles influencing running exists outside the vehicle based on the external driving environment information; and determining the target danger type and the corresponding target danger level of the vehicle according to the state information of at least one danger factor. The second processing unit 5022 is used for determining the target danger type and the corresponding target danger level of the vehicle according to the dangerous action of the driver if the driver is determined to have the dangerous action based on the internal driving environment information.

Fig. 12 is a schematic structural diagram of an information display device according to another exemplary embodiment of the present disclosure.

In one optional example, the apparatus of the present disclosure further comprises: a second obtaining module 505 and a first determining module 506. A second obtaining module 505, configured to obtain sight height information of the driver; and a first determining module 506, configured to determine, according to the sight-line height information acquired by the second acquiring module 505, target display area information corresponding to the driver.

Correspondingly, the first sending module 504 is further configured to send the target information display content, the target display control parameter, and the target display area information to the display device, so that the display device displays the target information display content in the target display area corresponding to the target display area information according to the target display control parameter.

In one optional example, the apparatus of the present disclosure further comprises: a first detection module 507 and a third acquisition module 508. A first detection module 507, configured to detect a current posture of a driver when the vehicle is detected to be in a non-driving state; a third obtaining module 508, configured to obtain the first entertainment content, the corresponding first display control parameter, and the first display area information if it is determined that the driver is in the leisure state according to the current posture of the driver obtained by the first detecting module 507; the corresponding first sending module 504 is further configured to send the first entertainment content, the corresponding first display control parameter, and the first display area information, which are acquired by the third acquiring module 508, to the display device, so that the display device displays the first entertainment content in the first display area corresponding to the first display area information according to the first display control parameter.

In an optional example, the third obtaining module 508 is specifically configured to: acquiring first entertainment content according to the viewing history of a driver; or acquiring the first entertainment content according to an entertainment program preset by the driver.

In one optional example, the apparatus of the present disclosure further comprises: a fourth obtaining module 509, configured to, in response to a navigation request of a user or when it is determined that navigation is required based on current driving environment information, obtain navigation information and corresponding second display control parameters and second display area information; the first sending module 504 is further configured to send the navigation information acquired by the fourth acquiring module 509, the corresponding second display control parameter, and the second display area information to the display device, so that the display device displays the navigation information in the second display area corresponding to the second display area information according to the second display control parameter.

In an optional example, the apparatus of the present disclosure further comprises a second detection module 510 and a fifth acquisition module 511. The second detection module 510 is configured to detect a current state and sight height information of the copilot user; a fifth obtaining module 511, configured to obtain the second entertainment content, and corresponding third display control parameter and third display area information if it is determined that the secondary driving user is in the leisure state according to the current state of the secondary driving user detected by the second detecting module 510; the first sending module 504 is further configured to send the second entertainment content and the corresponding third display control parameter and third display area information to the display device, so that the display device displays the second entertainment content in the third display area corresponding to the third display area information according to the third display control parameter.

In an alternative example, fig. 13 is a schematic structural diagram of a second processing module 503 provided in an exemplary embodiment of the present disclosure, and in this example, the second processing module 503 includes: a first determining unit 5031 and a second determining unit 5032. A first determining unit 5031, configured to determine target information display content according to the target risk type, the target risk level, and the first preset corresponding relationship; the first preset corresponding relation comprises corresponding relations of different danger types, different danger grades and information display contents; a second determining unit 5032, configured to determine a target display control parameter according to the target information display content and the second preset corresponding relationship; the second preset corresponding relationship comprises a corresponding relationship between information display content and display control parameters.

Exemplary System

The embodiment of the disclosure further provides a vehicle-mounted display system, and fig. 14 is a schematic structural diagram of the vehicle-mounted display system provided by the exemplary embodiment of the disclosure. The disclosed vehicle-mounted display system includes: an in-vehicle computing platform 601 and a display device 602. The vehicle-mounted computing platform 601 is connected with at least one camera, and is configured to acquire current driving environment information of a vehicle based on the at least one camera, so as to implement the information display method according to any one of the embodiments or examples above; the display device 602 is connected to the vehicle-mounted computing platform 601, and is configured to receive and display the display content sent by the vehicle-mounted computing platform 601; the display device 602 includes at least a control module and a display screen mounted on a front windshield of a vehicle.

Optionally, the vehicle-mounted display system may further include the at least one camera described above, and is configured to acquire current driving environment information of the vehicle.

Illustratively, the on-board display system may include at least one of the following cameras:

the system comprises a first camera for shooting the environment at the left front of the vehicle, a second camera for shooting the environment at the left rear of the vehicle, a third camera for shooting the environment at the right front of the vehicle, a fourth camera for shooting the environment at the right rear of the vehicle, a fifth camera for shooting the environment at the front of the vehicle, a sixth camera for shooting the environment in the vehicle and a seventh camera for shooting the environment at the rear of the vehicle.

Alternatively, the in-vehicle display system may further include another type of sensor, other than the camera, for acquiring current driving environment information of the vehicle or detecting a vehicle state and other related information in conjunction with the camera.

Alternatively, the display screen of the display device 602 may be a flexible transparent OLED display screen or other flexible transparent display screen that may be implemented.

Exemplary electronic device

An embodiment of the present disclosure further provides an electronic device, including: a memory for storing a computer program;

a processor configured to execute the computer program stored in the memory, and when the computer program is executed, the method according to any of the above embodiments of the present disclosure is implemented.

Fig. 15 is a schematic structural diagram of an application embodiment of the electronic device of the present disclosure. In this embodiment, the electronic device 10 includes one or more processors 11 and a memory 12.

The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by processor 11 to implement the methods of the various embodiments of the disclosure described above and/or other desired functionality. Various contents such as an input signal, a signal component, a noise component, etc. may also be stored in the computer-readable storage medium.

In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other form of connection mechanism (not shown).

The input means 13 may be, for example, a microphone or a microphone array as described above for capturing an input signal of a sound source.

The input device 13 may also include, for example, a keyboard, a mouse, and the like.

The output device 14 may output various information including the determined distance information, direction information, and the like to the outside. The output devices 14 may include, for example, a display, speakers, a printer, and a communication network and its connected remote output devices, among others.

Of course, for simplicity, only some of the components of the electronic device 10 relevant to the present disclosure are shown in fig. 15, omitting components such as buses, input/output interfaces, and the like. In addition, the electronic device 10 may include any other suitable components depending on the particular application.

Exemplary computer program product and computer-readable storage Medium

In addition to the methods and apparatus described above, embodiments of the present disclosure may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform steps in methods according to various embodiments of the present disclosure as described in the "exemplary methods" section of this specification above.

The computer program product may write program code for carrying out operations for embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.

Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform steps in methods according to various embodiments of the present disclosure as described in the "exemplary methods" section above of this specification.

The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The foregoing describes the general principles of the present disclosure in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present disclosure are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present disclosure. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the disclosure is not intended to be limited to the specific details so described.

In the present specification, the embodiments are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts in each embodiment are referred to each other. For the system embodiment, since it basically corresponds to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The block diagrams of devices, apparatuses, systems referred to in this disclosure are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".

The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

It is also noted that in the devices, apparatuses, and methods of the present disclosure, each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be considered equivalents of the present disclosure.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims

1. An information display method comprising:

when a vehicle is detected to be in a running state, acquiring current driving environment information of the vehicle;

if the vehicle is determined to be in a dangerous state based on the current driving environment information, acquiring a target danger type and a corresponding target danger level of the vehicle;

determining corresponding target information display content and target display control parameters according to the target danger types and the corresponding target danger levels;

sending the target information display content and the target display control parameter to a display device, so that the display device displays the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield on the vehicle.

2. The method of claim 1, wherein the current driving environment information includes at least one of external driving environment information and internal driving environment information of the vehicle, the internal driving environment information including driving state information of a driver;

if the vehicle is determined to be in a dangerous state based on the current driving environment information, acquiring a target dangerous type and a corresponding target dangerous grade of the vehicle, wherein the steps of:

and if the vehicle is determined to be in a dangerous state based on the current driving environment information, determining a target danger type and a corresponding target danger level of the vehicle based on at least one of the external driving environment information and the internal driving environment information.

3. The method of claim 1, prior to sending the target information display content and the target display control parameters to a display device, the method further comprising:

the method comprises the steps of obtaining sight height information of a driver, and determining target display area information corresponding to the driver according to the sight height information;

the sending the target information display content and the target display control parameter to a display device includes:

and sending the target information display content, the target display control parameter and the target display area information to the display equipment so that the display equipment displays the target information display content in a target display area corresponding to the target display area information according to the target display control parameter.

4. The method of claim 1, further comprising:

detecting a current posture of a driver when the vehicle is detected to be in a non-driving state;

if the driver is determined to be in the leisure state according to the current posture of the driver, first entertainment content, a corresponding first display control parameter and first display area information are obtained and sent to the display device, so that the display device can display the first entertainment content in a first display area corresponding to the first display area information according to the first display control parameter.

5. The method of claim 1, further comprising:

and when a navigation request of a user is responded or the current driving environment information is determined to be required to navigate, acquiring navigation information, corresponding second display control parameters and second display area information, and sending the navigation information to the display equipment, so that the display equipment displays the navigation information in a second display area corresponding to the second display area information according to the second display control parameters.

6. The method of claim 1, further comprising:

detecting the current state and sight height information of a pilot-driven user;

and if the driving assistant user is determined to be in a leisure state according to the current state of the driving assistant user, acquiring second entertainment content, a third display control parameter and third display area information corresponding to the second entertainment content, and sending the second entertainment content to the display equipment, so that the display equipment displays the second entertainment content in a third display area corresponding to the third display area information according to the third display control parameter.

7. The method according to any one of claims 1-6, wherein said determining corresponding target information display content and target display control parameters according to said target risk type and corresponding target risk level comprises:

determining the target information display content according to the target danger type, the target danger level and a first preset corresponding relation; the first preset corresponding relation comprises corresponding relations of different danger types, different danger grades and information display contents;

determining the target display control parameters according to the target information display content and a second preset corresponding relation; the second preset corresponding relationship comprises a corresponding relationship between information display content and display control parameters.

8. An information display apparatus comprising:

the device comprises a first acquisition module, a second acquisition module and a control module, wherein the first acquisition module is used for acquiring current driving environment information of a vehicle when the vehicle is detected to be in a driving state;

the first processing module is used for acquiring a target danger type and a corresponding target danger level of the vehicle if the vehicle is determined to be in a dangerous state based on the current driving environment information;

the second processing module is used for determining corresponding target information display content and target display control parameters according to the target danger types and the corresponding target danger levels;

the first sending module is used for sending the target information display content and the target display control parameter to a display device so that the display device can display the target information display content on a display screen according to the target display control parameter; the display screen of the display device is mounted on a front windshield on the vehicle.

9. A computer-readable storage medium storing a computer program for executing the information display method according to any one of claims 1 to 7.

10. An electronic device, the electronic device comprising:

a processor;

a memory for storing the processor-executable instructions;

the processor is used for reading the executable instructions from the memory and executing the instructions to realize the information display method of any one of the claims 1 to 7.

11. An in-vehicle display system comprising:

the vehicle-mounted computing platform is connected with at least one camera and used for acquiring current driving environment information of the vehicle based on the at least one camera so as to realize the information display method according to any one of claims 1 to 7;

the display equipment is connected with the vehicle-mounted computing platform and used for receiving and displaying the display content sent by the vehicle-mounted computing platform; the display device at least comprises a control module and a display screen, and the display screen is installed on a front windshield of the vehicle.