CN116052396A

CN116052396A - Vehicle information prompting method, device, electronic equipment and medium

Info

Publication number: CN116052396A
Application number: CN202310177840.4A
Authority: CN
Inventors: 杨林腾
Original assignee: Apollo Zhilian Beijing Technology Co Ltd
Current assignee: Apollo Zhilian Beijing Technology Co Ltd
Priority date: 2023-02-23
Filing date: 2023-02-23
Publication date: 2023-05-02

Abstract

The disclosure provides a vehicle information prompting method, a device, electronic equipment and a medium, relates to the technical field of computers, and in particular relates to the technical fields of intelligent driving, intelligent cabins, intelligent traffic, cloud computing and the like. The specific implementation scheme is as follows: acquiring an in-vehicle acquisition image of a current vehicle under the condition that the current light state of a target traffic light is a red light state; determining the current eye state of a driver in a current vehicle according to the in-vehicle acquired image; generating corresponding target prompt information according to the current eye state; outputting target prompt information to a driver; the target prompt information is used for prompting a driver to start driving. According to the method and the device, the corresponding target prompt information can be generated to prompt the driver to drive and start according to the current eye state of the driver, so that the effectiveness of the prompt information transmitted to the driver is ensured, the driver can drive the vehicle to start in time, and the traffic efficiency of the traffic light intersection is improved.

Description

Vehicle information prompting method, device, electronic equipment and medium

Technical Field

The disclosure relates to the technical field of computers, in particular to the technical fields of intelligent driving, intelligent cabins, intelligent traffic, cloud computing and the like, and particularly relates to a vehicle information prompting method, a vehicle information prompting device, electronic equipment and a vehicle information prompting medium.

Background

Traffic lights are a very common road scene in roads, when the traffic lights are in a red light state, a driver of a vehicle needs to stop for waiting, and when the traffic lights are in a green light state, the driver of the vehicle needs to drive the vehicle to start to pass through an intersection.

However, due to subjective factors or other objective factors of the driver, when the traffic light is in a green light state, the driver sometimes cannot drive the vehicle to start in time, so that the traffic efficiency of the traffic light intersection is affected.

Disclosure of Invention

The disclosure provides a vehicle information prompting method, a device, electronic equipment and a medium for prompting a driver to drive a vehicle in time.

According to an aspect of the present disclosure, there is provided a vehicle information prompting method including:

acquiring an in-vehicle acquisition image of a current vehicle under the condition that the current light state of a target traffic light is a red light state;

determining the current eye state of a driver in the current vehicle according to the in-vehicle acquired image;

generating corresponding target prompt information according to the current eye state;

outputting the target prompt information to the driver; the target prompt information is used for prompting the driver to start driving.

According to another aspect of the present disclosure, there is provided a vehicle information presenting apparatus including:

the acquisition image acquisition module is used for acquiring an in-vehicle acquisition image of the current vehicle under the condition that the current light state of the target traffic light is a red light state;

the eye state determining module is used for determining the current eye state of a driver in the current vehicle according to the in-vehicle acquired image;

the prompt information generation module is used for generating corresponding target prompt information according to the current eye state;

the prompt information output module is used for outputting the target prompt information to the driver; the target prompt information is used for prompting the driver to start driving.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the method of any one of the present disclosure.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, performs the method of any of the present disclosure.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1A is a schematic illustration of some prior art interfaces for prompting traffic light status in accordance with embodiments of the present disclosure;

FIG. 1B is a flow chart of some vehicle information prompting methods disclosed in accordance with embodiments of the present disclosure;

FIG. 2A is a flow chart of other vehicle information prompting methods disclosed in accordance with embodiments of the present disclosure;

FIG. 2B is a schematic illustration of some of the off-vehicle front areas disclosed in accordance with an embodiment of the present disclosure;

fig. 2C is a schematic diagram of some gaze areas disclosed in accordance with an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of some of the vehicle information presentation devices disclosed in accordance with an embodiment of the present disclosure;

fig. 4 is a block diagram of an electronic device for implementing the vehicle information prompting method disclosed in an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the daily driving process, due to subjective factors of a driver, such as low-head playing of a mobile phone by the driver and talking to passengers in the vehicle, or other objective factors, such as incapability of seeing traffic lights caused by shielding of the sight by a front vehicle, the driver sometimes cannot drive the vehicle to start in time when the traffic lights are in a green light state, and therefore traffic efficiency of traffic light intersections is affected.

To solve this problem, the prior art generally prompts the driver of the traffic light state through the vehicle, however, the prompting mode of the prior art is very single and fixed, and most of the prior art prompts the driver of the traffic light state through the display device in the vehicle, such as a central control screen or an instrument panel screen. Fig. 1A is a schematic diagram of an interface for prompting traffic light status in some prior art disclosed in accordance with an embodiment of the present disclosure, as shown in fig. 1A, displaying the remaining duration of the red light, as indicated by the numeral "47" in fig. 1A, and the total duration of the green light, etc., such as the numeral "44" in fig. 1A, on a display device of a vehicle.

Therefore, because the prompting mode in the prior art is single and fixed, when a driver performs non-driving related behaviors, for example, a mobile phone is played at a low head, the driver can look out of a car window or look into passengers in the car to talk, and the like, the driver can not timely perceive prompting information, the effectiveness of the prompting information transmitted to the driver is poor, the effect of the prompting information is weakened, the driver can not drive the vehicle to start in time finally, and the traffic efficiency of traffic light intersections is affected.

Fig. 1B is a flowchart of some vehicle information prompting methods disclosed in accordance with embodiments of the present disclosure, which may be applicable to a situation in which a driver is prompted to drive a vehicle start at a traffic light intersection. The method of the embodiment can be executed by the vehicle information prompting device disclosed by the embodiment of the disclosure, the device can be implemented by software and/or hardware, and can be integrated on any electronic equipment with computing capability, for example, the device can be integrated in a vehicle control unit in a vehicle, and the vehicle control unit is in communication connection with other electronic equipment in the vehicle, for example, the device is in communication connection with an on-board unit, an image acquisition device, an audio playing device, a display device and a seat controller in the vehicle.

As shown in fig. 1B, the vehicle information prompting method disclosed in the present embodiment may include:

s101, acquiring an in-vehicle acquired image of a current vehicle under the condition that the current light state of a target traffic light is a red light state.

The target traffic light represents a traffic light installed in a traffic light intersection where a current vehicle is located, and the target traffic light can be determined according to the vehicle position of the current vehicle and the traffic light positions of the traffic lights. The current vehicle then represents any vehicle in line waiting to pass at the traffic light intersection. The light state represents the current light color of the target traffic light, including red light state, green light state and yellow light state. An image acquisition device is installed in a vehicle of a current vehicle, and the image acquisition device comprises, but is not limited to, a high-precision camera, an infrared camera and the like, and can be used for acquiring images of the interior of the vehicle of the current vehicle to obtain an in-vehicle acquisition image.

It is understood that the in-vehicle captured image includes at least a face image portion of the driver in the current vehicle and an in-vehicle scene portion in the current vehicle.

In one embodiment, the vehicle control unit obtains the vehicle position of the current vehicle through the positioning device carried by the current vehicle, obtains the vehicle speed of the current vehicle through the running state device carried by the current vehicle, and obtains the traffic light position of each traffic light through road network data. And if the distance between the vehicle position of the current vehicle and the traffic light position of any traffic light is smaller than the distance threshold value and the vehicle speed of the current vehicle is zero, taking the traffic light as a target traffic light. Wherein the distance threshold is optionally 100 meters.

The current light state of the target traffic light is obtained, wherein the obtaining mode comprises, but is not limited to, the following two modes:

1) The vehicle control unit controls a forward-looking visual camera installed on the current vehicle to acquire images of the target traffic lights, acquires image acquisition results acquired by the forward-looking visual camera, and further identifies the light states of the target traffic lights according to the image acquisition results. Because the forward vision camera is usually a wide-angle camera, the range of the image acquisition area is wide, and the success rate of identifying the traffic light state can be ensured.

2) The vehicle control unit controls an on-board unit (OBU) installed by a current vehicle, and receives communication data including a light state sent by a Road Side Unit (RSU) installed by a target traffic light based on a road cooperation technology. The vehicle control unit further determines the current light state of the target traffic light according to the analysis result of the communication data.

If the current light state is determined to be the red light state, the vehicle control unit continues to determine the waiting time required by changing the light state from the red light state at the current moment to the green light state, controls an image acquisition device installed in the vehicle under the condition that the waiting time meets a time threshold value, triggers the image acquisition operation in the vehicle, and further acquires the acquired image in the vehicle of the current vehicle. Under the condition that the current light state of the target traffic light is the red light state, the in-vehicle acquisition image of the current vehicle is acquired, the effect of acquiring the in-vehicle acquisition image based on the light state is achieved, meaningless image acquisition operation is avoided, and steps executed by the method are simplified.

S102, determining the current eye state of a driver in the current vehicle according to the in-vehicle acquired image.

Wherein the current eye state represents whether the driver's eyes are attentively looking at a certain area at the current moment. The current eye states include a gazing state and a non-gazing state.

The gazing state means that the driver views a certain area with eye attention at the present moment, that is, the driver is in a state of being full of concentration, at which time the driver has a certain possibility of focusing on the change of the light state in time through visual sense. The non-gazing state indicates that the eyes of the driver watch a certain area without attention at the current moment, namely, the driver is in a distraction state or a fatigue state, and the non-gazing state includes but is not limited to a closed eye state, a semi-open and semi-closed state, a frequent blinking state and the like, and the driver cannot pay attention to the change of the light state in time through visual sense.

In one embodiment, the vehicle control unit acquires an in-vehicle captured image and identifies an eye image region of the driver in the in-vehicle captured image. The left eye vertex, right eye vertex, upper eye vertex, and lower eye vertex are determined from the eye image region. The lateral opening and closing distance of the eye is determined according to the left vertex of the eye and the right vertex of the eye, and the longitudinal opening and closing distance of the eye is determined according to the upper vertex of the eye and the lower vertex of the eye. And calculating the ratio of the longitudinal opening and closing distance to the transverse opening and closing distance as the eye height-width ratio. If the eye aspect ratio is greater than or equal to the aspect ratio threshold, determining that the current eye state of the driver is a gazing state; if the eye height-width ratio is smaller than Yu Gaokuan and larger than the threshold value and is larger than zero, the eyes are determined to be in a half-open and half-closed state, and the current eye state of the driver is further determined to be in a non-gazing state; if the eye height-width ratio is equal to zero, the eyes are determined to be in a closed-eye state, and the current eye state of the driver is further determined to be in a non-gazing state.

In another embodiment, the vehicle control unit acquires at least two consecutive in-vehicle acquired images and calculates the eye aspect ratio from the at least two in-vehicle acquired images, respectively. The calculation mode of the eye aspect ratio is the same as that described above, and will not be repeated here. And calculating the height-width ratio difference value of the eye height-width ratio between any two adjacent intra-vehicle collected images, if the height-width ratio difference value between the two adjacent intra-vehicle collected images exceeding the preset number is larger than a difference threshold value, determining that the eyes are in a frequent blinking state, and further determining that the current eye state of the driver is a non-gazing state.

In another embodiment, the vehicle control unit inputs the in-vehicle acquired image into a pre-trained eye state prediction model, and determines the current eye state according to the non-gazing state and the gazing state respectively predicted probability value output by the eye state prediction model, for example, if the output predicted probability value of the non-gazing state is greater than the predicted probability value of the gazing state, then determining that the current eye state is the non-gazing state; correspondingly, if the output predicted probability value of the gazing state is larger than the predicted probability value of the non-gazing state, determining that the current eye state is the gazing state. Types of eye state prediction models include machine learning models, such as convolutional neural network models, among others. The eye state prediction model is obtained through training according to a sample image marked with eye states.

Determining a current eye state of a driver in a current vehicle from an in-vehicle captured image

S103, generating corresponding target prompt information according to the current eye state.

The target prompt information is used for prompting a driver to start driving.

In one embodiment, the vehicle control unit generates the target cue information corresponding to the current eye state according to the current eye state and the association relationship between the preset candidate eye state and the candidate cue information.

Optionally, if the current eye state is a non-gazing state, it indicates that the driver is in a distraction state or a fatigue state, and the driver cannot pay attention to the change of the light state in time through visual sense, so that the vehicle control unit generates the voice prompt information and/or the touch prompt information as the target prompt information.

Optionally, if the current eye state is a gazing state, the driver is in a full-looking state, the vehicle control unit generates the target prompt information which is further determined according to the gazing region and is related to the gazing region from the candidate prompt information. The association relation between each gaze area and the candidate prompt information is established in advance, namely the vehicle control unit generates the candidate prompt information which can be directly determined to be associated with any gaze area according to any gaze area and is used as the target prompt information. For example, assuming that the gazing area is an outside area of the current vehicle, the voice prompt may be regarded as the target prompt.

The corresponding target prompt information is generated according to the current eye state, so that the corresponding target prompt information is determined according to different current eye states of a driver, and the effectiveness of the target prompt information is ensured.

S104, outputting target prompt information to the driver.

In one embodiment, the vehicle control unit sends the target prompt information to an electronic device associated with the prompt information type in the current vehicle according to the prompt information type of the target prompt information, so as to control the electronic device to output the target prompt information to the driver. Optionally, in the case that the type of the prompt information of the target prompt information is an audio prompt information, the vehicle control unit sends the audio prompt information to an audio playing device, such as a vehicle-mounted sound box, a vehicle-mounted speaker, etc., which is built in the current vehicle, so as to control the audio playing device to play the audio prompt information to the driver. The voice prompt information includes broadcasting voice or broadcasting prompt sound, for example, broadcasting countdown time of light state change, such as 5 seconds, 4 seconds, 3 seconds … …, etc.; for another example, the broadcasting frequency of the prompting sound in the form of "drop" can be set according to the requirement, for example, when the countdown time of the light state change is shorter, the broadcasting frequency of the prompting sound is improved, so as to improve the perception effectiveness of the prompting sound by the driver.

Optionally, in the case that the prompt information type of the target prompt information is visual prompt information, the vehicle control unit sends the visual prompt information to a display device built in the current vehicle, such as a central control screen or an instrument panel screen, so as to control the display device to display the visual prompt information including the image type and/or the text type to the driver, for example, in the central control screen or the instrument panel screen, displaying the countdown time of the light state change to the driver in a mode of popping up a card.

Optionally, in the case that the type of the prompt information of the target prompt information is a touch prompt information, the vehicle control unit sends the touch prompt information to the controller of the seat where the driver is located, so that the seat controller controls the seat where the driver is located, and transmits the touch prompt to the driver, for example, controls the seat where the driver is located to vibrate, and/or controls the seat belt of the seat where the driver is located to tighten or the like.

According to the method, under the condition that the current light state of the target traffic light is the red light state, an in-vehicle acquisition image of the current vehicle is obtained, the current eye state of a driver in the current vehicle is determined according to the in-vehicle acquisition image, corresponding target prompt information is generated according to the current eye state, and then the target prompt information is output to the driver; the target prompt information is used for prompting the driver to start driving, the effect of prompting the driver to start driving according to the current eye state of the driver is achieved, the effectiveness of transmitting the target prompt information to the driver is guaranteed, the driver can drive the vehicle to start in time, the traffic efficiency of a traffic light intersection is improved, and the problem that the driver cannot timely perceive the prompt information due to the adoption of a single and fixed prompt mode in the prior art is avoided.

Fig. 2A is a flowchart of another vehicle information prompting method disclosed according to an embodiment of the present disclosure, which is further optimized and expanded based on the above technical solution, and may be combined with the above various alternative embodiments.

As shown in fig. 2A, the vehicle information prompting method disclosed in the present embodiment may include:

s201, under the condition that the current light state of the target traffic light is the red light state, determining the target moment when the light state of the target traffic light is changed to the green light state, and determining the waiting time required by changing the light state to the green light state according to the current moment and the target moment.

The target time indicates a time corresponding to a change of the light state of the target traffic light from the red light state to the green light state in the light state change process of the current wheel, for example, when the light state is changed from the red light state to the green light state at 9:00 in the light state change process of the current wheel, the '9:00' is taken as the target time.

In one embodiment, the vehicle control unit controls the vehicle-mounted unit installed in the current vehicle to send a data acquisition request for a target time to the target traffic light based on the road cooperation technology when the current light state of the target traffic light is a red light state. And the target traffic light responds to the data acquisition request, and the road side unit installed through the target traffic light transmits a data packet containing the target moment to the vehicle-mounted unit based on the vehicle-road cooperation technology. The vehicle-mounted unit analyzes the data packet to obtain a target time, and transmits the target time to the vehicle control unit.

The vehicle control unit acquires the current time from the timing device of the current vehicle, and calculates the time difference between the current time and the target time as the waiting time required for the light state to change to the green state.

By way of example, assuming that the current time is 8 points 59 minutes 45 seconds and the target time is 9 points, the waiting time is 15 seconds.

S202, comparing the waiting time with a time threshold value, and acquiring an in-vehicle acquired image of the current vehicle under the condition that the waiting time is smaller than or equal to the time threshold value. In one embodiment, the vehicle control unit obtains a time threshold value, compares the waiting time with the time threshold value, does not trigger the operation of obtaining the in-vehicle collected image if the waiting time is determined to be greater than the time threshold value, and controls the in-vehicle mounted image collecting device to trigger the in-vehicle image collecting operation if the waiting time is determined to be less than or equal to the time threshold value, so as to obtain the in-vehicle collected image of the current vehicle.

Alternatively, the time threshold value may be empirically set to a fixed value, for example, set to a fixed 5 seconds; the time threshold value can be dynamically determined according to the current waiting sequence of the current vehicle at the traffic light intersection.

Optionally, the vehicle control unit controls the vehicle-mounted unit installed on the current vehicle, and sends the intersection image acquisition request to the target traffic light based on the vehicle-road cooperation technology. The target traffic light responds to the intersection image acquisition request, acquires an intersection image of the traffic light intersection through the installed image acquisition equipment, and sends a data packet containing the intersection image to the vehicle-mounted unit through the installed road side unit based on the vehicle-road cooperation technology. The vehicle-mounted unit analyzes the data packet to obtain an intersection image, and transmits the intersection image to the vehicle control unit.

The vehicle control unit inputs the intersection image into the target detection model, so that the current vehicle and other vehicles are determined in the intersection image according to the output result of the target detection model, the current waiting order of the current vehicle at the traffic light intersection is further determined, and finally the candidate time threshold value corresponding to the current waiting order is used as the time threshold value according to the corresponding relation between the candidate waiting order and the candidate time threshold value.

For example, assuming that the current waiting order is determined to be the 5 th bit and the candidate time threshold corresponding to the candidate waiting order of "5 th bit" is "10 seconds", then "10 seconds" is taken as the time threshold.

Determining a target moment when the light state of a target traffic light is changed into a green light state under the condition that the light state is changed into the red light state, determining waiting time required by the light state to be changed into the green light state according to the current moment and the target moment, comparing the waiting time with a time threshold value, and acquiring an in-vehicle acquired image of a current vehicle under the condition that the waiting time is smaller than or equal to the time threshold value, so that a prompt flow is triggered before the light state is not changed into the green light state, ensuring that a driver has enough driving start reaction time, and avoiding the problem that the driver starts triggering the prompt flow when the light state is in the green light state and possibly causing untimely driving start reaction; and because the in-vehicle acquisition image is acquired according to the comparison result of the waiting time and the time threshold value, the problem of excessive interference to a driver caused by premature triggering of a prompt flow is avoided.

S203, determining the current eye state of the driver in the current vehicle according to the in-vehicle acquired image.

S204, when the current eye state is a non-fixation state, S2051 is executed, and when the current eye state is a fixation state, S2052 is executed.

S2051, a tactile sensation presentation information for the driver is generated as a target presentation information.

In one embodiment, if the current eye state of the driver is a non-gazing state, vibration notification information acting on a seat in which the driver is located, seat belt tightening notification information of the seat in which the driver is located, and vibration notification information of the current vehicle steering wheel are generated. Optionally, the voice prompt information can also be generated as the target prompt information, that is, if the current eye state of the driver is a non-gazing state, the voice prompt information and the touch prompt information are generated to be used as the target prompt information together.

Under the condition that the current eye state is a non-gazing state, the driver cannot timely perceive the visual prompt information in the current vehicle, so that the touch prompt information aiming at the driver is taken as the target prompt information, the prompt information can be effectively transmitted to the driver, and the perception effectiveness of the driver on the prompt information is improved.

S2052, determining the current gazing area of the driver, and generating corresponding target prompt information according to the gazing area.

In one embodiment, the vehicle control unit performs gaze tracking on the in-vehicle captured image using a gaze tracking technique to determine a current gaze direction of the driver, and determines a current gaze area of the driver based on the current gaze direction. Matching the current gazing area of the driver with the association relation between the gazing area and the candidate prompt information, and determining the candidate prompt information associated with the current gazing area of the driver according to the matching result, and taking the candidate prompt information as the target prompt information.

Under the condition that the current eye state is the gazing state, the current gazing area of the driver is determined, and corresponding target prompt information is generated according to the gazing area, so that the effect of generating the corresponding target prompt information according to different gazing areas is realized, and the effectiveness of transmitting the prompt information to the driver is ensured.

Optionally, S2052 includes:

acquiring a vehicle acquisition image of a vehicle in front of the current vehicle under the condition that the gazing area is an external front area of the current vehicle; and determining the vehicle height of the front vehicle according to the vehicle acquisition image, and generating target prompt information according to the vehicle height.

The outside front area indicates an outside area that the driver can see through the front windshield of the current vehicle, and indicates that the driver is looking ahead at this time. Fig. 2B is a schematic view of some of the outside front areas disclosed in the embodiments of the present disclosure, as shown in fig. 2B, 20 denotes a current vehicle, 21 denotes an outside area direction in which a left line-of-sight boundary of a driver can be viewed through a front windshield, 22 denotes an outside area direction in which a right line-of-sight boundary of the driver can be viewed through the front windshield, and an outside area formed between the left line-of-sight boundary 21 and the right line-of-sight boundary 22 denotes the outside front area.

The preceding vehicle means a vehicle that belongs to the same lane as the current vehicle and is in front of the current vehicle.

In one embodiment, in the case where it is determined that the current gazing area of the driver is an area in front of the outside of the vehicle of the current vehicle, the vehicle control unit controls the front vision camera mounted on the current vehicle to perform image acquisition of the front vehicle and acquires a vehicle acquisition image of the front vehicle. The vehicle control unit performs object detection on the vehicle-collected image, determines an image size of the preceding vehicle in the vehicle-collected image, determines a real size of the preceding vehicle in the real world according to the image size, and determines a vehicle height of the preceding vehicle according to the real size. The vehicle control unit further judges whether the front vehicle forms a visual blind area for a driver of the current vehicle according to the vehicle height of the front vehicle, if so, generates sound prompt information acting on the audio playing device as target prompt information, and if not, generates any prompt information.

Under the condition that the gazing area is an external front area of the current vehicle, the vehicle height of the front vehicle is determined according to the vehicle acquisition image, and target prompt information is generated according to the vehicle height, so that the effect of judging whether to prompt according to whether the front vehicle forms a visual blind area for a driver is achieved, meaningless prompt is avoided to be generated for the driver when the front vehicle does not form the visual blind area, the problem of driving distraction of the driver is caused, and the driving safety of the driver is guaranteed.

Optionally, generating the target prompt information according to the vehicle height includes:

determining a blind area height threshold according to the type of the current vehicle, and comparing the blind area height threshold with the vehicle height; in the case where the vehicle height is greater than or equal to the blind area height threshold value, the sound prompt information is generated as the target prompt information.

In this case, the driver's sight line height is different for vehicles of different vehicle types, for example, in general, the driver's sight line height in SUV (Sport Utility Vehicle ) is higher than that in passenger car, and the corresponding height of the visual blind zone is different, so that the corresponding blind zone height threshold is set for different vehicle types.

In one embodiment, the vehicle control unit determines the blind area height threshold corresponding to the vehicle type of the current vehicle according to the vehicle type of the current vehicle and the association relationship between the vehicle type and the blind area height threshold, and optionally, determines that the blind area height threshold is 2.4 meters assuming that the vehicle type of the current vehicle is SUV.

The vehicle control unit compares the blind area height threshold value with the vehicle height of the front vehicle, if the vehicle height of the front vehicle is larger than or equal to the blind area height threshold value, the front vehicle is indicated to form a visual blind area for a driver of the current vehicle, and sound prompt information is generated at the moment to serve as target prompt information; if the vehicle height of the front vehicle is smaller than the blind area height threshold value, the front vehicle is indicated not to form a visual blind area for the driver of the current vehicle, namely, the driver can observe the change of the lamplight state, and no prompt information is generated at the moment.

The blind area height threshold value is determined according to the type of the vehicle of the current vehicle, the blind area height threshold value is compared with the vehicle height, and under the condition that the vehicle height is larger than or equal to the blind area height threshold value, sound prompt information is generated to serve as target prompt information.

Optionally, S2052 includes:

and generating visual prompt information as target prompt information when the gazing area is an in-vehicle display area of the current vehicle.

The in-vehicle display area represents an area capable of information visual display in the current vehicle, including but not limited to a center control screen or an instrument panel screen. Visual cues include, but are not limited to, image cues, text cues, and the like.

In one embodiment, if it is determined that the driver's gaze area is the in-vehicle display area of the current vehicle, visual cues acting on the in-vehicle display area are generated, including, but not limited to, image cues and/or text cues acting on the center control screen, and image cues and/or text cues acting on the dashboard screen, etc.

Under the condition that the gazing area is the in-vehicle display area of the current vehicle, the visual prompt information is generated to serve as the target prompt information, so that the type of the generated target prompt information is more reasonable, and the driver is ensured to timely perceive the target prompt information.

Optionally, S2052 includes:

when the gazing area is another in-vehicle area or another out-of-vehicle area of the current vehicle, the voice prompt information is generated as the target prompt information.

The other in-vehicle region is an in-vehicle region other than the in-vehicle display region, for example, a driver who plays a mobile phone with his/her head down or who is looking to talk to an in-vehicle passenger, or the like. The other outside area is an outside area other than the outside front area, for example, an outside left area that the driver can see through the left windshield of the current vehicle, or an outside right area that the driver can see through the right windshield of the current vehicle, and so on.

In one embodiment, if it is determined that the gaze area of the driver is another in-vehicle area or another out-of-vehicle area of the current vehicle, the audio prompt information acting on the audio playback device is generated as the target prompt information.

By generating the voice prompt information as the target prompt information under the condition that the gazing area is other in-vehicle areas or other out-of-vehicle areas of the current vehicle, the application scene of triggering prompt is expanded, and the target prompt information corresponding to the gazing area of the driver can be generated no matter the gazing area of the driver is any area.

S206, outputting target prompt information to the driver. Fig. 2C is a schematic diagram of some gaze areas disclosed in accordance with an embodiment of the present disclosure, as shown in fig. 2C, 23 representing an out-of-vehicle front area of the current vehicle, 24 representing an instrument area in an in-vehicle display area of the current vehicle, and 25 representing a center control area in the in-vehicle display area of the current vehicle.

Fig. 3 is a schematic structural diagram of some vehicle information prompting devices according to embodiments of the present disclosure, which may be suitable for prompting a driver to drive a vehicle to start at a traffic light intersection. The device of the embodiment can be implemented by software and/or hardware, and can be integrated on any electronic equipment with computing capability.

As shown in fig. 3, the vehicle information presentation apparatus 30 disclosed in the present embodiment may include a captured image acquisition module 31, an eye state determination module 32, a presentation information generation module 33, and a presentation information output module 34, wherein:

the acquisition image acquisition module 31 is used for acquiring an in-vehicle acquisition image of a current vehicle under the condition that the current light state of the target traffic light is a red light state;

an eye state determination module 32 for determining a current eye state of a driver in a current vehicle from the in-vehicle captured image;

The prompt information generating module 33 is configured to generate corresponding target prompt information according to the current eye state;

a prompt output module 34 for outputting a target prompt to the driver; the target prompt information is used for prompting a driver to start driving. Optionally, the acquired image acquisition module 31 is specifically configured to:

determining a target time when the light state of the target traffic light changes to the green light state, and determining waiting time required by changing the light state to the green light state according to the current time and the target time;

and comparing the waiting time with a time threshold value, and acquiring an in-vehicle acquired image of the current vehicle under the condition that the waiting time is smaller than or equal to the time threshold value.

Optionally, the prompt information generating module 33 is specifically configured to:

when the current eye state is a non-gazing state, a tactile sensation presentation information for the driver is generated as a target presentation information.

and under the condition that the current eye state is the gazing state, determining the current gazing area of the driver, and determining corresponding target prompt information according to the gazing area.

Optionally, the prompt information generating module 33 is specifically further configured to:

Acquiring a vehicle acquisition image of a vehicle in front of the current vehicle under the condition that the gazing area is an external front area of the current vehicle;

and determining the vehicle height of the front vehicle according to the vehicle acquisition image, and generating target prompt information according to the vehicle height.

determining a blind area height threshold according to the type of the current vehicle, and comparing the blind area height threshold with the vehicle height;

in the case where the vehicle height is greater than or equal to the blind area height threshold value, the sound prompt information is generated as the target prompt information.

generating voice prompt information as target prompt information under the condition that the gazing area is other in-vehicle areas or other out-of-vehicle areas of the current vehicle;

the other in-vehicle region is an in-vehicle region other than the in-vehicle display region, and the other out-vehicle region is an out-of-vehicle region other than the out-of-vehicle front region.

The vehicle information prompting device 30 disclosed in the embodiment of the present disclosure may execute the vehicle information prompting method disclosed in the embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method. Reference may be made to the description of embodiments of the disclosed method for details not described in this embodiment.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the related user personal information all conform to the regulations of related laws and regulations, and the public sequence is not violated.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

Fig. 4 illustrates a schematic block diagram of an example electronic device 400 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 4, the apparatus 400 includes a computing unit 401 that can perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM) 402 or a computer program loaded from a storage unit 408 into a Random Access Memory (RAM) 403. In RAM 403, various programs and data required for the operation of device 400 may also be stored. The computing unit 401, ROM 402, and RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

Various components in device 400 are connected to I/O interface 405, including: an input unit 406 such as a keyboard, a mouse, etc.; an output unit 407 such as various types of displays, speakers, and the like; a storage unit 408, such as a magnetic disk, optical disk, etc.; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the device 400 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The computing unit 401 may be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 401 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 executes the respective methods and processes described above, such as a vehicle information prompting method. For example, in some embodiments, the vehicle information prompting method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 400 via the ROM 402 and/or the communication unit 409. When the computer program is loaded into RAM 403 and executed by computing unit 401, one or more steps of the vehicle information prompting method described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured to perform the vehicle information prompting method by any other suitable means (e.g. by means of firmware).

Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. A vehicle information prompting method, comprising:

2. The method of claim 1, wherein the acquiring an in-vehicle captured image of the current vehicle comprises:

determining a target time when the light state of the target traffic light changes to a green light state, and determining waiting time required by changing the light state to the green light state according to the current time and the target time;

3. The method of claim 1, wherein the generating the corresponding target cue information from the current eye state comprises:

and generating touch feeling prompt information aiming at the driver as the target prompt information when the current eye state is a non-gazing state.

4. The method of claim 1, wherein the generating the corresponding target cue information from the current eye state comprises:

and under the condition that the current eye state is the gazing state, determining the current gazing area of the driver, and generating corresponding target prompt information according to the gazing area.

5. The method of claim 4, wherein the generating the corresponding target cue information from the gaze area comprises:

acquiring a vehicle acquisition image of a vehicle in front of the current vehicle under the condition that the gazing area is an outside front area of the current vehicle;

and determining the vehicle height of the front vehicle according to the vehicle acquisition image, and generating the target prompt information according to the vehicle height.

6. The method of claim 5, wherein the generating the target cue information from the vehicle height comprises:

determining a blind area height threshold according to the vehicle type of the current vehicle, and comparing the blind area height threshold with the vehicle height;

and generating sound prompt information as the target prompt information under the condition that the vehicle height is larger than or equal to the blind area height threshold value.

7. The method of claim 5, wherein the generating the corresponding target cue information from the gaze area comprises:

and generating visual prompt information as the target prompt information under the condition that the gazing area is the in-vehicle display area of the current vehicle.

8. The method of claim 7, wherein the generating the corresponding target cue information from the gaze area comprises:

generating voice prompt information as the target prompt information under the condition that the gazing area is other in-vehicle areas or other out-of-vehicle areas of the current vehicle;

the other in-vehicle region is an in-vehicle region other than the in-vehicle display region, and the other out-of-vehicle region is an out-of-vehicle region other than the out-of-vehicle front region.

9. A vehicle information presentation device comprising:

10. The apparatus of claim 9, wherein the acquired image acquisition module is specifically configured to:

11. The apparatus of claim 9, wherein the hint information generating module is specifically configured to:

12. The apparatus of claim 9, wherein the hint information generating module is specifically configured to:

13. The apparatus of claim 12, wherein the hint information generating module is further specifically configured to:

14. The apparatus of claim 13, wherein the hint information generating module is further specifically configured to:

15. The apparatus of claim 13, wherein the hint information generating module is further specifically configured to:

16. The apparatus of claim 15, wherein the hint information generating module is further specifically configured to:

17. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

18. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-8.

19. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-8.