CN112937601A

CN112937601A - Information prompting method and device and vehicle

Info

Publication number: CN112937601A
Application number: CN202110524873.2A
Authority: CN
Inventors: 李龙飞
Original assignee: Beijing Qihe Intelligent Technology Co ltd; FAW Group Corp
Current assignee: Beijing Qihe Intelligent Technology Co ltd; FAW Group Corp
Priority date: 2021-05-14
Filing date: 2021-05-14
Publication date: 2021-06-11
Anticipated expiration: 2041-05-14
Also published as: CN112937601B

Abstract

The embodiment of the invention discloses an information prompting method, an information prompting device and a vehicle. The method comprises the following steps: when information to be prompted corresponding to a vehicle is generated, determining the type of the information to be prompted, wherein the type of the information to be prompted comprises driving safety information and non-driving safety information; determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user; if the driver seat user identification information does not belong to the information set of the personnel to be prompted, acquiring current in-vehicle monitoring information; determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted, and determining a target prompting device corresponding to the target passenger; and sending the information to be prompted to a target prompting device for displaying. The technical scheme of the embodiment of the invention solves the problems that the vehicle prompt information is easy to ignore and the abnormal condition of the vehicle is difficult to find in time when the current vehicle driver is not the common vehicle driver, and improves the driving safety.

Description

Information prompting method and device and vehicle

Technical Field

The embodiment of the invention relates to the technical field of automatic control of vehicles, in particular to an information prompting method, an information prompting device and a vehicle.

Background

In the conventional vehicle driving process, the vehicle is controlled based on the main driving position, and when the vehicle has a fault, the driver is only prompted at the position of an instrument panel and the like of the main driving position.

In the actual driving process of the vehicle, the driver at the main driving position may not be the owner or the driver who is often used for driving the vehicle, for example, after the owner drinks, the owner may drive on his or her own or help the vehicle by a friend, because the driver has a low degree of understanding about the vehicle, the driver often ignores the fault prompt given by the driving position, and the owner cannot acquire the fault prompt information of the driving position, so that the fault problem is ignored, the driving hidden danger of the vehicle is caused, and even the accident injury is strengthened when the traffic accident occurs.

Disclosure of Invention

The invention provides an information prompting method, an information prompting device and a vehicle, which are used for displaying information to be prompted to passengers with clear importance, reducing hidden dangers of vehicle driving, reducing the occurrence probability of traffic accidents in the vehicle driving process and improving the driving safety.

In a first aspect, an embodiment of the present invention provides an information prompting method, including:

when information to be prompted corresponding to a vehicle is generated, determining the type of the information to be prompted, wherein the type of the information to be prompted comprises driving safety information and non-driving safety information;

determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user;

if the driver seat user identification information does not belong to the information set of the personnel to be prompted, acquiring current in-vehicle monitoring information;

determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted, and determining a target prompting device corresponding to the target passenger;

and sending the information to be prompted to a target prompting device for displaying.

In a second aspect, an embodiment of the present invention provides an information prompting apparatus, including:

the prompt information determining module is used for determining the type of the information to be prompted when the information to be prompted corresponding to the vehicle is generated, wherein the type of the information to be prompted comprises driving safety information and non-driving safety information;

the identification information acquisition module is used for determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation and acquiring identification information of a driver seat user;

the monitoring information acquisition module is used for acquiring the current in-vehicle monitoring information if the driver seat user identification information does not belong to the information set of the personnel to be prompted;

the target determining module is used for determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted and determining a target prompting device corresponding to the target passenger;

and the display module is used for sending the information to be prompted to the target prompting device for displaying.

In a third aspect, an embodiment of the present invention further provides a vehicle, including:

one or more camera devices for collecting monitoring information in the vehicle;

at least two prompting devices for displaying or playing the information to be prompted;

one or more alcohol detection devices for detecting exhaled air of the target passenger;

one or more controllers;

storage means for storing one or more programs;

when the one or more programs are executed by the one or more controllers, the one or more controllers are caused to implement the information presentation method as described above in the first aspect.

In a fourth aspect, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the information prompting method according to the first aspect.

According to the information prompting method, the information prompting device and the vehicle, when the information to be prompted corresponding to the vehicle is generated, the type of the information to be prompted is determined, and the type of the information to be prompted comprises driving safety information and non-driving safety information; determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user; if the driver seat user identification information does not belong to the information set of the personnel to be prompted, acquiring current in-vehicle monitoring information; determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted, and determining a target prompting device corresponding to the target passenger; and sending the information to be prompted to a target prompting device for displaying. By adopting the technical scheme, when the vehicle generates the information to be prompted, the person to be prompted to which the information to be prompted is determined according to the type of the information to be prompted, the driver position user identification information is obtained to determine whether the main driver is the person to be prompted, if not, the target passenger capable of clearly determining the meaning of the information to be prompted is determined in the current passenger of the vehicle, the target prompting device which is most convenient for the target passenger to check is determined, the information to be prompted is sent to the target prompting device to be displayed, so that the target passenger can timely obtain the information, the abnormal condition of the vehicle can be timely discovered, meanwhile, the non-driving safety information can also be timely sent to the corresponding person, and the vehicle abnormality can be solved as soon as possible. The problem of current vehicle driver be not vehicle driver commonly used when easily neglecting vehicle suggestion information, be difficult to in time discover vehicle abnormal situation is solved, the hidden danger of vehicle driving has been reduced, the promptness that the unusual running state of vehicle was discovered has been promoted, the injury when having reduced the emergence probability of vehicle traffic accident and traffic accident, has improved driving safety.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.

Fig. 1 is a flowchart of an information prompting method in a first embodiment of the present invention;

fig. 2 is a flowchart of an information prompting method in the second embodiment of the present invention;

fig. 3 is a schematic flow chart illustrating a process of matching user identification information of each passenger with an information set of a person to be prompted and determining a target passenger according to a matching result in the second embodiment of the present invention;

fig. 4 is a schematic structural diagram of an information prompt apparatus in a third embodiment of the present invention;

fig. 5 is a schematic structural diagram of a vehicle according to a fourth embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.

In the description of the present invention, it is to be understood that the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not necessarily used to describe a particular order or sequence, nor are they to be construed as indicating or implying relative importance. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

Example one

Fig. 1 is a flowchart of an information prompting method according to an embodiment of the present invention, where the present embodiment is applicable to a situation where a current primary driver is not a driver commonly used in a vehicle and needs to prompt an abnormal condition of the vehicle, the method may be executed by an information prompting device, the information prompting device may be implemented by software and/or hardware, the information prompting device may be configured on a computer device, and the computer device may be formed by two or more physical entities or may be formed by one physical entity.

As shown in fig. 1, an information prompting method provided in this embodiment specifically includes the following steps:

s101, when the information to be prompted corresponding to the vehicle is generated, determining the type of the information to be prompted.

The type of the information to be prompted comprises driving safety information and non-driving safety information.

In this embodiment, the information to be prompted may be information generated by the vehicle and generally displayed on an instrument panel of the vehicle, and the information is displayed in the abnormal state through a specific identifier to prompt an abnormality when the vehicle is in an abnormal driving state or when the vehicle has a problem that the driving of the vehicle is not affected but a potential safety hazard exists. The driving safety information may be understood as a prompt message that influences driving safety in the to-be-prompted message, and if the prompt message is not timely solved, the to-be-prompted message may be a relatively large prompt message that may cause an accident, and for example, the driving safety information may be any fault prompt message that may occur during the driving of the vehicle, such as engine oil pressure fault message, vehicle door unclosed indication message, steering power system fault message, tire pressure alarm message, and transmission fault message, which is not limited in this embodiment of the present invention. The non-driving safety information may be understood as a prompt message that does not affect driving safety in the message to be prompted, but needs to notify relevant personnel of repairing, refueling or maintaining the vehicle, and for example, the non-driving safety information may be a vehicle air conditioner fault message, a prompt message of fuel shortage 1/3, and the like that do not affect current driving safety, which is not limited in this embodiment of the present invention.

Specifically, when the vehicle is in an abnormal driving state or when the vehicle has a problem that driving is not affected but potential safety hazards exist in the driving process, the vehicle generates corresponding information to be prompted which needs to be displayed on an instrument panel, and when the information to be prompted is generated, a vehicle Electronic Control Unit (Electronic Control Unit) determines the type of the information to be prompted corresponding to the information to be prompted according to the specific content and the emergency state of the information to be prompted.

S102, determining an information set of the person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user.

In this embodiment, the preset prompt mapping relationship may be understood as a mapping relationship between different types of preset prompt information and corresponding prompted persons. For example, the prompted person corresponding to the air conditioner fault information may be an owner of the vehicle, and the prompted person corresponding to the reminding information of the insufficient fuel amount 1/3 may be a driver who frequently drives the current vehicle in the latest period of time, which is not limited in this embodiment of the present invention. The information set of the person to be prompted can be understood as a set of the person identification information corresponding to the information to be prompted and capable of receiving the information to be prompted. Furthermore, the persons to be prompted contained in the information set of the persons to be prompted can be drivers familiar with the operation of the current vehicle and can clarify the meaning of each prompting information and perform targeted operation, or persons having a subordinate relationship with the current vehicle. The driver seat user identification information can be understood as characteristic information which is possessed by a driver in the main driver seat and can be used for judging the identity of the driver seat user. Optionally, the driving seat user identification information may include one or more of image information of the driving seat user, sound information of the driving seat user, and fingerprint information of the driving seat user, and may include other information that may be used to determine the identity of the driving seat user, which is not limited in this embodiment of the present invention.

Specifically, one or more persons to be prompted corresponding to the types of the information to be prompted are determined according to a preset prompting mapping relation, a set for representing identity information of each person to be prompted is used for determining an information set of the person to be prompted, and driver seat user identification information used for determining the identity of a driver seat user CAN be acquired through a vehicle CAN bus. Alternatively, the driving seat user identification information may be image information of the driving seat user collected by a camera device installed in the vehicle, or may be a voice print of the driving seat user collected by a voice collecting device installed in the vehicle, or may be fingerprint information of the driving seat user collected by a fingerprint collecting device installed in a steering wheel of the vehicle, or the like.

S103, if the driver seat user identification information does not belong to the information set of the personnel to be prompted, current in-vehicle monitoring information is obtained.

In this embodiment, the current in-vehicle monitoring information may be image and sound information of users at various positions in the vehicle, which is collected by a camera device installed in the vehicle at the current time.

Specifically, the acquired driver seat user identification information is compared and matched with a to-be-prompted person information set, if the driver seat user identification information does not belong to the to-be-prompted person information set, it can be considered that a driver of the current vehicle is not a person to be prompted by the to-be-prompted information, the vehicle is not driven frequently, it is difficult to make clear the meanings of all prompt information displayed in an instrument panel, and at this time, the current in-vehicle monitoring information corresponding to the current time needs to be acquired through a camera device installed in the vehicle.

In the embodiment of the invention, whether the current driver is a common driver of the current vehicle and a person to be prompted who needs to receive the information to be prompted is determined through the identification information of the driver position user, the monitoring information in the current vehicle is timely acquired when the current driver is determined not to be the common driver and the person to be prompted, so as to determine the object to be prompted by the prompting information, the problem that the prompting information is overlooked due to unfamiliarity of the current driver to the vehicle is avoided, the aim of displaying the prompting information is improved, meanwhile, the prompting object is timely replaced when the current driver is found not to be the common driver, the early warning timeliness of the prompting information is enhanced, and the driving safety is improved.

And S104, determining a target passenger according to the current in-vehicle monitoring information and the information set of the person to be prompted, and determining a target prompting device corresponding to the target passenger.

In this embodiment, the target passenger may be understood as a passenger who should receive the prompt message when the vehicle needs to be presented with the prompt message. Further, the vehicle comprises at least two prompting devices, and the prompting devices can be understood as projection devices or display devices capable of displaying or playing information to be prompted so as to achieve a prompting purpose. The target prompting device can be understood as a prompting device which is arranged in at least two prompting devices at each position in the vehicle and is most convenient for a target passenger to receive information to be prompted.

Specifically, the identification information corresponding to each position passenger in the vehicle is determined according to the current monitoring information in the vehicle, the identification information is sequentially compared and matched with the information set of the person to be prompted, the passenger capable of receiving the information to be prompted is determined according to the matching result, and the passenger is used as the target passenger. After the target passenger is determined, the information such as the riding state, the watching position and the like of the target passenger is determined according to the current in-vehicle monitoring information, and then the prompting device which is most suitable for the target passenger to receive the information is determined according to the information, and the prompting device is determined as the target prompting device corresponding to the target passenger.

In the embodiment of the invention, the target passenger needing to receive the prompt information is determined according to the current in-vehicle monitoring information and the preset common driver information, the aim of displaying the prompt information is enhanced, and meanwhile, the target prompt device which is most suitable for receiving the information is selected for the target passenger, so that the target passenger can timely and accurately receive the prompt information, the early warning timeliness of the prompt information is improved, the prompt problem in the prompt information can be timely responded, the hidden danger of vehicle driving is reduced, the timeliness of discovering the abnormal driving state of the vehicle is improved, and the driving safety is improved.

And S105, sending the information to be prompted to a target prompting device for displaying.

Specifically, the to-be-prompted information is sent to the determined corresponding target prompting device through the vehicle CAN bus, so that the to-be-prompted information CAN be displayed in the target prompting device, further, a target passenger CAN give specific operation feedback according to the to-be-prompted information displayed by the target prompting device, and the abnormal problem given in the to-be-prompted information is solved in time.

The method and the device for prompting the vehicle information determine the type of the information to be prompted when the information to be prompted corresponding to the vehicle is generated, wherein the type of the information to be prompted comprises driving safety information and non-driving safety information; determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user; if the driver seat user identification information does not belong to the information set of the personnel to be prompted, acquiring current in-vehicle monitoring information; determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted, and determining a target prompting device corresponding to the target passenger; and sending the information to be prompted to a target prompting device for displaying. By adopting the technical scheme, when the vehicle generates the information to be prompted, the person to be prompted to which the information to be prompted is determined according to the type of the information to be prompted, the driver position user identification information is obtained to determine whether the main driver is the person to be prompted, if not, the target passenger capable of clearly determining the meaning of the information to be prompted is determined in the current passenger of the vehicle, the target prompting device which is most convenient for the target passenger to check is determined, the information to be prompted is sent to the target prompting device to be displayed, so that the target passenger can timely obtain the information, the abnormal condition of the vehicle can be timely discovered, meanwhile, the non-driving safety information can also be timely sent to the corresponding person, and the vehicle abnormality can be solved as soon as possible. The problem of current vehicle driver be not vehicle driver commonly used when easily neglecting vehicle suggestion information, be difficult to in time discover vehicle abnormal situation is solved, the hidden danger of vehicle driving has been reduced, the promptness that the unusual running state of vehicle was discovered has been promoted, the injury when having reduced the emergence probability of vehicle traffic accident and traffic accident, has improved driving safety.

Example two

Fig. 2 is a flowchart of an information prompting method provided in the second embodiment of the present invention, and the technical solution of the second embodiment of the present invention is further optimized based on the above optional technical solutions, and determines passenger user identification information corresponding to each passenger position according to current in-vehicle monitoring information, and further determines a target passenger who is a desired prompt for the information to be prompted among the passengers, and determines a target prompting device most suitable for the target passenger to receive the prompt information, among at least two prompting devices installed in the vehicle, according to the current gaze point and the current pose state of the target passenger, and displays the information to be prompted by using the target prompting device. Furthermore, the distance between the eyes of the target passenger and the determined target prompting device is considered, and whether the target passenger is in a drinking state or not is considered, and the broadcasting form of the target prompting device is adaptively adjusted, so that the prompting content contained in the information to be prompted can be timely received by the target passenger, the timeliness of discovering the abnormal driving state of the vehicle is improved, the occurrence probability of vehicle traffic accidents and the injury during the occurrence of the traffic accidents are reduced, and the driving safety is improved.

As shown in fig. 2, an information prompting method provided in the second embodiment of the present invention specifically includes the following steps:

s201, when the information to be prompted corresponding to the vehicle is generated, determining the type of the information to be prompted.

S202, determining an information set of the person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user.

S203, judging whether the driver seat user identification information belongs to the information set of the person to be prompted, if not, executing a step S204, and if so, executing a step S213.

Specifically, whether the current driver frequently drives the vehicle or whether the current information to be prompted should be received can be determined by judging whether the driver identification information belongs to the information set of the person to be prompted corresponding to the current information to be prompted, and whether the current driver can determine the meaning of different prompting information and perform corresponding operation on the current vehicle. If the driver position user identification information does not belong to the information set of the people to be prompted, the current driver is not a common driver of the current vehicle or the people to be prompted for the information to be prompted, the information to be prompted needs to be sent to other passengers in the vehicle for effective prompting, and then step S203 is executed; if the driver seat user identification information belongs to the information set of the person to be prompted, the current driver can be considered as a common driver of the current vehicle or the person to be prompted needs to be prompted for the information to be prompted, the content that the information to be prompted wants to be prompted can be effectively understood, and then step S213 is executed.

And S204, acquiring the current in-vehicle monitoring information.

And S205, determining passenger position user identification information corresponding to each passenger position according to the current in-vehicle monitoring information.

Specifically, whether a passenger is present at each passenger position in the current vehicle can be determined according to the acquired current in-vehicle monitoring information, the image information and the sound information of the passenger corresponding to the passenger position on which the passenger is present in the current vehicle can be determined according to the image information acquired by the camera device and the sound information acquired by the radio device in the current in-vehicle monitoring information, and then the image information and the sound information corresponding to the passenger position are determined as the passenger position user identification information corresponding to the passenger position.

In the embodiment of the invention, various different information on different passenger positions is obtained through the current in-vehicle monitoring information and is used as the corresponding passenger position user identification information, so that the identification result of the passenger on each passenger position is more accurate.

And S206, matching the user identification information of each passenger with the information set of the personnel to be prompted respectively, and determining the target passenger according to the matching result.

Specifically, user identification information of each passenger position extracted according to current in-vehicle monitoring information is respectively matched with an information set of people to be prompted so as to determine whether the passenger corresponding to each passenger position belongs to a common driver of the current vehicle or a person to be prompted of the information to be prompted, if the matching result is successful, the passenger of the passenger position successfully matched can be considered as the common driver of the current vehicle or the person to be prompted of the information to be prompted, the prompting information can be sent to the passenger so as to complete prompting, and therefore the passenger can be used as a target passenger to be prompted by the prompting information to be prompted.

Further, if the matching result is that the matching fails, it can be determined that the passengers on the passenger positions are not the common drivers of the current vehicles or the persons who need to be prompted for the to-be-prompted information, and even if the to-be-prompted information is sent to the passengers, effective feedback is difficult to obtain, at this time, the types of the to-be-prompted information can be judged, so as to determine whether the to-be-prompted information is the information that needs to be prompted for the drivers, so as to prompt in time when potential safety hazards exist in the vehicles, and reduce the number of prompting information that the drivers need to receive when the prompting content does not affect the safety of the vehicles, at this time, step S212 is executed.

Optionally, the passenger seat user identification information includes a passenger seat user identification information and a rear seat user identification information.

Further, fig. 3 is a schematic flow chart for matching the user identification information of each passenger seat with the information set of the person to be prompted and determining the target passenger according to the matching result, as shown in fig. 3, since the passenger in the passenger seat has a position advantage in controlling the vehicle or assisting the driver, the matching between the user identification information of the passenger seat and the information set of the person to be prompted is performed according to the sequence of first passenger seat and then rear seat, and the target passenger is determined according to the matching result, which specifically includes the following steps:

s2061, matching the identifying information of the copilot user with the information set of the person to be prompted, and determining a first matching result.

Specifically, image information or audio information in the passenger identification information of the copilot is matched with an information set of a person to be prompted, and a matching result is determined as a first matching result. If the image information or the audio information is successfully matched with any image information or audio information in the information set of the person to be prompted, determining that the first matching result is successful matching; otherwise, determining that the first matching result is matching failure.

S2062, determining whether the first matching result is a successful matching, if yes, performing step S2063, and if no, performing step S2064.

And S2063, determining the passenger in the auxiliary driving position as the target passenger.

Specifically, when the first matching result is that the matching is successful, the passenger in the passenger seat can be considered as a frequently-used driver of the current vehicle or a person to be prompted for the to-be-prompted information, so that the passenger in the passenger seat can clearly determine the prompting content transmitted by the to-be-prompted information and make corresponding feedback, and the passenger in the passenger seat is determined as the target passenger.

S2064, matching the identification information of the user at the rear ranking with the information set of the personnel to be prompted, and determining a second matching result.

Specifically, when the first matching result is that the matching fails, the passenger in the passenger seat is considered not to be a common driver of the current vehicle or a person whose information needs to be prompted, at this time, whether the passenger in the back row is the common driver of the current vehicle is determined, and the corresponding second matching result is obtained by matching the identification information of the user in the back row with the information set of the person to be prompted.

And S2065, if the second matching result is that the matching is successful, determining that the passenger corresponding to the passenger position user identification information which is successfully matched is the target passenger.

Specifically, if the second matching result is that the matching is successful, the passenger corresponding to the passenger position successfully matched can be considered as a common driver of the current vehicle or a person to be prompted for the information to be prompted, and at this time, the passenger corresponding to the passenger position user identification information successfully matched is determined as the target passenger, so that the information to be prompted is sent to the passenger position to complete effective prompting. Further, if the second matching result is that the matching fails, it may be determined that there is no driver in common use on the current vehicle or a person who needs to be prompted for the information to be prompted, and step S212 may be executed to improve the success rate of prompting as much as possible.

In the embodiment of the invention, whether the passenger at the passenger seat is the common driver of the current vehicle is preferentially determined, and the passenger at the passenger seat does not need to be matched with the passenger at the rear rank after the passenger at the passenger seat is determined to be the common driver, so that the matching times are reduced, the determination efficiency of the target passenger is improved, and meanwhile, the passenger at the passenger seat is preferentially determined, and the passenger at the passenger seat can better respond to the problem prompted by the information to be prompted after the passenger at the passenger seat is determined to be the target passenger, so that the driving safety is improved.

And S207, determining the current gazing point and the current pose state of the target passenger according to the current in-vehicle monitoring information.

In this embodiment, the current gaze point may be understood as a point of the object at which the target passenger is looking at the current time, that is, a point at which the attention of the target passenger is positioned and the visual cue information can be obtained. The current pose state can be understood as the posture that the target passenger is in at the current moment.

Specifically, the posture of the target passenger on the seat at the current time can be determined according to the image information in the current in-vehicle monitoring information, optionally, the current posture state can include a lying state and other states other than the lying state, such as a sitting posture state, meanwhile, the sight line direction of the target passenger can be determined according to the image information and the position of the camera device collecting the current in-vehicle monitoring information, and then the current fixation point of the target passenger can be determined according to the sight line of the target passenger.

And S208, judging whether the current pose state is a lying state, if so, executing a step S209, and if not, executing a step S210.

Specifically, when it is determined that the current pose state of the target passenger is the lying state, it may be considered that the prompting device corresponding to the current gaze point of the target passenger is far away from the eyes of the target passenger and is difficult to meet the information receiving requirement, and at this time, step S209 is executed; when it is determined that the current pose state of the target passenger is the non-lying state, it is considered that the distance between the eyes of the target passenger and each of the prompting devices can approximately satisfy the information receiving requirement, and at this time, step S210 is executed.

S209, the presentation device closest to the eye of the target passenger is determined as the target presentation device, and step S211 is executed.

The target prompting device is one of a copilot projection device, a copilot display device, a driving position seat back display device, a copilot seat back display device, a rear window projection display device and a roof display device.

In the embodiment, the copilot projection device can be understood as a projection device which is arranged at the copilot and displays information on a main windshield corresponding to the copilot in a projection mode; the copilot display device can be understood as a display device which is arranged in front of the copilot and has the functions of image display and audio playing; the driver seat back display device can be understood as a display device which is arranged at the back of a driver seat and has image display and audio playing functions, and the display content of the display device can be received by a passenger sitting at the passenger seat behind the driver seat; a passenger seat back display device, which can be understood as a display device with image display and audio playing functions, installed at the back of the passenger seat, and on which the display content can be received by the passenger seated at the passenger seat behind the passenger seat; the rear window projection display device can be understood as a projection device which is arranged near two rear windows of a vehicle and displays information on the rear window glass in a projection mode; the roof display device may be understood as a display device mounted on the roof of the vehicle and having image display and audio playing functions, and optionally, when the roof has a skylight, the roof display device may be replaced with a projection device that displays information in a projection form on the skylight, which may be set according to actual needs, and the embodiment of the present invention is not limited thereto.

Specifically, when the current pose state of the target passenger is a lying state, the prompting device corresponding to the current gaze point of the target passenger is often far away from the eyes of the target passenger, and even if the to-be-prompted information is displayed on the prompting device, the target passenger is difficult to see clearly.

S210, the prompting device closest to the current fixation point is determined as a target prompting device, and the step S211 is executed.

Specifically, when the current pose state of the target passenger is a non-lying state, distances from the target passenger to the surrounding prompting devices are approximately equal, and the target passenger belongs to a state that the prompting information in the corresponding prompting device can be received as long as attention is focused, and the prompting device closest to the current fixation point is determined as the target prompting device, so that the target passenger can obtain the prompting information displayed on the corresponding prompting device without turning around greatly.

And S211, sending the information to be prompted to a target prompting device for displaying.

Optionally, after the to-be-prompted information is sent to the target prompting device for displaying, in order to ensure that the current driver knows the vehicle driving condition, step S212 may be continuously executed to determine whether the to-be-prompted information needs to be sent to the vehicle instrument panel, so that the driver may obtain the to-be-prompted information in time and execute corresponding operations.

S212, judging whether the type of the information to be prompted is driving safety information, if so, executing a step S213, and if not, executing a step S214.

Specifically, whether the information to be prompted affects the current driving safety of the vehicle is determined by judging whether the type of the information to be prompted is driving safety information, whether the information to be prompted needs to be prompted at the current moment is determined, and if yes, the step S213 is executed; otherwise, step S214 is executed.

And S213, displaying the information to be prompted on a vehicle instrument panel.

Specifically, when the information to be prompted is driving safety information, the information to be prompted must be prompted at the current moment, and when it is determined that a frequently-used driver does not exist in the current vehicle, the current driver is a vehicle operator, and the prompting function can be exerted to the greatest extent by prompting the driver, so that the problem prompted by the information to be prompted can be better responded. Furthermore, when the current driver in the current vehicle is a common driver or a person to be prompted, the problem to be prompted in the prompt information can be made clear without participation of other passengers in the vehicle, and meanwhile, the driver is more convenient to receive the information provided on the vehicle instrument panel, so that the prompt purpose can be achieved by displaying the prompt information to be prompted through the vehicle instrument panel under the above conditions, and a better prompt effect is obtained.

And S214, sending the information to be prompted to the mobile terminal corresponding to the person to be prompted.

Specifically, when the information to be prompted is non-driving safety information, the information to be prompted is not known by drivers and passengers in the vehicle at the current moment in time and does not affect the safe driving of the vehicle, at the moment, the information to be prompted does not need to be displayed on a vehicle instrument panel, the quantity of information needing to be received by the driver is reduced, meanwhile, the mobile terminal of the person to be prompted can be determined according to the corresponding relation between the information to be prompted and the person to be prompted, the information to be prompted is sent to the corresponding mobile terminal, and therefore the problem that the vehicle corresponding to the information to be prompted is ignored is avoided.

Further, the second embodiment of the present invention further provides an optional implementation, after determining the target prompting device corresponding to the target passenger, further including:

determining the distance between the target prompting device and the eyes of the target passenger;

and if the distance is greater than the preset distance threshold, sending the information to be prompted to a mobile terminal of a target passenger for display, or generating voice prompt information according to the information to be prompted and playing the voice prompt information through a target prompt device.

Specifically, the distance between the target prompting device and the eyes of the target passenger is determined, and the distance is compared with a preset distance threshold value, so that whether the target passenger can clearly see the prompting information in the target prompting device at the current distance is determined, and the target prompting device can complete effective prompting. If the distance is greater than the preset distance threshold, the target passenger is considered to be difficult to completely acquire the to-be-prompted information generated by the current vehicle, at the moment, the mobile terminal communication mode corresponding to the target passenger pre-stored in the vehicle can be acquired, the to-be-prompted information is sent to the mobile terminal of the target passenger to be displayed, or voice prompt information can be generated according to the to-be-prompted information and played through the target prompt device.

In the embodiment of the invention, whether the target prompting device can effectively transmit the prompting information to the target passenger is concerned after the target prompting device is determined, and when the target prompting device is far away from the target passenger, the transmission of the information to be prompted is completed in a voice broadcasting or mobile terminal pushing mode, so that the effectiveness of prompting transmission is ensured, and the driving safety is further improved.

determining whether the target passenger is in a drinking state or not according to the current in-vehicle monitoring information;

and if the target passenger is in the drinking state, generating voice prompt information according to the information to be prompted, and sending the voice prompt information to the target prompt device for broadcasting.

Specifically, the information such as the face color and the limb movement of the target passenger is determined through the image information in the current in-vehicle monitoring information, whether the target passenger meets the preset drinking state condition or not is determined according to the information such as the face color and the limb movement, and then whether the target passenger is in the drinking state or not is determined. If the target passenger is determined to be in the drinking state, the target passenger may be difficult to accurately receive the visual prompt information, the target prompt device is only used for displaying the to-be-prompted information, a good prompt effect is difficult to achieve, at the moment, the voice prompt information can be generated according to the to-be-prompted information and is sent to the target prompt device for broadcasting, the receiving proportion of the target passenger to prompt contents in the drinking state can be increased through the voice prompt mode, the prompt effectiveness is improved, and the driving safety of the vehicle is enhanced.

Further, an embodiment of the present invention further provides a method for determining whether a target passenger is in a drinking state according to current in-vehicle monitoring information, which specifically includes the following steps:

A. and determining whether the facial expression and the limb actions of the target passenger meet the preset drinking state conditions or not according to the current in-vehicle monitoring information.

In the present embodiment, the predetermined drinking state condition may be a set of facial expressions and body movements that most people have after drinking, and an object having one or more facial expressions and body movements may be considered as possibly being in a drinking state.

Specifically, the facial expressions and the body movements of the target passenger are determined according to the current in-vehicle monitoring information, the facial expressions and the body movements are compared with the facial expressions and the body movement set in the preset drinking state condition, if the matching degree is higher than a preset threshold value, the target passenger can be considered to be possibly in the drinking state, and whether the target passenger is in the drinking state needs to be further verified.

B. If yes, detecting the gas exhaled by the target passenger through an alcohol detection device which is closest to the mouth of the target passenger in the current vehicle, and determining whether the target passenger is in a drinking state according to the detection result.

Specifically, when the facial expression and the limb movement of the target passenger satisfy the preset drinking state condition, the alcohol concentration in the exhaled gas of the target passenger can be detected according to the alcohol detection device closest to the mouth of the target passenger, when the alcohol concentration exceeds a preset concentration threshold, the target passenger can be considered to be in a drinking state, otherwise, the target passenger can be considered not to be in the drinking state.

In the embodiment of the invention, the image recognition mode is combined with the alcohol detection device, so that whether the target passenger is in the drinking state can be more accurately judged, the misjudgment of the state of the target passenger is prevented, the judgment accuracy is improved, and the prompt mode of the information to be prompted is timely adjusted according to different states of the target passenger, so that the target passenger can furthest make clear the warning information contained in the information to be prompted, further the driving suggestion is given to the current driver, the abnormal driving time of the vehicle is reduced, and the driving safety is improved.

According to the technical scheme of the embodiment, after the current driver is determined not to be a common driver or a person to be prompted of the current vehicle, the target passenger which is the common driver of the current vehicle is determined according to the sequence of the front passenger seat and the rear passenger seat, the corresponding target prompting device is determined according to the current point of regard and the current pose state of the target passenger, the information to be prompted is displayed on the target prompting device which is most convenient for the target passenger to watch, meanwhile, the distance relation between the target prompting device and the target passenger is considered, whether the target passenger is in a drinking state or not is considered, the information to be prompted is sent in a mode which is most suitable for the target passenger to receive aiming at the target passenger in different states, the probability that the information to be prompted is effectively received is improved, the timeliness that the abnormal driving state of the vehicle is discovered is improved, the occurrence probability of vehicle traffic accidents and the injury when the traffic accidents occur are reduced, the driving safety is improved.

EXAMPLE III

Fig. 4 is a schematic structural diagram of an information prompt apparatus according to a third embodiment of the present invention, where the information prompt apparatus includes: a prompt information determination module 31, an identification information acquisition module 32, a monitoring information acquisition module 33, a target determination module 34 and a display module 35.

The prompt information determining module 31 is configured to determine a type of information to be prompted when generating information to be prompted corresponding to a vehicle, where the type of information to be prompted includes driving safety information and non-driving safety information; the identification information acquisition module 32 is used for determining an information set of a person to be prompted according to the type of the information to be prompted and a preset prompting mapping relation, and acquiring identification information of a driver seat user; the monitoring information acquisition module 33 is configured to acquire current in-vehicle monitoring information if the driver seat user identification information does not belong to the information set of the person to be prompted; the target determining module 34 is used for determining a target passenger according to the current in-vehicle monitoring information and the information set of the personnel to be prompted, and determining a target prompting device corresponding to the target passenger; and the display module 35 is configured to send the information to be prompted to the target prompting device for displaying.

According to the technical scheme, when the vehicle generates the information to be prompted, the person to be prompted to which the information to be prompted is determined according to the type of the information to be prompted, driver position user identification information is obtained to determine whether the main driver is the person to be prompted, if not, the main driver determines a target passenger capable of clearly determining the meaning of the information to be prompted from the current passengers of the vehicle, determines a target prompting device which is most convenient for the target passenger to check, and sends the information to be prompted to the target prompting device to display so that the target passenger can timely obtain the information, abnormal conditions of the vehicle can be timely discovered, meanwhile, non-driving safety information can also be timely sent to the corresponding person, and vehicle abnormity can be solved as soon as possible. The problem of current vehicle driver be not vehicle driver commonly used when easily neglecting vehicle suggestion information, be difficult to in time discover vehicle abnormal situation is solved, the hidden danger of vehicle driving has been reduced, the promptness that the unusual running state of vehicle was discovered has been promoted, the injury when having reduced the emergence probability of vehicle traffic accident and traffic accident, has improved driving safety.

Optionally, at least two prompting devices are included in the current vehicle.

Optionally, the target determining module 34 includes:

the target passenger determining unit is used for determining passenger position user identification information corresponding to each passenger position according to the current in-vehicle monitoring information; and matching the user identification information of each passenger with the information set of the personnel to be prompted respectively, and determining the target passenger according to the matching result.

The target prompting device determining unit is used for determining the current gazing point and the current pose state of the target passenger according to the current in-vehicle monitoring information; if the current pose state is a lying state, determining a prompting device closest to the eye of the target passenger as a target prompting device; and if the current pose state is a non-lying state, determining the prompting device closest to the current fixation point as a target prompting device.

Further, the passenger position user identification information includes a passenger position user identification information and a rear ranking user identification information, and the target passenger determination unit is specifically configured to:

matching the identifying information of the copilot user with an information set of a person to be prompted, and determining a first matching result;

if the first matching result is that the matching is successful, determining the passenger at the passenger seat as a target passenger;

if the first matching result is matching failure, matching the identification information of the rear ranking user with the information set of the personnel to be prompted, and determining a second matching result;

and if the second matching result is successful matching, determining that the passenger corresponding to the passenger position user identification information which is successfully matched is the target passenger.

Optionally, the information prompting apparatus further includes:

and the distance determining module is used for determining the distance between the target prompting device and the eyes of the target passenger.

And the first prompting module is used for sending the to-be-prompted information to the mobile terminal of the target passenger for displaying if the distance is greater than the preset distance threshold value, or generating voice prompting information according to the to-be-prompted information and playing the voice prompting information through the target prompting device.

Optionally, the information prompting apparatus further includes:

and the drinking state determining module is used for determining whether the target passenger is in a drinking state according to the current in-vehicle monitoring information.

And the second prompting module is used for generating voice prompting information according to the to-be-prompted information if the target passenger is in a drinking state, and sending the voice prompting information to the target prompting device for broadcasting.

Optionally, the drinking status determining module is specifically configured to:

determining whether the facial expression and the limb actions of the target passenger meet the preset drinking state condition or not according to the current in-vehicle monitoring information;

if yes, detecting the gas exhaled by the target passenger through an alcohol detection device which is closest to the mouth of the target passenger in the current vehicle, and determining whether the target passenger is in a drinking state according to the detection result.

Optionally, the information prompting apparatus further includes:

and the instrument display module is used for displaying the information to be prompted on a vehicle instrument panel if the type of the information to be prompted is driving safety information.

Optionally, the information prompting apparatus further includes:

and the prompt sending module is used for sending the information to be prompted to the mobile terminal corresponding to the person to be prompted if the type of the information to be prompted is the driving fee safety information.

The information prompting device provided by the embodiment of the invention can execute the information prompting method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.

Example four

Fig. 5 is a schematic structural diagram of a vehicle according to a fourth embodiment of the present invention, as shown in fig. 5, the vehicle includes a camera 41, a prompting device 42, an alcohol detecting device 43, a controller 44, a storage device 45, an input device 46, and an output device 47; the number of the camera 41, the alcohol detection device 43 and the controller 44 in the vehicle may be one or more, the number of the prompting devices 42 is at least two, and one camera 41, one prompting device 42, one alcohol detection device 43 and one controller 44 are taken as an example in fig. 5; the camera 41, the prompting device 42, the alcohol detection device 43, the controller 44, the storage device 45, the input device 46, and the output device 47 in the vehicle may be connected by a bus or other means, and the bus connection is exemplified in fig. 5.

And the camera device 41 is used for collecting monitoring information in the vehicle.

And the prompting device 42 is used for displaying or playing the information to be prompted.

And an alcohol detection device 43 for detecting the exhaled gas of the target passenger.

The storage device 45 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the information prompting method in the embodiment of the present invention (for example, the prompting information determining module 31, the identification information acquiring module 32, the monitoring information acquiring module 33, the target determining module 34, and the display module 35). The controller 44 executes various functional applications and data processing of the vehicle, that is, implements the above-described information presentation method, by executing software programs, instructions, and modules stored in the storage device 45.

The storage device 45 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the storage device 45 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage device 45 may further include memory remotely located from the controller 44, which may be connected to the vehicle over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The input device 46 is operable to receive input numeric or character information and to generate key signal inputs relating to user settings and function controls of the vehicle. The output device 47 may include a display device such as a display screen.

EXAMPLE five

An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform an information prompting method, where the method includes:

Of course, the storage medium provided by the embodiment of the present invention contains computer-executable instructions, and the computer-executable instructions are not limited to the operations of the method described above, and may also perform related operations in the information prompting method provided by any embodiment of the present invention.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.

It should be noted that, in the embodiment of the above search apparatus, each included unit and module are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. An information prompting method, comprising:

and sending the information to be prompted to the target prompting device for displaying.

2. The method of claim 1, wherein the determining a target passenger based on the current in-vehicle monitoring information and the set of information about the person to be prompted comprises:

determining passenger position user identification information corresponding to each passenger position according to the current in-vehicle monitoring information;

and matching the user identification information of each passenger space with the information set of the personnel to be prompted respectively, and determining a target passenger according to a matching result.

3. The method of claim 2, wherein the passenger space user identification information includes a passenger space user identification information and a rear ranking user identification information, and wherein matching each of the passenger space user identification information with the information set of the person to be prompted and determining a target passenger according to a result of the matching comprises:

matching the copilot user identification information with the information set of the personnel to be prompted, and determining a first matching result;

if the first matching result is matching failure, matching the rear ranking user identification information with the information set of the personnel to be prompted, and determining a second matching result;

4. The method of claim 1, wherein at least two prompting devices are included in the current vehicle, and wherein determining a target prompting device corresponding to the target passenger comprises:

determining the current gazing point and the current pose state of the target passenger according to the current in-vehicle monitoring information;

if the current pose state is a lying state, determining a prompting device closest to the eye of the target passenger as a target prompting device;

if the current pose state is a non-lying state, determining a prompting device closest to the current fixation point as a target prompting device;

5. The method of claim 1, wherein after determining the target alert device corresponding to the target passenger, further comprising:

determining a distance between the target alert device and the eyes of the target passenger;

and if the distance is greater than a preset distance threshold value, sending the to-be-prompted information to a mobile terminal of the target passenger for display, or generating voice prompt information according to the to-be-prompted information and playing the voice prompt information through the target prompt device.

6. The method of claim 1, wherein after determining the target alert device corresponding to the target passenger, further comprising:

and if the target passenger is in a drinking state, generating voice prompt information according to the information to be prompted, and sending the voice prompt information to the target prompt device for broadcasting.

7. The method of claim 6, wherein said determining whether the target passenger is in a drinking status based on the current in-vehicle monitoring information comprises:

determining whether the facial expression and the limb action of the target passenger meet preset drinking state conditions or not according to the current in-vehicle monitoring information;

if yes, detecting the gas exhaled by the target passenger through an alcohol detection device closest to the mouth of the target passenger in the current vehicle, and determining whether the target passenger is in a drinking state according to a detection result.

8. The method of claim 1, wherein after determining the type of information to be prompted, further comprising:

and if the type of the information to be prompted is driving safety information, displaying the information to be prompted on a vehicle instrument panel.

9. An information presentation device, comprising:

10. A vehicle, characterized in that the vehicle comprises:

one or more controllers;

storage means for storing one or more programs;

when executed by the one or more controllers, cause the one or more controllers to implement the information prompting method of any of claims 1-8.