CN110861654A - Reminding method, reminding device, vehicle, equipment and storage medium - Google Patents

Reminding method, reminding device, vehicle, equipment and storage medium Download PDF

Info

Publication number
CN110861654A
CN110861654A CN201911144287.4A CN201911144287A CN110861654A CN 110861654 A CN110861654 A CN 110861654A CN 201911144287 A CN201911144287 A CN 201911144287A CN 110861654 A CN110861654 A CN 110861654A
Authority
CN
China
Prior art keywords
takeover
driver
reminding
prompting mode
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911144287.4A
Other languages
Chinese (zh)
Inventor
王一
周荣刚
谭北平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Beijing Mininglamp Software System Co ltd
Original Assignee
Beihang University
Beijing Mininglamp Software System Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University, Beijing Mininglamp Software System Co ltd filed Critical Beihang University
Priority to CN201911144287.4A priority Critical patent/CN110861654A/en
Publication of CN110861654A publication Critical patent/CN110861654A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers

Abstract

The application provides a reminding method, a reminding device, a vehicle, equipment and a storage medium, wherein the method comprises the following steps: acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle; after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of a secondary task currently performed by the driver; according to the takeover prompting mode, a starting instruction is sent to the corresponding reminding device, so that the reminding device can remind the driver, and in the mode, when the driver needs to take over the driving, the reminding information can be sent to the driver, so that the driver can take over the driving in time, the probability of accidents of the vehicle is reduced, and the safety of the driver is improved.

Description

Reminding method, reminding device, vehicle, equipment and storage medium
Technical Field
The application relates to the technical field of computers, in particular to a reminding method, a reminding device, a vehicle, equipment and a storage medium.
Background
With the development of technology, automatic driving technology is applied to more and more vehicles, so as to provide more convenient driving modes for drivers, for example: after the driver uses the automatic driving technique in the vehicle, the driver's identity is changed from the operator to the supervisor, thereby greatly reducing the workload of the driver, and the driver can have more time to process the secondary tasks, wherein the secondary tasks can include: make a call, text, write a mail, watch a video, etc.
In the process of automatic driving, after an event needing human participation is met, the driver needs to take over driving so as to switch the vehicle from an automatic driving mode to a manual mode, but at the moment, the driver possibly carries out secondary tasks, so that the driver cannot take over driving in time, the probability of accidents of the vehicle is increased, and the safety of the driver is further reduced.
Disclosure of Invention
In view of the above, an object of the embodiments of the present application is to provide a reminding method, a device, a vehicle, a device and a storage medium, so as to improve the safety of a driver.
In a first aspect, an embodiment of the present application provides a reminding method, including:
acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of a secondary task currently performed by the driver;
and sending a starting instruction to corresponding reminding equipment according to the takeover prompting mode so that the reminding equipment reminds the driver.
Optionally, the takeover prompting manner includes at least one of the following:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
Optionally, the secondary task category comprises at least one of:
visual, auditory, and audio-visual mixed.
Optionally, the determining, according to the category of the secondary task currently performed by the driver, a corresponding take-over prompting manner includes:
when the secondary task category is the visual category, determining an auditory takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
when the secondary task category is the auditory category, determining a visual takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
and when the secondary task category is the audio-visual mixed category, determining a haptic takeover prompting mode as a corresponding takeover prompting mode.
Optionally, when the determined takeover prompting mode is the visual takeover prompting mode, sending a start instruction to the corresponding reminding device according to the takeover prompting mode includes:
acquiring current eye movement track characteristic information of the driver;
determining the current gazing position information of the driver according to the eye movement track characteristic information;
and sending a starting instruction to a reminding device corresponding to the position information and used for carrying out a visual takeover prompting mode.
In a second aspect, an embodiment of the present application provides a reminding device, including:
the automatic driving system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
the determining unit is used for determining a corresponding takeover prompting mode according to the type of a secondary task currently performed by the driver after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving;
and the sending unit is used for sending a starting instruction to corresponding reminding equipment according to the take-over reminding mode so that the reminding equipment reminds the driver.
Optionally, the takeover prompting manner includes at least one of the following:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
Optionally, the secondary task category comprises at least one of:
visual, auditory, and audio-visual mixed.
Optionally, when the determining unit is configured to determine a corresponding takeover prompting mode according to the category of the secondary task currently performed by the driver, the determining unit includes:
when the secondary task category is the visual category, determining an auditory takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
when the secondary task category is the auditory category, determining a visual takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
and when the secondary task category is the audio-visual mixed category, determining a haptic takeover prompting mode as a corresponding takeover prompting mode.
Optionally, when the determined takeover prompting mode is the visual takeover prompting mode, the configuration of the sending unit, when being used for sending a start instruction to the corresponding reminding device according to the takeover prompting mode, includes:
acquiring current eye movement track characteristic information of the driver;
determining the current gazing position information of the driver according to the eye movement track characteristic information;
and sending a starting instruction to a reminding device corresponding to the position information and used for carrying out a visual takeover prompting mode.
In a third aspect, an embodiment of the present application provides an automatic driving vehicle, including the reminding device as set forth in any one of the first aspect.
In a fourth aspect, an embodiment of the present application provides an electronic device, including: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, when the electronic device runs, the processor and the storage medium communicate with each other through the bus, and the processor executes the machine-readable instructions to execute the steps of the reminding method according to any one of the first aspect.
In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the reminding method according to any one of the first aspect.
The technical scheme provided by the embodiment of the application can have the following beneficial effects:
in the application, in the process of automatically driving the automatic driving vehicle, the current secondary task type of the driver is acquired so as to master the current behavior of the driver, after the indication information which is sent by the automatic driving vehicle and used for indicating the driver to take over the driving is acquired, the corresponding take-over prompting mode can be determined according to the current secondary task type of the driver, then the starting instruction is sent to the corresponding prompting equipment according to the determined take-over prompting mode so as to send the prompting information to the corresponding prompting equipment to prompt the user, and through the mode, when the driver needs to take over the driving, the prompting information can be sent to the driver, so that the driver can take over the driving in time, the probability of the vehicle accidents is reduced, and the safety of the driver is improved, and when the driver is reminded, the driver is reminded in a targeted manner according to the type of the secondary task currently performed by the driver, so that the driver can respond to the reminding quickly, and the safety of the driver is further improved.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic flowchart of a reminding method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another reminding method according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a reminding device according to a second embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
Example one
Fig. 1 is a schematic flow chart of a reminding method according to an embodiment of the present application, and as shown in fig. 1, the method includes the following steps:
step 101, obtaining a secondary task type currently performed by a driver in an automatic driving process of the automatic driving vehicle.
Specifically, in order to provide accurate reminding for a driver when the driver is required to take over driving, a secondary task category currently performed by the driver needs to be acquired, so that which senses currently used by the driver are determined according to the secondary task category currently performed by the driver, and accurate reminding is performed for the senses used by the driver, wherein the secondary task includes but is not limited to: the method comprises the following steps of making a call, sending a short message, writing a mail, listening to music, watching a video and the like, wherein the sense organ used when the user calls and listens to the music is an auditory sense organ, the sense organ used when the user writes the mail is a visual sense organ, and the sense organ used when the user watches the video comprises the auditory sense organ and the visual sense organ.
In the process of automatic driving, the automatic driving vehicle may acquire an image of the driver through an internal camera device, determine a secondary task category currently performed by driving through analysis of the image, or the automatic driving vehicle may be in communication connection with all devices placed inside the vehicle, determine which device the user is specifically using by determining the use condition of the device, determine the secondary task category currently performed by the driver through determining the operation condition of the device currently used by the driver, of course, acquire the secondary task category currently performed by the driver during automatic driving of the automatic driving vehicle through other manners, and the specific manner of obtaining the secondary task category currently performed by the driver is not particularly limited herein.
It should be noted that, what types of secondary tasks are specifically included may be set according to actual needs, and is not specifically limited herein.
And 102, after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of the secondary task currently performed by the driver.
Specifically, the autonomous vehicle collects and analyzes road conditions during autonomous driving, and analyzes own vehicle conditions to determine whether the current road and own vehicle conditions require a driver to take over driving, for example: when the automatic driving vehicle determines that the lane line of the current road is not clear through the acquired road image, in order to reduce traffic accidents, at this time, the indicating information for indicating the driver to take over driving needs to be sent to the reminding device, or when the automatic driving vehicle detects that the tire pressure is insufficient or the oil amount is low, the indicating information for indicating the driver to take over driving needs to be sent to the reminding device, of course, the indicating information for indicating the driver to take over driving can be sent when other situations occur, and the situation that the indicating information for indicating the driver to take over driving needs to be sent about the specific need can be set according to actual needs, for example: it may be set that when the road condition, the vehicle condition, the weather condition, or the like does not satisfy the requirement of the automatic driving, the instruction information for instructing the driver to take over the driving is transmitted, and the specific case of transmitting the instruction information is not specifically limited herein.
After the reminding device receives the prompt information, the current sense of the driver can be determined according to the type of the secondary task currently performed by the driver, so that an accurate taking-over reminding mode is made for the driver, for example: when the secondary task currently performed by the driver is listening to music, the determined takeover prompting mode may be outputting a specific audio, or may further include a specific visual prompting (for example, when a light is set inside the automatic driving vehicle, the visual prompting may be that the light emits light in a specified manner), or may further perform prompting by using a touch prompting mode (for example, a driver's seat vibrates for prompting), one or more prompting modes may be set according to an actual situation when the corresponding takeover prompting mode is determined, a method for determining the corresponding takeover prompting mode according to the secondary task category may be set according to an actual need, and the type and number of the determined takeover prompting modes may also be set according to the actual need, which is not specifically limited herein.
103, sending a starting instruction to corresponding reminding equipment according to the takeover prompting mode so that the reminding equipment reminds the driver.
Specifically, after the reminding device acquires the takeover reminding mode, the reminding device can know that the reminding devices need to be controlled to remind the driver, so that the reminding device can send a starting instruction to the reminding devices corresponding to the takeover reminding mode, the corresponding reminding devices can remind the driver according to the preset reminding mode after being started, the driver can give up continuing to carry out the secondary task to take over the driving, the probability of accidents of the vehicle is favorably reduced, the safety of the driver is favorably improved, the driver is reminded according to the current secondary task category of the driver in a targeted mode, the driver can respond to the reminding quickly, and the safety of the driver is further improved.
In one possible embodiment, the takeover prompting means includes at least one of:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
Specifically, when determining the takeover prompting mode, at least one of the prompting modes may be determined as a corresponding takeover prompting mode according to actual needs, for example: when one of the takeover prompting modes is determined to be the corresponding takeover prompting mode, the takeover prompting mode can be determined according to a preset rule, for example, when the sense organ currently used by the driver is determined to be a visual sense organ through the secondary task category, the driver can be reminded by using an auditory takeover prompting mode or a tactile takeover prompting mode, that is: the reminding mode that uses is the sense organ that the driver did not use when carrying out secondary task classification, of course, also can use vision class to take over the suggestion mode, if the secondary task that the driver carried on at present is when seeing the file through the panel computer, can send instruction information to the panel computer shows specific content on the screen and realizes reminding to the driver, can carry out accurate warning to the driver through above-mentioned mode, be favorable to making the driver take over the driving fast, for example again: when two or three of the takeover prompting modes are determined as corresponding takeover prompting modes, the takeover prompting modes can also be determined according to preset rules, for example, when the sense organ currently used by the driver is determined to be a visual sense organ through the secondary task category, the driver can be reminded by using an auditory takeover prompting mode and a tactile takeover prompting mode, namely: the used reminding mode is a sense organ which is not used by the driver when the secondary task is performed, of course, a visual takeover reminding mode can be used, and one of an auditory takeover reminding mode or a tactile takeover reminding mode can be selected, if the secondary task currently performed by the driver is to watch a file through a tablet computer, the tablet computer can be sent with indication information so as to display specific content on a screen, and a sound in the automatic driving vehicle is started to send out designated audio or to enable a seat of the driver to vibrate, and the driver is reminded through the two takeover reminding modes, for example: can set up above-mentioned three kinds of warning modes into the takeover suggestion mode that corresponds, can strengthen the dynamics of reminding the driver through taking over the suggestion mode that sets up two kinds or three kinds of takeover suggestion modes into corresponding to and increase the kind that many drivers reminded, thereby be favorable to making the driver can take over the driving fast.
It should be noted that what kind or kinds of takeover prompting manners are specifically used may be set up corresponding rules or algorithms according to actual needs, and is not specifically limited herein.
In one possible embodiment, the secondary task categories include at least one of:
visual, auditory, and audio-visual mixed.
It should be noted that, several secondary task categories are specifically set, and the specific setting manner of the secondary task categories may be set according to actual needs, and is not specifically limited herein.
In one possible embodiment, when performing step 102, this can be achieved by:
when the secondary task category is the visual category, determining an auditory takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode; when the secondary task category is the auditory category, determining a visual takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode; and when the secondary task category is the audio-visual mixed category, determining a haptic takeover prompting mode as a corresponding takeover prompting mode.
Specifically, when reminding the driver, the sense organ that the driver did not use when carrying out secondary task is used, can carry out better accurate warning to the driver, is favorable to making the driver take over the driving fast.
It should be noted that, specifically, one takeover prompting mode and two takeover prompting modes may be set according to actual needs, and are not specifically limited herein.
In a possible implementation, fig. 2 is a schematic flow chart of another reminding method provided in an embodiment of the present application, and when the determined takeover prompting manner is the visual takeover prompting manner, as shown in fig. 2, in executing step 103, the following steps may be implemented:
and step 201, obtaining the current eye movement track characteristic information of the driver.
Step 202, determining the current gazing position information of the driver according to the eye movement track characteristic information.
And 203, sending a starting instruction to a reminding device corresponding to the position information and used for carrying out a visual takeover reminding mode.
Specifically, when it is determined that the takeover prompting mode is the visual takeover prompting mode, in order to increase the probability of attracting the attention of the driver, the driver needs to be purposefully visually prompted, for example: need carry out the vision in the position department that the driver gazed, in order to realize above-mentioned purpose, need obtain the current eye movement orbit characteristic information of driver, can analyze out the position that the driver gazed at present according to eye movement orbit characteristic information, then start this position department and be used for carrying out the reminding equipment of vision type takeover suggestion mode, so that the reminding equipment on this position carries out the vision and reminds, through above-mentioned mode, be favorable to improving the probability that the driver noticed, thereby be favorable to improving the speed that the driver took over the driving, and then be favorable to improving driver's security.
It should be noted that the reminding device related in the first embodiment of the present application may be set according to actual needs, for example: the reminding device for performing the visual takeover reminding mode may be a light, or may also be an image display device, etc., the reminding device for performing the auditory takeover reminding mode may be a sound device inside an automatic driving vehicle, or may also be an earphone worn by a driver, etc., the reminding device for performing the tactile takeover reminding mode may be a seat capable of vibrating, or a device capable of performing tactile reminding worn by the driver, and the specific reminding device is not specifically limited herein.
Example two
Fig. 3 is a schematic structural diagram of a reminding device according to a second embodiment of the present application, and as shown in fig. 3, the reminding device includes:
an acquisition unit 31 configured to acquire a category of a secondary task currently performed by a driver in an autonomous driving process of the autonomous vehicle;
the determining unit 32 is configured to determine, after acquiring instruction information, which is sent by the autonomous vehicle and used to instruct the driver to take over driving, a corresponding take-over prompting mode according to a type of a secondary task currently performed by the driver;
and the sending unit 33 is configured to send a start instruction to a corresponding reminding device according to the takeover prompting manner, so that the reminding device reminds the driver.
In a possible embodiment, the takeover prompting means includes at least one of:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
In one possible embodiment, the secondary task categories include at least one of:
visual, auditory, and audio-visual mixed.
In a possible embodiment, the configuration of the determining unit 32, when configured to determine the corresponding takeover prompting mode according to the secondary task category currently performed by the driver, includes:
when the secondary task category is the visual category, determining an auditory takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
when the secondary task category is the auditory category, determining a visual takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
and when the secondary task category is the audio-visual mixed category, determining a haptic takeover prompting mode as a corresponding takeover prompting mode.
In a possible implementation, when the determined takeover prompting manner is the visual takeover prompting manner, the configuring of the sending unit 33 is configured to send a start instruction to a corresponding reminding device according to the takeover prompting manner, and includes:
acquiring current eye movement track characteristic information of the driver;
determining the current gazing position information of the driver according to the eye movement track characteristic information;
and sending a starting instruction to a reminding device corresponding to the position information and used for carrying out a visual takeover prompting mode.
Regarding the related principles of the second embodiment, reference may be made to the related description of the first embodiment, and the detailed description thereof is omitted here.
The second embodiment of the application further provides an automatic driving vehicle which comprises the reminding device related to the second embodiment.
EXAMPLE III
Fig. 4 is a schematic structural diagram of an electronic device according to a third embodiment of the present application, including: a processor 401, a storage medium 402 and a bus 403, where the storage medium 402 stores machine-readable instructions executable by the processor 401, when the electronic device executes the above-mentioned reminding method, the processor 401 and the storage medium 402 communicate with each other through the bus 403, and the processor 401 executes the machine-readable instructions to perform the following steps:
acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of a secondary task currently performed by the driver;
and sending a starting instruction to corresponding reminding equipment according to the takeover prompting mode so that the reminding equipment reminds the driver.
In this embodiment of the application, the storage medium 402 may further execute other machine-readable instructions to execute other methods as described in the first embodiment, and for the specific steps and principles of the executed method, reference is made to the description of the first embodiment, which is not described in detail herein.
Example four
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the following steps:
acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of a secondary task currently performed by the driver;
and sending a starting instruction to corresponding reminding equipment according to the takeover prompting mode so that the reminding equipment reminds the driver.
In the embodiment of the present application, when being executed by a processor, the computer program may further execute other machine-readable instructions to perform other methods as described in the first embodiment, and for the specific method steps and principles to be performed, reference is made to the description of the first embodiment, which is not described in detail herein.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments provided in the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the present disclosure, which should be construed in light of the above teachings. Are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A reminding method is characterized by comprising the following steps:
acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving, determining a corresponding taking over prompting mode according to the type of a secondary task currently performed by the driver;
and sending a starting instruction to corresponding reminding equipment according to the takeover prompting mode so that the reminding equipment reminds the driver.
2. The reminding method according to claim 1, wherein the takeover prompting means includes at least one of:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
3. The reminder method of claim 1, wherein the secondary task categories include at least one of:
visual, auditory, and audio-visual mixed.
4. The reminding method according to claim 3, wherein the determining a corresponding taking over reminding mode according to the class of the secondary task currently performed by the driver comprises:
when the secondary task category is the visual category, determining an auditory takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
when the secondary task category is the auditory category, determining a visual takeover prompting mode and/or a tactile takeover prompting mode as a corresponding takeover prompting mode;
and when the secondary task category is the audio-visual mixed category, determining a haptic takeover prompting mode as a corresponding takeover prompting mode.
5. The reminding method according to claim 2 or 4, wherein when the determined takeover reminding mode is the visual takeover reminding mode, the sending a start instruction to the corresponding reminding device according to the takeover reminding mode comprises:
acquiring current eye movement track characteristic information of the driver;
determining the current gazing position information of the driver according to the eye movement track characteristic information;
and sending a starting instruction to a reminding device corresponding to the position information and used for carrying out a visual takeover prompting mode.
6. A reminder device, comprising:
the automatic driving system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the type of a secondary task currently performed by a driver in the automatic driving process of the automatic driving vehicle;
the determining unit is used for determining a corresponding takeover prompting mode according to the type of a secondary task currently performed by the driver after acquiring instruction information which is sent by the automatic driving vehicle and used for instructing the driver to take over driving;
and the sending unit is used for sending a starting instruction to corresponding reminding equipment according to the take-over reminding mode so that the reminding equipment reminds the driver.
7. The reminder device of claim 6, wherein the take-over reminder arrangement includes at least one of:
a visual takeover prompting mode, an auditory takeover prompting mode and a tactile takeover prompting mode.
8. An autonomous vehicle, characterized in that it comprises a reminder device according to any one of claims 6 to 7.
9. An electronic device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the electronic device is running, the processor executing the machine-readable instructions to perform the steps of the alerting method of any of claims 1-5.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the reminder method according to any one of claims 1 to 5.
CN201911144287.4A 2019-11-20 2019-11-20 Reminding method, reminding device, vehicle, equipment and storage medium Pending CN110861654A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911144287.4A CN110861654A (en) 2019-11-20 2019-11-20 Reminding method, reminding device, vehicle, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911144287.4A CN110861654A (en) 2019-11-20 2019-11-20 Reminding method, reminding device, vehicle, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN110861654A true CN110861654A (en) 2020-03-06

Family

ID=69655723

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911144287.4A Pending CN110861654A (en) 2019-11-20 2019-11-20 Reminding method, reminding device, vehicle, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110861654A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111619479A (en) * 2020-05-20 2020-09-04 重庆金康赛力斯新能源汽车设计院有限公司 Driving takeover prompting method, device and system, vehicle-mounted controller and storage medium
CN111959524A (en) * 2020-08-20 2020-11-20 中国第一汽车股份有限公司 Man-machine interaction control system and method for automatic driving vehicle
CN114162138A (en) * 2020-09-10 2022-03-11 中国移动通信有限公司研究院 Automatic driving mode switching method and device
CN114379563A (en) * 2020-10-21 2022-04-22 广州汽车集团股份有限公司 Safe driving control method and system and storage medium
CN114454895A (en) * 2020-11-10 2022-05-10 奥迪股份公司 Method, equipment and system for automatically taking over vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103593942A (en) * 2012-06-22 2014-02-19 通用汽车环球科技运作有限责任公司 Alert systems and methods for a vehicle
US20160031441A1 (en) * 2014-07-31 2016-02-04 Toyota Motor Engineering & Manufacturing North America, Inc. Self-explaining autonomous vehicle
CN106274480A (en) * 2015-06-23 2017-01-04 沃尔沃汽车公司 For the method and apparatus that can complete secondary task during semi-autonomous driving
CN108819945A (en) * 2018-05-25 2018-11-16 吉利汽车研究院(宁波)有限公司 A kind of automatic driving vehicle adapter tube suggestion device and method
CN109334673A (en) * 2018-10-30 2019-02-15 奇瑞汽车股份有限公司 Adapter tube based reminding method, device and the storage medium of intelligent automobile

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103593942A (en) * 2012-06-22 2014-02-19 通用汽车环球科技运作有限责任公司 Alert systems and methods for a vehicle
US20160031441A1 (en) * 2014-07-31 2016-02-04 Toyota Motor Engineering & Manufacturing North America, Inc. Self-explaining autonomous vehicle
CN106274480A (en) * 2015-06-23 2017-01-04 沃尔沃汽车公司 For the method and apparatus that can complete secondary task during semi-autonomous driving
CN108819945A (en) * 2018-05-25 2018-11-16 吉利汽车研究院(宁波)有限公司 A kind of automatic driving vehicle adapter tube suggestion device and method
CN109334673A (en) * 2018-10-30 2019-02-15 奇瑞汽车股份有限公司 Adapter tube based reminding method, device and the storage medium of intelligent automobile

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111619479A (en) * 2020-05-20 2020-09-04 重庆金康赛力斯新能源汽车设计院有限公司 Driving takeover prompting method, device and system, vehicle-mounted controller and storage medium
CN111619479B (en) * 2020-05-20 2022-03-01 重庆金康赛力斯新能源汽车设计院有限公司 Driving takeover prompting method, device and system, vehicle-mounted controller and storage medium
CN111959524A (en) * 2020-08-20 2020-11-20 中国第一汽车股份有限公司 Man-machine interaction control system and method for automatic driving vehicle
CN114162138A (en) * 2020-09-10 2022-03-11 中国移动通信有限公司研究院 Automatic driving mode switching method and device
CN114162138B (en) * 2020-09-10 2023-10-27 中国移动通信有限公司研究院 Automatic driving mode switching method and device
CN114379563A (en) * 2020-10-21 2022-04-22 广州汽车集团股份有限公司 Safe driving control method and system and storage medium
CN114379563B (en) * 2020-10-21 2023-08-08 广州汽车集团股份有限公司 Safe driving control method, system and storage medium thereof
CN114454895A (en) * 2020-11-10 2022-05-10 奥迪股份公司 Method, equipment and system for automatically taking over vehicle

Similar Documents

Publication Publication Date Title
CN110861654A (en) Reminding method, reminding device, vehicle, equipment and storage medium
US9815478B2 (en) Driving assistance system and driving assistance method
Ho et al. Assessing the effectiveness of various auditory cues in capturing a driver's visual attention.
US20180345980A1 (en) Driver monitoring system
US10259464B2 (en) Control for an electronic multi-function apparatus
EP3002740B1 (en) Method and system for avoiding an in-alert driver of a vehicle
Giang et al. Driver engagement in notifications: A comparison of visual-manual interaction between smartwatches and smartphones
CN112036314A (en) Steering wheel hands-off detection method and device, electronic equipment and storage medium
CN109624985B (en) Early warning method and device for preventing fatigue driving
JP2014071628A (en) Drive support system, drive support program, and drive support method
US9035780B2 (en) Apparatus for preventing passive task-related fatigue of driver and method thereof
CN110737330A (en) Method and device for reminding abnormal travel and storage medium
Jarosch et al. The impact of non-driving related tasks on take-over performance in conditionally automated driving–a review of the empirical evidence
CN111993889A (en) Vehicle instrument control method, device, equipment and storage medium
US9618345B2 (en) Method and system for identifying a situation with a potentially in-alert driver
JP2010282368A (en) Driving support device and program
JP7354888B2 (en) Information processing device, program, and information processing method
CN114037981A (en) Fatigue driving warning method, fatigue driving warning device, storage medium and electronic equipment
CN108055401B (en) Elastic frame processing method and device, storage medium and electronic equipment
GB2558671A (en) Communication control apparatus and method
JP2019023806A (en) Information control device
Riener Information injection below conscious awareness: Potential of sensory channels
CN113183971B (en) Driver state monitoring method and device, vehicle-mounted terminal and readable storage medium
CN111783550B (en) Monitoring and adjusting method and system for emotion of driver
Pinotti et al. A model for an innovative Lane Change Assistant HMI

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200306

RJ01 Rejection of invention patent application after publication