CN111409646A - Automatic driving control method, system, medium and vehicle-mounted terminal based on multi-mode identification - Google Patents

Automatic driving control method, system, medium and vehicle-mounted terminal based on multi-mode identification Download PDF

Info

Publication number
CN111409646A
CN111409646A CN202010158159.1A CN202010158159A CN111409646A CN 111409646 A CN111409646 A CN 111409646A CN 202010158159 A CN202010158159 A CN 202010158159A CN 111409646 A CN111409646 A CN 111409646A
Authority
CN
China
Prior art keywords
user
control instruction
vehicle
automatic driving
user control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010158159.1A
Other languages
Chinese (zh)
Other versions
CN111409646B (en
Inventor
应宜伦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pateo Connect and Technology Shanghai Corp
Original Assignee
Shanghai Pateo Electronic Equipment Manufacturing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Pateo Electronic Equipment Manufacturing Co Ltd filed Critical Shanghai Pateo Electronic Equipment Manufacturing Co Ltd
Priority to CN202010158159.1A priority Critical patent/CN111409646B/en
Publication of CN111409646A publication Critical patent/CN111409646A/en
Application granted granted Critical
Publication of CN111409646B publication Critical patent/CN111409646B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/0098—Details of control systems ensuring comfort, safety or stability not otherwise provided for
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0001—Details of the control system
    • B60W2050/0043—Signal treatments, identification of variables or parameters, parameter estimation or state estimation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0062—Adapting control system settings
    • B60W2050/0075—Automatic parameter input, automatic initialising or calibrating means
    • B60W2050/0082—Automatic parameter input, automatic initialising or calibrating means for initialising the control system
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The invention provides an automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification; the automatic driving control method based on the multimode recognition comprises the following steps: acquiring a user control instruction sent by a user, and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions comprise gesture instructions and/or voice commands; when the user control instruction belongs to the preset control instruction set, controlling automatic driving of the vehicle according to the user control instruction; the method controls the automatic driving of the vehicle by identifying the user control instruction sent by the user, so that the control mode is simpler, the user operation is convenient, the time spent by the user on controlling the automatic driving vehicle is saved, good use experience is brought to the user, and the safety and the reliability of the user on controlling the automatic driving of the vehicle are ensured.

Description

Automatic driving control method, system, medium and vehicle-mounted terminal based on multi-mode identification
Technical Field
The invention belongs to the field of automatic driving vehicle control, and particularly relates to an automatic driving control method, an automatic driving control system, an automatic driving control medium and a vehicle-mounted terminal based on multi-mode identification.
Background
A Self-driving vehicle (Self-driving car), also called as an unmanned vehicle, a computer-driven vehicle or a wheeled mobile robot, is an intelligent vehicle that realizes unmanned driving through a computer system. With the popularization of the autonomous vehicle, the autonomous vehicle may be used as a taxi or a public transportation, and when a user needs to input a destination while using the autonomous vehicle, the autonomous vehicle generates a driving route based on a current location and the destination and drives according to the generated driving route.
However, the road condition on the driving route is not constant, and when there are many vehicles driving on the road, traffic accidents, temporary parking or lane change, and other sudden problems, it is necessary to drive the vehicle automatically to be able to drive controllably according to the real-time road conditions or user requirements in order to avoid the problems of potential safety hazards, traffic congestion, and the like. At present, the controllability of the existing automatic driving vehicle is poor, automatic driving can only be realized under the control of a computer system generally, and in the automatic driving process, a user needs to manually operate a control interface of the computer system, so that the automatic driving vehicle is not humanized enough, manual operation is complex, the control time can be prolonged, and poor use experience is brought to the user.
Disclosure of Invention
In view of the above drawbacks of the prior art, an object of the present invention is to provide an automatic driving control method, system, medium, and vehicle-mounted terminal based on multi-mode recognition, which can solve the problems of complicated control process and long control time in the prior art when a user manually operates a control interface by recognizing a user control command sent by the user.
To achieve the above and other related objects, the present invention provides an automatic driving control method based on multimode recognition, comprising the steps of: acquiring a user control instruction sent by a user, and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions comprise gesture instructions and/or voice commands; and when the user control instruction belongs to the preset control instruction set, controlling the automatic driving of the vehicle according to the user control instruction.
In an embodiment of the present invention, the method further includes: and when the user control instruction belongs to the preset control instruction set, verifying the automatic driving control authority of the user, and when the verification result is that the vehicle passes, controlling the automatic driving of the vehicle according to the user control instruction.
In an embodiment of the present invention, the manner of verifying the autopilot control authority of the user is as follows: one or a combination of a plurality of modes of face recognition, voiceprint recognition and iris recognition.
In an embodiment of the present invention, the preset control instruction set is obtained based on a cloud server.
In an embodiment of the present invention, the method further includes updating the preset control instruction set based on the cloud server.
In an embodiment of the present invention, the method further includes: and acquiring road condition information around the vehicle, judging the feasibility of the user in automatic driving control on the vehicle based on the road condition information, and controlling the vehicle to automatically drive according to the user control instruction when the feasibility judgment result is feasible.
The invention provides an automatic driving control system based on multimode identification, which comprises an information acquisition module and a driving control module; the information acquisition module is used for acquiring a user control instruction sent by a user and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions comprise gesture instructions and/or voice commands; and the driving control module is used for controlling the automatic driving of the vehicle according to the user control instruction when the user control instruction belongs to the preset control instruction set.
The present invention provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described multimode-recognition-based automatic driving control method.
The present invention provides a vehicle-mounted terminal, including: a processor and a memory; the memory is used for storing a computer program; the processor is used for executing the computer program stored in the memory so as to enable the vehicle-mounted terminal to execute the automatic driving control method based on the multimode identification.
The invention provides an automatic driving control system based on multimode identification, which comprises the vehicle-mounted terminal and a user control instruction acquisition device; the user control instruction acquisition device is used for acquiring a user control instruction sent by a user and sending the user control instruction to the vehicle-mounted terminal; the user control instructions include gesture instructions and/or voice commands.
As described above, the automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification according to the present invention have the following advantages:
(1) the automatic driving control of the vehicle is realized by identifying the user control instruction sent by the user, so that the control mode of the automatic driving vehicle is simpler, the user operation is convenient, the time spent by the user on the control of the automatic driving vehicle is saved, and the good use experience is brought to the user.
(2) The equipment for collecting the user control instruction sent by the user and other equipment in the automatic driving vehicle are separately and independently used, so that the interference of other equipment on the collection result of the user control instruction is avoided, and the safety and reliability of the user on the automatic driving control of the vehicle are ensured.
Drawings
Fig. 1 is a flowchart illustrating an automatic driving control method based on multi-mode recognition according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of an automatic driving control system based on multi-mode recognition according to an embodiment of the present invention.
FIG. 3 is a schematic structural diagram of a vehicle-mounted terminal according to an embodiment of the invention.
Fig. 4 is a schematic structural diagram of an automatic driving control system based on multi-mode recognition according to another embodiment of the present invention.
FIG. 5 is a schematic structural diagram of a vehicle-mounted terminal according to another embodiment of the invention.
Description of the element reference numerals
21 information acquisition module
22 driving control module
31 processor
32 memory
41 vehicle-mounted terminal
42 user control instruction acquisition device
51 processor
52 memory
53 user control instruction acquisition device
S1-S2
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
According to the automatic driving control method, the system, the medium and the vehicle-mounted terminal based on the multimode identification, the automatic driving control of the vehicle is realized by identifying the user control instruction sent by the user, so that the control mode of the automatic driving vehicle is simpler, the user operation is facilitated, the time spent by the user on the automatic driving vehicle control is saved, and good use experience is brought to the user; the equipment for collecting the user control instruction sent by the user and other equipment in the automatic driving vehicle are separately and independently used, so that the interference of other equipment on the collection result of the user control instruction is avoided, and the safety and reliability of the user on the automatic driving control of the vehicle are ensured.
As shown in fig. 1, in an embodiment, the automatic driving control method based on multi-mode recognition of the present invention includes the following steps:
step S1, obtaining a user control instruction sent by a user, and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions include gesture instructions and/or voice commands. .
It should be noted that the preset control instruction set includes all control instructions preset by the user, that is, all control instruction elements form a total preset control instruction set.
Further, in an embodiment of the present invention, only the gesture command sent by the user or only the voice command sent by the user may be obtained, and the gesture command and the voice command sent by the user may also be obtained simultaneously, where control command elements included in the preset control command set corresponding to the three ways are different.
When only gesture instructions issued by the user are acquired, each control instruction element only includes definitions of the gesture instructions, such as: "user's finger pointing forward indicates driving forward", "user's finger pointing backward indicates backing backward", "user's hands cross indicates parking immediately", and so on.
When only voice commands issued by the user are acquired, only voice commands are included in each control instruction element, such as: "drive forward", "reverse backward", "park immediately", and the like.
When the gesture command and the voice command sent by the user are obtained simultaneously, in an embodiment, the preset control command set may include a gesture command diversity and a voice command diversity, where the gesture command diversity includes a preset control command element, and each control command element is only defined for the gesture command, such as: "the user's finger points forward to indicate driving forward", "the user's finger points backward to indicate backing backward", "the user's hands cross to indicate parking immediately", and so on; the voice command diversity includes a preset number of control instruction elements, and each control instruction element only includes voice commands, such as: "drive forward", "reverse backward", "park immediately", and the like. In one embodiment, the predetermined control command set may further include a predetermined number of control command elements, wherein each of the control command elements includes a definition of a gesture command and a voice command, such as: "the user points to the front to indicate forward driving and send out a voice command of forward driving", "the user points to the back to indicate backward reversing and send out a voice command of backward reversing", "the user crosses both hands to indicate immediate parking and send out a voice command of immediate parking", and so on.
It should be noted that, the automatic driving of the vehicle is controlled through two instructions, namely voice and gesture, so that the safety of the user on the automatic driving control of the vehicle is improved, and the operation is safer than that of a single voice or gesture control instruction.
In an embodiment of the present invention, the preset control instruction set is obtained based on a cloud server.
Specifically, a user presets an instruction for controlling automatic driving of the vehicle on the control instruction setting device to form a preset control instruction set, the preset control instruction set is uploaded to the cloud server through the control instruction setting device, and finally, the vehicle-mounted terminal downloads the preset control instruction set from the cloud server to the local.
It should be noted that the user may also directly preset a command for controlling the automatic driving of the vehicle on the in-vehicle terminal.
In an embodiment of the present invention, the method further includes updating the preset control instruction set based on the cloud server.
Specifically, the user can modify, add or delete some instructions for controlling automatic driving of the vehicle on the control instruction setting device to form a new preset control instruction set, and send the new preset control instruction set to the cloud server to update the preset control instruction set.
And step S2, when the user control instruction belongs to the preset control instruction set, controlling the automatic driving of the vehicle according to the user control instruction.
Specifically, when the gesture instruction and/or the voice command are contained in a preset control instruction set and indicate that the gesture instruction and/or the voice command sent by the user meet the requirement of a preset control instruction, the vehicle-mounted terminal may control the vehicle to automatically drive based on the gesture instruction and/or the voice command.
It should be noted that, when the gesture instruction and the voice command sent by the user are simultaneously obtained, and the preset control instruction set includes a gesture instruction diversity and a voice command diversity, it is further necessary to determine whether the vehicle driving operation indicated by the gesture instruction sent by the user is consistent with the vehicle driving operation corresponding to the voice command sent by the user, and only when the vehicle driving operation indicated by the gesture instruction sent by the user is consistent with the vehicle driving operation corresponding to the voice command sent by the user, the vehicle-mounted terminal performs the automatic driving control operation on the vehicle based on the gesture instruction and the voice command.
In an embodiment of the present invention, when the user control command belongs to the preset control command set, verifying the automatic driving control authority of the user, and when the verification result is that the user control command passes, controlling the automatic driving of the vehicle according to the user control command.
Specifically, after a gesture instruction and/or a voice command sent by a user are obtained, the vehicle-mounted terminal verifies the automatic driving control authority of the user, and only when the verification result passes, the vehicle-mounted terminal conducts automatic driving control on the vehicle based on the gesture instruction and/or the voice command.
Further, the user may be a passenger in the vehicle or a pedestrian other than the vehicle.
In an embodiment of the present invention, the verification of the automatic driving control authority of the user is performed by one or a combination of several manners of face recognition, voiceprint recognition and iris recognition.
Specifically, the authorized addition operation of the automatic driving control authority is performed on an appointed user capable of performing automatic driving control on the vehicle in advance (the authorized addition of the automatic driving control authority of the appointed user is realized by associating one or more of face information, voiceprint information and iris information of the appointed user with the automatic driving control authority), and after the user sends a gesture instruction and/or a voice command, the vehicle-mounted terminal respectively collects one or more of the face information, the voiceprint information and the iris information of the user through the combination of one or more of face recognition, voiceprint recognition and iris recognition, so that the verification operation of the automatic driving control authority of the user is realized.
In an embodiment of the present invention, the method further includes acquiring traffic information around the vehicle, determining feasibility of the user in performing automatic driving control on the vehicle based on the traffic information, and controlling the vehicle to perform automatic driving according to the user control instruction when the feasibility determination result is feasible.
Specifically, in the driving process of the vehicle, the road condition information around the vehicle is monitored in real time, so that the feasibility of the user in controlling the driving of the vehicle is judged when the user performs automatic driving control on the vehicle according to the road condition information, and corresponding processing is executed according to the feasibility judgment result. If the feasibility judgment result is feasible, the vehicle automatically drives according to the instruction sent by the gesture instruction and/or the voice command; otherwise, when the feasibility judgment result is that the feasibility judgment result is not feasible, the vehicle does not execute any operation, the driving state of the vehicle before the user sends the gesture command and/or the voice command is kept, and meanwhile, an alarm signal is sent and/or voice interaction is carried out with the user to remind the user and/or execute subsequent operation according to the voice command of the user.
For example, when a user suddenly gives a gesture command and/or a voice command to instruct the vehicle to change lane to the left during the driving of the vehicle, but the vehicle comes behind the left lane and is in a short distance, and the lane change is dangerous, that is, when the feasibility is proved to be unfeasible, the vehicle does not perform any operation (the vehicle driving is not controlled according to the instruction given by the gesture command and/or the voice command); otherwise, when the feasibility judgment result is feasible, the vehicle driving is controlled according to the instruction sent by the gesture instruction and/or the voice command.
Further, in an embodiment of the present invention, based on the road condition information, the feasibility of the vehicle in the normal driving process (that is, the user does not issue the gesture command and/or the voice command in the driving process of the vehicle) is determined, and when the feasibility determination result is not feasible, an alarm signal is issued and/or voice interaction is performed with the user, so as to remind the user and/or perform subsequent operations according to the voice instruction of the user; when the feasibility judgment result is feasible, the vehicle keeps running normally.
It should be noted that the protection scope of the automatic driving control method based on multimode identification according to the present invention is not limited to the execution sequence of the steps listed in the embodiment, and all the solutions implemented by adding, subtracting, and replacing the steps according to the principle of the present invention are included in the protection scope of the present invention.
As shown in fig. 2, in an embodiment, the automatic driving control system based on multi-mode recognition of the present invention includes an information collecting module 21 and a driving control module 22.
The information acquisition module 21 is configured to acquire a user control instruction sent by a user, and determine whether the user control instruction belongs to a preset control instruction set; the user control instructions include gesture instructions and/or voice commands.
The driving control module 22 is configured to control automatic driving of the vehicle according to the user control instruction when the user control instruction belongs to the preset control instruction set.
It should be noted that the structures and principles of the information acquisition module 21 and the driving control module 22 correspond to the steps in the automatic driving control method based on multi-mode recognition one by one, and therefore are not described herein again.
It should be noted that the division of the modules of the above system is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the x module may be a processing element that is set up separately, or may be implemented by being integrated in a chip of the system, or may be stored in a memory of the system in the form of program code, and the function of the x module may be called and executed by a processing element of the system. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
The storage medium of the present invention stores thereon a computer program that, when executed by a processor, implements the above-described automated driving control method based on multimode recognition. The storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic disk, U-disk, memory card, or optical disk.
As shown in fig. 3, the in-vehicle terminal of the present invention includes a processor 31 and a memory 32.
The memory 32 is used for storing computer programs. Preferably, the memory 32 comprises: various media that can store program codes, such as ROM, RAM, magnetic disk, U-disk, memory card, or optical disk.
The processor 31 is connected to the memory 32 and configured to execute the computer program stored in the memory 32, so that the in-vehicle terminal executes the above-mentioned automatic driving control method based on multimode identification.
Preferably, the Processor 31 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; the integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components.
It should be noted that the automatic driving control system based on multimode identification of the present invention can implement the automatic driving control method based on multimode identification of the present invention, but the implementation device of the automatic driving control method based on multimode identification of the present invention includes, but is not limited to, the structure of the automatic driving control system based on multimode identification as illustrated in this embodiment, and all the structural modifications and substitutions of the prior art made according to the principles of the present invention are included in the protection scope of the present invention.
As shown in fig. 4, in an embodiment, the automatic driving control system based on multi-mode recognition of the present invention includes the above-mentioned vehicle-mounted terminal 41 and the user control command collecting device 42.
The user control instruction acquisition device 42 is used for acquiring a user control instruction sent by a user and sending the user control instruction to the vehicle-mounted terminal 41; the user control instructions include gesture instructions and/or voice commands.
The operating principle of the automatic driving control system based on multimode identification is as follows: a user sends a user control instruction, a user control instruction acquisition device 42 acquires the user control instruction and sends the user control instruction to the vehicle-mounted terminal 41, and the vehicle-mounted terminal 41 acquires the user control instruction and judges whether the user control instruction belongs to a preset control instruction set or not based on the user control instruction; when the user control instruction belongs to a preset control instruction set, the vehicle-mounted terminal 41 controls the automatic driving of the vehicle according to the user control instruction.
Further, as shown in fig. 5, in an embodiment of the present invention, the vehicle-mounted terminal may have a function of the user control instruction collecting device 42 for collecting voice and/or gestures, that is, in the embodiment, the vehicle-mounted terminal of the present invention includes a processor 51, a memory 52 and a user control instruction collecting device 53, at this time, the vehicle-mounted terminal may directly collect a user control instruction sent by a user through the user control instruction collecting device 53, and determine whether the user control instruction belongs to a preset control instruction set based on the user control instruction; when the user control instruction belongs to a preset control instruction set, the vehicle-mounted terminal 41 controls the automatic driving of the vehicle according to the user control instruction.
In summary, the automatic driving control method, system, medium and terminal based on multimode identification of the present invention realize automatic driving control of a vehicle by identifying a user control instruction sent by a user, so that the control mode of the automatic driving vehicle is simpler, the user operation is facilitated, the time spent by the user in controlling the automatic driving vehicle is saved, and good use experience is brought to the user; the equipment for collecting the user control instruction sent by the user and other equipment in the automatic driving vehicle are separately and independently used, so that the interference of other equipment on the collection result of the user control instruction is avoided, and the safety and reliability of the user on the automatic driving control of the vehicle are ensured. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (10)

1. An automatic driving control method based on multimode recognition is characterized by comprising the following steps:
acquiring a user control instruction sent by a user, and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions comprise gesture instructions and/or voice commands;
and when the user control instruction belongs to the preset control instruction set, controlling the automatic driving of the vehicle according to the user control instruction.
2. The multimode identification based automatic driving control method according to claim 1, further comprising:
and when the user control instruction belongs to the preset control instruction set, verifying the automatic driving control authority of the user, and when the verification result is that the vehicle passes, controlling the automatic driving of the vehicle according to the user control instruction.
3. The multimode identification based autonomous driving control method of claim 2, wherein the manner of verifying the autonomous driving control authority of the user is:
one or a combination of a plurality of modes of face recognition, voiceprint recognition and iris recognition.
4. The multimode-recognition-based automatic driving control method according to claim 1, wherein the preset control instruction set is obtained based on a cloud server.
5. The multi-mode recognition based automatic driving control method according to claim 4, further comprising updating the preset control instruction set based on the cloud server.
6. The multimode identification based automatic driving control method according to claim 1, further comprising:
and acquiring road condition information around the vehicle, judging the feasibility of the user in automatic driving control on the vehicle based on the road condition information, and controlling the vehicle to automatically drive according to the user control instruction when the feasibility judgment result is feasible.
7. An automatic driving control system based on multi-mode identification is characterized by comprising an information acquisition module and a driving control module;
the information acquisition module is used for acquiring a user control instruction sent by a user and judging whether the user control instruction belongs to a preset control instruction set; the user control instructions comprise gesture instructions and/or voice commands;
and the driving control module is used for controlling the automatic driving of the vehicle according to the user control instruction when the user control instruction belongs to the preset control instruction set.
8. A storage medium having stored thereon a computer program, characterized in that the computer program, when being executed by a processor, implements the multimode identification based autopilot control method of any one of claims 1 to 6.
9. A vehicle-mounted terminal characterized by comprising: a processor and a memory;
the memory is used for storing a computer program;
the processor is used for executing the computer program stored by the memory to enable the vehicle-mounted terminal to execute the automatic driving control method based on multimode identification in any one of claims 1 to 6.
10. An automatic driving control system based on multimode identification, which is characterized by comprising the vehicle-mounted terminal and a user control instruction acquisition device of claim 9;
the user control instruction acquisition device is used for acquiring a user control instruction sent by a user and sending the user control instruction to the vehicle-mounted terminal; the user control instructions include gesture instructions and/or voice commands.
CN202010158159.1A 2020-03-09 2020-03-09 Automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification Active CN111409646B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010158159.1A CN111409646B (en) 2020-03-09 2020-03-09 Automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010158159.1A CN111409646B (en) 2020-03-09 2020-03-09 Automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification

Publications (2)

Publication Number Publication Date
CN111409646A true CN111409646A (en) 2020-07-14
CN111409646B CN111409646B (en) 2023-06-13

Family

ID=71489109

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010158159.1A Active CN111409646B (en) 2020-03-09 2020-03-09 Automatic driving control method, system, medium and vehicle-mounted terminal based on multimode identification

Country Status (1)

Country Link
CN (1) CN111409646B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114103988A (en) * 2020-08-31 2022-03-01 奥迪股份公司 Safety monitoring device, vehicle comprising same, and corresponding method, equipment and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106527431A (en) * 2016-10-28 2017-03-22 百度在线网络技术（北京）有限公司 Automatic driving method and device for transportation media
CN106891895A (en) * 2017-03-22 2017-06-27 北京图森未来科技有限公司 A kind of control method for vehicle and device
JP2017121865A (en) * 2016-01-07 2017-07-13 トヨタ自動車株式会社 Automatic drive vehicle
CN109144040A (en) * 2017-06-16 2019-01-04 纵目科技（上海）股份有限公司 System controls the method and system of vehicle by identification control information
CN109703567A (en) * 2019-01-25 2019-05-03 安徽酷哇机器人有限公司 Control method for vehicle
CN209290349U (en) * 2018-12-06 2019-08-23 重庆工程职业技术学院 A kind of autonomous driving vehicle member identities automatic identification equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017121865A (en) * 2016-01-07 2017-07-13 トヨタ自動車株式会社 Automatic drive vehicle
CN106527431A (en) * 2016-10-28 2017-03-22 百度在线网络技术（北京）有限公司 Automatic driving method and device for transportation media
CN106891895A (en) * 2017-03-22 2017-06-27 北京图森未来科技有限公司 A kind of control method for vehicle and device
CN109144040A (en) * 2017-06-16 2019-01-04 纵目科技（上海）股份有限公司 System controls the method and system of vehicle by identification control information
CN209290349U (en) * 2018-12-06 2019-08-23 重庆工程职业技术学院 A kind of autonomous driving vehicle member identities automatic identification equipment
CN109703567A (en) * 2019-01-25 2019-05-03 安徽酷哇机器人有限公司 Control method for vehicle

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114103988A (en) * 2020-08-31 2022-03-01 奥迪股份公司 Safety monitoring device, vehicle comprising same, and corresponding method, equipment and medium
CN114103988B (en) * 2020-08-31 2024-04-19 奥迪股份公司 Safety monitoring device, vehicle comprising same, and corresponding method, device and medium

Also Published As

Publication number Publication date
CN111409646B (en) 2023-06-13

Similar Documents

Publication Publication Date Title
US11724700B2 (en) Intelligent driving method and intelligent driving system
CN107792057B (en) Licensing for partially autonomous vehicle operation
CN110979314A (en) Autonomous passenger-riding parking method, vehicle-mounted equipment and storage medium
CN109709966B (en) Control method and device for unmanned vehicle
US20240001930A1 (en) Intelligent Driving Method and Intelligent Driving System
CN112124148B (en) AGV trolley charging method, device, equipment and storage medium
CN113479195A (en) Method for automatic valet parking and system for carrying out said method
CN112230656A (en) Automatic driving method for park vehicle, system, client and storage medium thereof
CN110969893A (en) Vehicle autonomous passenger-replacing parking method, vehicle-mounted equipment and storage medium
WO2021213325A1 (en) Cruise control method and system, and vehicle
CN110942665A (en) Vehicle positioning method, vehicle-mounted equipment and storage medium
CN111942384B (en) Vehicle low-speed automatic cruise method, client and vehicle low-speed automatic cruise system
WO2023226733A1 (en) Vehicle scene data acquisition method and apparatus, storage medium and electronic device
CN110606070A (en) Intelligent driving vehicle and braking method thereof, vehicle-mounted equipment and storage medium
CN112363511A (en) Vehicle path planning method and device, vehicle-mounted device and storage medium
CN114228743A (en) Unmanned logistics vehicle control method, device and system and readable storage medium
CN111409646A (en) Automatic driving control method, system, medium and vehicle-mounted terminal based on multi-mode identification
CN110648547A (en) Transport infrastructure communication and control
CN111986413A (en) Interaction method, device, system and computer readable storage medium
CN110942651B (en) Vehicle failure processing method, vehicle-mounted equipment and storage medium
CN111824170B (en) Method, system, device and electronic equipment for obtaining vehicle performance information
CN114228702A (en) Passenger-riding parking method and device, storage medium and vehicle
CN112950981A (en) Parking space-based vehicle searching method and device
JP2021149700A (en) Software rewriting apparatus
CN111063214A (en) Vehicle positioning method, vehicle-mounted equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
CB03 Change of inventor or designer information
CB03 Change of inventor or designer information

Inventor after: Ying Zhenkai

Inventor before: Ying Yilun

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 201822 No.208, building 4, no.1411, Yecheng Road, Jiading Industrial Zone, Jiading District, Shanghai

Applicant after: Botai vehicle networking technology (Shanghai) Co.,Ltd.

Address before: 201822 No.208, building 4, no.1411, Yecheng Road, Jiading Industrial Zone, Jiading District, Shanghai

Applicant before: SHANGHAI PATEO ELECTRONIC EQUIPMENT MANUFACTURING Co.,Ltd.

GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: Room 3701, No. 866 East Changzhi Road, Hongkou District, Shanghai, 200080

Patentee after: Botai vehicle networking technology (Shanghai) Co.,Ltd.

Country or region after: China

Address before: 201822 No.208, building 4, no.1411, Yecheng Road, Jiading Industrial Zone, Jiading District, Shanghai

Patentee before: Botai vehicle networking technology (Shanghai) Co.,Ltd.

Country or region before: China