CN113147767A - Vehicle running monitoring method, device and system and vehicle - Google Patents
Vehicle running monitoring method, device and system and vehicle Download PDFInfo
- Publication number
- CN113147767A CN113147767A CN202110572629.3A CN202110572629A CN113147767A CN 113147767 A CN113147767 A CN 113147767A CN 202110572629 A CN202110572629 A CN 202110572629A CN 113147767 A CN113147767 A CN 113147767A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- data
- time period
- target time
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 68
- 230000002159 abnormal effect Effects 0.000 claims abstract description 45
- 230000008569 process Effects 0.000 claims abstract description 31
- 230000001133 acceleration Effects 0.000 claims abstract description 11
- 238000004891 communication Methods 0.000 claims description 13
- 238000012806 monitoring device Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013024 troubleshooting Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/02—Ensuring safety in case of control system failures, e.g. by diagnosing, circumventing or fixing failures
- B60W50/0205—Diagnosing or detecting failures; Failure detection models
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W2050/0001—Details of the control system
- B60W2050/0043—Signal treatments, identification of variables or parameters, parameter estimation or state estimation
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a vehicle running monitoring method, device and system and a vehicle. Wherein, the method comprises the following steps: monitoring to obtain video data of the vehicle in a target time period, wherein the vehicle is controlled by adopting an unmanned system; analyzing the video data to obtain the driving data of the vehicle in the target time period, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off; acquiring historical control data of the vehicle in a target time period, wherein the historical control data is data generated by the unmanned system controlling the vehicle in the target time period; and judging whether the vehicle is abnormal in the driving process according to the driving data and the historical control data. The invention solves the technical problem that whether the abnormal condition occurs in the driving process of the vehicle controlled by the unmanned system is difficult to monitor.
Description
Technical Field
The invention relates to the field of unmanned driving, in particular to a vehicle running monitoring method, device and system and a vehicle.
Background
In the field of unmanned driving, when an unmanned driving system is adopted to control a vehicle to run, the accuracy, timeliness and safety of vehicle control are all the vital requirements. Different from other fields, once the unmanned system has problems in controlling the vehicle, the risk of road safety is inevitably caused, and the traffic accident is more serious.
However, if only the method of system-internal self-checking and self-monitoring is adopted for the state of the unmanned system operating vehicle, it is difficult to ensure the robustness of the vehicle operated by the unmanned system. When the unmanned system has a problem, the accuracy of the unmanned system for evaluating the accuracy of the unmanned system for controlling the vehicle becomes unreliable, so that a method for accurately and reliably judging whether an abnormal condition occurs in the driving process of the vehicle controlled by the unmanned system is urgently needed.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a vehicle running monitoring method, a device and a system and a vehicle, which at least solve the technical problem that whether an abnormal condition occurs in the running process of the vehicle controlled by an unmanned system is difficult to monitor.
According to an aspect of an embodiment of the present invention, there is provided a vehicle travel monitoring method including: monitoring to obtain video data of a vehicle running in a target time period, wherein the vehicle is controlled by adopting an unmanned system; analyzing the video data to obtain the driving data of the vehicle in the target time period, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off; acquiring historical manipulation data of the vehicle in the target time period, wherein the historical manipulation data is data generated by the unmanned system manipulating the vehicle in the target time period; and judging whether the vehicle is abnormal in the driving process or not according to the driving data and the historical control data.
Optionally, if it is determined that an abnormal condition occurs during the running of the vehicle, the method further includes: acquiring a hardware fault type corresponding to the abnormal condition; acquiring sensor data of the vehicle, wherein the sensor data is data obtained by monitoring hardware of the vehicle by a sensor, and the hardware is hardware corresponding to the hardware fault type; and analyzing the sensor data and judging whether the hardware has faults.
Optionally, if the hardware does not fail, further comprising: and judging whether the unmanned system of the vehicle breaks down or not based on the driving data, the historical control data and the sensor data.
Optionally, if the unmanned system of the vehicle fails, the method further comprises: determining a system fault type of the unmanned system; and if the system fault type of the unmanned system is any one of the first types, sending a first instruction to the vehicle, wherein the first instruction is used for controlling the vehicle to stop.
Optionally, the method further includes: and if the system fault type of the unmanned system is any one of the second types, sending a second instruction to the vehicle, wherein the second instruction is used for controlling the vehicle to be switched from the operation and control by adopting the unmanned system to manual operation and control.
According to another aspect of the embodiments of the present invention, there is also provided a vehicle driving monitoring method, including: displaying monitoring data on a monitoring interface of a vehicle, wherein the monitoring data is video data for monitoring the vehicle running in a target time period, and the vehicle is controlled by adopting an unmanned system; displaying the driving data of the vehicle analyzed from the video data on the monitoring interface, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off; responding to a calling operation received by the monitoring interface, and acquiring historical control data of the vehicle in the target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period; displaying whether the vehicle has abnormal running conditions in the running process on the monitoring interface, wherein whether the vehicle has the abnormal running conditions is determined according to the running data and the historical control data.
According to still another aspect of the embodiments of the present invention, there is also provided a vehicle travel monitoring apparatus including: the monitoring module is used for monitoring and obtaining video data of a vehicle in a target time period, wherein the vehicle is controlled by an unmanned system; the analysis module is used for analyzing the video data to obtain the driving data of the vehicle in the target time period; the acquisition module is used for acquiring historical control data of the vehicle in the target time period, wherein the historical control data is data generated by the unmanned system controlling the vehicle in the target time period; and the judging module is used for judging whether the vehicle has abnormal conditions in the driving process according to the driving data and the historical control data.
According to still another aspect of the embodiments of the present invention, there is also provided a vehicle travel monitoring system including: the system comprises image acquisition equipment, a processor and communication equipment, wherein the image acquisition equipment is used for monitoring and obtaining video data of a vehicle in a target time period, and the vehicle is controlled by adopting an unmanned system; the communication equipment is used for communicating with vehicle-mounted communication equipment of the vehicle to acquire historical control data of the vehicle in the target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period; the processor is connected with the image acquisition equipment and the communication equipment and is used for analyzing the video data to obtain the driving data of the vehicle in the target time period; the processor is further used for judging whether the vehicle is abnormal in the driving process according to the driving data and the historical control data.
According to still another aspect of the embodiments of the present invention, there is also provided a vehicle including: the unmanned system is used for controlling the vehicle to run; the vehicle-mounted communication equipment is connected with the unmanned system and comprises a sending module and a receiving module, wherein the sending module is used for sending historical control data of the vehicle to a vehicle running monitoring system, and the historical control data is data generated when the unmanned system controls the vehicle in a target time period; the receiving module is used for receiving a first instruction and/or receiving a second instruction, wherein the first instruction is used for controlling the vehicle to stop, and the second instruction is used for controlling the vehicle to be manually controlled by switching the control of the unmanned system.
According to still another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium including a stored program, wherein the apparatus on which the storage medium is located is controlled to execute any one of the above-described vehicle control methods when the program is executed.
In the embodiment of the invention, the video data is obtained by monitoring the video data when the vehicle runs in the target time period, the running data of the vehicle in the target time period is obtained by analyzing the video data, and the historical control data of the vehicle in the target time period is obtained, so that the purpose of judging whether the vehicle is abnormal in the running process according to the running data and the historical control data is achieved, the technical effect of monitoring the running process of the vehicle controlled by the unmanned system is realized, and the technical problem that whether the abnormal condition occurs in the running process of the vehicle controlled by the unmanned system is difficult to monitor is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a schematic flow chart of a first vehicle driving monitoring method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a second vehicle driving monitoring method according to an embodiment of the present invention;
fig. 3 is a block diagram of a first vehicle travel monitoring device according to an embodiment of the present invention;
fig. 4 is a block diagram of a second vehicle travel monitoring device according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
In accordance with an embodiment of the present invention, there is provided an embodiment of a vehicle travel monitoring method, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than presented herein.
Fig. 1 is a schematic flow chart of a first vehicle driving monitoring method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
and S102, monitoring to obtain video data of the vehicle in a target time period, wherein the vehicle is controlled by adopting an unmanned system. Alternatively, an external video data acquisition device may be used to monitor the driving of the vehicle and acquire video data of the driving of the vehicle in real time. For example, the video capture device may be disposed on the road side, above the road, or in other places where the driving state of the vehicle and the state of the road can be completely captured.
Step S104, analyzing the video data to obtain the driving data of the vehicle in the target time period, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off.
And step S106, acquiring historical control data of the vehicle in a target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period. Alternatively, the historical manipulation data may include a manipulation instruction of the vehicle by the unmanned system, for example, a manipulation instruction for controlling the speed, acceleration, steering, or turning on and off of an indicator light of the vehicle.
And step S108, judging whether the vehicle is abnormal in the driving process according to the driving data and the historical control data. Alternatively, the abnormal situation may be an abnormal driving behavior of the vehicle, and may also be a behavior in which an actual running behavior of the vehicle is not in accordance with a manipulation instruction of the unmanned system. For example, when the command of the unmanned system of the vehicle is to instruct the vehicle to accelerate, but the vehicle continues to keep running at a constant speed on the road, it may be determined that an abnormal situation occurs during the running of the vehicle.
Through the steps, the mode of monitoring and obtaining the video data of the vehicle in the running process in the target time period is adopted, the running data of the vehicle in the target time period is obtained through analyzing the video data, the historical control data of the vehicle in the target time period is obtained, and the purpose of judging whether the abnormal condition occurs in the running process of the vehicle according to the running data and the historical control data is achieved, so that the technical effect of monitoring the running process of the vehicle controlled by the unmanned system is achieved, and the technical problem that whether the abnormal condition occurs in the running process of the vehicle controlled by the unmanned system is difficult to monitor is solved.
As an alternative embodiment, if it is determined that an abnormal condition occurs during the running of the vehicle, the hardware fault type corresponding to the abnormal condition may be obtained first; secondly, acquiring sensor data of the vehicle, wherein the sensor data is data obtained by monitoring hardware of the vehicle by a sensor, and the hardware is hardware corresponding to the type of hardware fault; and then analyzing the sensor data and judging whether the hardware has faults.
When an abnormal condition occurs during the running process of the vehicle, according to the alternative embodiment, the hardware condition of the vehicle may be detected first, and specifically, hardware related to the type of the abnormal condition may be detected. Optionally, the hardware fault type corresponding to each abnormal condition and the hardware associated with the corresponding hardware fault type may be set in advance according to the abnormal condition that may occur to the vehicle, so as to directly determine which hardware may be subjected to troubleshooting when the vehicle has the abnormal condition. Alternatively, troubleshooting of the hardware may be achieved by analyzing monitoring data of a sensor for monitoring the hardware.
As an alternative embodiment, if the hardware is not faulty, it may be determined whether the unmanned system of the vehicle is faulty based on the driving data, the historical manipulation data, and the sensor data. When the hardware of the vehicle is not in fault, reasonable guess can be carried out, the unmanned system of the vehicle is likely to be in fault, and abnormal conditions of the vehicle in the driving process are caused. Therefore, it is possible to determine whether the unmanned system of the vehicle is malfunctioning based on the traveling data, the historical manipulation data, and the sensor data. For example, whether the driving behavior of the vehicle when the abnormal condition occurs is consistent with the control command of the unmanned system or not may be detected firstly, and if the driving behavior of the vehicle is inconsistent with the control command of the unmanned system, the control command of the unmanned system is analyzed in sequence by combining the sensor data, and the mismatch between the control command and the hardware action occurs when the control command of the unmanned system controls a part of hardware of the vehicle. Through the analysis process, whether the unmanned system has faults or not can be determined, and the fault reason of the unmanned system can be determined.
As an alternative embodiment, if the unmanned system of the vehicle has a fault, the type of system fault of the unmanned system may also be determined; and if the type of the system fault of the unmanned system is any one of the first types, sending a first instruction to the vehicle, wherein the first instruction is used for controlling the vehicle to stop. Optionally, the fault of the unmanned system may be classified according to the severity of the fault of the unmanned system, so as to obtain a plurality of system fault types. When the first type is a system fault type seriously damaging the running safety of the vehicle, a first instruction for controlling the vehicle to stop can be sent to the vehicle, so that the vehicle can be safely stopped as soon as possible.
As an alternative embodiment, if the type of the system fault of the unmanned system is any one of the second types, a second instruction is sent to the vehicle, wherein the second instruction is used for controlling the vehicle to be switched from the operation of the unmanned system to manual operation. Optionally, when a driver is in the vehicle controlled by the unmanned system, or the vehicle can receive remote control of the driver, a second instruction can be sent to the vehicle, the vehicle can be controlled by the unmanned system to be manually controlled by the second instruction, and then the driver can take over driving control of the vehicle, so that traffic accidents are avoided.
Fig. 2 is a schematic flow chart of a second vehicle driving monitoring method according to an embodiment of the present invention, as shown in fig. 2, the method includes the following steps:
step S202, displaying monitoring data on a monitoring interface of the vehicle, wherein the monitoring data is video data of the monitored vehicle during running in a target time period, and the vehicle is controlled by adopting an unmanned system;
step S204, displaying the driving data of the vehicle analyzed from the video data on a monitoring interface, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off;
step S206, responding to the calling operation received by the monitoring interface, and acquiring historical control data of the vehicle in a target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period;
and step S208, displaying whether the abnormal driving condition occurs in the driving process of the vehicle on the monitoring interface, wherein whether the vehicle is abnormal is determined according to the driving data and the historical control data.
Example 2
According to an embodiment of the present invention, there is also provided a first vehicle travel monitoring device for implementing the vehicle travel monitoring method, and fig. 3 is a block diagram of a first vehicle travel monitoring device according to an embodiment of the present invention, and as shown in fig. 3, the first vehicle travel monitoring device 30 includes: the monitoring module 32, the analyzing module 34, the obtaining module 36 and the judging module 38 are described as follows for the first vehicle driving monitoring device 30.
The monitoring module 32 is used for monitoring and obtaining video data of the vehicle in a target time period, wherein the vehicle is controlled by an unmanned system;
an analysis module 34, connected to the monitoring module 32, for analyzing the video data to obtain the driving data of the vehicle in the target time period;
an obtaining module 36, connected to the analyzing module 34, configured to obtain historical control data of the vehicle in a target time period, where the historical control data is data generated when the unmanned system controls the vehicle in the target time period;
and the judging module 38 is connected to the acquiring module 36, and is configured to judge whether an abnormal condition occurs in the vehicle during the driving process according to the driving data and the historical control data.
It should be noted that the monitoring module 32, the analyzing module 34, the obtaining module 36 and the determining module 38 correspond to steps S102 to S108 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in embodiment 1.
Example 3
According to an embodiment of the present invention, there is also provided a second vehicle travel monitoring device for implementing the vehicle travel monitoring method, fig. 4 is a block diagram of a second vehicle travel monitoring device according to an embodiment of the present invention, and as shown in fig. 4, the second vehicle travel monitoring device 40 includes: a display module 42, a first display module 44, an acquisition module 46 and a second display module 48, which will be described below with respect to the second vehicle travel monitoring device 40.
The display module 42 is configured to display monitoring data on a monitoring interface of the vehicle, where the monitoring data is video data of the monitored vehicle during running in a target time period, and the vehicle is controlled by using an unmanned system;
a first display module 44, connected to the display module 42, for displaying the driving data of the vehicle analyzed from the video data on the monitoring interface, wherein the driving data at least includes one of the following data: speed, acceleration, steering angle, indicator light on and off;
an obtaining module 46, connected to the first displaying module 44, configured to obtain historical control data of the vehicle in a target time period in response to a retrieving operation received by the monitoring interface, where the historical control data is data generated when the unmanned system controls the vehicle in the target time period;
and a second display module 48, connected to the obtaining module 46, for displaying whether the abnormal driving condition occurs during the driving process of the vehicle on the monitoring interface, wherein whether the abnormal driving condition occurs in the vehicle is determined according to the driving data and the historical operating data.
It should be noted that the display module 42, the first display module 44, the obtaining module 46 and the second display module 48 correspond to steps S202 to S208 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1.
Example 4
Embodiments of the present invention also provide a computer-readable storage medium. Alternatively, in this embodiment, the computer-readable storage medium may be used to store the program code executed by the vehicle travel monitoring method provided in embodiment 1.
Optionally, in this embodiment, the computer-readable storage medium may be located in any one of a group of computer terminals in a computer network, or in any one of a group of mobile terminals.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: monitoring to obtain video data of the vehicle in a target time period, wherein the vehicle is controlled by adopting an unmanned system; analyzing the video data to obtain the driving data of the vehicle in the target time period, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off; acquiring historical control data of the vehicle in a target time period, wherein the historical control data is data generated by the unmanned system controlling the vehicle in the target time period; and judging whether the vehicle is abnormal in the driving process according to the driving data and the historical control data.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: if the abnormal condition of the vehicle in the driving process is judged, the method further comprises the following steps: acquiring a hardware fault type corresponding to the abnormal condition; acquiring sensor data of a vehicle, wherein the sensor data is data obtained by monitoring hardware of the vehicle by a sensor, and the hardware is hardware corresponding to a hardware fault type; and analyzing the sensor data and judging whether the hardware has faults.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: if the hardware does not have a fault, the method further comprises the following steps: and judging whether the unmanned system of the vehicle breaks down or not based on the driving data, the historical control data and the sensor data.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: if the unmanned system of the vehicle has a fault, the method further comprises the following steps: determining a system fault type of the unmanned system; and if the type of the system fault of the unmanned system is any one of the first types, sending a first instruction to the vehicle, wherein the first instruction is used for controlling the vehicle to stop.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: and if the system fault type of the unmanned system is any one of the second types, sending a second instruction to the vehicle, wherein the second instruction is used for controlling the vehicle to be switched from the operation and control by the unmanned system to manual operation and control.
Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: displaying monitoring data on a monitoring interface of the vehicle, wherein the monitoring data is video data of the monitored vehicle in a target time period, and the vehicle is controlled by adopting an unmanned system; displaying the driving data of the vehicle analyzed from the video data on a monitoring interface, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off; responding to a calling operation received by a monitoring interface, and acquiring historical control data of the vehicle in a target time period, wherein the historical control data is data generated by the unmanned system controlling the vehicle in the target time period; and displaying whether the abnormal driving condition occurs in the driving process of the vehicle on a monitoring interface, wherein whether the vehicle is abnormal or not is determined according to the driving data and the historical control data.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit may be a division of a logic function, and an actual implementation may have another division, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A vehicle travel monitoring method, characterized by comprising:
monitoring to obtain video data of a vehicle running in a target time period, wherein the vehicle is controlled by adopting an unmanned system;
analyzing the video data to obtain the driving data of the vehicle in the target time period, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off;
acquiring historical manipulation data of the vehicle in the target time period, wherein the historical manipulation data is data generated by the unmanned system manipulating the vehicle in the target time period;
and judging whether the vehicle is abnormal in the driving process or not according to the driving data and the historical control data.
2. The method according to claim 1, wherein if it is determined that an abnormal situation occurs during the traveling of the vehicle, further comprising:
acquiring a hardware fault type corresponding to the abnormal condition;
acquiring sensor data of the vehicle, wherein the sensor data is data obtained by monitoring hardware of the vehicle by a sensor, and the hardware is hardware corresponding to the hardware fault type;
and analyzing the sensor data and judging whether the hardware has faults.
3. The method of claim 2, wherein if the hardware does not fail, further comprising:
and judging whether the unmanned system of the vehicle breaks down or not based on the driving data, the historical control data and the sensor data.
4. The method of claim 3, wherein if the unmanned system of the vehicle fails, further comprising:
determining a system fault type of the unmanned system;
and if the system fault type of the unmanned system is any one of the first types, sending a first instruction to the vehicle, wherein the first instruction is used for controlling the vehicle to stop.
5. The method of claim 4, further comprising:
and if the system fault type of the unmanned system is any one of the second types, sending a second instruction to the vehicle, wherein the second instruction is used for controlling the vehicle to be switched from the operation and control by adopting the unmanned system to manual operation and control.
6. A vehicle travel monitoring method, characterized by comprising:
displaying monitoring data on a monitoring interface of a vehicle, wherein the monitoring data is video data for monitoring the vehicle running in a target time period, and the vehicle is controlled by adopting an unmanned system;
displaying the driving data of the vehicle analyzed from the video data on the monitoring interface, wherein the driving data at least comprises one of the following data: speed, acceleration, steering angle, indicator light on and off;
responding to a calling operation received by the monitoring interface, and acquiring historical control data of the vehicle in the target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period;
displaying whether the vehicle has abnormal running conditions in the running process on the monitoring interface, wherein whether the vehicle has the abnormal running conditions is determined according to the running data and the historical control data.
7. A vehicle travel monitoring device, characterized by comprising:
the monitoring module is used for monitoring and obtaining video data of a vehicle in a target time period, wherein the vehicle is controlled by an unmanned system;
the analysis module is used for analyzing the video data to obtain the driving data of the vehicle in the target time period;
the acquisition module is used for acquiring historical control data of the vehicle in the target time period, wherein the historical control data is data generated by the unmanned system controlling the vehicle in the target time period;
and the judging module is used for judging whether the vehicle has abnormal conditions in the driving process according to the driving data and the historical control data.
8. A vehicle travel monitoring system, comprising: image acquisition equipment, a processor and communication equipment, wherein,
the image acquisition equipment is used for monitoring and obtaining video data of a vehicle in a target time period, wherein the vehicle is controlled by adopting an unmanned system;
the communication equipment is used for communicating with vehicle-mounted communication equipment of the vehicle to acquire historical control data of the vehicle in the target time period, wherein the historical control data is data generated when the unmanned system controls the vehicle in the target time period;
the processor is connected with the image acquisition equipment and the communication equipment and is used for analyzing the video data to obtain the driving data of the vehicle in the target time period; the processor is further used for judging whether the vehicle is abnormal in the driving process according to the driving data and the historical control data.
9. A vehicle, characterized by comprising: unmanned system, vehicle-mounted communication equipment, wherein,
the unmanned system is used for controlling the vehicle to run;
the vehicle-mounted communication equipment is connected with the unmanned system and comprises a sending module and a receiving module, wherein,
the sending module is used for sending historical control data of the vehicle to a vehicle running monitoring system, wherein the historical control data is data generated when the unmanned system controls the vehicle in a target time period;
the receiving module is used for receiving a first instruction and/or receiving a second instruction, wherein the first instruction is used for controlling the vehicle to stop, and the second instruction is used for controlling the vehicle to be manually controlled by switching the control of the unmanned system.
10. A computer-readable storage medium characterized by comprising a stored program, wherein an apparatus in which the storage medium is located is controlled to execute the vehicle control method according to any one of claims 1 to 6 when the program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110572629.3A CN113147767A (en) | 2021-05-25 | 2021-05-25 | Vehicle running monitoring method, device and system and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110572629.3A CN113147767A (en) | 2021-05-25 | 2021-05-25 | Vehicle running monitoring method, device and system and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113147767A true CN113147767A (en) | 2021-07-23 |
Family
ID=76877324
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110572629.3A Pending CN113147767A (en) | 2021-05-25 | 2021-05-25 | Vehicle running monitoring method, device and system and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113147767A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114545812A (en) * | 2021-12-15 | 2022-05-27 | 株式会社Iat | Remote vehicle driving method and system |
| CN114937319A (en) * | 2022-06-02 | 2022-08-23 | 重庆长安汽车股份有限公司 | Vehicle data processing method and device, electronic equipment and medium |
| CN116010854A (en) * | 2023-02-03 | 2023-04-25 | 小米汽车科技有限公司 | Abnormality cause determination method, abnormality cause determination device, electronic device and storage medium |
-
2021
- 2021-05-25 CN CN202110572629.3A patent/CN113147767A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114545812A (en) * | 2021-12-15 | 2022-05-27 | 株式会社Iat | Remote vehicle driving method and system |
| CN114937319A (en) * | 2022-06-02 | 2022-08-23 | 重庆长安汽车股份有限公司 | Vehicle data processing method and device, electronic equipment and medium |
| CN116010854A (en) * | 2023-02-03 | 2023-04-25 | 小米汽车科技有限公司 | Abnormality cause determination method, abnormality cause determination device, electronic device and storage medium |
| CN116010854B (en) * | 2023-02-03 | 2023-10-17 | 小米汽车科技有限公司 | Abnormality cause determination method, abnormality cause determination device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113147767A (en) | Vehicle running monitoring method, device and system and vehicle | |
| CN109387376A (en) | The diagnostic method of vehicle trouble, the diagnostic device of vehicle trouble and server | |
| CN111537916B (en) | Voltage sampling chip power supply ground disconnection fault diagnosis method, device and equipment | |
| CN104991546A (en) | Vehicle state recording method, electronic device and system | |
| KR20160062259A (en) | Method, system and computer readable medium for managing abnormal state of vehicle | |
| KR101803908B1 (en) | Integrated monitoring system and method for error diagnosis of vehicle using isobus and images | |
| CN112512017A (en) | Information processing method and device for remotely monitoring state of intelligent vehicle-mounted networking terminal | |
| CN111142504B (en) | Bus detection device and method | |
| JP2007028411A (en) | Network diagnosis apparatus and method | |
| CN107957719B (en) | Robot and abnormity monitoring method and device thereof | |
| CN110435669B (en) | Vehicle fault prompt information processing method and device and terminal | |
| CN114500834B (en) | Reset method, device, equipment and storage medium of vehicle-mounted panoramic image system | |
| CN113879324B (en) | Intelligent driving vehicle sensor fault processing method and device | |
| JP3997529B2 (en) | Vehicle failure diagnosis method | |
| CN114679569A (en) | Production line visual monitoring method and system based on three-dimensional modeling and storage medium | |
| CN113085861A (en) | Control method and device for automatic driving vehicle and automatic driving vehicle | |
| CN112327814A (en) | Vehicle fault processing method and system | |
| CN114518741A (en) | Monitoring method, monitoring device and monitoring system for automatic driving vehicle | |
| CN111698469B (en) | Visual monitoring method and system for unmanned vehicle | |
| CN115767074A (en) | Camera state detection method and device, vehicle and storage medium | |
| CN115484453B (en) | Self-checking method and device for vehicle-mounted image system, vehicle and storage medium | |
| CN118277011A (en) | Method for displaying vehicle-mounted equipment data and human-computer interaction equipment | |
| CN114876692A (en) | Protection method, device and circuit for starting motor and working machine | |
| CN117125177A (en) | Electric vehicle fault processing method and device, storage medium and electronic device | |
| CN118034234A (en) | Vehicle-cloud-collaborative risk restoration method, storage medium and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |