CN117156473A - Internet of vehicles data quality monitoring method and system - Google Patents
Internet of vehicles data quality monitoring method and system Download PDFInfo
- Publication number
- CN117156473A CN117156473A CN202311113803.3A CN202311113803A CN117156473A CN 117156473 A CN117156473 A CN 117156473A CN 202311113803 A CN202311113803 A CN 202311113803A CN 117156473 A CN117156473 A CN 117156473A
- Authority
- CN
- China
- Prior art keywords
- data
- internet
- vehicles
- information
- abnormal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000002159 abnormal effect Effects 0.000 claims abstract description 124
- 238000012545 processing Methods 0.000 claims abstract description 69
- 238000004891 communication Methods 0.000 claims abstract description 51
- 230000005540 biological transmission Effects 0.000 claims abstract description 50
- 230000005856 abnormality Effects 0.000 claims abstract description 18
- 230000006855 networking Effects 0.000 claims abstract description 17
- 238000004458 analytical method Methods 0.000 claims description 18
- 238000012821 model calculation Methods 0.000 claims description 7
- 238000007405 data analysis Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 11
- 238000011156 evaluation Methods 0.000 description 8
- 230000006978 adaptation Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/04—Arrangements for maintaining operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/40—Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Maintenance And Management Of Digital Transmission (AREA)
Abstract
The application discloses a method and a system for monitoring the quality of internet of vehicles data, which relate to the technical field of automobile data processing and comprise the steps of collecting the internet of vehicles data output by communication equipment at a vehicle body end, and checking the internet of vehicles data to obtain abnormal information at a data source end; monitoring a transmission link between the communication equipment and the Internet of vehicles platform to obtain link abnormality information; monitoring a service module in the Internet of vehicles platform for processing Internet of vehicles data to obtain server side abnormal information; the service module is used for processing the internet of vehicles data to obtain processed data; when the processing data output by the Internet of vehicles platform is abnormal, analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information to obtain fault information causing the processing data to be abnormal. According to the application, full-link monitoring can be realized by respectively monitoring the vehicle body end, the data transmission link and the platform server, so that when the vehicle networking data are abnormal after final processing, the fault cause can be rapidly and accurately positioned.
Description
Technical Field
The application relates to the technical field of automobile data processing, in particular to an Internet of vehicles data quality monitoring method and system.
Background
The vehicle networking system is a vehicle-mounted terminal device installed on a vehicle instrument desk, and is used for collecting, storing and transmitting all working conditions outside the vehicle, so that real-time information interaction among vehicles and between vehicles and road side infrastructure can be realized, the current state is informed, the current road environment information is obtained, and therefore the conditions of road danger are cooperatively perceived, various collision early warning information is timely provided, and road traffic accidents are prevented. The vehicle-mounted terminal equipment is an important component in a vehicle networking system and is responsible for collecting vehicle networking data, wherein the vehicle networking data specifically refers to data information such as vehicle running states, fuel consumption states and the like by using a vehicle-mounted data acquisition system such as an image acquisition system, a sensor and the like; the processing of the collected data mainly depends on a background data processing system.
The cloud platform can monitor the abnormal state of the vehicle, such as early warning and monitoring on whether the vehicle has thermal runaway or not by utilizing the vehicle state carstatus (1 represents running, 2 represents power-down), the charging state charge status (1 represents charging and other states represent non-charging) and the terminal time (terminal time) in the data. Therefore, the data analysis result of the cloud platform can be seriously influenced by the quality of the data transmission between the Internet of vehicles equipment and the cloud platform. The data returned by the new energy automobile mainly has two problems: firstly, the data returned by the new energy automobile is missing, and the platform cannot analyze and use the data because the data is incomplete; secondly, the real-time performance of the data returned by the new energy automobile is not high, and the data returned is not the data within a certain time range at the current moment, so that when the cloud platform performs function early warning by utilizing the data, the real-time dependence on the data is high, and the early warning function of the cloud service platform is adversely affected by the data delay. Therefore, the quality of data transmission of the internet of vehicles equipment is very important to monitor.
The first prior art provides a method and a device for evaluating data transmission quality of internet of vehicles equipment, wherein the method comprises the following steps: selecting at least two evaluation areas and uploading all vehicles to be evaluated with preset type data from each evaluation area within a preset time length; reading preset type data uploaded from each evaluation area by all vehicles to be evaluated within a preset time length; based on preset type data uploaded by each vehicle to be evaluated from each evaluation area within a preset time length, respectively determining the data quality index of each vehicle to be evaluated; wherein, an evaluation area and a vehicle to be evaluated correspond to a data quality index; based on a plurality of data quality indexes corresponding to each evaluation area, respectively extracting at least one target vehicle of which the data quality indexes do not meet a first preset requirement from all vehicles to be evaluated corresponding to each evaluation area; and screening out target vehicles with VIN code repetition from all the target vehicles, and regarding the target vehicles as fault vehicles with poor data transmission quality of the Internet of vehicles.
In the second prior art, a data quality monitoring method and device based on an electric automobile service platform are provided, and analysis is performed on a plurality of indexes of accuracy, reliability and timeliness of data quality of electric automobile charging equipment, so that an electric automobile data quality overall evaluation method is established, and operation and maintenance personnel are informed in time, and analysis and treatment of problems are performed on equipment, stations and the like with frequent problems of data quality.
The existing technology still has the disadvantage that the monitoring of the data quality is rarely considered from the full link, and the technical scheme for respectively monitoring the vehicle body end, the data transmission link and the platform service end is lacking, so that the current establishment of the data quality index of the internet of vehicles cannot intuitively reflect the factors influencing the data quality, and the investigation and analysis of the factors causing the abnormality of the data of the internet of vehicles are inconvenient.
Disclosure of Invention
Aiming at the defects in the prior art, the application aims to provide the method and the system for monitoring the quality of the data of the Internet of vehicles, which can realize full-link monitoring by respectively monitoring a vehicle body end, a data transmission link and a platform service end, thereby rapidly and accurately positioning the failure cause when the data of the Internet of vehicles is abnormal after final processing.
In order to achieve the above purpose, the technical scheme adopted is as follows:
the first aspect of the application provides a method for monitoring the quality of internet of vehicles data, which comprises the following steps:
collecting vehicle networking data output by communication equipment of a vehicle body end, and checking the vehicle networking data according to a vehicle networking data standard to obtain abnormal information of a data source end;
monitoring a transmission link between the communication equipment and the Internet of vehicles platform to obtain link abnormality information;
monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform to obtain server side abnormal information; the service module is used for processing the internet of vehicles data to obtain processed data;
when the processing data output by the Internet of vehicles platform is abnormal, analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information to obtain fault information causing the processing data to be abnormal.
In some embodiments, the body side includes a plurality of functional domains, each functional domain including a plurality of components, each component generating and outputting at least one internet of vehicles data; the method is characterized in that the data of the Internet of vehicles of each functional domain are respectively collected, and the data source end abnormal information of each functional domain is obtained by respectively checking the Internet of vehicles of each functional domain.
In some embodiments, the link anomaly information includes IP connection platform failure anomaly information for the communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
In some embodiments, the link anomaly information includes gateway receive service information, message queue access information, data resolution service information, and data warehouse entry service information for the internet of vehicles platform.
In some embodiments, the server side exception information includes data processing service information and model calculation service information.
An internet of vehicles data quality monitoring system, comprising:
the data source end analysis module is used for collecting the internet of vehicles data output by the communication equipment of the vehicle body end and checking the internet of vehicles data according to the internet of vehicles data standard to obtain abnormal information of the data source end;
the transmission link analysis module is used for monitoring a transmission link between the communication equipment and the internet of vehicles platform to obtain link abnormality information;
the server analysis module is used for monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform so as to obtain server abnormal information; the service module is used for processing the internet of vehicles data to obtain processed data;
and the data quality monitoring module is used for analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information when the processed data output by the Internet of vehicles platform is abnormal, so as to obtain fault information causing the processed data to be abnormal.
In some embodiments, the body side includes a plurality of functional domains, each functional domain including a plurality of components, each component generating and outputting at least one internet of vehicles data; the method is characterized in that the data of the Internet of vehicles of each functional domain are respectively collected, and the data source end abnormal information of each functional domain is obtained by respectively checking the Internet of vehicles of each functional domain.
In some embodiments, the link anomaly information includes IP connection platform failure anomaly information for the communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
In some embodiments, the link anomaly information includes gateway receive service information, message queue access information, data resolution service information, and data warehouse entry service information for the internet of vehicles platform.
In some embodiments, the server side exception information includes data processing service information and model calculation service information.
The technical scheme provided by the application has the beneficial effects that:
the vehicle body end, the data transmission link and the platform server end are respectively monitored to realize full-link monitoring, so that when the vehicle networking data are abnormal after final processing, the fault cause is rapidly and accurately positioned.
Drawings
Fig. 1 is a flowchart of a method for monitoring internet of vehicles data quality in an embodiment of the present application.
Fig. 2 is a schematic diagram of functional modules of a data quality monitoring system for internet of vehicles in an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the accompanying drawings and examples.
As shown in fig. 1, an embodiment of the present application provides a method for monitoring quality of internet of vehicles data, including: and acquiring the Internet of vehicles data output by the communication equipment of the vehicle body end, and checking the Internet of vehicles data according to the Internet of vehicles data standard to obtain the abnormal information of the data source end. And monitoring a transmission link between the communication equipment and the Internet of vehicles platform to obtain link abnormality information. And monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform to obtain server side abnormal information. The service module is used for processing the internet of vehicles data to obtain processed data. When the processing data output by the Internet of vehicles platform is abnormal, analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information to obtain fault information causing the processing data to be abnormal. According to the application, full-link monitoring can be realized by respectively monitoring the vehicle body end, the data transmission link and the platform server, so that when the vehicle networking data are abnormal after final processing, the fault cause can be rapidly and accurately positioned.
In a specific embodiment, the method for monitoring the quality of internet of vehicles data includes:
s1, acquiring the Internet of vehicles data output by the communication equipment of the vehicle body end, and checking the Internet of vehicles data according to the Internet of vehicles data standard to obtain the abnormal information of the data source end. And monitoring a transmission link between the communication equipment and the Internet of vehicles platform to obtain link abnormality information. And monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform to obtain server side abnormal information. The service module is used for processing the internet of vehicles data to obtain processed data.
And S2, when the processed data output by the Internet of vehicles platform is abnormal, analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information to obtain fault information causing the processed data to be abnormal.
In the embodiment, the method and the device are used for monitoring the full link of the data transmission processing of the internet of vehicles, so that the reason that the final processing data fails can be rapidly positioned and analyzed, a new index is derived for the establishment of the quality index of the data of the internet of vehicles, and label support is provided for the quality portrait of the data of the internet of vehicles.
In a preferred embodiment, the body end includes a plurality of functional domains, each of the functional domains including a plurality of components, each of the components generating and outputting at least one of the internet of vehicles data. The method is used for respectively collecting the internet of vehicles data of each functional domain, and respectively carrying out the verification on the internet of vehicles of each functional domain to obtain the abnormal information of the data source end of each functional domain.
In the present embodiment, the whole vehicle is generally classified into a power domain (safety), a chassis domain (vehicle movement), a cabin domain/intelligent information domain (entertainment information), an autopilot domain (assisted driving), and a body domain (body electronics).
For example, the power domain includes an engine and a gearbox, wherein the two kinds of internet of vehicles data (or signal parameters) associated with the engine that can be output by the controller of the power domain are the engine speed and the actual torque percentage of the engine, respectively, and the two kinds of internet of vehicles data (or signal parameters) associated with the gearbox that can be output by the controller of the power domain are the current gear and the gearbox mode, respectively.
The vehicle networking data standard comprises a theoretical value range and a theoretical frequency for each signal parameter, the actual value range and the actual frequency of the signal parameter output by the power domain controller are respectively compared with the theoretical value range and the theoretical frequency, if the comparison does not exceed the range or the comparison is always performed, the signal parameter is normal, and if the comparison exceeds the range or the comparison is inconsistent, the signal parameter is abnormal.
Examples of data source quality monitoring and comparison results are shown in table 1 below:
table 1 data source quality monitoring and comparison results example table
The abnormal type and the abnormal occurrence time of the abnormal signal parameters are recorded as the abnormal information of the data source end, so that when the processing data processed according to the data of the Internet of vehicles is abnormal, the factors which cause the final processing result to be abnormal can be conveniently reversely checked.
Examples of data source quality monitoring output anomalies are shown in table 2 below:
table 2 data source quality monitoring output exception results example table
The communication equipment collects data sources from controllers in different domains of the vehicle, relevant parameters of output signals of the controllers are counted according to different domains, theoretical values and theoretical ranges in a signal standard table are compared, abnormal conditions are recorded, pertinence to the different domains of the vehicle can be improved, and fault positioning and searching efficiency is improved.
In a preferred embodiment, the link anomaly information includes IP connection platform failure anomaly information for the communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
In this embodiment, the abnormal state and occurrence time of the communication device affecting the data transmission of the internet of vehicles are recorded and counted for the communication device, including failure abnormality of the IP connection platform, service abnormality of the operator, communication module failure, and SIM card failure, and result output is performed according to different terminal numbers of the communication device and different software versions of the communication device. Examples of abnormal output results of the communication terminal in the data transmission link are shown in the following table 3:
table 3 example table of abnormal output results of communication terminals in data transmission link
In a preferred embodiment, the link anomaly information includes gateway receiving service information, message queue access information, data parsing service information, and data warehousing service information for the internet of vehicles platform.
In this embodiment, the abnormal state and occurrence time of the communication device affecting the data transmission of the internet of vehicles are recorded and counted for the internet of vehicles platform, and the abnormal state and occurrence time includes related anomalies of gateway receiving service, message queue access, data analyzing service and data warehousing service. Examples of platform service exception output results in a data transmission link are shown in table 4 below:
| exception event name | Service name | Time of occurrence |
| Gateway receiving service | Service-1 | 2023-7-12 3：16：24 |
| Message queue access | Service-2 | 2023-7-12 4：56：24 |
| Data resolution service | Service-3 | 2023-7-12 5：36：24 |
| Data warehouse entry service | Service-4 | 2023-7-12 6：26：24 |
Table 4 example table of platform service exception output results in data transmission links
In a preferred embodiment, the server side exception information includes data processing service information and model calculation service information.
In this embodiment, the service and occurrence time that affect the data processing and cause the output result to be abnormal are recorded and counted, including the data processing service and the model calculation service, and output according to different services of the platform. Examples of data processing monitoring and results output are shown in table 5 below:
| exception event name | Service name | Time of occurrence |
| Data processing service | Service-A | 2023-7-12 2：56：24 |
| Model computing service | Service-B | 2023-7-12 3：56：24 |
Table 5 data processing monitoring and results output example table
In a preferred embodiment, off-line statistics is performed according to the day, and for the output result of the data source quality monitoring, the total number of anomalies in which the actual value of the signal parameter is not in the range is counted, and the total number of anomalies in which the actual frequency of the signal is inconsistent with the theoretical frequency is summed up to be the total number of anomalies of the data source. And counting the total number of abnormal events of different communication terminal numbers and different versions and the total number of different service abnormal events of the platform according to the output result of the data transmission link monitoring, and summing the total number of the abnormal events to be the total number of the data transmission link. And counting the total times of different service abnormal events of the platform according to the output result of the data processing process monitoring, and summing the total times as the total times of the data processing process abnormal events. Examples of data quality monitoring metrics are shown in table 6 below:
then, the example of the XX year XX month XX day data quality monitoring statistics is shown in table 7 below:
| problem attribution | Total number of anomalies |
| Data source | 2 |
| Data transmission link | 4 |
| Data processing process | 5 |
Table 7 example of data quality monitoring statistics for XX month XX day
In this embodiment, based on the time dimension, the data source quality index, the data transmission link quality index and the data processing process quality index result are displayed on the interface according to the day, the week and the month, if an abnormality of a certain link is found, the service personnel can check the detail data in time through alarm reminding, and specific abnormal conditions are tracked.
Based on the data quality monitoring on the three aspects of data source, data transmission link and data processing process, index definition and creation are respectively carried out, the service is helped to more intuitively and rapidly find out the data quality problem, improvement suggestions are formulated in time, the data quality of the Internet of vehicles is improved, new indexes can be derived based on the indexes, and label support is provided for the quality representation of the data of the Internet of vehicles.
Based on the data source quality monitoring, different controllers are classified, abnormal conditions and occurrence time after theoretical values and actual values of all signals are compared are recorded and uploaded to a platform, and specific data source problems are identified more clearly.
Based on the monitoring of the data transmission link, recording and counting abnormal states and occurrence time affecting data transmission aiming at the communication equipment and the Internet of vehicles platform respectively, and generating a data transmission link quality index.
Based on monitoring the data processing process, recording and counting abnormal service states and frequencies affecting the data processing to cause abnormal output results, and generating the quality index of the data processing process.
Based on time dimension, displaying the index results on an interface according to days, weeks and months, if an abnormality of a certain link is found, reminding through an alarm, timely checking detailed data by service personnel, and tracking specific abnormal conditions
Fig. 2 shows that the application provides a system for monitoring data quality of internet of vehicles, which comprises a data source end analysis module, a transmission link analysis module, a server end analysis module and a data quality monitoring module. The data source end analysis module is used for collecting the internet of vehicles data output by the communication equipment of the vehicle body end and verifying the internet of vehicles data according to the internet of vehicles data standard to obtain the abnormal information of the data source end. The transmission link analysis module is used for monitoring a transmission link between the communication equipment and the Internet of vehicles platform so as to obtain link abnormality information. The server analysis module is used for monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform so as to obtain server abnormal information. The service module is used for processing the internet of vehicles data to obtain processed data. The data quality monitoring module is used for analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information when the processed data output by the Internet of vehicles platform is abnormal, so as to obtain fault information which causes the processed data to be abnormal. According to the application, full-link monitoring can be realized by respectively monitoring the vehicle body end, the data transmission link and the platform server, so that when the vehicle networking data are abnormal after final processing, the fault cause can be rapidly and accurately positioned.
In a specific embodiment, the above-mentioned internet of vehicles data quality monitoring system includes:
the data source end analysis module is used for collecting the internet of vehicles data output by the communication equipment of the vehicle body end and verifying the internet of vehicles data according to the internet of vehicles data standard to obtain the abnormal information of the data source end.
The transmission link analysis module is used for monitoring a transmission link between the communication equipment and the Internet of vehicles platform so as to obtain link abnormality information.
The server analysis module is used for monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform so as to obtain server abnormal information.
The service module is used for processing the internet of vehicles data to obtain processed data. The data quality monitoring module is used for analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information when the processed data output by the Internet of vehicles platform is abnormal, so as to obtain fault information which causes the processed data to be abnormal.
According to the application, full-link monitoring can be realized by respectively monitoring the vehicle body end, the data transmission link and the platform server, so that when the vehicle networking data are abnormal after final processing, the fault cause can be rapidly and accurately positioned.
In the embodiment, the method and the device are used for monitoring the full link of the data transmission processing of the internet of vehicles, so that the reason that the final processing data fails can be rapidly positioned and analyzed, a new index is derived for the establishment of the quality index of the data of the internet of vehicles, and label support is provided for the quality portrait of the data of the internet of vehicles.
In a preferred embodiment, the body end includes a plurality of functional domains, each of the functional domains including a plurality of components, each of the components generating and outputting at least one of the internet of vehicles data. The method is used for respectively collecting the internet of vehicles data of each functional domain, and respectively carrying out the verification on the internet of vehicles of each functional domain to obtain the abnormal information of the data source end of each functional domain.
In the present embodiment, the whole vehicle is generally classified into a power domain (safety), a chassis domain (vehicle movement), a cabin domain/intelligent information domain (entertainment information), an autopilot domain (assisted driving), and a body domain (body electronics).
For example, the power domain includes an engine and a gearbox, wherein the two kinds of internet of vehicles data (or signal parameters) associated with the engine that can be output by the controller of the power domain are the engine speed and the actual torque percentage of the engine, respectively, and the two kinds of internet of vehicles data (or signal parameters) associated with the gearbox that can be output by the controller of the power domain are the current gear and the gearbox mode, respectively.
The vehicle networking data standard comprises a theoretical value range and a theoretical frequency for each signal parameter, the actual value range and the actual frequency of the signal parameter output by the power domain controller are respectively compared with the theoretical value range and the theoretical frequency, if the comparison does not exceed the range or the comparison is always performed, the signal parameter is normal, and if the comparison exceeds the range or the comparison is inconsistent, the signal parameter is abnormal.
The abnormal type and the abnormal occurrence time of the abnormal signal parameters are recorded as the abnormal information of the data source end, so that when the processing data processed according to the data of the Internet of vehicles is abnormal, the factors which cause the final processing result to be abnormal can be conveniently reversely checked.
The communication equipment collects data sources from controllers in different domains of the vehicle, relevant parameters of output signals of the controllers are counted according to different domains, theoretical values and theoretical ranges in a signal standard table are compared, abnormal conditions are recorded, pertinence to the different domains of the vehicle can be improved, and fault positioning and searching efficiency is improved.
In a preferred embodiment, the link anomaly information includes IP connection platform failure anomaly information for the communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
In this embodiment, the abnormal state and occurrence time of the communication device affecting the data transmission of the internet of vehicles are recorded and counted for the communication device, including failure abnormality of the IP connection platform, service abnormality of the operator, communication module failure, and SIM card failure, and result output is performed according to different terminal numbers of the communication device and different software versions of the communication device.
In a preferred embodiment, the link anomaly information includes gateway receiving service information, message queue access information, data parsing service information, and data warehousing service information for the internet of vehicles platform.
In this embodiment, the abnormal state and occurrence time of the communication device affecting the data transmission of the internet of vehicles are recorded and counted for the internet of vehicles platform, and the abnormal state and occurrence time includes related anomalies of gateway receiving service, message queue access, data analyzing service and data warehousing service.
The data transmission link monitoring module comprises two parts, wherein one part is realized by the communication equipment, the abnormal state and the frequency of the communication equipment affecting the data transmission are recorded and counted, the abnormal state is stored locally, and when the abnormal state is recovered, the abnormal state is uploaded to the Internet of vehicles platform according to a set protocol and a period. And the other part is realized by the internet of vehicles platform, the abnormal state and frequency of the internet of vehicles platform end affecting data transmission are recorded and counted, and the result is synchronized to the internet of vehicles platform.
In a preferred embodiment, the server side exception information includes data processing service information and model calculation service information.
In this embodiment, the service and occurrence time that affect the data processing and cause the output result to be abnormal are recorded and counted, including the data processing service and the model calculation service, and output according to different services of the platform.
In a preferred embodiment, off-line statistics is performed according to the day, and for the output result of the data source quality monitoring, the total number of anomalies in which the actual value of the signal parameter is not in the range is counted, and the total number of anomalies in which the actual frequency of the signal is inconsistent with the theoretical frequency is summed up to be the total number of anomalies of the data source. And counting the total number of abnormal events of different communication terminal numbers and different versions and the total number of different service abnormal events of the platform according to the output result of the data transmission link monitoring, and summing the total number of the abnormal events to be the total number of the data transmission link. And counting the total times of different service abnormal events of the platform according to the output result of the data processing process monitoring, and summing the total times as the total times of the data processing process abnormal events.
In this embodiment, based on the time dimension, the data source quality index, the data transmission link quality index and the data processing process quality index result are displayed on the interface according to the day, the week and the month, if an abnormality of a certain link is found, the service personnel can check the detail data in time through alarm reminding, and specific abnormal conditions are tracked.
In summary, the application aims to help the business to more intuitively and rapidly find the data quality problem by defining indexes of different dimensions for three links of data sources, data transmission links and data processing processes which affect the data quality, and to make improvement suggestions in time so as to improve the data quality of the Internet of vehicles.
The data standard design system of the present embodiment is suitable for the above-mentioned data standard design methods.
The application is not limited to the embodiments described above, but a number of modifications and adaptations can be made by a person skilled in the art without departing from the principle of the application, which modifications and adaptations are also considered to be within the scope of the application.
Claims (10)
1. The method for monitoring the data quality of the Internet of vehicles is characterized by comprising the following steps of:
collecting vehicle networking data output by communication equipment of a vehicle body end, and checking the vehicle networking data according to a vehicle networking data standard to obtain abnormal information of a data source end;
monitoring a transmission link between the communication equipment and the Internet of vehicles platform to obtain link abnormality information;
monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform to obtain server side abnormal information; the service module is used for processing the internet of vehicles data to obtain processed data;
when the processing data output by the Internet of vehicles platform is abnormal, analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information to obtain fault information causing the processing data to be abnormal.
2. The method for monitoring quality of internet of vehicles data according to claim 1, wherein the vehicle body terminal comprises a plurality of functional domains, each functional domain comprises a plurality of parts, and each part generates and outputs at least one type of internet of vehicles data; the method is characterized in that the data of the Internet of vehicles of each functional domain are respectively collected, and the data source end abnormal information of each functional domain is obtained by respectively checking the Internet of vehicles of each functional domain.
3. The internet of vehicles data quality monitoring method of claim 1, wherein the link anomaly information includes IP connection platform failure anomaly information for a communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
4. The method for monitoring quality of internet of vehicles according to claim 1, wherein the link abnormality information includes gateway reception service information, message queue access information, data analysis service information, and data warehouse entry service information for an internet of vehicles platform.
5. The internet of vehicles data quality monitoring method of claim 1, wherein the server side anomaly information includes data processing service information and model calculation service information.
6. A system for monitoring the quality of internet of vehicles data, comprising:
the data source end analysis module is used for collecting the internet of vehicles data output by the communication equipment of the vehicle body end and checking the internet of vehicles data according to the internet of vehicles data standard to obtain abnormal information of the data source end;
the transmission link analysis module is used for monitoring a transmission link between the communication equipment and the internet of vehicles platform to obtain link abnormality information;
the server analysis module is used for monitoring a service module used for processing the Internet of vehicles data in the Internet of vehicles platform so as to obtain server abnormal information; the service module is used for processing the internet of vehicles data to obtain processed data;
and the data quality monitoring module is used for analyzing according to the data source end abnormal information, the link abnormal information and the server end abnormal information when the processed data output by the Internet of vehicles platform is abnormal, so as to obtain fault information causing the processed data to be abnormal.
7. The internet of vehicles data quality monitoring system of claim 6, wherein the body side includes a plurality of functional domains, each functional domain including a plurality of components, each component generating and outputting at least one internet of vehicles data; the method is characterized in that the data of the Internet of vehicles of each functional domain are respectively collected, and the data source end abnormal information of each functional domain is obtained by respectively checking the Internet of vehicles of each functional domain.
8. The internet of vehicle data quality monitoring system of claim 6, wherein the link anomaly information includes IP connection platform failure anomaly information for the communication device, carrier service failure anomaly information, communication module failure information, and SIM card failure information.
9. The internet of vehicle data quality monitoring system of claim 6, wherein the link anomaly information includes gateway receive service information, message queue access information, data resolution service information, and data warehouse entry service information for an internet of vehicle platform.
10. The internet of vehicles data quality monitoring system of claim 6, wherein the server side anomaly information includes data processing service information and model computation service information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311113803.3A CN117156473A (en) | 2023-08-29 | 2023-08-29 | Internet of vehicles data quality monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311113803.3A CN117156473A (en) | 2023-08-29 | 2023-08-29 | Internet of vehicles data quality monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117156473A true CN117156473A (en) | 2023-12-01 |
Family
ID=88883805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311113803.3A Pending CN117156473A (en) | 2023-08-29 | 2023-08-29 | Internet of vehicles data quality monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117156473A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117425153A (en) * | 2023-12-18 | 2024-01-19 | 新华三网络信息安全软件有限公司 | Risk detection method and device for Internet of vehicles terminal |
-
2023
- 2023-08-29 CN CN202311113803.3A patent/CN117156473A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117425153A (en) * | 2023-12-18 | 2024-01-19 | 新华三网络信息安全软件有限公司 | Risk detection method and device for Internet of vehicles terminal |
| CN117425153B (en) * | 2023-12-18 | 2024-03-26 | 新华三网络信息安全软件有限公司 | Risk detection method and device for Internet of vehicles terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102263337B1 (en) | Cloud-based vehicle breakdown diagnosis method, device and system | |
| CN103455026B (en) | A kind of car fault diagnosis and method for early warning and device | |
| CN102881057B (en) | Based on vehicle management system and the vehicles management method thereof of iOBD | |
| US20170024943A1 (en) | System and Method for Service Assessment | |
| CN117156473A (en) | Internet of vehicles data quality monitoring method and system | |
| CN103632211A (en) | Motor vehicle fault pre-warning and callback prediction system | |
| CN111740953B (en) | Data access forwarding method and system for vehicle supervision platform | |
| CN109765879A (en) | A kind of remote monitoring system of new-energy automobile | |
| CN111740952B (en) | Vehicle supervision platform data management method and system | |
| CN112116105A (en) | Enterprise-level new energy automobile supervision system based on Internet of things platform | |
| CN210426762U (en) | Automatic noise monitoring and data management system for high-speed railway | |
| CN111127695A (en) | Vehicle monitoring system used in six-emission stage of vehicle utilization country | |
| CN105988460B (en) | Vehicle runway dynamic testing method, device and system | |
| CN117231910A (en) | Hydrogen filling monitoring method and device based on Internet of vehicles | |
| CN106228639B (en) | The treating method and apparatus of OBD data | |
| CN111367263A (en) | Mine car monitoring device and system | |
| CN112394040A (en) | Motor vehicle pollution discharge supervision system and method | |
| CN113806343B (en) | Evaluation method and system for Internet of vehicles data quality | |
| KR102295427B1 (en) | System and method for detecting status of vehicle based on data collected by obd | |
| CN114217596A (en) | Intelligent diagnosis upgrading system and method based on Internet of vehicles | |
| CN113392995A (en) | Comprehensive public transport vehicle engineering management system | |
| CN114140904A (en) | Cloud platform system for vehicle product data tracking | |
| CN112528389A (en) | Vehicle information processing method and device and vehicle operation management platform | |
| CN111741042A (en) | Oil consumption, driving track and safe driving integrated remote monitoring system | |
| CN115963408B (en) | Energy storage power station single battery fault early warning system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |