CN111723488A - Assessment method and system for ADAS test - Google Patents
Assessment method and system for ADAS test Download PDFInfo
- Publication number
- CN111723488A CN111723488A CN202010575432.0A CN202010575432A CN111723488A CN 111723488 A CN111723488 A CN 111723488A CN 202010575432 A CN202010575432 A CN 202010575432A CN 111723488 A CN111723488 A CN 111723488A
- Authority
- CN
- China
- Prior art keywords
- evaluation
- data
- test
- test file
- evaluation index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/15—Vehicle, aircraft or watercraft design
Abstract
The invention provides an assessment method and system for an ADAS test, and relates to the field of vehicle tests. The method comprises the steps of obtaining data in a test file after receiving the test file and one or more evaluation index systems selected from a plurality of prestored evaluation index systems, wherein the test file comprises data used for representing vehicle performance, and then evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report. The invention can automatically evaluate the test data, and reduces the occurrence of low accuracy of the evaluation result caused by insufficient experience of research personnel or insufficient research and reading of industry standards, thereby improving the accuracy of the evaluation. The invention provides a plurality of evaluation index systems, avoids single evaluation index, and can select different evaluation indexes according to the evaluation requirement of the user, thereby generating an evaluation report with pertinence to the user and reducing the time for screening data by the user.
Description
Technical Field
The invention relates to the field of vehicle tests, in particular to an evaluation method and system for ADAS tests.
Background
In recent years, the automobile industry has been rapidly developed, the automobile intelligence degree has been greatly improved, roads, traffic and safety are concerned by everyone, and how to improve the active safety of automobiles becomes a focus of attention and research. An Advanced Driver Assistance System (Advanced Driver Assistance System), referred to as ADAS, has come into force. The ADAS utilizes a sensor arranged on a vehicle to collect environmental data inside and outside the vehicle, and carries out identification, detection and tracking on static and dynamic objects, so that a driver can perceive possible dangers in the fastest time, and attention is attracted and safety is improved. With the continuous promotion of related national ADAS standard and regulation, the national management department pays more and more attention to the performance of auxiliary driving. The department of transportation of 4.1.2019 released "requirements and test regulations for the performance of an automatic emergency braking system of a commercial vehicle" (JT/T1242-2019), marked that the field of commercial vehicles such as passenger cars is officially demanding assistant driving as a mandatory requirement, and put higher requirements on the functions of Automatic Emergency Braking (AEB), Front Collision Warning (FCW), Lane Departure Warning (LDW) and the like in ADAS and the safety and reliability of vehicle transportation, and the construction of ADAS technical test capability has been reluctant.
Because ADAS starts late in China and lacks of talents in related fields, the system is not established completely, and the following defects exist:
(1) in the ADAS test evaluation stage, a great deal of manpower and time are consumed in the analysis and evaluation of test data, and when the data is analyzed and evaluated by adopting the manpower, the subjective experience of people has a great influence on the evaluation result;
(2) the existing evaluation schemes are single, some evaluation schemes only compare experienced driving data or only test laws and regulations, and the evaluation schemes cannot meet the multidimensional evaluation of ADAS driving performance and cannot improve the competitiveness of products;
(3) I-VISTA began to experimentally score the overall performance of individual host plant vehicles, but only published information to automotive consumers.
Disclosure of Invention
The first aspect of the present invention is to provide an evaluation method for ADAS testing, which solves the technical problems of low accuracy and single evaluation index in evaluating test data of a whole vehicle in the prior art.
It is a further object of the first aspect of the invention to further improve the accuracy of the evaluation of the test data.
It is an object of the second aspect of the present invention to provide an evaluation system for ADAS testing.
According to an object of a first aspect of the present invention, there is provided an evaluation method for ADAS testing, comprising:
receiving a test file and one or more evaluation index systems selected from a plurality of pre-stored evaluation index systems, wherein the test file contains data for representing vehicle performance;
acquiring data in a test file;
and evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report.
Optionally, after acquiring the data in the test file, the method further includes:
and preprocessing the data in the test file to filter interference data.
Optionally, the test file includes simulation test data and/or bench test data.
Optionally, the assessment report includes at least one of legitimacy, safety, and comfort.
Optionally, the evaluation index system is compiled according to legal regulations and vehicle industry standards.
Optionally, the number of pieces of test files received at a time may be up to 1000 pieces.
According to the object of the second aspect of the present invention, the present invention further provides an evaluation system for ADAS test, comprising an obtaining module and an evaluation module connected to each other; wherein the content of the first and second substances,
the acquisition module is used for acquiring data in a test file after receiving the test file and selecting one or more evaluation index systems from a plurality of pre-stored evaluation index systems, and sending the data to the evaluation module, wherein the test file comprises data used for representing vehicle performance;
and the evaluation module is used for evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report.
Optionally, the evaluation module is further configured to pre-process data in the test file to filter invalid data.
Optionally, the test file includes simulation test data and/or bench test data.
Optionally, the assessment report includes at least one of legitimacy, safety, and comfort.
The method comprises the steps of obtaining data in a test file after receiving the test file and one or more evaluation index systems selected from a plurality of prestored evaluation index systems, wherein the test file comprises data used for representing vehicle performance, and then evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report. The invention can automatically evaluate the test data, and reduces the occurrence of low accuracy of the evaluation result caused by insufficient experience of research personnel or insufficient research and reading of industry standards, thereby improving the accuracy of the evaluation. The invention provides a plurality of evaluation index systems, avoids single evaluation index, and can select different evaluation indexes according to the evaluation requirement of the user, thereby generating an evaluation report with pertinence to the user and reducing the time for screening data by the user.
Furthermore, after the data in the test file is acquired, the data in the test file is preprocessed to filter interference data, so that effective data can be extracted, the evaluation accuracy is further improved, and the misjudgment rate is reduced.
The above and other objects, advantages and features of the present invention will become more apparent to those skilled in the art from the following detailed description of specific embodiments thereof, taken in conjunction with the accompanying drawings.
Drawings
Some specific embodiments of the invention will be described in detail hereinafter, by way of illustration and not limitation, with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:
FIG. 1 is a schematic flow chart diagram of an evaluation method with respect to ADAS testing according to one embodiment of the present invention;
FIG. 2 is a schematic flow chart diagram of an evaluation method for ADAS testing according to another embodiment of the present invention;
fig. 3 is a schematic block diagram of an evaluation system for ADAS testing according to one embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
Fig. 1 is a schematic flow diagram of an evaluation method with respect to ADAS testing according to one embodiment of the present invention. As shown in fig. 1, in a specific embodiment, the evaluation method for ADAS testing may generally include the following steps:
s100, receiving a test file and one or more evaluation index systems selected by a user from a plurality of pre-stored evaluation index systems, wherein the test file contains data for representing vehicle performance;
s200, acquiring data in the test file;
and S300, evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report. Wherein, the evaluation index system is compiled according to laws and regulations and vehicle industry standards.
The invention can automatically evaluate the test data, and reduces the occurrence of low accuracy of the evaluation result caused by insufficient experience of research personnel or insufficient research and reading of industry standards, thereby improving the accuracy of the evaluation. The invention provides a plurality of evaluation index systems, avoids single evaluation index, and can select different evaluation indexes according to the evaluation requirement of the user, thereby generating an evaluation report with pertinence to the user, reducing the time for screening data by the user, and enabling the user to know the evaluation result at a glance. The automation means that the whole test data evaluation process is less in manual participation and the operation time is within the acceptable degree range of people.
Fig. 2 is a schematic flow chart of an evaluation method with respect to ADAS testing according to another embodiment of the present invention. As shown in fig. 2, in another embodiment, after acquiring the data in the test file, the following steps are further included:
s210, preprocessing the data in the test file to filter interference data.
The invention can extract effective data, further improve the evaluation accuracy and reduce the misjudgment rate.
Further, the test file of the present invention includes simulation test data and/or bench test data.
That is to say, a user imports a test result obtained by a bench test or a simulation test into an evaluation system of the ADAS bench test and the road test, the evaluation system intercepts and filters the imported test data, the user manually selects an evaluation index system (the evaluation index system is compiled according to laws, regulations and industrial standards) according to the requirement, after the selection of the evaluation index system is completed, the evaluation system performs compliance judgment on the test data according to the evaluation index system selected by the user, and simultaneously obtains indexes such as safety, comfort, KPI and the like. And after the evaluation is finished, the evaluation is visually displayed in forms, graphs and the like, so that the evaluation is convenient for a user to check.
In this embodiment, the format of the test data should strictly follow the format specified by the evaluation system, and the format of the evaluation system includes the data format frequently used in the data testing industry at present, and if the user has special requirements, the test data can be converted into the data format frequently used in the industry according to the requirements.
In the embodiment, the evaluation index system strictly complies with each legal regulation in the field of automobile auxiliary driving, and meanwhile, the evaluation standard adopts high-influence standards, such as GB/T26773, JT/T883, Q/JLS J8220066-2018, JT/T1242-2019, Ero-CAP, C-CAP, i-VISTA and the like. The evaluation algorithm was rigorously tested and optimized on a continuous iteration.
In the present embodiment, the result is shown in the form of a chart, such as a bar chart, a pie chart, a table, etc., which can be easily understood by those skilled in the art.
The invention feeds back the evaluation result to the development process of the ADAS product, and can help to improve the safety, the comfort and the product competitiveness from multiple aspects such as technical requirements, the improvement of control strategies, test evaluation and the like. The method has the technical effects of saving cost, being objective in evaluation, improving working efficiency and accelerating research and development progress.
According to the invention, the accurate evaluation of the test result is realized through the multi-dimensional evaluation indexes built in the software, the test result files of bench tests, road tests and other sources are supported to be quickly imported in batches, various data formats such as txt, csv, xls and the like are supported, automatic analysis is carried out, the KPI quantitative evaluation of the corresponding finished automobile test result is successfully realized through evaluation index algorithm, and the KPI quantitative evaluation is a numerical index which has great reference significance and is obtained according to analysis of a large amount of ADAS test evaluation data.
The multidimensional evaluation index includes multiple performance indexes such as legality, safety, comfort and the like, that is, the evaluation report includes evaluations of multiple performance indexes such as legality, safety, comfort and the like.
Further, the evaluation index system includes a plurality of industry legislative standards that have been released so far. Such as GB/T26773, JT/T883, Q/JLS J8220066-2018 and JT/T1242-2019, and also comprises an illegal law evaluation standard library such as i-VISTA2018 intelligent driving evaluation index and the like.
Further, the design standard for rapid batch import is as follows: the number of the test files received in a single time can reach 1000 pieces at most, the reading speed of a single test file does not exceed 0.5s, and the evaluation speed of a single test file does not exceed 2 s.
Further, the plurality of data formats in the evaluation report include a current test file storage format, which is composed of test file formats such as txt, csv, xls, and the like.
Fig. 3 is a schematic block diagram of an evaluation system for ADAS testing according to one embodiment of the present invention. As shown in fig. 3, in a specific embodiment, the evaluation system 100 for ADAS test includes an obtaining module 10 and an evaluation module 20 connected to each other, wherein the obtaining module 10 is configured to obtain data in a test file after receiving the test file and selecting one or more evaluation indexes from a plurality of evaluation indexes stored in advance, and send the data to the evaluation module 20, and the test file contains data for characterizing vehicle performance. Specifically, the test file contains simulation test data and/or bench test data. The evaluation module 20 evaluates the data in the test file by using the selected evaluation index system to obtain an evaluation report. Here, the evaluation index system may be selected for evaluation according to the user's needs. All the evaluation index systems are stored in the evaluation system, namely, various legal and regulatory standards and industry recommendation standards are placed in the evaluation system in an algorithm form and are modularized, so that the evaluation index systems are convenient to call.
Further, the evaluation module 20 is also configured to preprocess data in the test file to filter invalid data.
The invention adopts an evaluation system with a plurality of built-in laws and regulations and standards, and the algorithm is strictly tested, so that the method has high reliability, is convenient for research and development engineers to carry out targeted test and research and development on different laws and regulations standards in the test and evaluation process, and reduces the research and analysis time of the research and development engineers on the laws and regulations standards in the research and development engineering. The invention can reach 1000 test data processed at a time, the speed of reference manual processing is exponentially increased, KPI indexes are obtained by a large amount of past test data and reference laws and regulations, subjective parameters are objectified, and a large amount of unnecessary errors caused by empirical judgment are avoided in research and development engineering.
Thus, it should be appreciated by those skilled in the art that while a number of exemplary embodiments of the invention have been illustrated and described in detail herein, many other variations or modifications consistent with the principles of the invention may be directly determined or derived from the disclosure of the present invention without departing from the spirit and scope of the invention. Accordingly, the scope of the invention should be understood and interpreted to cover all such other variations or modifications.
Claims (10)
1. An evaluation method for ADAS testing, comprising:
receiving a test file and one or more evaluation index systems selected from a plurality of pre-stored evaluation index systems, wherein the test file contains data for representing vehicle performance;
acquiring data in a test file;
and evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report.
2. The evaluation method of claim 1, after obtaining the data in the test file, further comprising:
and preprocessing the data in the test file to filter interference data.
3. The evaluation method according to claim 1,
the test file comprises simulation test data and/or bench test data.
4. The evaluation method according to claim 1,
the evaluation report includes at least one of legitimacy, safety and comfort.
5. The evaluation method according to claim 1,
the evaluation index system is compiled according to laws and regulations and vehicle industry standards.
6. The evaluation method according to claim 1,
the number of pieces of the test file received at a time can reach 1000 pieces at most.
7. An evaluation system related to ADAS test is characterized by comprising an acquisition module and an evaluation module which are connected with each other; wherein the content of the first and second substances,
the acquisition module is used for acquiring data in a test file after receiving the test file and selecting one or more evaluation index systems from a plurality of pre-stored evaluation index systems, and sending the data to the evaluation module, wherein the test file comprises data used for representing vehicle performance;
and the evaluation module is used for evaluating the data in the test file by using the selected evaluation index system to obtain an evaluation report.
8. The evaluation system of claim 1,
the evaluation module is further used for preprocessing the data in the test file to filter invalid data.
9. The evaluation system of claim 1,
the test file comprises simulation test data and/or bench test data.
10. The evaluation system of claim 1,
the assessment report includes at least one of legitimacy, safety, and comfort.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010575432.0A CN111723488A (en) | 2020-06-22 | 2020-06-22 | Assessment method and system for ADAS test |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010575432.0A CN111723488A (en) | 2020-06-22 | 2020-06-22 | Assessment method and system for ADAS test |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111723488A true CN111723488A (en) | 2020-09-29 |
Family
ID=72568173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010575432.0A Pending CN111723488A (en) | 2020-06-22 | 2020-06-22 | Assessment method and system for ADAS test |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111723488A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113162826A (en) * | 2021-04-21 | 2021-07-23 | 江铃汽车股份有限公司 | Finished automobile network testing method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109520744A (en) * | 2018-11-12 | 2019-03-26 | 百度在线网络技术（北京）有限公司 | The driving performance test method and device of automatic driving vehicle |
| CN109827781A (en) * | 2018-12-29 | 2019-05-31 | 中国汽车技术研究中心有限公司 | A kind of vehicle testing data processing method, apparatus and system |
| CN110888416A (en) * | 2019-12-03 | 2020-03-17 | 上海交通大学 | Vision ADAS-ECU hardware-in-the-loop simulation test system |
-
2020
- 2020-06-22 CN CN202010575432.0A patent/CN111723488A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109520744A (en) * | 2018-11-12 | 2019-03-26 | 百度在线网络技术（北京）有限公司 | The driving performance test method and device of automatic driving vehicle |
| CN109827781A (en) * | 2018-12-29 | 2019-05-31 | 中国汽车技术研究中心有限公司 | A kind of vehicle testing data processing method, apparatus and system |
| CN110888416A (en) * | 2019-12-03 | 2020-03-17 | 上海交通大学 | Vision ADAS-ECU hardware-in-the-loop simulation test system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113162826A (en) * | 2021-04-21 | 2021-07-23 | 江铃汽车股份有限公司 | Finished automobile network testing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107918382B (en) | Automobile fault diagnosis method, automobile fault diagnosis device and electronic equipment | |
| US9244054B2 (en) | Systems and methods for determining a state of deterioration of engine oil using multiple preselected oil properties | |
| CN109767597B (en) | Vehicle accident early warning method and system | |
| CN105976074A (en) | Vehicle health parameter generation and presentation method and device | |
| CN112730748B (en) | Large-scale screening method for high NOx emission of heavy diesel vehicle based on working condition selection | |
| CN101465059A (en) | Early-warning system for inspecting and judging urban road traffic safety situation | |
| CN103543020B (en) | A kind of method based on the second-hand automobile newness rate of in good time technology for detection data evaluation | |
| CN109857085B (en) | Method and system for generating driving data in simulation mode, simulation terminal and test system | |
| CN113611104B (en) | Risk identification method and device for freight vehicle, storage medium and terminal | |
| CN111723488A (en) | Assessment method and system for ADAS test | |
| CN115423035A (en) | User portrait generation method based on feature variable scoring, equipment, automobile and storage medium | |
| CN106710027A (en) | Configuration method and device of on-board equipment | |
| Wali et al. | How driving volatility in time to collision relates to crash severity in a naturalistic driving environment | |
| CN113263993B (en) | Fault early warning method, device, communication equipment and storage medium | |
| CN111896264B (en) | Method and device for generating test working condition of range extender engine and electronic equipment | |
| CN113221457A (en) | Method, device, equipment and medium for determining vehicle maintenance information | |
| CN116757538A (en) | Dynamic assessment system and method for energy efficiency and carbon emission performance of vehicles | |
| CN115222145A (en) | Driving range prediction method and system based on new energy automobile operation big data | |
| CN114743384A (en) | Alarm method and device | |
| CN110648002B (en) | Vehicle diagnosis method, device, equipment and readable storage medium | |
| CN108268678A (en) | Driving behavior analysis method, apparatus and system | |
| CN110610389A (en) | Target standard determination method and device | |
| CN116026355B (en) | Automobile safety monitoring method and system | |
| CN116343484B (en) | Traffic accident identification method, terminal and storage medium | |
| CN111443621B (en) | Model generation method, model generation device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 310051 No. 1760, Jiangling Road, Hangzhou, Zhejiang, Binjiang District Applicant after: Zhejiang Geely Remote New Energy Commercial Vehicle Group Co.,Ltd. Applicant after: Zhejiang Geely new energy Commercial Vehicle Development Co.,Ltd. Applicant after: ZHEJIANG GEELY HOLDING GROUP Co.,Ltd. Address before: Room 612, building 1, 1760 Jiangling Road, Binjiang District, Hangzhou City, Zhejiang Province Applicant before: ZHEJIANG GEELY NEW ENERGY COMMERCIAL VEHICLE GROUP Co.,Ltd. Applicant before: Zhejiang Geely new energy Commercial Vehicle Development Co.,Ltd. Applicant before: ZHEJIANG GEELY HOLDING GROUP Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230802 Address after: 310051 No. 1760, Jiangling Road, Hangzhou, Zhejiang, Binjiang District Applicant after: Zhejiang Geely Remote New Energy Commercial Vehicle Group Co.,Ltd. Applicant after: ZHEJIANG GEELY HOLDING GROUP Co.,Ltd. Address before: 310051 No. 1760, Jiangling Road, Hangzhou, Zhejiang, Binjiang District Applicant before: Zhejiang Geely Remote New Energy Commercial Vehicle Group Co.,Ltd. Applicant before: Zhejiang Geely new energy Commercial Vehicle Development Co.,Ltd. Applicant before: ZHEJIANG GEELY HOLDING GROUP Co.,Ltd. |