CN114398250A - Vehicle test evaluation method and device based on functional scene - Google Patents

Vehicle test evaluation method and device based on functional scene Download PDF

Info

Publication number
CN114398250A
CN114398250A CN202111444214.4A CN202111444214A CN114398250A CN 114398250 A CN114398250 A CN 114398250A CN 202111444214 A CN202111444214 A CN 202111444214A CN 114398250 A CN114398250 A CN 114398250A
Authority
CN
China
Prior art keywords
data
test
source
scene
functional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111444214.4A
Other languages
Chinese (zh)
Inventor
崔盛凯
接桂利
姚成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Network Technology Shanghai Co Ltd
Original Assignee
International Network Technology Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Network Technology Shanghai Co Ltd filed Critical International Network Technology Shanghai Co Ltd
Priority to CN202111444214.4A priority Critical patent/CN114398250A/en
Publication of CN114398250A publication Critical patent/CN114398250A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3696Methods or tools to render software testable

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention provides a vehicle test evaluation method and device based on a functional scene, wherein the method comprises the following steps: based on the received test request, sending a data acquisition request to a data source, and receiving source data returned by the data source based on the data acquisition request; performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data; based on preset conditions, performing functional scene test by using the test data to obtain a test result; and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result. According to the invention, data is preprocessed to check the integrity of the data, and null data, loss data, error data and data which is not matched with a functional scene are eliminated, so that the output of error information is effectively avoided, and the accuracy and reliability of a scene test are improved; based on the preset conditions, the vehicle test data is efficiently and automatically tested and evaluated, and the test efficiency is improved.

Description

Vehicle test evaluation method and device based on functional scene
Technical Field
The invention relates to the technical field of data processing, in particular to a vehicle test evaluation method and device based on a functional scene.
Background
With the rapid development of the internet and the maturity of the automobile intelligent technology, the auto-driving automobile industry is continuously developed. Before the automatic driving automobile is put into the market, all functions of the automatic driving automobile need to be tested to ensure the safety of the automatic driving automobile.
At present, a scene simulation test technology is mostly adopted to carry out an in-loop test on vehicles, even if the vehicles are positioned in a closed and open field to carry out the test; a scene simulation test system generates a virtual scene; generating a sensor signal based on a virtual scene by a sensor model and sensor signal simulation software, and sending the sensor signal to a vehicle electronic control unit; and the vehicle electronic control unit performs decision planning and task execution according to the environment perception data, simultaneously reads vehicle position information and course information for updating parameters by scene simulation software, and gives a sensor simulation signal according to the new position information, and the steps are repeated.
However, since the autonomous driving vehicle needs to test multiple environments and multiple scenes, a large amount of autonomous driving vehicle data is generated, the vehicle data processing and the automated testing need to be started manually for the large amount of vehicle data, and after the testing is finished, the testing result information needs to be checked manually, so that the labor consumption is high, and errors are easy to generate; in addition, the above method also performs test evaluation on invalid data such as null data, error data, and damaged data, so as to generate error information.
Disclosure of Invention
The invention provides a vehicle test evaluation method and device based on a functional scene, which are used for solving the defect of low test efficiency caused by large vehicle test data volume in the prior art, realizing automatic analysis and test of vehicle test data and improving the test accuracy and test efficiency.
The invention provides a vehicle test evaluation method based on a functional scene, which comprises the following steps: sending a data acquisition request to a data source based on the received test request, and receiving source data returned by the data source based on the data acquisition request; performing scene matching on the source data based on a function scene to be tested, and preprocessing the source data to obtain test data; based on preset conditions, performing functional scene test by using the test data to obtain a test result; and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
According to the vehicle test evaluation method based on the functional scene provided by the invention, the scene matching is carried out on the source data based on the functional scene to be tested, and the preprocessing is carried out on the source data acquired from the data source, and the method comprises the following steps: performing signal screening on the source data based on a signal type corresponding to a function scene to be tested to obtain signal data corresponding to the function scene to be tested; and carrying out frequency reduction processing on the signal data to obtain test data.
According to the vehicle test evaluation method based on the functional scene, provided by the invention, the signal screening is carried out on the source data based on the preset signal type, and the method comprises the following steps: determining a corresponding signal type based on the functional scene to be tested; and screening the source data based on the signal type, and eliminating the source data which does not accord with the signal type to obtain the signal data.
According to the vehicle test evaluation method based on the functional scenario provided by the invention, after the receiving of the source data returned by the data source based on the data acquisition request, the method further comprises the following steps: and transcoding the source file based on a preset data format to obtain source data.
According to the vehicle test evaluation method based on the functional scene, the transcoding of the source data based on the preset data format comprises the following steps: identifying a source format of the source data, and screening the source data based on a preset source format; and converting the source format of the screened source data into the preset data format based on the preset data format.
According to the vehicle test evaluation method based on the functional scenario, after the evaluation result is obtained, the method comprises the following steps: generating a test report according to the evaluation result; sending the test report to a test user side; and/or sending the test data which fails to pass the evaluation to the cloud end according to the evaluation result.
The invention also provides a vehicle test evaluation device based on the functional scene, which comprises: the data acquisition module is used for sending a data acquisition request to a data source based on the received test request and receiving source data returned by the data source based on the data acquisition request; the preprocessing module is used for carrying out scene matching on the source data based on a functional scene to be tested and preprocessing the source data to obtain test data; the test module is used for performing functional scene test by using the test data based on preset conditions to obtain a test result; and the evaluation module is used for evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the vehicle test evaluation method based on the functional scenario.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the functional scenario-based vehicle test evaluation method as described in any of the above.
The present invention also provides a computer program product comprising a computer program which, when executed by a processor, performs the steps of the functional scenario-based vehicle test evaluation method as described in any of the above.
According to the vehicle test evaluation method and device based on the functional scene, the accuracy of the acquired source data is improved by acquiring the source data from the data source, the situation that the source data is distorted is avoided, and the reliability of the source data source is effectively ensured; the source data are subjected to scene matching based on the functional scene to be tested, and the data are preprocessed to check the integrity of the data and eliminate null data, loss data, error data and data which are not matched with the functional scene, so that the output of error information is effectively avoided, and the accuracy and reliability of the scene test are improved; through the setting of the preset conditions, the test data meeting the preset conditions can be automatically tested, so that the test data of the vehicle can be effectively and fully automatically tested and evaluated, the test efficiency is greatly improved, and the workload of testers is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of a functional scenario-based vehicle test evaluation method provided by the present invention;
FIG. 2 is a second schematic flow chart of the vehicle test evaluation method based on the functional scenario provided in the present invention;
FIG. 3 is a schematic structural diagram of a vehicle test evaluation device based on a functional scenario according to the present invention;
FIG. 4 is a second schematic diagram of the functional scenario-based vehicle test evaluation apparatus according to the present invention;
fig. 5 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 shows a schematic flow chart of a vehicle test evaluation method based on a functional scenario, where an execution subject of the method is a data processing system, and the method includes:
s11, sending a data acquisition request to the data source based on the received test request, and receiving source data returned by the data source based on the data acquisition request;
s12, performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data;
s13, based on preset conditions, performing a function scene test by using the test data to obtain a test result;
and S14, evaluating the test data based on the test result by using the preset threshold range to obtain an evaluation result.
It should be noted that S1N in this specification does not represent the sequence of the vehicle test evaluation method based on the functional scenario, and the vehicle test evaluation method based on the functional scenario of the present invention is specifically described below.
Step S11, based on the received test request, sending a data obtaining request to the data source, and receiving source data returned by the data source based on the data obtaining request.
In this embodiment, after sending the data obtaining request to the data source, the data source receives the data obtaining request, and returns the corresponding source data to the data processing system according to the data obtaining request. It should be noted that after the data source receives the data request, the method further includes: and carrying out safety check on the data acquisition request so as to improve the safety of data transmission. The specific safe verification method can adopt the existing safe verification methods such as digital signature and the like, and the method is not further limited here.
In an optional embodiment, before receiving source data returned by the data source based on the data acquisition request, the method further includes: and transcoding the source file based on a preset data format to obtain source data. For example, if the source file format obtained from the data source is rec format and the preset format may be csv format, the source file is converted from rec format to csv format to reduce the capacity of stored information, which is favorable for subsequent reprocessing and ensures the security of data. In this embodiment, the preset data format may be set based on the data format of the obtained source file and design requirements, and is not further limited herein.
In an optional embodiment, transcoding the source data based on the preset data format includes: identifying a source format of source data, and screening the source data based on a preset source format; and converting the source format of the screened source data into a preset data format based on the preset data format. It should be noted that the format of the source data is screened to preliminarily screen out the data that does not meet the requirements of the functional scene, so that the subsequent data amount to be transcoded is reduced, and the conversion efficiency is improved. And step S12, performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data.
In this embodiment, performing scene matching on source data based on a functional scene to be tested, and preprocessing the source data includes: performing signal screening on the source data based on the signal type corresponding to the function scene to be tested to obtain signal data corresponding to the function scene to be tested; and performing frequency reduction processing on the signal data to obtain test data.
More specifically, the signal screening of the source data based on the signal type corresponding to the functional scenario to be tested includes: determining a corresponding signal type based on the functional scene to be tested; and screening the source data based on the signal type, and eliminating the source data which do not accord with the signal type to obtain the signal data. It should be noted that, by performing signal screening on the acquired source data, data which is easy to generate error information, such as null data, damaged data or erroneous data, is removed, thereby avoiding performing unnecessary subsequent tests and improving the efficiency of evaluation. In addition, the functional scenario refers to a test scenario corresponding to different driving functions of the vehicle, such as an adaptive cruise functional scenario, and further such as a deflector rod lane changing functional scenario.
For example, in the adaptive cruise function scenario, in order to ensure the stability of the acceleration, other data signals may be removed based on the signal type to retain the acceleration signal data, so that the subsequent test using the acceleration is facilitated, and the stability of the acceleration is further facilitated to be evaluated. In addition, after the acceleration signal data are obtained through screening, the frequency reduction processing is carried out on the acceleration signal data so as to reduce 100Hz to 10Hz, and therefore when the frequency-reduced data are used for testing subsequently, energy consumption is reduced, and testing efficiency is improved.
And step S13, performing a function scene test by using the test data based on preset conditions to obtain a test result.
In this embodiment, based on a preset condition, performing a test by using the test data to obtain a test result, including: presetting preset conditions; and automatically utilizing the test data to perform functional scene test based on the test data meeting the preset conditions to obtain a test result. It should be noted that, by means of preset conditions, the test data is automatically subjected to function scenario test, so that automatic driving parameters of automatic driving of the vehicle under different function scenarios are conveniently adjusted according to test results, and safety of automatic driving is further ensured. In addition, the test data may be tested by using existing test software, which is not further limited herein.
In addition, the preset condition may be a preset time period, for example, when the preset time period condition is met, the data processing system automatically performs a test by using the obtained test data, so as to perform a function scene test on the obtained test data at regular time; or the preset condition may be a preset trigger condition, for example, the preset trigger condition is that the test data conforms to a certain data volume, and when the obtained test data conforms to the preset trigger condition, the data processing system automatically triggers to perform a function scenario test on the obtained test data. The specific preset conditions may be set according to actual design requirements, and are not further limited herein.
And step S14, evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
In this embodiment, the evaluation of the test data based on the test result by using the preset threshold range includes: and comparing the obtained test result with a preset threshold range, if the test result accords with the preset threshold range, the test case formed corresponding to the test data passes, otherwise, the test case formed corresponding to the test data does not pass. For example, when the test data is acceleration, the absolute value of the acceleration cannot be larger than 0.5m/s during steady running2Therefore, the predetermined threshold range is not more than 0.5m/s2Comparing the test result with a preset threshold range to determine the auto-cruise powerAnd under the condition of energy, whether the test case corresponding to the test data passes or not is judged.
In an alternative embodiment, after obtaining the evaluation result, the method includes: generating a test report according to the evaluation result; and sending the test report to a test user side. It should be noted that, in this embodiment, the test report may be automatically triggered and sent to the test user side through jenkins, so that a tester at the test user side can check the test condition of the test data based on the test report.
In an optional embodiment, after obtaining the evaluation result, the method further includes: and sending the test data which fails to pass the evaluation to the cloud end according to the evaluation result so as to be checked by related testers.
In an alternative embodiment, referring to fig. 2, the method further comprises:
s21, the data processing system receives the test request initiated by the test user terminal and sends a data acquisition request to the data source;
s22, the data source receives the data acquisition request, carries out safety check on the data acquisition request, and returns source data to the data processing system based on passing the safety check;
s23, the data processing system tests by using the test data based on the preset condition and evaluates the test data based on the test result by using the preset threshold range to obtain an evaluation result;
and S24, the data processing system sends the test data which do not pass the evaluation to the cloud end according to the evaluation result, generates a corresponding test report according to the test data which pass the evaluation, and sends the test report to the test user end.
In summary, the embodiment of the present invention obtains the source data from the data source, so as to improve the accuracy of the obtained source data, avoid the source data being tampered with, and effectively ensure the reliability of the source data source; the source data are subjected to scene matching based on the functional scene to be tested, and the data are preprocessed to check the integrity of the data and eliminate null data, loss data, error data and data which are not matched with the functional scene, so that the output of error information is effectively avoided, and the accuracy and reliability of the scene test are improved; through the setting of the preset conditions, the test data meeting the preset conditions can be automatically tested, so that the test data of the vehicle can be effectively and fully automatically tested and evaluated, the test efficiency is greatly improved, and the workload of testers is reduced.
The vehicle test evaluation device based on the functional scenario provided by the invention is described below, and the vehicle test evaluation device based on the functional scenario described below and the vehicle test evaluation method based on the functional scenario described above can be referred to correspondingly.
Fig. 3 shows a schematic structural diagram of a vehicle test evaluation device based on a functional scenario, where the device includes a data processing system, and specifically includes:
the data acquisition module 31 is used for sending a data acquisition request to the data source based on the received test request and receiving source data returned by the data source based on the data acquisition request;
the preprocessing module 32 is used for performing scene matching on the source data based on the functional scene to be tested and preprocessing the source data to obtain test data;
the test module 33 is used for performing a functional scene test by using the test data based on a preset condition to obtain a test result;
the evaluation module 34 evaluates the test data based on the test result by using a preset threshold range to obtain an evaluation result.
In this embodiment, after the data obtaining module 31 sends the data obtaining request to the data source, the data source receives the data obtaining request, and returns the corresponding source data to the data processing system according to the data obtaining request. It should be noted that the data sources, include: a request receiving unit that receives a data acquisition request; the safety verification unit is used for carrying out safety verification on the data acquisition request; and the information sending unit is used for sending the corresponding source data to the data processing system according to the data acquisition request based on passing the security check.
In an optional embodiment, the data processing module 31 further includes: and the transcoding unit is used for transcoding the source file based on a preset data format to obtain source data. For example, if the source file format obtained from the data source is rec format and the preset format may be csv format, the source file is converted from rec format to csv format to reduce the capacity of stored information, which is favorable for subsequent reprocessing and ensures the security of data. In this embodiment, the preset data format may be set based on the data format of the obtained source file and design requirements, and is not further limited herein.
In an optional embodiment, the transcoding unit comprises: the identification subunit is used for identifying the source format of the source data and screening the source data based on a preset source format; and the code conversion subunit converts the source format of the screened source data into a preset data format based on the preset data format. It should be noted that the format of the source data is screened to preliminarily screen out the data that does not meet the requirements of the functional scene, so that the subsequent data amount to be transcoded is reduced, and the conversion efficiency is improved. A pre-processing module 32 comprising: the signal screening unit is used for screening the source data based on the signal type corresponding to the function scene to be tested to obtain signal data corresponding to the function scene to be tested; and the frequency reduction processing unit is used for carrying out frequency reduction processing on the signal data to obtain test data.
Still further, the signal screening unit includes: the signal determining subunit determines a corresponding signal type based on the functional scene to be tested; and the signal screening subunit screens the source data based on the signal type, and rejects the source data which does not accord with the signal type to obtain the signal data. It should be noted that, by performing signal screening on the acquired source data, data which is easy to generate error information, such as null data, damaged data or erroneous data, is removed, thereby avoiding performing unnecessary subsequent tests and improving the efficiency of evaluation.
A test module 33 comprising: a condition presetting unit that presets a preset condition; and the test unit automatically utilizes the test data to test based on the test data meeting the preset conditions to obtain a test result. It should be noted that, the test data is automatically subjected to the function scenario test based on the preset conditions, so that the automatic driving parameters of the automatic driving of the vehicle under different function scenarios are conveniently adjusted according to the test results, and the safety of the automatic driving is further ensured. In addition, the test data may be tested by using test software, which is not further limited herein.
In addition, the preset condition may be a preset time period, for example, when the preset time period condition is met, the data processing system automatically performs a test by using the obtained test data, so as to perform a function scene test on the obtained test data at regular time; or the preset condition may be a preset trigger condition, for example, the preset trigger condition is that the test data conforms to a certain data volume, and when the obtained test data conforms to the preset trigger condition, the data processing system automatically triggers to perform a function scenario test on the obtained test data. The specific preset conditions may be set according to actual design requirements, and are not further limited herein.
An evaluation module 34, comprising: and the comparison unit is used for comparing the obtained test result with a preset threshold range, if the test result accords with the preset threshold range, the evaluation result indicates that the test case formed by the corresponding test data passes, otherwise, the evaluation result indicates that the test case formed by the corresponding test data does not pass. For example, when the test data is acceleration, the absolute value of the acceleration cannot be larger than 0.5m/s during steady running2Therefore, the predetermined threshold range is not more than 0.5m/s2And comparing the test result with a preset threshold range so as to determine whether the test case corresponding to the test data passes or not in the scene of the automatic cruise function.
In an optional embodiment, the apparatus further comprises: the report generation module generates a test report according to the evaluation result; and the report sending module is used for sending the test report to the test user side. It should be noted that, in this embodiment, the test report may be automatically triggered and sent to the test user side through jenkins, so that a tester at the test user side can check the test condition of the test data based on the test report.
In an optional embodiment, the apparatus further comprises: and the failed data sending module is used for sending the test data which are not subjected to evaluation to the cloud end according to the evaluation result so as to be checked by related testers.
In an alternative embodiment, referring to fig. 4, the apparatus further comprises: data processing system, data source, test user side and high in the clouds, wherein:
the data processing system receives a test request initiated by a test user terminal and sends a data acquisition request to a data source;
the data source receives the data acquisition request, performs security verification on the data acquisition request, and returns source data to the data processing system based on passing of the security verification;
the data processing system is used for testing by using the test data based on a preset condition and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result;
and the data processing system sends the test data which fails to pass the evaluation to the cloud end according to the evaluation result, generates a corresponding test report according to the test data which passes the evaluation, and sends the test report to the test user end.
In summary, in the embodiments of the present invention, the data acquisition module acquires the source data to improve the accuracy of the acquired source data, avoid the source data being tampered with, and effectively ensure the reliability of the source data; the source data are subjected to scene matching based on a function scene to be tested through a preprocessing module, data are preprocessed to check the integrity of the data, and null data, loss data, error data and data which are not matched with the function scene are eliminated, so that the output of error information is effectively avoided, and the accuracy and reliability of scene testing are improved; the test module automatically tests the test data meeting the preset conditions based on the preset conditions, so that the test data of the vehicle can be effectively and fully automatically tested and evaluated, the test efficiency is greatly improved, and the workload of testers is reduced; the test result is evaluated through the evaluation module so as to know the test condition in time and further adjust the automatic driving parameters of the corresponding function scene according to the test result.
Fig. 5 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 5: a processor (processor)51, a communication Interface (communication Interface)52, a memory (memory)53 and a communication bus 54, wherein the processor 51, the communication Interface 52 and the memory 53 complete communication with each other through the communication bus 54. The processor 51 may invoke logic instructions in the memory 53 to perform a functional scenario-based vehicle test evaluation method comprising: based on the received test request, sending a data acquisition request to a data source, and receiving source data returned by the data source based on the data acquisition request; performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data; based on preset conditions, performing functional scene test by using the test data to obtain a test result; and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
In addition, the logic instructions in the memory 53 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product, the computer program product comprising a computer program, the computer program being stored on a non-transitory computer-readable storage medium, wherein when the computer program is executed by a processor, the computer is capable of executing the method for evaluating a vehicle test based on a functional scenario provided by the above methods, the method comprising: based on the received test request, sending a data acquisition request to a data source, and receiving source data returned by the data source based on the data acquisition request; performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data; based on preset conditions, performing functional scene test by using the test data to obtain a test result; and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements a method for functional scenario-based vehicle test evaluation provided by the above methods, the method comprising: based on the received test request, sending a data acquisition request to a data source, and receiving source data returned by the data source based on the data acquisition request; performing scene matching on the source data based on the functional scene to be tested, and preprocessing the source data to obtain test data; based on preset conditions, performing functional scene test by using the test data to obtain a test result; and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A vehicle test evaluation method based on a functional scene is characterized by comprising the following steps:
sending a data acquisition request to a data source based on the received test request, and receiving source data returned by the data source based on the data acquisition request;
performing scene matching on the source data based on a function scene to be tested, and preprocessing the source data to obtain test data;
based on preset conditions, performing functional scene test by using the test data to obtain a test result;
and evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
2. The functional scenario-based vehicle test evaluation method of claim 1, wherein the performing scenario matching on the source data based on the functional scenario to be tested and preprocessing the source data obtained from a data source comprises:
performing signal screening on the source data based on a signal type corresponding to a function scene to be tested to obtain signal data corresponding to the function scene to be tested;
and carrying out frequency reduction processing on the signal data to obtain test data.
3. The functional scenario-based vehicle test evaluation method of claim 2, wherein the signal screening of the source data based on the signal type corresponding to the functional scenario to be tested comprises:
determining a corresponding signal type based on the functional scene to be tested;
and screening the source data based on the signal type, and eliminating the source data which does not accord with the signal type to obtain the signal data.
4. The functional scenario-based vehicle test evaluation method according to claim 1, further comprising, after the receiving source data returned by the data source based on the data acquisition request:
and transcoding the source file based on a preset data format to obtain source data.
5. The functional scenario-based vehicle test evaluation method according to claim 4, wherein transcoding the source data based on the preset data format includes:
identifying a source format of the source data, and screening the source data based on a preset source format;
and converting the source format of the screened source data into the preset data format based on the preset data format.
6. The functional scenario-based vehicle test evaluation method of claim 1, further comprising, after the obtaining of the evaluation result:
generating a test report according to the evaluation result;
sending the test report to a test user side; and/or the presence of a gas in the gas,
and sending the test data which fails to pass the evaluation to the cloud end according to the evaluation result.
7. A vehicle test evaluation device based on a functional scenario is characterized by comprising:
the data acquisition module is used for sending a data acquisition request to a data source based on the received test request and receiving source data returned by the data source based on the data acquisition request;
the preprocessing module is used for carrying out scene matching on the source data based on a functional scene to be tested and preprocessing the source data to obtain test data;
the test module is used for performing functional scene test by using the test data based on preset conditions to obtain a test result;
and the evaluation module is used for evaluating the test data based on the test result by using a preset threshold range to obtain an evaluation result.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of the functional scenario-based vehicle test evaluation method of any one of claims 1 to 6.
9. A non-transitory computer-readable storage medium, on which a computer program is stored, wherein the computer program, when being executed by a processor, implements the steps of the functional scenario-based vehicle test evaluation method according to any one of claims 1 to 6.
10. A computer program product comprising a computer program, wherein the computer program when executed by a processor implements the steps of the functional scenario-based vehicle test evaluation method of any one of claims 1 to 6.
CN202111444214.4A 2021-11-30 2021-11-30 Vehicle test evaluation method and device based on functional scene Pending CN114398250A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111444214.4A CN114398250A (en) 2021-11-30 2021-11-30 Vehicle test evaluation method and device based on functional scene

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111444214.4A CN114398250A (en) 2021-11-30 2021-11-30 Vehicle test evaluation method and device based on functional scene

Publications (1)

Publication Number Publication Date
CN114398250A true CN114398250A (en) 2022-04-26

Family

ID=81225902

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111444214.4A Pending CN114398250A (en) 2021-11-30 2021-11-30 Vehicle test evaluation method and device based on functional scene

Country Status (1)

Country Link
CN (1) CN114398250A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115437869A (en) * 2022-11-08 2022-12-06 腾讯科技(深圳)有限公司 Down-conversion point detection method, device, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112346982A (en) * 2020-11-11 2021-02-09 东软睿驰汽车技术(沈阳)有限公司 Test case generation method and device and electronic equipment
CN113092135A (en) * 2021-04-14 2021-07-09 东软睿驰汽车技术(沈阳)有限公司 Test method, device and equipment for automatically driving vehicle
CN113687600A (en) * 2021-10-21 2021-11-23 中智行科技有限公司 Simulation test method, simulation test device, electronic equipment and storage medium
CN113704077A (en) * 2020-05-20 2021-11-26 中国移动通信集团浙江有限公司 Test case generation method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113704077A (en) * 2020-05-20 2021-11-26 中国移动通信集团浙江有限公司 Test case generation method and device
CN112346982A (en) * 2020-11-11 2021-02-09 东软睿驰汽车技术(沈阳)有限公司 Test case generation method and device and electronic equipment
CN113092135A (en) * 2021-04-14 2021-07-09 东软睿驰汽车技术(沈阳)有限公司 Test method, device and equipment for automatically driving vehicle
CN113687600A (en) * 2021-10-21 2021-11-23 中智行科技有限公司 Simulation test method, simulation test device, electronic equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115437869A (en) * 2022-11-08 2022-12-06 腾讯科技(深圳)有限公司 Down-conversion point detection method, device, equipment and storage medium
CN115437869B (en) * 2022-11-08 2023-03-24 腾讯科技(深圳)有限公司 Down-conversion point detection method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN113205070A (en) Visual perception algorithm optimization method and system
CN105068935B (en) Method and device for processing software test result
CN114398250A (en) Vehicle test evaluation method and device based on functional scene
CN114564381A (en) Complete machine production and test method for Internet of things equipment
CN117724982A (en) Simulation evaluation method and device, electronic equipment and storage medium
CN115269384A (en) Integration test method, system, electronic device and storage medium
CN211554929U (en) Human-computer interaction interface automatic identification system based on Android OS
CN116431522A (en) Automatic test method and system for low-code object storage gateway
CN111193631B (en) Information processing method, system, and computer-readable storage medium
KR20230004314A (en) Vision inspection system based on deep learning and vision inspection method using thereof
CN115757158A (en) Automatic test platform, test method and test equipment for vehicle-mounted controller
US20220058530A1 (en) Method and device for optimizing deep learning model conversion, and storage medium
CN115622912A (en) Cloud platform performance testing method and device, electronic equipment and storage medium
CN110210048B (en) Method and device for establishing patrol analysis model
CN114021705A (en) Model accuracy determination method, related device and equipment
JP2022036054A (en) Inspection device, inspection method, and inspection program for strung wire
CN112395695A (en) Method and system for establishing simulation scene in real time
CN115132173A (en) Testing method of voice interaction system, audio recognition method and related equipment
CN112015645A (en) Function test method and device of web system and electronic equipment
CN112908357A (en) Instrument sound testing method and device, testing equipment and storage medium
CN113723437B (en) Automatic training method of AI model and AI model training system
CN117349189B (en) APP new version testing method, equipment and medium
CN115883431B (en) Terminal communication protocol performance test system, method, vehicle and storage medium
US11551061B2 (en) System for generating synthetic digital data of multiple sources
CN118332304B (en) Method and system for evaluating artificial intelligence model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination