CN113029196A - Navigation application test method and test platform - Google Patents
Navigation application test method and test platform Download PDFInfo
- Publication number
- CN113029196A CN113029196A CN202110230221.8A CN202110230221A CN113029196A CN 113029196 A CN113029196 A CN 113029196A CN 202110230221 A CN202110230221 A CN 202110230221A CN 113029196 A CN113029196 A CN 113029196A
- Authority
- CN
- China
- Prior art keywords
- navigation
- information
- version
- navigation information
- navigation application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C25/00—Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3696—Methods or tools to render software testable
Abstract
A navigation application test method and a test platform are disclosed. The navigation application test platform comprises: the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, wherein the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application; and the processing device is used for selecting the first navigation information and the second navigation information from the storage device and calculating the difference between the selected first navigation information and the selected second navigation information. Therefore, excessive manual participation is not needed in the testing process, and the labor cost can be saved while the testing complexity is reduced.
Description
Technical Field
The present disclosure relates to the field of navigation, and in particular, to a navigation application testing method and a testing platform.
Background
The navigation application provides navigation services to the user, primarily by generating navigation planning information.
The quality of the submitted test of the navigation application is directly related to the quality of the navigation result, so the comparison test of the navigation application of the new version and the old version becomes more important.
The existing testing method mainly aims at diff testing of the interface, namely, regression testing is carried out on various information output by the interface according to a starting position and an end position. The test method has poor usability, needs professionals to execute scripts, has non-visual comparison results and lacks of difference statistical data; and the expansibility is poor, and each time one information output is added to the interface, a large amount of coding adaptation work needs to be carried out by professional personnel.
Therefore, a more convenient and practical navigation application test scheme is needed.
Disclosure of Invention
The technical problem to be solved by the present disclosure is to provide a more convenient and practical navigation application test scheme. .
According to a first aspect of the present disclosure, there is provided a navigation application testing platform, comprising: the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, wherein the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application; and the processing device is used for selecting the first navigation information and the second navigation information from the storage device and calculating the difference between the selected first navigation information and the selected second navigation information.
According to a second aspect of the present disclosure, there is provided a navigation application testing method, including: sending test configuration information to a navigation application test platform, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position; and receiving a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by the navigation application test platform through calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
According to a third aspect of the present disclosure, there is provided a navigation application testing method, including: acquiring test configuration information, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data; aiming at each piece of test data, obtaining first navigation information of the piece of test data based on the navigation application of the first version, and obtaining second navigation information of the piece of test data based on the navigation application of the second version; a difference between the first navigation information and the second navigation information is calculated.
According to a fourth aspect of the present disclosure, there is provided a navigation application testing apparatus, comprising: the system comprises a sending module, a navigation application testing platform and a test module, wherein the sending module is used for sending test configuration information to the navigation application testing platform, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more test data, and the test data comprises a starting position and an end position; the receiving module is used for receiving a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by the navigation application testing platform through calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
According to a fifth aspect of the present disclosure, there is provided a navigation application testing apparatus comprising: the system comprises a first acquisition module, a second acquisition module and a test configuration module, wherein the first acquisition module is used for acquiring test configuration information which comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data; the second acquisition module is used for acquiring first navigation information of each piece of test data based on the navigation application of the first version and acquiring second navigation information of each piece of test data based on the navigation application of the second version; and the calculating module is used for calculating the difference between the first navigation information and the second navigation information.
According to a sixth aspect of the present disclosure, there is provided a computing device comprising: a processor; and a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of the first to third aspects as described above.
According to a seventh aspect of the present disclosure, there is provided a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to perform the method of any of the first to third aspects described above.
Therefore, the method and the device can automatically realize the contrast test of the navigation applications of different versions by utilizing the navigation application test platform, the test result can be directly output to a user by the platform, excessive manual participation is not needed, and the labor cost can be saved while the test complexity is reduced.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing in greater detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.
FIG. 1 shows a schematic structural diagram of a navigation application test platform according to one embodiment of the present disclosure.
FIG. 2 shows a schematic flow diagram of a navigation application testing method according to one embodiment of the present disclosure.
FIG. 3 illustrates an tbt engine testing flow diagram based on a platform implementation according to one embodiment of the present disclosure.
Fig. 4 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure.
Fig. 5 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure.
FIG. 6 shows a schematic structural diagram of a computing device, according to one embodiment of the present disclosure.
Detailed Description
Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The navigation application referred to in the present disclosure may be an application program (navigation software) adapted to be installed and run on a device for providing a map navigation service, or may be a program module for implementing a specific navigation function in the application program (navigation software). The navigation information includes information for navigation.
That is, the navigation application may be an application program that can be independently installed and run on the client, or may be a functional module in the application program. For example, the navigation application may be a module in a navigation system for providing turn-by-turn navigation functionality. The turn-by-turn navigation means the turn-by-turn navigation, that is, the navigation information at the intersection is prompted when each intersection arrives, such as left turn, right turn, straight going, head dropping and the like. The module for providing turn-by-turn navigation functionality, which may also be referred to as the tbt engine, tbt is an abbreviation for turn by turn.
FIG. 1 shows a schematic structural diagram of a navigation application test platform according to one embodiment of the present disclosure. The navigation application test platform can provide navigation application test service, and testers can utilize the navigation application test platform to realize comparison test of navigation applications of different versions. The navigation application test platform can be arranged at a server side or a client side.
Referring to fig. 1, the navigation application testing platform 100 includes a storage device 110 and a processing device 120.
The storage device 110 is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information. The first navigation information is navigation information obtained based on a first version of a navigation application. The second navigation information is navigation information obtained based on a second version of the navigation application. The first version is different from the second version.
The first navigation information may be existing navigation information, such as navigation information that may be generated during use by a first version of the navigation application. The first navigation information may also be navigation information generated in real time, such as navigation information generated for the test data by a first version of a navigation application.
The second navigation information may be existing navigation information, such as navigation information generated during use by a second version of the navigation application. The second navigation information may also be navigation information generated in real time, such as navigation information generated for the test data by a second version of the navigation application.
By way of example, the first version may refer to an old version, as may be the version currently in use, or the version previously in use. The second version may refer to a new version, such as a new version that may be developed by a developer before the test is submitted. The first navigation information stored in the storage device 110 may be navigation information generated by the first version of navigation application during use, and the second navigation information stored in the storage device 120 may be navigation information generated by the second version of navigation application for one or more pieces of test data when the test is submitted after development is completed.
The processing device 120 is configured to select the first navigation information and the second navigation information from the storage device 110, and calculate a difference between the selected first navigation information and the selected second navigation information.
The selection of the first navigation information and the second navigation information from the storage device 110 refers to the selection of the first navigation information and the second navigation information which can be used for comparing differences from the plurality of pieces of first navigation information and the plurality of pieces of second navigation information stored in the storage device 110, that is, the navigation information obtained by different versions of navigation applications for the same test data. The difference between the selected first navigation information and the second navigation information can be used for the comparison test of the navigation applications of different versions, for example, the calculation result of the difference between the selected first navigation information and the second navigation information can be used as the comparison test result of the navigation applications of different versions. The calculating the difference between the selected first navigation information and the second navigation information may include calculating whether there is a difference between the two pieces of navigation information, and/or calculating a specific difference rate.
As described above, the navigation application may be an application program that can be independently installed and run on the client, or may be a program module for implementing a certain function in the application program, such as a turn-by-turn navigation module (i.e., tbt engine). The contents indicated by the first navigation information and the second navigation information are different according to the specific type of the navigation application. The manner in which the first navigation information and the second navigation information are selected for calculation is also different.
Taking the navigation application as an application program (e.g., navigation software) capable of being independently installed and operated, the navigation application may generate navigation information including, but not limited to, one or more items of route planning information, navigation guidance information, and journey prediction information for the start position and the end position. The path planning information is used for representing a traveling route from a starting position to a terminal position; the navigation guidance information may refer to guidance information output by the navigation application for instructing the user to travel along a travel route represented by the path planning information; the journey prediction information may be information obtained by predicting the distance, time, cost, etc. of the whole journey, such as route length, journey time consumption, journey expense (such as oil consumption), etc.
Thus, the first navigation information may include, but is not limited to, one or more of first path plan information, first navigation guidance information, and first trip prediction information; the second navigation information may include, but is not limited to, one or more of second path plan information, second navigation direction information, and second trip prediction information.
The processing device 120 may select the first navigation information and the second navigation information generated for the same or substantially the same start position and end position from the storage device 110, and calculate a difference between the first path planning information and the second path planning information in the two pieces of navigation information, and/or calculate a difference between the first navigation guidance information and the second navigation guidance information, and/or calculate a difference between the first trip prediction information and the second trip prediction information.
Specifically, various difference calculation methods may be employed. For example, in calculating the difference between the first path planning information and the second path planning information, the difference between the first navigation guidance information and the second navigation guidance information, and the difference between the first trip estimate information and the second trip estimate information, the difference may be calculated by comparing the similarity (text similarity and/or graphic similarity) therebetween, wherein the difference is inversely related to the similarity, i.e., the greater the similarity, the smaller the difference. For another example, the difference may also be calculated by comparing binary streams, that is, when comparing the difference between two pieces of information, whether there are inconsistent numbers in the binary streams of the two pieces of information may be compared, and if there are no inconsistent numbers, it may be considered that there is no difference.
Taking the navigation application as a functional module (i.e., tbt engine) for providing turn-by-turn navigation function as an example, the navigation application may generate navigation information at each intersection according to a navigation path generated based on a start position and an end position, the navigation information including, but not limited to, navigation action information for prompting a user how to travel at the intersection, voice broadcast information, enlarged intersection, and the like.
The processing device 120 may select the first navigation information and the second navigation information generated for the same or substantially the same incoming road segment and outgoing road segment from the storage device 110 and calculate a difference between the two pieces of navigation information. An intersection, that is, an intersection, refers to a place where two or more roads meet. The driving-in road section refers to a road section which is passed before reaching the intersection position, namely a section of road which is positioned behind the intersection position in the road traveling direction represented by the navigation path. The driven-out section refers to a section of road that passes after reaching the intersection position, that is, a section of road that is located in front of the intersection position in the road traveling direction represented by the navigation path.
Specifically, various difference calculation methods may be employed. For example, the difference may be calculated by comparing the similarity between the first navigation information and the second navigation information, wherein the difference is inversely related to the similarity, i.e. the greater the similarity the smaller the difference. For another example, the difference between the first navigation information and the second navigation information may also be calculated by comparing binary streams, that is, whether there is a difference between the two pieces of navigation information may be determined by comparing whether there are inconsistent numbers in the binary streams of the two pieces of navigation information, where there is no inconsistent number and it may be considered that there is no difference, optionally, a difference rate may also be calculated according to the number of inconsistent numbers, and the difference rate is positively correlated with the number of inconsistent numbers, that is, the greater the number of inconsistent numbers, the greater the difference rate is.
The difference between the first navigation information and the second navigation information obtained by calculation can be used for representing the comparison result of the navigation application of the first version and the navigation application of the second version aiming at the same test data. Therefore, the navigation application testing platform 100 may enable a user to intuitively feel a comparison result of different versions of navigation applications by outputting a difference between the first navigation information and the second navigation information.
Optionally, the processing device 120 may also evaluate the first version of the navigation application and/or the second version of the navigation application based on a difference between the first navigation information and the second navigation information, such as evaluating advantages and disadvantages of the two versions of the navigation application. For example, the processing device 120 may evaluate the performance of the two versions of the navigation application based on a difference between the first and second path planning information and a difference between the first and second trip prediction information.
When the navigation application is navigation software for performing navigation planning on the initial position and the end position, navigation information obtained by different versions of the navigation application aiming at the same initial position and end position can be directly selected for comparison.
When the navigation application is a functional module for outputting navigation information one by one, because the first navigation information and the second navigation information are the navigation information output one by one in the navigation process, the first navigation information and the second navigation information which can be used for comparison may be generated in the process of navigation planning of a navigation system which is provided with navigation applications of different versions and aims at different initial positions and end positions, and therefore, how to generate and select the proper first navigation information and the proper second navigation information which can be used for comparison is the key for realizing the disclosure.
Therefore, the present disclosure provides a general navigation information generation, selection and difference calculation scheme.
In particular, the navigation application testing platform 100 may further include a first obtaining means. The first acquisition device is used for acquiring test configuration information specified by a user, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position.
After obtaining the test configuration information specified by the user, the navigation application test platform 100 may first determine whether an executable program of a version (i.e., a first version or a second version) corresponding to the navigation application exists, and if the executable program does not exist, may also receive the executable program uploaded by the user through the client device, or may also obtain the executable program through other manners by the platform, for example, the executable program may be automatically compiled by the user or the platform.
The processing device 120 is further configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, obtain second navigation information of the piece of test data based on the navigation application of the second version, store the obtained first navigation information and the obtained second navigation information in the storage device, and store the obtained first navigation information and the obtained second navigation information in the storage device 110.
Taking the navigation application for outputting the navigation information one by one at intersections as an example, the processing device 120 may process one or more pieces of test data by running the first executable program corresponding to the navigation application of the first version to obtain the first navigation path corresponding to the test data, and perform simulated navigation on the first navigation path by running the first executable program to obtain the first navigation information output one by one at intersections in the navigation process. The first executable program may be an executable program of an application in which the first version of the navigation application is located. Specifically, in the case that the navigation application is a function module (such as an tbt engine) in the navigation system for providing turn-by-turn navigation functions, the first executable program may refer to an executable program corresponding to the navigation system in which the first version tbt engine is built.
Accordingly, the processing device 120 may process one or more pieces of test data by running a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and perform simulated navigation on the second navigation path by running the second executable program to obtain second navigation information output by the navigation application of the second version one by one at intersections during the navigation process. The first executable program may be an executable program of an application in which the first version of the navigation application is located. Specifically, in the case that the navigation application is a function module (such as an tbt engine) in the navigation system for providing turn-by-turn navigation functions, the second executable program may refer to an executable program corresponding to the navigation system in which the second version tbt engine is built.
The test configuration information may further include at least part of parameter configuration information required for simulated navigation, and the processing device 120 may perform simulated navigation on the first navigation path by executing the first executable program based on at least part of the parameter configuration information and/or perform simulated navigation on the second navigation path by executing the second executable program based on at least part of the parameter configuration information. At least part of the parameter configuration information may include, but is not limited to, configuration parameters such as GPS signal frequency.
The navigation application testing platform 100 may also include a second acquisition device. The second obtaining device is used for obtaining rules created by a user, the rules comprise a data selecting method and a difference calculating method, the data selecting method is used for indicating the selecting rules of the first navigation information and the second navigation information used for comparison, namely indicating which two pieces of data are compared, and the difference calculating method is used for indicating the difference calculating rule between the first navigation information and the second navigation information, namely how the two pieces of data are compared.
The processing device 120 may select the first navigation information and the second navigation information for which the difference needs to be calculated based on a data selection method, and calculate the difference between the selected first navigation information and the second navigation information based on a difference calculation method.
The selection rule may be, but is not limited to, that an error between the navigation paths corresponding to the first navigation information and the second navigation information does not exceed a threshold. And/or the difference calculation rule may be, but is not limited to, comparing binary streams. And/or the rule created by the user may further include a road name, where the road name is used to represent a road name of a navigation path corresponding to the first navigation information and the second navigation information for comparison, and specifically, may include, but is not limited to, a name of an incoming road segment and a name of an outgoing road segment.
When the first navigation information and the second navigation information are selected based on the rule created by the user, the processing device 120 may select the first navigation information and the second navigation information having the same road name and the error between the navigation paths not exceeding a threshold (e.g., 5 meters), and determine whether there is a difference between the two navigation information by comparing whether there is a digital inconsistency in the binary streams of the two navigation information, and the difference calculation process may refer to the above related description. The error between the navigation paths may be an error between start and end points corresponding to the navigation paths, and the navigation path mentioned here is also a navigation path at an intersection, that is, a navigation path including an incoming road segment and an outgoing road segment at the intersection.
The processing device 120 may also evaluate the first version of the navigation application and/or the second version of the navigation application based on the difference calculation result. In particular, the processing device 120 may evaluate a difference between the first version of the navigation application and the second version of the navigation application, and may also evaluate a navigation quality of the first version of the navigation application and/or a navigation quality of the second version of the navigation application. The navigation application testing platform 100 may also include an output device. The output device is used for outputting the difference calculation result and/or the evaluation result determined based on the difference calculation result.
FIG. 2 shows a schematic flow diagram of a navigation application testing method according to one embodiment of the present disclosure. Fig. 2 is a schematic diagram of the navigation application testing platform located on a server different from the client, and it should be understood that the navigation application testing platform may also be located on the client. The client may refer to a client program installed on the terminal device, such as a client corresponding to the navigation application test platform.
Referring to fig. 2, the client may perform step S110 and step S120.
In step S110, the test configuration information is sent to the navigation application test platform.
The test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more test data, the test data including a start location and an end location.
In step S120, a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result is received.
The difference calculation result is obtained by calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
That is, the navigation application testing platform may obtain the test configuration information from the client, and perform the navigation information generation and difference calculation step (i.e., step S120).
Specifically, the navigation application test platform may obtain, for each piece of test data, first navigation information of the piece of test data based on the first version of the navigation application, obtain second navigation information of the piece of test data based on the second version of the navigation application, and calculate a difference between the first navigation information and the second navigation information. For the process of acquiring the first navigation information and the second navigation information and the process of calculating the difference, the above description may be referred to, and details are not repeated herein.
As an example, the client may further execute step S130 to send the rule created by the user to the navigation application testing platform. The rules include a data selection method for indicating a selection rule of the first navigation information and the second navigation information for comparison, and a difference calculation method for indicating a difference calculation rule between the first navigation information and the second navigation information. The navigation application test platform may select appropriate navigation information from the generated plurality of pieces of first navigation information and second navigation information for difference calculation based on a rule obtained from the client, and a specific implementation process may refer to the above related description, which is not described herein again.
As an example, the navigation application testing platform may further send the difference calculation result and/or the evaluation information determined based on the difference calculation result to the client, and the client outputs the difference calculation result and/or the evaluation information determined based on the difference calculation result.
The navigation application is further described below as an tbt engine.
the tbt engine can generate navigation information, voice broadcast, enlarged intersection images and the like one by one, and is one of the most important components of the navigation system, and the quality of the submitted test of the tbt engine is directly related to the quality of the navigation result, so the comparison test of the new engine and the old engine is particularly important.
FIG. 3 illustrates an tbt engine testing flow diagram based on a platform implementation according to one embodiment of the present disclosure.
As shown in fig. 3, firstly, the relevant personnel can select the new and old engine versions, the start and end point test data sets, the GPS signal frequency and other configuration parameters on the platform, and create a diff task (i.e. a difference calculation task). The platform can judge whether the new and old engine versions selected by the relevant personnel have corresponding executable program versions, if the selected engine has no executable program version, the executable program can be automatically compiled by the platform, or the executable program can be automatically compiled by the relevant personnel and uploaded to the platform.
After obtaining the executable programs of the new and old version engines, the platform may cyclically select the test data in the start and end point test data sets (i.e., each start and end point data), and iteratively perform the following operations.
Aiming at each start-end point data, the new engine executable program and the old engine executable program respectively calculate a navigation path; aiming at the navigation path, the executable program of the new engine and the old engine carries out simulation navigation based on the selected configuration parameters; aiming at the simulated navigation, the executable program of the new engine and the old engine outputs relevant information in the navigation process to a database; and performing difference comparison on the two pieces of navigation related information output by the executable programs of the new engine and the old engine, and calculating the difference rate.
The key to the comparison of the differences between the two pieces of navigation-related information output by the old and new engine executables is which two pieces of data are to be compared, and how the two pieces of data are to be compared, the present disclosure provides a set of built-in methods for the tbt business scenario that can easily decide which two pieces of data to compare the differences, and how to compare the differences.
The general difference comparison scheme for the tbt engine is detailed below.
For a new output information, such as a road name, the relevant person creates a rule on the platform, where the rule may include the name of the information, the name of the built-in method for which two pieces of data are to be differentiated (corresponding to the above-mentioned selection rule), and the name of the built-in method for how two pieces of data are to be differentiated (corresponding to the above-mentioned difference calculation rule).
For example, the rule may be expressed as:
rule(
name is the name of the road name,
which＝“pos_5”，
how＝″match_without_number″
)
the road name is an information name, and the name can be displayed on the platform as a label; the pos _5 is a built-in method name for making difference between two pieces of data, and the method represents that the error of a GPS point of the two pieces of data does not exceed 5 meters; "match _ without _ number" is a built-in method name of how two pieces of data are compared to be different, and the method represents that if there are digits in the information which are not consistent, the data can be considered to be different, otherwise, if there are digits in the information which are consistent, the data can be considered to be not different.
Therefore, the universal difference comparison platform for the tbt engine is designed in the disclosure, any person can perform comparison tests on the new and old engines for the navigation information existing in the tbt engine, and most people can also realize the comparison tests through new rules for the newly added navigation information of the tbt engine after training, so that the test cost is greatly reduced. Moreover, the comparison result is visual, complex manual intervention is not needed, a new output information comparison can be added in the several-row configuration, and the platform also supports real-time checking of the task progress in the diff task process.
Fig. 4 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure. Wherein the functional elements of the navigation application testing apparatus may be implemented by hardware, software, or a combination of hardware and software implementing the principles of the present disclosure. It will be appreciated by those skilled in the art that the functional units described in fig. 4 may be combined or divided into sub-units to implement the principles of the invention described above. Thus, the description herein may support any possible combination, or division, or further definition of the functional units described herein.
In the following, functional units that the navigation application testing apparatus can have and operations that each functional unit can perform are briefly described, and for the details related thereto, reference may be made to the above description, which is not repeated herein.
Referring to fig. 4, the navigation application testing apparatus 400 includes a transmitting module 410 and a receiving module 420.
The sending module 410 is configured to send test configuration information to the navigation application testing platform, where the test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more test data, and the test data includes a start position and an end position.
The receiving module 420 is configured to receive a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, where the difference calculation result is obtained by the navigation application testing platform by calculating a difference between first navigation information obtained for the test data based on the first version of the navigation application and second navigation information obtained for the test data based on the second version of the navigation application.
The sending module 410 may further send a rule created by a user to the navigation application testing platform, where the rule includes a data selecting method for indicating a selecting rule of the first navigation information and the second navigation information for comparison and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information.
Fig. 5 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure. Wherein the functional elements of the navigation application testing apparatus may be implemented by hardware, software, or a combination of hardware and software implementing the principles of the present disclosure. It will be appreciated by those skilled in the art that the functional units described in fig. 5 may be combined or divided into sub-units to implement the principles of the invention described above. Thus, the description herein may support any possible combination, or division, or further definition of the functional units described herein.
In the following, functional units that the navigation application testing apparatus can have and operations that each functional unit can perform are briefly described, and for the details related thereto, reference may be made to the above description, which is not repeated herein.
Referring to fig. 5, the navigation application testing apparatus 500 includes a first obtaining module 510, a second obtaining module 520, and a calculating module 530.
The first obtaining module 510 is configured to obtain test configuration information, where the test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more pieces of test data. The second obtaining module 520 is configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, and obtain second navigation information of the piece of test data based on the navigation application of the second version. The calculation module 530 is used for calculating a difference between the first navigation information and the second navigation information.
As an example, the first obtaining module 510 may further obtain a rule created by the user, where the rule includes a data selecting method for indicating a selecting rule of the first navigation information and the second navigation information for comparison and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information. The second obtaining module 520 may select the first navigation information and the second navigation information for which the difference needs to be calculated based on a data selection method, and calculate the difference between the selected first navigation information and the second navigation information based on a difference calculation method.
The navigation application testing device 500 may further include an output module for outputting the difference calculation result and/or evaluation information determined based on the difference calculation result. When the navigation application testing apparatus 500 is located at the server side, the output module may transmit the difference calculation result and/or the evaluation information determined based on the difference calculation result to the client device, and the client device outputs the difference calculation result and/or the evaluation information determined based on the difference calculation result.
FIG. 6 is a schematic structural diagram of a computing device that can be used to implement the navigation application testing method according to an embodiment of the present invention.
Referring to fig. 6, computing device 600 includes memory 610 and processor 620.
The processor 620 may be a multi-core processor or may include a plurality of processors. In some embodiments, processor 620 may include a general-purpose host processor and one or more special coprocessors such as a Graphics Processor (GPU), a Digital Signal Processor (DSP), or the like. In some embodiments, processor 620 may be implemented using custom circuits, such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA).
The memory 610 may include various types of storage units, such as system memory, Read Only Memory (ROM), and permanent storage. Wherein the ROM may store static data or instructions that are required by the processor 620 or other modules of the computer. The persistent storage device may be a read-write storage device. The persistent storage may be a non-volatile storage device that does not lose stored instructions and data even after the computer is powered off. In some embodiments, the persistent storage device employs a mass storage device (e.g., magnetic or optical disk, flash memory) as the persistent storage device. In other embodiments, the permanent storage may be a removable storage device (e.g., floppy disk, optical drive). The system memory may be a read-write memory device or a volatile read-write memory device, such as a dynamic random access memory. The system memory may store instructions and data that some or all of the processors require at runtime. In addition, the memory 610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), magnetic and/or optical disks, may also be employed. In some embodiments, memory 610 may include a removable storage device that is readable and/or writable, such as a Compact Disc (CD), a digital versatile disc read only (e.g., DVD-ROM, dual layer DVD-ROM), a Blu-ray disc read only, an ultra-dense disc, a flash memory card (e.g., SD card, min SD card, Micro-SD card, etc.), a magnetic floppy disk, or the like. Computer-readable storage media do not contain carrier waves or transitory electronic signals transmitted by wireless or wired means.
The memory 610 has stored thereon executable code that, when processed by the processor 620, causes the processor 620 to perform the navigation application testing methods described above.
The navigation application testing platform, method, apparatus and device according to the present invention have been described in detail above with reference to the accompanying drawings.
Furthermore, the method according to the invention may also be implemented as a computer program or computer program product comprising computer program code instructions for carrying out the above-mentioned steps defined in the above-mentioned method of the invention.
Alternatively, the invention may also be embodied as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon executable code (or a computer program, or computer instruction code) which, when executed by a processor of an electronic device (or computing device, server, etc.), causes the processor to perform the steps of the above-described method according to the invention.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems and methods according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (19)
1. A navigation application testing platform, comprising:
the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, wherein the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application;
and the processing device is used for selecting the first navigation information and the second navigation information from the storage device and calculating the difference between the selected first navigation information and the selected second navigation information.
2. The navigation application testing platform of claim 1, further comprising:
first acquiring means for acquiring test configuration information specified by a user, the test configuration information including a first version of a navigation application, a second version of the navigation application, and one or more pieces of test data,
the processing device is further configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, obtain second navigation information of the piece of test data based on the navigation application of the second version, and store the obtained first navigation information and the obtained second navigation information in the storage device.
3. The navigation application testing platform of claim 2, wherein the navigation application is configured to output navigation information on a crossing-by-crossing basis, the test data including a start position and an end position,
the processing device processes one or more pieces of test data by running a first executable program corresponding to the navigation application of the first version to obtain a first navigation path corresponding to the test data, and performs simulated navigation on the first navigation path by running the first executable program to obtain first navigation information output by the navigation application of the first version one by one at intersections in the navigation process, and/or
The processing device processes one or more pieces of test data by running a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and performs simulated navigation on the second navigation path by running the second executable program to obtain second navigation information output by the navigation application of the second version one by one at intersections in the navigation process.
4. The navigation application testing platform of claim 3,
the test configuration information further comprises at least part of parameter configuration information required for simulated navigation,
the processing device simulates navigation of the first navigation path by running the first executable program based on at least part of the parameter configuration information and/or simulates navigation of the second navigation path by running the second executable program based on at least part of the parameter configuration information.
5. The navigation application testing platform of claim 1, further comprising:
second acquiring means for acquiring a rule created by a user, the rule including a data selecting method for indicating a selecting rule of first navigation information and second navigation information for comparison and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information, wherein,
the processing device selects first navigation information and second navigation information of which the difference needs to be calculated based on the data selection method, and calculates the difference between the selected first navigation information and the second navigation information based on the difference calculation method.
6. The navigation application testing platform of claim 5,
the rule further comprises a road name, wherein the road name is used for representing the road name of the navigation path corresponding to the first navigation information and the second navigation information for comparison, and/or
The selection rule is that the error between the navigation paths corresponding to the first navigation information and the second navigation information does not exceed a threshold value, and/or
The difference calculation rule is whether the comparison binary stream is consistent or not.
7. The navigation application testing platform of claim 1,
the first navigation information includes one or more of first path planning information, first navigation guidance information, and first trip prediction information, the second navigation information includes one or more of second path planning information, second navigation guidance information, and second trip prediction information,
the processing device is used for selecting first navigation information and second navigation information which are generated aiming at the same or basically same starting position and end position from the storage device, calculating the difference between the first path planning information and the second path planning information, and/or calculating the difference between the first navigation guidance information and the second navigation guidance information, and/or calculating the difference between the first journey estimation information and the second journey estimation information.
8. The navigation application testing platform of claim 1,
the processing means is further adapted to evaluate the first version of the navigation application and/or the second version of the navigation application based on a difference calculation result, and/or
The navigation application test platform further comprises: and sending means for sending the difference calculation result and/or the evaluation result determined based on the difference calculation result to the client.
9. A navigation application testing method comprises the following steps:
sending test configuration information to a navigation application test platform, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position;
receiving a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by the navigation application test platform by calculating a difference between first navigation information obtained for the test data based on the first version of the navigation application and second navigation information obtained for the test data based on the second version of the navigation application.
10. The navigation application testing method of claim 9, further comprising:
and sending a rule created by a user to the navigation application test platform, wherein the rule comprises a data selection method and a difference calculation method, the data selection method is used for indicating a selection rule of the first navigation information and the second navigation information for comparison, and the difference calculation method is used for indicating a difference calculation rule between the first navigation information and the second navigation information.
11. The navigation application testing method of claim 10,
the rule further comprises a road name, wherein the road name is used for representing the road name of the navigation path corresponding to the first navigation information and the second navigation information for comparison, and/or
The selection rule is that the error between the navigation paths corresponding to the first navigation information and the second navigation information does not exceed a threshold value, and/or
The difference calculation rule is whether the comparison binary stream is consistent or not.
12. A navigation application testing method comprises the following steps:
acquiring test configuration information, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data;
for each piece of test data, obtaining first navigation information of the piece of test data based on the navigation application of the first version, and obtaining second navigation information of the piece of test data based on the navigation application of the second version;
a difference between the first navigation information and the second navigation information is calculated.
13. The navigation application testing method of claim 12, wherein the navigation application is configured to output navigation information on an intersection-by-intersection basis, the test data includes a start position and an end position,
the step of obtaining the first navigation information of the piece of test data based on the navigation application of the first version comprises the following steps: processing the test data by operating a first executable program corresponding to the navigation application of the first version to obtain a first navigation path corresponding to the test data, and performing simulated navigation on the first navigation path by operating the first executable program to obtain first navigation information output by the navigation application of the first version one by one at intersections in the navigation process, and/or
The step of obtaining the second navigation information of the piece of test data based on the navigation application of the second version comprises: and processing the test data by operating a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and performing simulated navigation on the second navigation path by operating the second executable program to obtain second navigation information output by the navigation application of the second version one by one at intersections in the navigation process.
14. The navigation application testing method of claim 12, further comprising:
acquiring a rule created by a user, the rule including a data selection method for indicating a selection rule of first navigation information and second navigation information for comparison and a difference calculation method for indicating a difference calculation rule between the first navigation information and the second navigation information,
wherein the step of calculating the difference between the first navigation information and the second navigation information comprises: and selecting the first navigation information and the second navigation information which need to calculate the difference based on the data selection method, and calculating the difference between the selected first navigation information and the selected second navigation information based on the difference calculation method.
15. The navigation application testing method of claim 14, further comprising:
outputting the difference calculation result and/or evaluation information determined based on the difference calculation result.
16. A navigation application testing device, comprising:
the system comprises a sending module, a test module and a test module, wherein the sending module is used for sending test configuration information to a navigation application test platform, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more test data, and the test data comprises a starting position and an end position;
a receiving module, configured to receive a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, where the difference calculation result is obtained by the navigation application testing platform by calculating a difference between first navigation information obtained for the test data by the navigation application based on the first version and second navigation information obtained for the test data by the navigation application based on the second version.
17. A navigation application testing device, comprising:
the system comprises a first acquisition module, a second acquisition module and a test configuration module, wherein the first acquisition module is used for acquiring test configuration information which comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data;
the second acquisition module is used for acquiring first navigation information of each piece of test data based on the navigation application of the first version and acquiring second navigation information of each piece of test data based on the navigation application of the second version aiming at each piece of test data;
and the calculating module is used for calculating the difference between the first navigation information and the second navigation information.
18. A computing device, comprising:
a processor; and
a memory having executable code stored thereon which, when executed by the processor, causes the processor to perform the method of any of claims 9 to 15.
19. A non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to perform the method of any of claims 9 to 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110230221.8A CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110230221.8A CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113029196A true CN113029196A (en) | 2021-06-25 |
| CN113029196B CN113029196B (en) | 2022-10-18 |
Family
ID=76465485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110230221.8A Active CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113029196B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114427867A (en) * | 2022-04-07 | 2022-05-03 | 北京骑胜科技有限公司 | Performance verification method and device of combined navigation model |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130116924A1 (en) * | 2009-08-20 | 2013-05-09 | Ford Global Technologies, Llc | Methods and Systems for Testing Navigation Routes |
| CN109086210A (en) * | 2018-08-14 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | For testing the navigation information method and apparatus of navigation application |
| CN109146333A (en) * | 2018-09-29 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Navigation algorithm appraisal procedure and device |
| CN109634872A (en) * | 2019-02-25 | 2019-04-16 | 北京达佳互联信息技术有限公司 | Application testing method, device, terminal and storage medium |
| CN210015237U (en) * | 2018-12-18 | 2020-02-04 | 深圳华大北斗科技有限公司 | Navigation module test system |
| CN111123321A (en) * | 2019-12-03 | 2020-05-08 | 深圳华大北斗科技有限公司 | Navigation product test system and method |
-
2021
- 2021-03-02 CN CN202110230221.8A patent/CN113029196B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130116924A1 (en) * | 2009-08-20 | 2013-05-09 | Ford Global Technologies, Llc | Methods and Systems for Testing Navigation Routes |
| CN109086210A (en) * | 2018-08-14 | 2018-12-25 | 百度在线网络技术（北京）有限公司 | For testing the navigation information method and apparatus of navigation application |
| CN109146333A (en) * | 2018-09-29 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Navigation algorithm appraisal procedure and device |
| CN210015237U (en) * | 2018-12-18 | 2020-02-04 | 深圳华大北斗科技有限公司 | Navigation module test system |
| CN109634872A (en) * | 2019-02-25 | 2019-04-16 | 北京达佳互联信息技术有限公司 | Application testing method, device, terminal and storage medium |
| CN111123321A (en) * | 2019-12-03 | 2020-05-08 | 深圳华大北斗科技有限公司 | Navigation product test system and method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114427867A (en) * | 2022-04-07 | 2022-05-03 | 北京骑胜科技有限公司 | Performance verification method and device of combined navigation model |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113029196B (en) | 2022-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109215372B (en) | Road network information updating method, device and equipment | |
| Krukar et al. | The effect of orientation instructions on the recall and reuse of route and survey elements in wayfinding descriptions | |
| JP3842799B2 (en) | Map data providing device | |
| JP2005115687A (en) | Road maintenance support system | |
| CN103294594A (en) | Test based static analysis misinformation eliminating method | |
| US20160110654A1 (en) | Statistical estimation of origin and destination points of trip using plurality of types of data sources | |
| US10488206B2 (en) | Method and system for improving spatial accuracy of map data | |
| CN113029196B (en) | Navigation application test method and test platform | |
| US20170308625A1 (en) | Computer-readable recording medium, road construction planning method, and information processing apparatus | |
| CN115384516A (en) | Tire wear mileage calculation method, device and equipment for transport vehicle | |
| JP2015049187A (en) | Simulation travel route generation method and system | |
| US9110921B2 (en) | Map editing with little user input | |
| KR101423968B1 (en) | Data processing method for road driving test in driver's license test, and computer-readable recording medium with data processing program for road driving test for the same | |
| CN117146847A (en) | Automobile route planning algorithm test system, method, equipment and medium | |
| CN108595095B (en) | Method and device for simulating movement locus of target body based on gesture control | |
| CN110648008A (en) | Road condition prediction method and device | |
| JP7381719B2 (en) | Data generation device, data generation method, and program | |
| Ocana et al. | Automatic linguistic reporting of customer activity patterns in open malls | |
| US20140039789A1 (en) | Dynamic progressive map granularity for navigation | |
| CN108509635B (en) | Method and apparatus for generating information | |
| CN113008246A (en) | Map matching method and device | |
| JP7444805B2 (en) | Data preparation system, data preparation method | |
| CN113029146A (en) | Navigation action prediction model training method, navigation action generation method and device | |
| JP7438797B2 (en) | Information processing device, industry estimation method, industry estimation program, and its storage medium | |
| CN109000662B (en) | Navigation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |