CN113029196B - Navigation application test method and test platform - Google Patents
Navigation application test method and test platform Download PDFInfo
- Publication number
- CN113029196B CN113029196B CN202110230221.8A CN202110230221A CN113029196B CN 113029196 B CN113029196 B CN 113029196B CN 202110230221 A CN202110230221 A CN 202110230221A CN 113029196 B CN113029196 B CN 113029196B
- Authority
- CN
- China
- Prior art keywords
- navigation
- information
- version
- navigation information
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C25/00—Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3696—Methods or tools to render software testable
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Navigation (AREA)
- Debugging And Monitoring (AREA)
Abstract
A navigation application test method and a test platform are disclosed. The navigation application test platform comprises: the device comprises a storage device and a control device, wherein the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application; and the processing device is used for selecting the first navigation information and the second navigation information from the storage device and calculating the difference between the selected first navigation information and the selected second navigation information. Therefore, excessive manual participation is not needed in the testing process, and the labor cost can be saved while the testing complexity is reduced.
Description
Technical Field
The present disclosure relates to the field of navigation, and in particular, to a navigation application testing method and a testing platform.
Background
The navigation application provides navigation services to the user, primarily by generating navigation planning information.
The quality of the submitted test of the navigation application is directly related to the quality of the navigation result, so the comparison test of the navigation application of the new version and the old version becomes more important.
The existing testing method mainly aims at diff testing of the interface, namely, regression testing is carried out on various information output by the interface according to a starting position and an end position. The test method has poor usability, needs professionals to execute scripts, has non-visual comparison results and lacks of difference statistical data; and the expansibility is poor, and each time one information output is added to the interface, a large amount of coding adaptation work needs to be carried out by professional personnel.
Therefore, a more convenient and practical navigation application test scheme is needed.
Disclosure of Invention
The technical problem to be solved by the present disclosure is to provide a more convenient and practical navigation application test scheme.
According to a first aspect of the present disclosure, there is provided a navigation application testing platform, comprising: the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, wherein the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application; and the processing device is used for selecting the first navigation information and the second navigation information from the storage device and calculating the difference between the selected first navigation information and the selected second navigation information.
According to a second aspect of the present disclosure, there is provided a navigation application testing method, including: sending test configuration information to a navigation application test platform, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position; and receiving a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by the navigation application test platform through calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
According to a third aspect of the present disclosure, there is provided a navigation application testing method, including: acquiring test configuration information, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data; aiming at each piece of test data, obtaining first navigation information of the piece of test data based on the navigation application of the first version, and obtaining second navigation information of the piece of test data based on the navigation application of the second version; a difference between the first navigation information and the second navigation information is calculated.
According to a fourth aspect of the present disclosure, there is provided a navigation application testing apparatus, comprising: the system comprises a sending module, a navigation application testing platform and a test module, wherein the sending module is used for sending test configuration information to the navigation application testing platform, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more test data, and the test data comprises a starting position and an end position; the receiving module is used for receiving a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by the navigation application testing platform through calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
According to a fifth aspect of the present disclosure, there is provided a navigation application testing apparatus comprising: the system comprises a first acquisition module, a second acquisition module and a test configuration module, wherein the first acquisition module is used for acquiring test configuration information which comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data; the second acquisition module is used for acquiring first navigation information of each piece of test data based on the navigation application of the first version and acquiring second navigation information of each piece of test data based on the navigation application of the second version; and the calculating module is used for calculating the difference between the first navigation information and the second navigation information.
According to a sixth aspect of the present disclosure, there is provided a computing device comprising: a processor; and a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of the first to third aspects as described above.
According to a seventh aspect of the present disclosure, there is provided a non-transitory machine-readable storage medium having stored thereon executable code, which when executed by a processor of an electronic device, causes the processor to perform the method of any of the first to third aspects described above.
Therefore, the method and the device can automatically realize the contrast test of the navigation applications of different versions by utilizing the navigation application test platform, the test result can be directly output to a user by the platform, excessive manual participation is not needed, and the labor cost can be saved while the test complexity is reduced.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing in greater detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.
FIG. 1 shows a schematic structural diagram of a navigation application test platform according to one embodiment of the present disclosure.
FIG. 2 shows a schematic flow diagram of a navigation application testing method according to one embodiment of the present disclosure.
FIG. 3 shows a tbt engine test flow diagram based on a platform implementation according to one embodiment of the present disclosure.
Fig. 4 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure.
Fig. 5 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure.
FIG. 6 shows a schematic structural diagram of a computing device, according to one embodiment of the present disclosure.
Detailed Description
Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The navigation application referred to in the present disclosure may be an application program (navigation software) adapted to be installed and run on a device for providing a map navigation service, or may be a program module for implementing a specific navigation function in the application program (navigation software). The navigation information includes information for navigation.
That is, the navigation application may be an application program that can be independently installed and run on the client, or may be a functional module in the application program. For example, the navigation application may be a module in a navigation system for providing turn-by-turn navigation functionality. The turn-by-turn navigation means the turn-by-turn navigation, that is, the navigation information at the intersection is prompted when each intersection arrives, such as left turn, right turn, straight going, head dropping and the like. The module for providing turn-by-turn navigation functionality, which may also be referred to as tbt engine, tbt is an abbreviation for turn by turn.
FIG. 1 shows a schematic structural diagram of a navigation application test platform according to one embodiment of the present disclosure. The navigation application test platform can provide navigation application test service, and testers can utilize the navigation application test platform to realize comparison test of navigation applications of different versions. The navigation application test platform can be arranged at a server side or a client side.
Referring to fig. 1, the navigation application testing platform 100 includes a storage device 110 and a processing device 120.
The storage device 110 is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information. The first navigation information is navigation information obtained based on a first version of a navigation application. The second navigation information is navigation information obtained based on a second version of the navigation application. The first version is different from the second version.
The first navigation information may be existing navigation information, such as navigation information generated by a first version of the navigation application during use. The first navigation information may also be navigation information generated in real time, such as navigation information generated for the test data by a first version of a navigation application.
The second navigation information may be existing navigation information, such as navigation information generated during use by a second version of the navigation application. The second navigation information may also be navigation information generated in real time, such as navigation information generated for the test data by a second version of a navigation application.
By way of example, the first version may refer to an old version, as may be the version currently in use, or the version previously in use. The second version may refer to a new version, such as a new version that may be developed by a developer before the test is submitted. The first navigation information stored in the storage device 110 may be navigation information generated by the first version of navigation application during use, and the second navigation information stored in the storage device 120 may be navigation information generated by the second version of navigation application for one or more pieces of test data when the test is submitted after development is completed.
The processing device 120 is configured to select the first navigation information and the second navigation information from the storage device 110, and calculate a difference between the selected first navigation information and the selected second navigation information.
The selection of the first navigation information and the second navigation information from the storage device 110 refers to the selection of the first navigation information and the second navigation information which can be used for comparing differences from the plurality of pieces of first navigation information and the plurality of pieces of second navigation information stored in the storage device 110, that is, the navigation information obtained by different versions of navigation applications for the same test data. The difference between the selected first navigation information and the second navigation information can be used for the comparison test of the navigation applications of different versions, for example, the calculation result of the difference between the selected first navigation information and the second navigation information can be used as the comparison test result of the navigation applications of different versions. The calculating the difference between the selected first navigation information and the second navigation information may include calculating whether there is a difference between the two pieces of navigation information, and/or calculating a specific difference rate.
As described above, the navigation application may be an application program capable of being independently installed and running on the client, or may be a program module for implementing a certain function in the application program, such as a turn-by-turn navigation module (i.e., tbt engine). The contents indicated by the first navigation information and the second navigation information are different according to the specific type of the navigation application. The manner in which the first navigation information and the second navigation information are selected for calculation is also different.
Taking the navigation application as an application program (e.g., navigation software) capable of being independently installed and operated, the navigation application may generate navigation information including, but not limited to, one or more items of route planning information, navigation guidance information, and journey prediction information for the start position and the end position. The path planning information is used for representing a traveling route from a starting position to a terminal position; the navigation guidance information may refer to guidance information output by the navigation application for instructing the user to travel along a travel route represented by the path planning information; the journey prediction information may be information obtained by predicting the distance, time, cost, etc. of the whole journey, such as route length, journey time consumption, journey expense (such as oil consumption), etc.
Thus, the first navigation information may include, but is not limited to, one or more of first path plan information, first navigation guidance information, and first trip prediction information; the second navigation information may include, but is not limited to, one or more of second path plan information, second navigation direction information, and second trip prediction information.
The processing device 120 may select the first navigation information and the second navigation information generated for the same or substantially the same start position and end position from the storage device 110, and calculate a difference between the first path planning information and the second path planning information in the two pieces of navigation information, and/or calculate a difference between the first navigation guidance information and the second navigation guidance information, and/or calculate a difference between the first trip prediction information and the second trip prediction information.
Specifically, various difference calculation methods may be employed. For example, in calculating the difference between the first path planning information and the second path planning information, the difference between the first navigation guidance information and the second navigation guidance information, and the difference between the first trip estimate information and the second trip estimate information, the difference may be calculated by comparing the similarity (text similarity and/or graphic similarity) therebetween, wherein the difference is inversely related to the similarity, i.e., the greater the similarity, the smaller the difference. For another example, the difference may also be calculated by comparing binary streams, that is, when comparing the difference between two pieces of information, whether there are inconsistent numbers in the binary streams of the two pieces of information may be compared, and if there are no inconsistent numbers, it may be considered that there is no difference.
Taking the navigation application as a functional module (i.e., tbt engine) for providing the turn-by-turn navigation function as an example, the navigation application may generate navigation information at each intersection according to a navigation path generated based on the start position and the end position, where the navigation information includes, but is not limited to, navigation action information for prompting a user how to travel at the intersection, voice broadcast information, an enlarged intersection view, and the like.
The processing device 120 may select the first navigation information and the second navigation information generated for the same or substantially the same incoming road segment and outgoing road segment from the storage device 110 and calculate a difference between the two pieces of navigation information. An intersection, that is, an intersection, refers to a place where two or more roads meet. The driving-in road section refers to a road section which is passed by before reaching the intersection position, namely a section of road which is positioned behind the intersection position in the road traveling direction represented by the navigation path. The driven-out section refers to a section of road that passes after reaching the intersection position, that is, a section of road that is located in front of the intersection position in the road traveling direction represented by the navigation path.
Specifically, various difference calculation methods may be employed. For example, the difference may be calculated by comparing the similarity between the first navigation information and the second navigation information, wherein the difference is inversely related to the similarity, i.e. the greater the similarity the smaller the difference. For another example, the difference between the first navigation information and the second navigation information may also be calculated by comparing binary streams, that is, whether there is a difference between the two pieces of navigation information may be determined by comparing whether there are inconsistent numbers in the binary streams of the two pieces of navigation information, where there is no inconsistent number and it may be considered that there is no difference, optionally, a difference rate may also be calculated according to the number of inconsistent numbers, and the difference rate is positively correlated with the number of inconsistent numbers, that is, the greater the number of inconsistent numbers, the greater the difference rate is.
The difference between the first navigation information and the second navigation information obtained by calculation can be used for representing the comparison result of the navigation application of the first version and the navigation application of the second version aiming at the same test data. Therefore, the navigation application testing platform 100 may enable the user to intuitively feel the comparison result of different versions of the navigation application by outputting the difference between the first navigation information and the second navigation information.
Optionally, the processing device 120 may also evaluate the first version of the navigation application and/or the second version of the navigation application based on a difference between the first navigation information and the second navigation information, such as evaluating advantages and disadvantages of the two versions of the navigation application. For example, the processing device 120 may evaluate the performance of the two versions of the navigation application based on a difference between the first and second path planning information and a difference between the first and second trip prediction information.
When the navigation application is navigation software for performing navigation planning on the initial position and the end position, navigation applications of different versions can be directly selected to compare navigation information obtained by aiming at the same initial position and the same end position.
When the navigation application is a functional module for outputting navigation information one by one, because the first navigation information and the second navigation information are the navigation information output one by one in the navigation process, the first navigation information and the second navigation information which can be used for comparison may be generated in the process of navigation planning of a navigation system which is provided with navigation applications of different versions and aims at different initial positions and end positions, and therefore, how to generate and select the proper first navigation information and the proper second navigation information which can be used for comparison is the key for realizing the disclosure.
Therefore, the present disclosure provides a general navigation information generation, selection and difference calculation scheme.
In particular, the navigation application testing platform 100 may further include a first obtaining means. The first acquisition device is used for acquiring test configuration information specified by a user, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position.
After obtaining the test configuration information specified by the user, the navigation application test platform 100 may first determine whether an executable program of a version (i.e., a first version or a second version) corresponding to the navigation application exists, and if the executable program does not exist, may also receive the executable program uploaded by the user through the client device, or may also obtain the executable program through other methods by the platform, for example, the executable program may be automatically compiled by the user or the platform.
The processing device 120 is further configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, obtain second navigation information of the piece of test data based on the navigation application of the second version, store the obtained first navigation information and the obtained second navigation information in the storage device, and store the obtained first navigation information and the obtained second navigation information in the storage device 110.
Taking the navigation application for outputting the navigation information one by one at intersections as an example, the processing device 120 may process one or more pieces of test data by running the first executable program corresponding to the navigation application of the first version to obtain the first navigation path corresponding to the test data, and perform simulated navigation on the first navigation path by running the first executable program to obtain the first navigation information output one by one at intersections in the navigation process. The first executable program may be an executable program of an application in which the first version of the navigation application is located. Specifically, in the case that the navigation application is a functional module (such as tbt engine) in the navigation system for providing turn-by-turn navigation functions, the first executable program may refer to an executable program corresponding to the navigation system in which the first version of tbt engine is built.
Accordingly, the processing device 120 may process one or more pieces of test data by running a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and perform simulated navigation on the second navigation path by running the second executable program to obtain second navigation information output by the navigation application of the second version from intersection to intersection in the navigation process. The first executable program may be an executable program of an application in which the first version of the navigation application is located. Specifically, in the case that the navigation application is a functional module (such as tbt engine) in the navigation system for providing turn-by-turn navigation functions, the second executable program may refer to an executable program corresponding to the navigation system with a second version of tbt engine built therein.
The test configuration information may further include at least part of parameter configuration information required for simulated navigation, and the processing device 120 performs simulated navigation on the first navigation path by running a first executable program based on at least part of the parameter configuration information and/or performs simulated navigation on the second navigation path by running a second executable program based on at least part of the parameter configuration information. At least part of the parameter configuration information may include, but is not limited to, configuration parameters such as GPS signal frequency.
The navigation application testing platform 100 may also include a second acquisition device. The second obtaining device is used for obtaining rules created by a user, the rules comprise a data selecting method and a difference calculating method, the data selecting method is used for indicating the selecting rules of the first navigation information and the second navigation information used for comparison, namely indicating which two pieces of data are compared, and the difference calculating method is used for indicating the difference calculating rule between the first navigation information and the second navigation information, namely how the two pieces of data are compared.
The processing device 120 may select the first navigation information and the second navigation information for which the difference needs to be calculated based on a data selection method, and calculate the difference between the selected first navigation information and the second navigation information based on a difference calculation method.
The selection rule may be, but is not limited to, that an error between the navigation paths corresponding to the first navigation information and the second navigation information does not exceed a threshold. And/or the difference calculation rule may be, but is not limited to, comparing binary streams. And/or the rule created by the user may further include a road name, where the road name is used to represent a road name of a navigation path corresponding to the first navigation information and the second navigation information for comparison, and specifically, may include, but is not limited to, a name of an incoming road segment and a name of an outgoing road segment.
When the first navigation information and the second navigation information are selected based on the rule created by the user, the processing device 120 may select the first navigation information and the second navigation information having the same road name and the error between the navigation paths not exceeding a threshold (e.g., 5 meters), and determine whether there is a difference between the two navigation information by comparing whether there is a digital inconsistency in the binary streams of the two navigation information, and the difference calculation process may refer to the above related description. The error between the navigation paths may be an error between start and end points corresponding to the navigation paths, and the navigation path mentioned here is also a navigation path at an intersection, that is, a navigation path including an incoming road segment and an outgoing road segment at the intersection.
The processing device 120 may also evaluate the first version of the navigation application and/or the second version of the navigation application based on the difference calculation. Specifically, the processing device 120 may evaluate a difference between the first version of the navigation application and the second version of the navigation application, and may also evaluate the navigation quality of the first version of the navigation application and/or the navigation quality of the second version of the navigation application. The navigation application testing platform 100 may also include an output device. The output device is used for outputting the difference calculation result and/or the evaluation result determined based on the difference calculation result.
FIG. 2 shows a schematic flow chart of a navigation application testing method according to one embodiment of the present disclosure. Fig. 2 is a schematic diagram of the navigation application testing platform located on a server different from the client, and it should be understood that the navigation application testing platform may also be located on the client. The client may refer to a client program installed on the terminal device, such as a client corresponding to the navigation application test platform.
Referring to fig. 2, the client may perform step S110 and step S120.
In step S110, the test configuration information is sent to the navigation application test platform.
The test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more test data, the test data including a start location and an end location.
In step S120, a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result is received.
The difference calculation result is obtained by calculating the difference between first navigation information obtained by the navigation application based on the first version aiming at the test data and second navigation information obtained by the navigation application based on the second version aiming at the test data.
That is, the navigation application testing platform may obtain the test configuration information from the client, and perform the navigation information generation and difference calculation step (i.e., step S120).
Specifically, the navigation application test platform may obtain, for each piece of test data, first navigation information of the piece of test data based on the first version of the navigation application, obtain second navigation information of the piece of test data based on the second version of the navigation application, and calculate a difference between the first navigation information and the second navigation information. For the process of acquiring the first navigation information and the second navigation information and the process of calculating the difference, the above description may be referred to, and details are not repeated herein.
As an example, the client may further execute step S130 to send the rule created by the user to the navigation application testing platform. The rules include a data selection method for indicating a selection rule of the first navigation information and the second navigation information for comparison, and a difference calculation method for indicating a difference calculation rule between the first navigation information and the second navigation information. The navigation application test platform may select appropriate navigation information from the generated plurality of pieces of first navigation information and second navigation information for difference calculation based on a rule obtained from the client, and a specific implementation process may refer to the above related description, which is not described herein again.
As an example, the navigation application testing platform may further send the difference calculation result and/or the evaluation information determined based on the difference calculation result to the client, and the client outputs the difference calculation result and/or the evaluation information determined based on the difference calculation result.
The navigation application is further described below as tbt engine.
5363 the engine tbt can generate navigation information, voice broadcast, intersection enlargement one by one, which is one of the most important components of the navigation system, and the quality of the submitted test of the tbt engine is directly related to the quality of the navigation result, so the comparison test of the new engine and the old engine is very important.
FIG. 3 shows a tbt engine test flow diagram based on a platform implementation according to one embodiment of the present disclosure.
As shown in fig. 3, firstly, the relevant personnel can select the new and old engine versions, the start and end point test data sets, the GPS signal frequency and other configuration parameters on the platform, and create a diff task (i.e. a difference calculation task). The platform can judge whether the new and old engine versions selected by the relevant personnel have corresponding executable program versions, if the selected engine has no executable program version, the executable program can be automatically compiled by the platform, or the executable program can be automatically compiled by the relevant personnel and uploaded to the platform.
After obtaining the executable programs of the new and old version engines, the platform may loop through the test data in the start and end point test data set (i.e., each start and end point data), and iteratively perform the following operations.
Aiming at each start-end point data, the new engine executable program and the old engine executable program respectively calculate a navigation path; aiming at the navigation path, the executable program of the new engine and the old engine carries out simulation navigation based on the selected configuration parameters; aiming at the simulated navigation, the executable program of the new engine and the old engine outputs relevant information in the navigation process to a database; and performing difference comparison on the two pieces of navigation related information output by the executable programs of the new engine and the old engine, and calculating the difference rate.
The key to the difference comparison between two pieces of navigation related information output by the executable programs of the new engine and the old engine is which two pieces of data are different and how the two pieces of data are compared, the present disclosure provides a set of built-in methods for tbt service scenarios, which can conveniently decide which two pieces of data are compared with each other and how to compare the differences.
The general difference comparison scheme for the tbt engine is detailed below.
For a new output information, such as a road name, the relevant person creates a rule on the platform, where the rule may include the name of the information, the name of the built-in method for which two pieces of data are to be differentiated (corresponding to the above-mentioned selection rule), and the name of the built-in method for how two pieces of data are to be differentiated (corresponding to the above-mentioned difference calculation rule).
For example, the rule may be expressed as:
rule(
name = "road name",
which＝“pos_5”，
how＝″match_without_number″
)
the road name is an information name, and the name can be displayed on the platform as a label; the pos _5 is a built-in method name for making difference between two pieces of data, and the method represents that the error of a GPS point of the two pieces of data does not exceed 5 meters; "match _ without _ number" is a built-in method name of how two pieces of data are compared to be different, and the method represents that if there are digits in the information which are not consistent, the data can be considered to be different, otherwise, if there are digits in the information which are consistent, the data can be considered to be not different.
Therefore, the universal difference comparison platform for the tbt engine is designed, for the existing navigation information of the tbt engine, anyone can perform comparison tests on a new engine and an old engine, and for the newly added navigation information of the tbt engine, most people can also achieve the comparison tests through newly added rules after training, so that the test cost is greatly reduced. Moreover, the comparison result is visual, complex manual intervention is not needed, a new output information comparison can be added in the several-row configuration, and the platform also supports real-time checking of the task progress in the diff task process.
Fig. 4 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure. Wherein the functional elements of the navigation application testing apparatus may be implemented by hardware, software, or a combination of hardware and software implementing the principles of the present disclosure. It will be appreciated by those skilled in the art that the functional units described in fig. 4 may be combined or divided into sub-units to implement the principles of the invention described above. Thus, the description herein may support any possible combination, or division, or further definition of the functional units described herein.
In the following, functional units that the navigation application testing apparatus can have and operations that each functional unit can perform are briefly described, and for the details related thereto, reference may be made to the above description, which is not repeated herein.
Referring to fig. 4, the navigation application testing apparatus 400 includes a transmitting module 410 and a receiving module 420.
The sending module 410 is configured to send test configuration information to the navigation application testing platform, where the test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more test data, and the test data includes a start position and an end position.
The receiving module 420 is configured to receive a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, where the difference calculation result is obtained by the navigation application testing platform by calculating a difference between first navigation information obtained for the test data based on the first version of the navigation application and second navigation information obtained for the test data based on the second version of the navigation application.
The sending module 410 may further send a rule created by a user to the navigation application testing platform, where the rule includes a data selecting method for indicating a selecting rule of the first navigation information and the second navigation information for comparison and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information.
Fig. 5 shows a schematic structural diagram of a navigation application testing device according to an embodiment of the present disclosure. Wherein the functional elements of the navigation application testing apparatus may be implemented by hardware, software, or a combination of hardware and software implementing the principles of the present disclosure. It will be appreciated by those skilled in the art that the functional units described in fig. 5 may be combined or divided into sub-units to implement the principles of the invention described above. Thus, the description herein may support any possible combination, or division, or further definition of the functional units described herein.
In the following, functional units that the navigation application testing apparatus can have and operations that each functional unit can perform are briefly described, and for the details related thereto, reference may be made to the above description, which is not repeated herein.
Referring to fig. 5, the navigation application testing device 500 includes a first obtaining module 510, a second obtaining module 520, and a calculating module 530.
The first obtaining module 510 is configured to obtain test configuration information, where the test configuration information includes a first version of the navigation application, a second version of the navigation application, and one or more pieces of test data. The second obtaining module 520 is configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, and obtain second navigation information of the piece of test data based on the navigation application of the second version. The calculation module 530 is used for calculating a difference between the first navigation information and the second navigation information.
As an example, the first obtaining module 510 may further obtain a rule created by the user, where the rule includes a data selecting method for indicating a selecting rule of the first navigation information and the second navigation information for comparison and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information. The second obtaining module 520 may select the first navigation information and the second navigation information for which the difference needs to be calculated based on a data selection method, and calculate the difference between the selected first navigation information and the second navigation information based on a difference calculation method.
The navigation application testing device 500 may further include an output module for outputting the difference calculation result and/or evaluation information determined based on the difference calculation result. When the navigation application testing apparatus 500 is located at the server side, the output module may transmit the difference calculation result and/or the evaluation information determined based on the difference calculation result to the client device, and the client device outputs the difference calculation result and/or the evaluation information determined based on the difference calculation result.
FIG. 6 is a schematic structural diagram of a computing device that can be used to implement the navigation application testing method according to an embodiment of the present invention.
Referring to fig. 6, computing device 600 includes memory 610 and processor 620.
The processor 620 may be a multi-core processor or may include a plurality of processors. In some embodiments, processor 620 may include a general-purpose host processor and one or more special coprocessors such as a Graphics Processor (GPU), a Digital Signal Processor (DSP), or the like. In some embodiments, processor 620 may be implemented using custom circuits, such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA).
The memory 610 may include various types of storage units, such as system memory, read Only Memory (ROM), and permanent storage. Wherein the ROM may store static data or instructions that are required by the processor 620 or other modules of the computer. The persistent storage device may be a read-write storage device. The persistent storage may be a non-volatile storage device that does not lose stored instructions and data even after the computer is powered off. In some embodiments, the persistent storage device employs a mass storage device (e.g., magnetic or optical disk, flash memory) as the persistent storage device. In other embodiments, the permanent storage may be a removable storage device (e.g., floppy disk, optical drive). The system memory may be a read-write memory device or a volatile read-write memory device, such as a dynamic random access memory. The system memory may store instructions and data that some or all of the processors require at runtime. In addition, the memory 610 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), magnetic and/or optical disks, may also be employed. In some embodiments, memory 610 may include a removable storage device that is readable and/or writable, such as a Compact Disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, dual layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (e.g., SD card, min SD card, micro-SD card, etc.), a magnetic floppy disc, or the like. Computer-readable storage media do not contain carrier waves or transitory electronic signals transmitted by wireless or wired means.
The memory 610 has stored thereon executable code that, when processed by the processor 620, causes the processor 620 to perform the navigational application testing methods described above.
The navigation application testing platform, method, apparatus and device according to the present invention have been described in detail above with reference to the accompanying drawings.
Furthermore, the method according to the invention may also be implemented as a computer program or computer program product comprising computer program code instructions for carrying out the above-mentioned steps defined in the above-mentioned method of the invention.
Alternatively, the invention may also be embodied as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon executable code (or a computer program, or computer instruction code) which, when executed by a processor of an electronic device (or computing device, server, etc.), causes the processor to perform the steps of the above-described method according to the invention.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems and methods according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (17)
1. A navigation application testing platform, wherein the navigation application is configured to output navigation information on a crossing-by-crossing basis, the platform comprising:
the storage device is used for storing one or more pieces of first navigation information and one or more pieces of second navigation information, wherein the first navigation information is navigation information obtained based on a first version of navigation application, and the second navigation information is navigation information obtained based on a second version of navigation application;
processing means for selecting the first navigation information and the second navigation information from the storage means and calculating a difference between the selected first navigation information and the second navigation information, wherein,
the processing device processes one or more pieces of test data by running a first executable program corresponding to the navigation application of the first version to obtain a first navigation path corresponding to the test data, and performs simulated navigation on the first navigation path by running the first executable program to obtain first navigation information output by the navigation application of the first version one by one at intersections in the navigation process, wherein the test data comprises a starting position and an end position, and the test data comprises a starting position and an end position
The processing device processes one or more pieces of test data by running a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and performs simulated navigation on the second navigation path by running the second executable program to obtain second navigation information output by the navigation application of the second version one by one at intersections in the navigation process,
the processing means selects, from the storage means, first navigation information and second navigation information generated for an incoming link and an outgoing link for which an error does not exceed a threshold value.
2. The navigation application testing platform of claim 1, further comprising:
first acquiring means for acquiring test configuration information specified by a user, the test configuration information including a first version of a navigation application, a second version of the navigation application, and one or more pieces of test data,
the processing device is further configured to, for each piece of test data, obtain first navigation information of the piece of test data based on the navigation application of the first version, obtain second navigation information of the piece of test data based on the navigation application of the second version, and store the obtained first navigation information and the obtained second navigation information in the storage device.
3. The navigation application testing platform of claim 2,
the test configuration information further comprises at least part of parameter configuration information required for simulated navigation,
the processing device simulates navigation of the first navigation path by running the first executable program based on at least part of the parameter configuration information and/or simulates navigation of the second navigation path by running the second executable program based on at least part of the parameter configuration information.
4. The navigation application testing platform of claim 1, further comprising:
a second obtaining means for obtaining a rule created by a user, the rule including a data selecting method for indicating a selecting rule of first navigation information and second navigation information for comparison, the selecting rule being such that an error between an incoming road section and an outgoing road section corresponding to the first navigation information and the second navigation information does not exceed a threshold value, and a difference calculating method for indicating a difference calculating rule between the first navigation information and the second navigation information, wherein,
the processing device selects first navigation information and second navigation information of which the difference needs to be calculated based on the data selection method, and calculates the difference between the selected first navigation information and the second navigation information based on the difference calculation method.
5. The navigation application testing platform of claim 4,
the rule further comprises a road name, wherein the road name is used for representing the road name of the navigation path corresponding to the first navigation information and the second navigation information for comparison, and/or
The difference calculation rule is whether the comparison binary stream is consistent or not.
6. The navigation application testing platform of claim 1,
the first navigation information includes one or more of first path planning information, first navigation guidance information, and first trip prediction information, the second navigation information includes one or more of second path planning information, second navigation guidance information, and second trip prediction information,
the processing device is configured to calculate a difference between the first route planning information and the second route planning information, and/or calculate a difference between the first navigation guidance information and the second navigation guidance information, and/or calculate a difference between the first trip prediction information and the second trip prediction information.
7. The navigation application testing platform of claim 1,
the processing means is further adapted to evaluate the first version of the navigation application and/or the second version of the navigation application based on a difference calculation result, and/or
The navigation application test platform further comprises: and sending means for sending the difference calculation result and/or the evaluation result determined based on the difference calculation result to the client.
8. A navigation application testing method comprises the following steps:
sending test configuration information to a navigation application test platform, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data, and the test data comprises a starting position and an end position;
receiving a difference calculation result sent by the navigation application test platform and/or an evaluation result determined based on the difference calculation result, wherein the difference calculation result is obtained by calculating a difference between first navigation information obtained by the navigation application test platform based on the first version of the navigation application for the test data and second navigation information obtained by the navigation application test platform based on the second version of the navigation application for the test data, the first navigation information and the second navigation information used for calculating the difference are for a driving-in road section and a driving-out road section with an error not exceeding a threshold value, the first navigation information is obtained by operating a first executable program corresponding to the navigation application of the first version to perform simulated navigation on a first navigation path to obtain navigation information output by intersections in the navigation process of the navigation application of the first version, and the second navigation information is obtained by operating a second executable program corresponding to the navigation application of the second version of the navigation application to perform simulated navigation on a second navigation path to obtain navigation information output by intersections in the navigation process of the navigation application of the second version of the navigation application.
9. The navigation application testing method of claim 8, further comprising:
sending a rule created by a user to the navigation application test platform, wherein the rule comprises a data selection method and a difference calculation method, the data selection method is used for indicating a selection rule of first navigation information and second navigation information used for comparison, the selection rule is that an error between an entering road section and an exiting road section corresponding to the first navigation information and the second navigation information does not exceed a threshold value, and the difference calculation method is used for indicating a difference calculation rule between the first navigation information and the second navigation information.
10. The navigation application testing method of claim 9,
the rule further comprises a road name, wherein the road name is used for representing the road name of the navigation path corresponding to the first navigation information and the second navigation information for comparison, and/or
The difference calculation rule is whether the comparison binary stream is consistent or not.
11. A navigation application testing method comprises the following steps:
acquiring test configuration information, wherein the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data;
for each piece of test data, obtaining first navigation information of the piece of test data based on the navigation application of the first version, and obtaining second navigation information of the piece of test data based on the navigation application of the second version;
calculating a difference between the first navigation information and the second navigation information,
wherein the navigation application is configured to output navigation information from intersection to intersection, the test data including a start position and an end position,
the step of obtaining the first navigation information of the piece of test data based on the navigation application of the first version comprises the following steps: processing the test data by operating a first executable program corresponding to the navigation application of the first version to obtain a first navigation path corresponding to the test data, performing simulated navigation on the first navigation path by operating the first executable program to obtain first navigation information output by the navigation application of the first version one by one at intersections in the navigation process, and obtaining first navigation information output by the navigation application of the first version one by one at intersections in the navigation process
The step of obtaining the second navigation information of the piece of test data based on the navigation application of the second version comprises: processing the test data by operating a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, and performing simulated navigation on the second navigation path by operating the second executable program to obtain second navigation information output by the navigation application of the second version one by one in the navigation process,
the method further comprises the following steps: selecting first navigation information and second navigation information generated aiming at an incoming road section and an outgoing road section with errors not exceeding a threshold value,
the step of calculating the difference between the first navigation information and the second navigation information comprises: a difference between the first navigation information and the second navigation information of the selected incoming road segment and outgoing road segment for which the error does not exceed the threshold is calculated.
12. The navigation application testing method of claim 11, further comprising:
acquiring a rule created by a user, the rule including a data selection method for indicating a selection rule of first navigation information and second navigation information for comparison and a difference calculation method for indicating a difference calculation rule between the first navigation information and the second navigation information,
wherein the step of calculating the difference between the first navigation information and the second navigation information comprises: and selecting the first navigation information and the second navigation information which need to calculate the difference based on the data selection method, and calculating the difference between the selected first navigation information and the selected second navigation information based on the difference calculation method.
13. The navigation application testing method of claim 12, further comprising:
outputting the difference calculation result and/or evaluation information determined based on the difference calculation result.
14. A navigation application testing device, comprising:
the system comprises a sending module, a test module and a test module, wherein the sending module is used for sending test configuration information to a navigation application test platform, the test configuration information comprises a first version of navigation application, a second version of navigation application and one or more test data, and the test data comprises a starting position and an end position;
a receiving module, configured to receive a difference calculation result sent by the navigation application testing platform and/or an evaluation result determined based on the difference calculation result, where the difference calculation result is obtained by calculating a difference between first navigation information obtained by the navigation application testing platform for the test data based on the navigation application of the first version and second navigation information obtained by the navigation application testing platform for the test data based on the second version, the first navigation information and the second navigation information used for calculating the difference are for an incoming road segment and an outgoing road segment with an error not exceeding a threshold, the first navigation information is obtained by running a first executable program corresponding to the navigation application of the first version to perform simulated navigation on a first navigation path to obtain navigation information output by the navigation application of the first version at an intersection in a navigation process, and the second navigation information is obtained by running a second executable program corresponding to the navigation application of the second version to perform simulated navigation on a second navigation path one by one in the navigation process to obtain navigation information output by one at an intersection in the navigation process of the second version.
15. A navigation application testing device, comprising:
the system comprises a first acquisition module, a second acquisition module and a test configuration module, wherein the first acquisition module is used for acquiring test configuration information which comprises a first version of navigation application, a second version of navigation application and one or more pieces of test data;
the second acquisition module is used for acquiring first navigation information of each piece of test data based on the navigation application of the first version and acquiring second navigation information of each piece of test data based on the navigation application of the second version aiming at each piece of test data;
a calculation module for calculating a difference between the first navigation information and the second navigation information,
the navigation application is used for outputting navigation information one intersection by one intersection, the test data comprises a starting position and an end position, the first acquisition module is used for processing the test data by running a first executable program corresponding to the navigation application of the first version to obtain a first navigation path corresponding to the test data, the first executable program is used for simulating and navigating the first navigation path to obtain first navigation information output one intersection by one in the navigation process of the navigation application of the first version, the second acquisition module is used for processing the test data by running a second executable program corresponding to the navigation application of the second version to obtain a second navigation path corresponding to the test data, the second executable program is used for simulating and navigating the second navigation path to obtain second navigation information output one by one in the navigation process of the navigation application of the second version, and the calculation module is used for selecting the first navigation information and the second navigation information generated for the entry road section and the exit road section with the error not exceeding the threshold value and calculating the difference between the first navigation information and the entry road section and the second navigation information of the entry road section with the error not exceeding the threshold value.
16. A computing device, comprising:
a processor; and
a memory having executable code stored thereon, which when executed by the processor, causes the processor to perform the method of any of claims 8 to 13.
17. A non-transitory machine-readable storage medium having stored thereon executable code which, when executed by a processor of an electronic device, causes the processor to perform the method of any of claims 8 to 13.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110230221.8A CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110230221.8A CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113029196A CN113029196A (en) | 2021-06-25 |
| CN113029196B true CN113029196B (en) | 2022-10-18 |
Family
ID=76465485
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110230221.8A Active CN113029196B (en) | 2021-03-02 | 2021-03-02 | Navigation application test method and test platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113029196B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114427867A (en) * | 2022-04-07 | 2022-05-03 | 北京骑胜科技有限公司 | Performance verification method and device of combined navigation model |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8364402B2 (en) * | 2009-08-20 | 2013-01-29 | Ford Global Technologies, Llc | Methods and systems for testing navigation routes |
| CN109086210B (en) * | 2018-08-14 | 2020-07-03 | 百度在线网络技术（北京）有限公司 | Navigation information method and device for testing navigation application |
| CN109146333A (en) * | 2018-09-29 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Navigation algorithm appraisal procedure and device |
| CN210015237U (en) * | 2018-12-18 | 2020-02-04 | 深圳华大北斗科技有限公司 | Navigation module test system |
| CN109634872B (en) * | 2019-02-25 | 2023-03-10 | 北京达佳互联信息技术有限公司 | Application testing method, device, terminal and storage medium |
| CN111123321A (en) * | 2019-12-03 | 2020-05-08 | 深圳华大北斗科技有限公司 | Navigation product test system and method |
-
2021
- 2021-03-02 CN CN202110230221.8A patent/CN113029196B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113029196A (en) | 2021-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Krukar et al. | The effect of orientation instructions on the recall and reuse of route and survey elements in wayfinding descriptions | |
| JP6332287B2 (en) | Route prediction apparatus and route prediction method | |
| US8825364B2 (en) | Vehicle position recognition device and vehicle position recognition program | |
| JP3842799B2 (en) | Map data providing device | |
| JP2005115687A (en) | Road maintenance support system | |
| CN101218486A (en) | Method, device and system for modeling a road network graph | |
| KR20040072101A (en) | Navigation apparatus and method for calculating optimal path | |
| US20160110654A1 (en) | Statistical estimation of origin and destination points of trip using plurality of types of data sources | |
| JP2004163424A (en) | Method of generating gps simulation scenario for simulating therewith real driving experiment along prespecified itinerary, and device of executing the method for simulating real driving experiment along prespecified itinerary with gps simulation scenario | |
| CN113029196B (en) | Navigation application test method and test platform | |
| CN103453910A (en) | Method for establishing map data and navigation device | |
| CN110542425B (en) | Navigation path selection method, navigation device, computer equipment and readable medium | |
| JP2019220048A (en) | Traffic flow prediction device and traffic flow prediction system | |
| JP4736590B2 (en) | Candidate route creation device, method, program, traffic simulation device, method and program, route search device, method, and program | |
| JP2015049187A (en) | Simulation travel route generation method and system | |
| US9110921B2 (en) | Map editing with little user input | |
| KR101423968B1 (en) | Data processing method for road driving test in driver's license test, and computer-readable recording medium with data processing program for road driving test for the same | |
| CN117146847A (en) | Automobile route planning algorithm test system, method, equipment and medium | |
| CN110648008A (en) | Road condition prediction method and device | |
| US20120151440A1 (en) | Software library reconstruction device, software library reconstruction method, and navigation device using this software library reconstruction method | |
| JP7381719B2 (en) | Data generation device, data generation method, and program | |
| KR20140056672A (en) | Test route creating method and apparatus for electronic scoring type road-driving test | |
| US20140039789A1 (en) | Dynamic progressive map granularity for navigation | |
| CN113008246A (en) | Map matching method and device | |
| JP2007183818A (en) | Combination evaluation system for software components |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |