CN110888963A

CN110888963A - Data acquisition method and device, electronic equipment and storage medium

Info

Publication number: CN110888963A
Application number: CN201911233832.7A
Authority: CN
Inventors: 辛龙鹏
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2019-12-05
Filing date: 2019-12-05
Publication date: 2020-03-17
Anticipated expiration: 2039-12-05
Also published as: CN110888963B

Abstract

The application discloses a data acquisition method, a data acquisition device, electronic equipment and a storage medium, and relates to the technical field of electronic maps. The specific implementation scheme is as follows: acquiring associated position information corresponding to first position information according to the first position information in a position query request sent by a client; acquiring a first database corresponding to second position information according to the second position information determined by the client from the associated position information; and acquiring first map data corresponding to the second position information from the first database and sending the first map data to the client, so that the client selects required target data from the first map data. According to the method and the device, the corresponding associated position information is obtained according to the first position information input by the client, so that a user can quickly determine the required second position information. In addition, according to the embodiment of the application, the corresponding map data can be directly acquired from the first database through the second position information, so that the data acquisition efficiency of a user is improved.

Description

Data acquisition method and device, electronic equipment and storage medium

Technical Field

The application relates to the technical field of computers, in particular to the technical field of electronic maps.

Background

With the development of mobile communication technology and the popularization of electronic navigation applications, electronic maps have become an indispensable travel tool in people's lives. However, due to the limitations of the prior art in the data production chain, manual operation errors, irregular data production and other reasons, the defects that the use experience of the electronic map is affected by wrong data, dirty data and the like are inevitable. For example, when a user drives a vehicle through a certain intersection, the navigation broadcasting needs to turn right, and the user is prohibited from turning right in reality, so that the user can violate traffic regulations, thereby seriously affecting the user experience and causing the user to lose.

In order to solve the above problem, it is necessary to analyze the map data to confirm the cause of the occurrence. The existing data analysis mode needs a data analyst to download the mother database data and pull the data of the corresponding position from the mother database for analysis. However, since the parent database stores all map road data across the country and the topological relationship between the data is complex, even if the data analyst has a high business level, the data analyst cannot quickly obtain the data of the target location, and it takes a long time to repeatedly pull the data many times to obtain the required data, which results in a decrease in data analysis efficiency and an increase in data analysis cost.

Disclosure of Invention

Embodiments of the present application provide a data acquisition method, an apparatus, an electronic device, and a storage medium, so as to solve one or more technical problems in the prior art.

In a first aspect, an embodiment of the present application provides a data acquisition method, including:

acquiring a plurality of associated position information corresponding to first position information according to the first position information in a position query request sent by a client;

acquiring a first database corresponding to second position information according to the second position information determined by the client from the plurality of associated position information;

acquiring first map data corresponding to the second position information from a first database;

and sending the first map data to the client so that the client selects required target data from the first map data.

According to the embodiment, the corresponding associated position information can be acquired according to the first position information input by the client, so that the user can quickly determine the required second position information. In addition, the corresponding map data can be directly acquired from the first database through the second position information, so that the data acquisition efficiency of a user is improved, the time consumed by searching the data is effectively saved, and the time consumed for acquiring the data is increased from the small level to the minute level.

In one embodiment, the data acquisition method further comprises:

acquiring second map data from a second database;

dividing the second map data according to a preset division rule to obtain a plurality of first map data;

the plurality of first map data are distributively stored into a plurality of first databases.

According to the embodiment, the second map data in the second database are divided, so that the complexity of the topological relation of ten million-level dotted line data in the second map data is effectively reduced, the efficiency of data retrieval can be effectively improved by storing the data in different first databases in a distributed manner, and the time consumption for acquiring the data is reduced.

In one embodiment, the data acquisition method further comprises:

determining data version information of the divided first map data;

establishing an index relationship between data version information of first map data and a first database storing the first map data;

storing the index relationship in a second database.

In the embodiment, the index relationship between the data version information and the first database storing the first map data is established, so that the map data associated with the second position information can be quickly acquired from the first database according to the index relationship stored in the second database. In addition, the index relation and the map data are respectively stored in different databases, namely the first database and the second database, so that the data storage pressure of the databases can be effectively relieved, the storage space of the databases is saved, and the query efficiency of the databases is improved.

In one embodiment, acquiring a first database corresponding to second location information according to the second location information determined by a client from a plurality of associated location information includes:

determining data version information selected by a client;

acquiring a corresponding index relation from a second database according to the second position information and the data version information;

and acquiring a first database corresponding to the second position information by using the corresponding index relation.

In the embodiment, the first database which is corresponding to the second position information and stores the map data related to the second position information can be quickly found by using the index relationship between the second position information and the corresponding data version information.

In one embodiment, obtaining the second map data from the second database comprises:

and acquiring the latest second map data from the second database according to the preset data updating frequency.

According to the embodiment, the latest second map data in the second database is obtained at regular time, so that the accuracy and timeliness of the data stored in each first database can be guaranteed, and the data of different versions stored in the first databases can be matched with different query requirements of users. The accuracy of acquiring the data information is improved.

In one embodiment, the data acquisition method further comprises:

acquiring a plurality of map elements corresponding to the second position information according to an element query request sent by a client;

acquiring position information of a target element from a first database according to the target element determined by a client from a plurality of map elements;

and displaying the target elements on the base map of the map according to the geometric topological mode selected by the client and the position information of the target elements.

The embodiment can realize the transformation of the map data into the visual map elements and the visualization of the target elements selected by the user from the map elements on the base map, thereby reducing the requirement on the knowledge level of the user and enabling the professional and complex map data to be easy to understand and read.

In one embodiment, the data acquisition method further comprises:

acquiring a target verification source corresponding to verification source information according to the verification source information in a verification request sent by a client;

acquiring third map data corresponding to the second position information from the target verification source;

and sending the third map data to the client so that the client verifies the first map data by using the third map data.

According to the embodiment, the verification of the first map data can be realized through the third map data acquired from the target verification source, and the accuracy and the situation of the acquired first map data are ensured.

In a second aspect, an embodiment of the present application provides a data obtaining apparatus, including:

the first acquisition module is used for acquiring a plurality of associated position information corresponding to the first position information according to the first position information in the position query request sent by the client;

the second acquisition module is used for acquiring a first database corresponding to second position information according to the second position information determined by the client from the plurality of associated position information;

the third acquisition module is used for acquiring first map data corresponding to the second position information from the first database;

and the first sending module is used for sending the first map data to the client so that the client can select the required target data from the first map data.

In one embodiment, the data acquisition device further comprises:

the fourth acquisition module is used for acquiring the second map data from the second database;

the dividing module is used for dividing the second map data according to a preset dividing rule to obtain a plurality of first map data;

the first storage module is used for storing the plurality of first map data into the plurality of first databases in a distributed mode.

In one embodiment, the data acquisition device further comprises:

the determining module is used for determining data version information of the divided first map data;

the index relation establishing module is used for establishing an index relation between the data version information of the first map data and a first database for storing the first map data;

and the second storage module is used for storing the index relation into a second database.

In one embodiment, the second obtaining module includes:

the determining submodule is used for determining the data version information selected by the client;

the first obtaining submodule is used for obtaining a corresponding index relation from a second database according to the second position information and the data version information;

and the second obtaining submodule is used for obtaining the first database corresponding to the second position information by utilizing the corresponding index relation.

In one embodiment, the fourth obtaining module comprises:

and the third acquisition submodule is used for acquiring the latest second map data from the second database according to the preset data updating frequency.

In one embodiment, the data acquisition device further comprises:

the fifth acquisition module is used for acquiring a plurality of map elements corresponding to the second position information according to the element query request sent by the client;

the sixth acquisition module is used for acquiring the position information of the target element from the first database according to the target element determined by the client from the plurality of map elements;

and the display module is used for displaying the target elements on the base map of the map according to the geometric topological mode selected by the client and the position information of the target elements.

In one embodiment, the data acquisition device further comprises:

a seventh obtaining module, configured to obtain, according to verification source information in a verification request sent by a client, a target verification source corresponding to the verification source information;

the eighth acquiring module is used for acquiring third map data corresponding to the second position information from the target verification source;

and the second sending module is used for sending the third map data to the client so that the client verifies the first map data by using the third map data.

In a third aspect, an embodiment of the present application provides an electronic device, where functions of the electronic device may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described functions.

In one possible design, the electronic device includes a processor and a memory, the memory is used for storing a program for supporting the electronic device to execute the data acquisition method, and the processor is configured to execute the program stored in the memory. The electronic device may also include a communication interface for communicating with other devices or a communication network.

In a fourth aspect, embodiments of the present application provide a non-transitory computer-readable storage medium storing computer instructions for storing an electronic device and computer software instructions for the electronic device, which include a program for executing the data acquisition method.

One embodiment in the above application has the following advantages or benefits: according to the method and the device, the corresponding associated position information is obtained according to the first position information input by the client, so that a user can quickly determine the required second position information. And the corresponding map data can be directly acquired from the first database through the second position information, so that the data acquisition efficiency of a user is improved, and the time for searching the data is saved. According to the embodiment of the application, the technical means of obtaining the associated position information corresponding to the first position information and obtaining the corresponding map data according to the second position information determined from the associated position information are adopted, so that the technical problems that the target position cannot be quickly confirmed and the related map data of the target position can be quickly and accurately found from the database are solved, and the technical effects that the related data can be quickly obtained according to the request of the client and the data query time is saved are achieved.

Other effects of the above-described alternative will be described below with reference to specific embodiments.

Drawings

The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:

FIG. 1 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 2 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 3 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 4 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 5 is a diagram illustrating a step S200 of a data acquisition method according to a first embodiment of the present application;

FIG. 6 is a diagram illustrating a step S500 of a data acquisition method according to a first embodiment of the present application;

FIG. 7 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 8 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 9 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 10 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 11 is a schematic diagram of a data acquisition method according to a first embodiment of the present application;

FIG. 12 is a schematic diagram of a data acquisition device according to a second embodiment of the present application;

FIG. 13 is a schematic diagram of a data acquisition device according to a second embodiment of the present application;

FIG. 14 is a schematic diagram of a data acquisition device according to a second embodiment of the present application;

FIG. 15 is a schematic diagram of a second acquisition module of the data acquisition apparatus according to the second embodiment of the present application;

FIG. 16 is a schematic diagram of a fourth acquisition module of the data acquisition apparatus according to the second embodiment of the present application;

FIG. 17 is a schematic diagram of a data acquisition device according to a second embodiment of the present application;

FIG. 18 is a schematic diagram of a data acquisition device according to a second embodiment of the present application;

fig. 19 is a block diagram of an electronic device for implementing a method of data acquisition of an embodiment of the present application.

Detailed Description

The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

According to a first embodiment of the present application, as shown in fig. 1, the present application provides a data acquisition method, including the steps of:

s101: according to first position information in a position query request sent by a client, acquiring a plurality of associated position information corresponding to the first position information.

The client can comprise a data analysis platform pre-installed on the terminal, and the client can also comprise a data analysis platform loaded on a webpage.

The location query request may be a request generated by the client after the user sends the request to the client through manual input or voice.

The first location information may include general location information or specific location information corresponding to a navigation error location reported by a user.

The associated location information may include information of location points around the location point to which the first location information corresponds. The associated location information may also include information similar to the content of the first location information. For example, if the first location information is the west second flag, the second location information may be a west second flag subway station, a west second flag elementary school, a west second flag street, or a west second flag bus station.

S102: and acquiring a first database corresponding to the second position information according to the second position information determined by the client from the plurality of associated position information.

When the location input by the user is the location that the user needs to accurately query, the second location information may be equal to the first location information. The second location information may be different from the first location information when the location entered by the user is a location used by the user to obfuscate the query.

The first database corresponding to the second location information may be understood as a database in which data relating to the second location information is stored. The first database may store only data related to the second position information, or may store map data of position information other than the second position information. For example, when the second location information is a west second flag subway station, the first database may be a database that stores only map data related to a west second flag area, or may be a database that stores map data related to beijing city.

S103: first map data corresponding to the second position information is acquired from the first database.

The first map data corresponding to the second position information may include map data of a position point corresponding to the second position information, or may include map data within a preset range around the position point corresponding to the second position information.

The first map data may include road data (e.g., number of lanes, intersection type, road direction, etc.), traffic limitation data (e.g., vehicle speed limitation, turning limitation, etc.), vehicle information data, traffic collection device data (e.g., electronic eye position, electronic eye type), etc., which are not limited herein.

S104: and sending the first map data to the client so that the client selects required target data from the first map data.

The target data may include map data required by the user for data analysis.

In one application example, the above embodiments may be applied to a server of a data analysis platform (client). And the data analysis platform generates a corresponding position query request according to POI (Point of Interest) or coordinates input by a user. Thereby enabling the server to retrieve the associated location information based on the POI or coordinates. As shown in fig. 2, when the user inputs the POI "xibi flag" in the client, the client generates first location query information based on the xibi flag and sends the first location query information to the server, and the server obtains associated location information of the xibi flag (for example, xibi flag subway station, xibi flag public transit station, xibi flag intelligent school yard, xibi flag Minkoyuan, xibi flag subway station a1 port, xibi flag north road, second-stage primary school, xibi flag street, xibi flag bridge, etc.) by using a vertical retrieval technique according to the first location information, and feeds back the associated location information to the client for the user to select.

In another application example, when the first map data acquired by the server from the first database according to the second position information includes electronic eye data, lane data, traffic light data and traffic regulation data of the second position, the data are all sent to the client. If the user only needs to analyze the data by using the electronic eye data and the traffic light data, the user can select the electronic eye data and the traffic light data from the client side to check the details. For example, the user needs to view the type and setting position of the electronic eye through the electronic eye data. And checking the signal change frequency of the traffic lights through the traffic light data.

In one embodiment, as shown in fig. 3, the data acquisition method further includes the steps of:

s301: second map data is obtained from a second database.

The second database may include a database storing all map data nationwide. The second map data may include specific map data for various cities across the country.

S302: and dividing the second map data according to a preset division rule to obtain a plurality of first map data.

The preset division rule can be set and adjusted as required. For example, the division rule may be to divide the second map data by city, or may be to divide the second map data by city.

S303: the plurality of first map data are distributively stored into a plurality of first databases.

For example, the map data of each city is stored in a first database. For another example, the map data of each urban area in each city is stored in a first database.

According to the embodiment, the second map data in the second database are divided, so that the complexity of the topological relation of ten-million-level data in the second map data is effectively reduced, the efficiency of data retrieval can be effectively improved by storing the second map data in different first databases in a distributed manner, and the time consumption for acquiring the data is reduced.

In one example, if the second map data in the second database is divided into two-dimensional grids, and the data in each grid is stored in a MapInfo (map information) File format in the NFS (Network File System), the MapInfo data needs to be converted into a format adapted to a PostgreSQL library (object relational database) by using an OGR (geospatial data conversion) technology. And then dividing the converted second map data according to the city, and respectively storing each first map data obtained after division into a first database. And establishing an index relationship with each first database by using an XPGDB (Extended PostgreSQL Data Base), thereby realizing that the first database corresponding to the position information is acquired by using the XPGDB.

It should be noted that the basis of the XPGDB library in this example is the PostgreSQL library, so that converting MapInfo data into a format adapted to the PostgreSQL library can facilitate data query. Each first database can be respectively stored in different servers, so that the data bearing load of the servers is reduced.

In one embodiment, as shown in fig. 4, the data acquisition method further includes:

s401: data version information of the divided first map data is determined. Since the data in the second database may be updated at irregular times, it is necessary to record the version of the acquired data. And one-click synchronous switching of the data can be realized according to the version information when the data is called.

S402: an index relationship between data version information of the first map data and a first database storing the first map data is established.

The first map data of different versions may be stored in different first databases, so that the first databases stored in the first map data of different versions can be quickly and accurately acquired through the index relationship.

S403: storing the index relationship in a second database.

In one example, the second database may employ an XDB library (Extended Data Base), and the basis of the XDB library may be a MySQL library (relational database)

In one example, a user may perform data analysis work using first map data of different data version information. Therefore, when the user switches the data version, the session control object is required to be used for storing the information of the data version required by the user, and the information is used for accurately matching the index relationship corresponding to the data version information in the second database, so that the map data of the required data version is acquired from the corresponding first database by using the index relationship, and thus, one-click synchronous switching of the data version is realized.

In one embodiment, as shown in fig. 5, acquiring, according to second location information determined by a client from a plurality of associated location information, a first database corresponding to the second location information includes:

s1021: and determining the data version information selected by the client.

S1022: and acquiring the corresponding index relation from the second database according to the second position information and the data version information.

S1023: and acquiring a first database corresponding to the second position information by using the corresponding index relation.

In one embodiment, as shown in FIG. 6, obtaining the second map data from the second database includes:

s3011: and acquiring the latest second map data from the second database according to the preset data updating frequency.

In one embodiment, as shown in fig. 7, the data acquisition method further includes:

s701: and acquiring a plurality of map elements corresponding to the second position information according to the element query request sent by the client.

Map elements may include roads, electronic eyes, traffic restrictions, vehicle information, traffic lights, surrounding shops of roads, and the like.

S702: according to a target element determined by a client from a plurality of map elements, position information of the target element is obtained from a first database.

The target elements may include map elements that the user desires to view visually. The position information may include GPS (Global Positioning System) coordinate information of the target element in the real scene.

In one example, the user may select a desired target element from a plurality of map elements that the server feeds back to the client.

S703: and displaying the target elements on the base map of the map according to the geometric topological mode selected by the client and the position information of the target elements.

In one example, after determining the target element, the user may click or frame a specific area where the target element needs to be displayed on a map location corresponding to the second location information through the client. So that the client sends a request for displaying the target element to the server according to a Geographic Information System (GIS) range of the specific area, so that the server displays the target element on the base map of the specific area.

In an application example, as shown in fig. 8, when a target element needs to be displayed, a map base map is loaded first, and then a road network filtering and geometric topological algorithm is applied to describe the point-line relationship of the target element in a layer above the base map, so that an image in which only the target element relationship is included in the map is displayed on a client. The user can see the position and the mutual relation of the target elements on the map at a glance. So as to facilitate subsequent data analysis by the user.

In one embodiment, as shown in fig. 9, the data acquisition method further includes:

s901: and acquiring a target verification source corresponding to verification source information according to the verification source information in the verification request sent by the client.

The target verification source can be used as a basis and a reference for judging whether the first map data has problems. Verification sources may include both auction verification sources and internal verification sources. Wherein the offer verification source may include an electronically mapped verification source provided by another service provider. The internal verification source covers hundreds of degrees of panorama, real scene pictures collected by field operation, lane blocking, pre-online and other verification sources. These verification sources may all exist as buttons on the client display interface (as shown in fig. 10). The verification request sent by the client may be generated based on a verification source button selected by the user on the client display interface.

S902: and acquiring third map data corresponding to the second position information from the target verification source.

In one example, as shown in fig. 10, the third map data may be a VR (Virtual Reality) live view image of a field-captured 360-degree restored Reality scene. As shown in fig. 11, the third map data may also be a navigation planned route planned for the target location by the contest.

S903: and sending the third map data to the client so that the client verifies the first map data by using the third map data.

The third map data can be compared with the information of the first map data and displayed on the same interface on the display interface of the client, so that the operation cost of a user is reduced, and the user can clearly verify the first map data by using the third map data.

In one embodiment, the map data changes every day for each city due to the higher frequency of map data updates. However, the number and storage space of the first databases are limited, so that in order to more effectively store the map data, the data with the retrieval rate lower than the threshold value can be deleted from the first databases and backed up to the file storage system (for example, an AFS distributed file storage system) by analyzing the behavior of the user retrieving the data in the first databases. When the user needs to call the data deleted from the first database, the corresponding data can be obtained from the cloud and stored in the first database.

For example, according to the behavior of the user to call the data, if the frequency of the user to call the data in the last 10 days reaches 98%, the data before 10 days is considered to be cold data, and the cold data can be deleted and backed up to the file storage system, so that the disk space of the first database is saved, and the first database service is kept in a circular available state.

In one example, the first database may delete and backup stored cold data to the file storage system at a preset frequency. The first database may also determine cold data by frequency of data retrieval.

In an application example, as shown in fig. 11, the data obtaining method embodiment of the present application may be applied to a server of a client. The server comprises an element query module, a quick positioning module, a version switching module, a multi-source verification module and a vertical retrieval module. A user operates a Web (World Wide Web) browser (client) according to a demand. And the client sends an http request to the server according to the user operation. The server monitors and determines a specific request sent by the client through the event, and distributes the request to different modules according to the request content.

When the request is sent to the quick positioning module, the quick positioning module utilizes the vertical retrieval module to vertically retrieve data according to the first position information input by the user. And feeding back the retrieved associated position information to the client for selection by the user. And acquiring a first database corresponding to the second position information by using the XPGDB cloud according to the second position information selected by the user, and acquiring map data of the second position information from the first database and feeding the map data back to the client so as to enable the user to select required target data from the map data.

When the request is sent to the element query module, the element query module detects the map elements by using the vertical retrieval module according to the second position information, and feeds the retrieved map elements corresponding to the second position information back to the client for selection by the user. And according to the target elements selected by the user, a map loading module is used for loading the base map, and a geometric topological module is used for depicting and rendering the point-line relation of the target elements on the base map according to a geometric topological algorithm determined by the user and feeding the point-line relation back to the client for the user to check.

When the request is sent to the version switching module, the version switching module stores the information of the data version required by the user by using the session object according to the data version information selected by the user, and accurately matches the index relationship corresponding to the data version information in the XDB library by using the information so as to acquire the map data of the required data version from the corresponding first database by using the index relationship, thereby realizing one-key synchronous switching of the data version.

When the request is sent to the multi-source verification module, the multi-source verification module obtains corresponding data from the competitive product verification source module or the internal verification module according to the verification source selection of the user and feeds the data back to the client.

When the server receives a data updating request, the server acquires the latest map data from the NFS, performs data conversion and division on the map data, stores the divided map data into each first database, and stores the version information of each map data and the index relation of each first database into the XDB.

And when the server receives the cold data backup request, the cold data with the calling rate lower than the threshold value is acquired from each first database, and the cold data is deleted from the first database and backed up into the AFS. And the XDB is used for storing the index relation between the cold data and the AFS, so that the cold data can be quickly retrieved from the AFS when a user needs to call the cold data.

In an application example, the data acquisition method of the present application can be applied to a data analysis platform (client). When a user (data analyst) receives navigation error information fed back by a mobile terminal user, target data on a map required for analyzing the navigation error information can be quickly acquired by using a data analysis platform. Specifically, the user may input a GPS coordinate or a specific location point corresponding to the navigation error information into the data analysis platform, and select a required data version according to a time when the user of the mobile terminal feeds back the navigation error information. And the data analysis platform sends an http request to the back-end server according to the information input by the user. The server vertically retrieves a plurality of associated interest points (associated position information) corresponding to the position according to the GPS coordinates or specific position points (first position information) in the position query request sent by the data analysis platform, and feeds the associated interest points back to the data analysis platform for the user to view and select. After the user selects the interest point (second position information), the data analysis platform sends the selection result to the server. And the server acquires the index relation from the second database according to the interest points selected by the user and the data version required by the user. And searching a first database corresponding to the interest points selected by the user by using XPGDB according to the index relation. And acquiring first map data corresponding to the interest points selected by the user from the first database and sending the first map data to the data analysis platform, so that the user can select target data needing attention from the first map data. Therefore, the technical effect that the user can quickly acquire the required data only by inputting the position information is achieved, the technical problem that the user can acquire the required target data only by pulling the data from the original map database (second database) for multiple times in the prior art is solved, and the time consumption for acquiring the data by the user is reduced from the hour level to the minute level.

The data analysis platform can also provide the function of online drawing for the user. Because there are many map elements presented on a map and not all of them need to be of interest to the user. Therefore, in order to facilitate the user to visually view the data, only the required map elements can be displayed on the map according to the needs of the user, and the map elements can be drawn according to a certain geometric topological relation. Specifically, the user can specify the position where the drawing is needed and input the drawing request to the data analysis platform. The mapping position specified by the user may be a position (second position information) determined when data is acquired in the previous step, or may be a position selected by the user directly on the map. And the data analysis platform sends an http request (element query request) to the server according to the mapping request, the server vertically retrieves a plurality of map elements corresponding to the appointed mapping positions according to the request, and feeds the retrieved map elements back to the data analysis platform for the user to check and select. After a user selects a target element and a geometric topological mode from a plurality of map elements, the data analysis platform sends an element selection result and the geometric topological mode to the server. The server acquires the position information (GPS coordinates on the map) of the target element from the corresponding first database using XPGDB according to the target element selected by the user. And drawing the target elements on the loaded map base map based on the geometric topological mode and the position information of the target elements, and sending the drawn images to a data analysis platform for a user to view.

The data analysis platform can also provide the user with the function of data multi-source verification. Thereby assisting the user in judging the accuracy of the acquired data. Specifically, the user may specify the required verification sources (internal verification sources and contest verification sources) from the data analysis platform. The data analysis platform sends an http request (verification request) to the server according to a verification source specified by a user, and the server calls corresponding verification source data according to the request and feeds the verification source data back to the data analysis platform so that the user can select a specific verification mode from the required verification sources to verify the map data (first map data) of the target position. The specific verification method comprises the following steps: the method comprises the steps of obtaining map data of a target position in a reality source, obtaining a live-action image of the target position in the reality source, obtaining a navigation planning route of the target position in the reality source and the like.

The data analysis platform also provides a function for updating data information in the first database and the second database. The data analysis platform may request the server to acquire the latest map data (second map data) from the map data mother database (second database) at regular time (for example, in units of days). And the latest acquired map data is divided into cities to obtain map data (first map data) of each city. The map data of each city is then stored in a different first database, and the index relationship between the data version information and the first database in which the map data is stored in a second database. Therefore, the server can quickly retrieve the first database corresponding to the interest point selected by the user by using the XPGDB according to the index relation and acquire the related map data from the first database.

The data analysis platform also provides a cold data backup function. When the server monitors that data with the called rate lower than the threshold exists in each first database, the data is cleared from the first database and stored in the AFS. Therefore, the storage space of the first database is effectively saved, and the running speed of the first database is increased. And when the data with the called rate lower than the threshold value needs to be used, the server can acquire the data from the AFS and store the data into the corresponding first database again for the user to use.

In one example, the data acquisition method of the present application may be applied to Location analysis of LBS (Location based services) road data problem. By the method, the related data required by the user for analyzing the LBS road data problem can be quickly and accurately acquired.

According to a second embodiment of the present application, as shown in fig. 12, an embodiment of the present application provides a data acquisition apparatus 1000, including:

the first obtaining module 121 is configured to obtain, according to first location information in a location query request sent by a client, a plurality of associated location information corresponding to the first location information.

The second obtaining module 122 is configured to obtain, according to second location information determined by the client from the multiple pieces of associated location information, a first database corresponding to the second location information.

The third obtaining module 123 is configured to obtain the first map data corresponding to the second location information from the first database.

And a first sending module 124, configured to send the first map data to the client, so that the client selects the required target data from the first map data.

In one embodiment, as shown in fig. 13, the data acquisition apparatus 1000 further includes:

the fourth obtaining module 131 is configured to obtain the second map data from the second database.

The dividing module 132 is configured to divide the second map data according to a preset dividing rule to obtain a plurality of first map data.

The first storage module 133 is configured to store the plurality of first map data in a distributed manner in the plurality of first databases.

In one embodiment, as shown in fig. 14, the data acquisition apparatus 1000 further includes:

the determining module 141 is configured to determine data version information of the divided first map data.

The index relationship establishing module 142 is configured to establish an index relationship between the data version information of the first map data and a first database storing the first map data.

And a second storage module 143, configured to store the index relationship in the second database.

In one embodiment, as shown in fig. 15, the second obtaining module 122 includes:

a determining sub-module 1221, configured to determine data version information selected by the client.

The first obtaining sub-module 1222 is configured to obtain the corresponding index relationship from the second database according to the second location information and the data version information.

The second obtaining sub-module 1223 is configured to obtain, by using the corresponding index relationship, the first database corresponding to the second location information.

In one embodiment, as shown in fig. 16, the fourth obtaining module 131 includes:

the third obtaining sub-module 1311 is configured to obtain the latest second map data from the second database according to the preset data update frequency.

In one embodiment, as shown in fig. 17, the data acquisition apparatus 1000 further includes:

the fifth obtaining module 171 is configured to obtain a plurality of map elements corresponding to the second location information according to the element query request sent by the client.

A sixth obtaining module 172, configured to obtain, according to a target element determined by the client from the plurality of map elements, location information of the target element from the first database.

And a display module 173, configured to display the target element on the base map of the map according to the geometric topological manner selected by the client and the position information of the target element.

In one embodiment, as shown in fig. 18, the data acquisition apparatus 1000 further includes:

a seventh obtaining module 181, configured to obtain, according to verification source information in the verification request sent by the client, a target verification source corresponding to the verification source information.

An eighth obtaining module 182, configured to obtain third map data corresponding to the second location information from the target verification source.

The second sending module 183 is configured to send the third map data to the client, so that the client verifies the first map data with the third map data.

The functions of each module in each apparatus in the embodiment of the present application may refer to corresponding descriptions in the above method, and are not described herein again.

According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.

As shown in fig. 19, it is a block diagram of an electronic device according to the method of data acquisition in the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.

As shown in fig. 19, the electronic apparatus includes: one or more processors 1901, a memory 1902, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display Graphical information for a Graphical User Interface (GUI) on an external input/output device, such as a display device coupled to the Interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 19 illustrates an example of one processor 1901.

The memory 1902 is a non-transitory computer readable storage medium provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform the method of data acquisition provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method of data acquisition provided herein.

The memory 1902, as a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the method of data acquisition in the embodiments of the present application (for example, the first acquisition module 10, the second acquisition module 19, the third acquisition module 30, and the first sending module 40 shown in fig. 13). The processor 1901 executes various functional applications of the server and data processing, i.e., implements the method of data acquisition in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 1902.

The memory 1902 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the stored data area may store data created from use of the electronic device by data acquisition, and the like. Further, the memory 1902 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 1902 optionally includes memory located remotely from the processor 1901, and such remote memory may be coupled to the data acquisition electronics via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The electronic device of the method of data acquisition may further comprise: an input device 1903 and an output device 1904. The processor 1901, the memory 1902, the input device 1903, and the output device 1904 may be connected by a bus or other means, and fig. 19 illustrates an example of a connection by a bus.

The input device 1903 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the data-capturing electronic apparatus, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer, one or more mouse buttons, a track ball, a joystick, or other input device. The output devices 1904 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The Display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) Display, and a plasma Display. In some implementations, the display device can be a touch screen.

Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, Integrated circuitry, Application Specific Integrated Circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (Cathode Ray Tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present application can be achieved, and the present invention is not limited herein.

The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method of data acquisition, comprising:

acquiring a first database corresponding to second position information determined by the client from the plurality of associated position information;

acquiring first map data corresponding to the second position information from the first database;

2. The method of claim 1, further comprising:

acquiring second map data from a second database;

dividing the second map data according to a preset dividing rule to obtain a plurality of first map data;

and storing a plurality of first map data in a plurality of first databases in a distributed mode.

3. The method of claim 2, further comprising:

determining data version information of the divided first map data;

establishing an index relationship between data version information of the first map data and a first database storing the first map data;

and storing the index relation in a second database.

4. The method of claim 3, wherein obtaining a first database corresponding to second location information determined by the client from the plurality of associated location information comprises:

determining data version information selected by the client;

acquiring a corresponding index relation from the second database according to the second position information and the data version information;

and acquiring the first database corresponding to the second position information by using the corresponding index relation.

5. The method of claim 2, wherein obtaining second map data from a second database comprises:

6. The method of claim 1, further comprising:

acquiring a plurality of map elements corresponding to the second position information according to an element query request sent by the client;

acquiring position information of a target element determined by the client from a plurality of map elements from the first database;

and displaying the target element on a base map of a map according to the geometric topological mode selected by the client and the position information of the target element.

7. The method of claim 1, further comprising:

acquiring a target verification source corresponding to verification source information according to the verification source information in a verification request sent by the client;

8. A data acquisition apparatus, comprising:

the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a plurality of associated position information corresponding to first position information according to the first position information in a position query request sent by a client;

a second obtaining module, configured to obtain, according to second location information determined by the client from the multiple pieces of associated location information, a first database corresponding to the second location information;

9. The apparatus of claim 8, further comprising:

10. The apparatus of claim 9, further comprising:

the determining module is used for determining the data version information of the divided first map data;

11. The apparatus of claim 10, wherein the second obtaining module comprises:

the first obtaining submodule is used for obtaining a corresponding index relation from the second database according to the second position information and the data version information;

12. The apparatus of claim 9, wherein the fourth obtaining module comprises:

and the third obtaining submodule is used for obtaining the latest second map data from the second database according to the preset data updating frequency.

13. The apparatus of claim 8, further comprising:

a fifth obtaining module, configured to obtain, according to an element query request sent by the client, a plurality of map elements corresponding to the second location information;

a sixth obtaining module, configured to obtain, according to a target element determined by the client from the plurality of map elements, location information of the target element from the first database;

and the display module is used for displaying the target element on the base map of the map according to the geometric topological mode selected by the client and the position information of the target element.

14. The apparatus of claim 8, further comprising:

a seventh obtaining module, configured to obtain, according to verification source information in a verification request sent by the client, a target verification source corresponding to the verification source information;

an eighth obtaining module, configured to obtain third map data corresponding to the second location information from the target verification source;

15. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.