CN110134728B - Method and system for providing map space data based on full text search - Google Patents
Method and system for providing map space data based on full text search Download PDFInfo
- Publication number
- CN110134728B CN110134728B CN201910384467.3A CN201910384467A CN110134728B CN 110134728 B CN110134728 B CN 110134728B CN 201910384467 A CN201910384467 A CN 201910384467A CN 110134728 B CN110134728 B CN 110134728B
- Authority
- CN
- China
- Prior art keywords
- data
- interface
- text search
- full
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000008676 import Effects 0.000 claims abstract description 33
- 238000013507 mapping Methods 0.000 claims description 5
- 238000010276 construction Methods 0.000 abstract description 6
- 238000012545 processing Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000001174 ascending effect Effects 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
Abstract
The invention discloses a method and a system for providing map space data based on full-text search, belonging to the field of data search, aiming at solving the technical problem of how to quickly and efficiently query data under the condition of multi-data-source heterogeneous data in the information construction process, and the technical scheme is as follows: the method is based on a restful interface and a webservice interface or a high-speed service interface which are used for providing customizable parameters for mobile end apps and pc ends and display enterprise positions; the method comprises the following steps: s1, constructing an import template; s2, configuring a full-text search server solr import task; s3, customizing query parameters by a user; and S4, the user selects and generates a restful interface and a webservice interface or a high-speed service interface according to the requirement. The system comprises a data import module, a full-text search server solr, a user-defined parameter module and an interface generation module, wherein the data import module transmits data to the full-text search server solr, and the full-text search server solr and the user-defined parameter module respectively transmit the data interface generation module.
Description
Technical Field
The invention relates to the field of data search, in particular to a method and a system for providing map space data based on full text search.
Background
The traditional research and development method for displaying the enterprise position nearby on the map compares each piece of data with the current longitude and latitude through a system background algorithm, and returns a comparison result according to the ascending order or the descending order of the comparison result. The query efficiency can be further improved under the condition of small data volume, the query efficiency is slower and slower along with the increase of the data volume, the corresponding time of the data volume reaching a million level is about seven to eight seconds, and the customer experience is seriously influenced. Therefore, in the information construction process, how to quickly and efficiently query data under the condition of multi-data-source heterogeneous data is a technical problem in the prior art at present.
Patent document CN105468720A discloses a method of integrating distributed data processing systems, a corresponding system and a data processing method thereof. The integration method comprises the following steps: building a distributed system infrastructure Hadoop cluster; establishing a distributed database Hbase, a full-text search server Solr and a distributed real-time computing system Storm on the Hadoop cluster to obtain the total architecture of the distributed data processing system; and setting a first configuration file and a second configuration file on a data access layer of the total architecture to provide a uniform data access interface and integrate the distributed data processing system. However, in the informatization construction process of the technical scheme, data query cannot be completed quickly and efficiently under the condition of multi-data-source heterogeneous data.
Patent No. CN106708996A discloses a method and system for full text search of a relational database. The method comprises the following steps: importing the data of the relational database into a non-relational database and an index server; packaging the data of the relational database to generate an index request; and indexing the index request into the index server according to a predetermined Mapping storage structure, wherein the predetermined Mapping storage structure comprises: a participle field, a non-participle field, and an info field. However, in the informatization construction process of the technical scheme, data query cannot be completed quickly and efficiently under the condition of multi-data-source heterogeneous data.
Disclosure of Invention
The technical task of the invention is to provide a method and a system for providing map space data based on full-text search, so as to solve the problem of how to quickly and efficiently query data under the condition of multi-data-source heterogeneous data in the information construction process.
The technical task of the invention is realized in the following way, a method for providing map space data based on full text search is characterized in that a restful interface and a webservice interface or a high-speed service interface for displaying enterprise positions are provided for mobile terminal app and pc terminals based on a full text search server solr, and customizable parameters are provided for the mobile terminal app and the pc terminals; the method comprises the following specific steps:
s1, constructing an import template: a user self-defines a multi-data-source heterogeneous data import template and imports data into a full-text search server solr;
s2, configuring a full-text search server solr import task;
s3, customizing query parameters by a user;
and S4, the user selects and generates a restful interface and a webservice interface or a high-speed service interface according to the requirement.
Preferably, the specific steps of constructing the import template in step S1 are as follows:
s101, configuring source database information: integrating multiple data sources, and configuring the integrated data into a file;
s102, customizing the imported fields: and mapping and corresponding the imported fields and the solr variable of the full-text search server.
Preferably, when the global search server solr is configured to import a task in step S2, the task is periodically imported or manually imported as needed, the condition of the imported task is monitored in real time, and an error log query is provided.
Preferably, the user-defined query parameter in step S3 is specifically based on a file, the user defines parameter information as needed and sets a cascade relationship between the parameter information, and if the parameter information is related to longitude and latitude, the adopted parameter type is location; the parameter information includes the number of parameters, the type of the parameters, the name of the parameters and whether the parameters need to be filled.
Preferably, in the step S4, the restful interface and the webservice interface or the high-speed service interface are generated based on the geodesist () method and the spatial function of the solr, respectively, so as to provide a space search interface for the user.
More preferably, the source data includes relational and non-relational databases.
More preferably, the relational database comprises Oracle, mysql and DB2; the non-relational database adopts MongoDB.
A system for providing map space data based on full-text search comprises a data import module, a full-text search server solr, a custom parameter module and an interface generation module, wherein the data import module transmits data to the full-text search server solr, and the full-text search server solr and the custom parameter module respectively transmit the data interface generation module.
Preferably, the data import module is used for importing data into the full-text search server solr according to a multi-data-source heterogeneous data import template defined by a user;
the full-text search server solr is used for receiving and storing data imported by the data import module;
the user-defined parameter module is used for defining the number of parameters, the types of the parameters, the names of the parameters and information on whether the parameters need to be filled according to the needs of a user, and a cascade relation is set among the parameters;
the interface generating module is used for selectively generating a restful interface and a webservice interface or a high-speed service interface according to the user requirement, and the restful interface and the webservice interface or the high-speed service interface are generated respectively based on the model () method and the spatial function of the solr, so that a space search interface is provided for the user.
More preferably, the source data includes a relational database and a non-relational database.
The method and the system for providing map space data based on full text search have the following advantages that:
the method is mainly applied to quickly and efficiently inquiring enterprise data according to the current longitude and latitude on a map, and quickly and efficiently inquiring the data under the condition of heterogeneous data of multiple data sources in the information construction process;
the invention greatly improves the query efficiency, and the ten-million-level data query time is in the millisecond level;
the load pressure of the database and the server is reduced, and the equipment cost is saved; the invention has been applied to Shenyang food and drug administration mobile app application;
according to the method, the map space information is returned quickly and efficiently according to the user customized interface, for example, the data is displayed nearby according to the current longitude and latitude information; meanwhile, the invention can expand the function in an extending way, not only returns the map space information, but also can be used for any query limited by the database and the program performance.
Drawings
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a block diagram of a method for providing map space data based on full text search;
fig. 2 is a block diagram illustrating a system for providing map space data based on full text search.
Detailed Description
A method and system for providing map space data based on a full text search according to the present invention will be described in detail with reference to the accompanying drawings and embodiments.
Example 1:
as shown in fig. 1, the method for providing map space data based on full-text search of the present invention is a restful interface and a webservice interface or a high-speed service interface for displaying enterprise locations, which provide customizable parameters for mobile end apps and pc ends based on a full-text search server solr; the method comprises the following specific steps:
s1, constructing an import template: the method comprises the following steps that a user self-defines a multi-data-source heterogeneous data importing template, and data are imported into a full-text search server solr, and the method specifically comprises the following steps: wherein the source data comprises a relational database and a non-relational database; the relational database comprises Oracle, mysql and DB2; the non-relational database adopts MongoDB;
s101, configuring source database information: integrating multiple data sources, and configuring the integrated data into a file;
s102, customizing the imported fields: and mapping and corresponding the imported fields and the SOLR variable of the full-text search server.
S2, configuring a full-text search server solr import task: leading in tasks regularly or manually according to needs, monitoring the condition of the task in real time and providing error log query;
s3, user-defined query parameters: based on the file, the user defines the parameter information according to the requirement and sets the cascade relation among all the parameter information, if the parameter information is related to the longitude and latitude, the adopted parameter type is location; the parameter information comprises the number of parameters, the type of the parameters, the name of the parameters and whether the parameters need to be filled or not;
s4, a user selects and generates a restful interface and a webservice interface or a high-speed service interface as required; the restful interface and the webservice interface or the high-speed service interface are generated based on the geodesist () method and the spatial function of the solr respectively, and a space search interface is provided for a user.
Example 2:
as shown in fig. 2, the system for providing map space data based on full text search of the present invention includes a data import module, a full text search server solr, a custom parameter module and an interface generation module, wherein the data import module transmits data to the full text search server solr, and the full text search server solr and the custom parameter module respectively transmit the data interface generation module;
the data import module is used for importing data into a full-text search server solr according to a multi-data-source heterogeneous data import template defined by a user; the source data comprises a relational database and a non-relational database, wherein the relational database comprises Oracle, mysql and DB2, and the non-relational database adopts MongoDB;
the full-text search server solr is used for receiving and storing data imported by the data import module;
the user-defined parameter module is used for defining the number of parameters, the types of the parameters, the names of the parameters and the information whether the parameters need to be filled according to the needs of a user, and a cascade relation is set among the parameters;
the interface generating module is used for selectively generating a restful interface and a webservice interface or a high-speed service interface according to the user requirement, and the restful interface and the webservice interface or the high-speed service interface are generated respectively based on the model () method and the spatial function of the solr, so that a space search interface is provided for the user.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (6)
1. A method for providing map space data based on full-text search is characterized in that the method is a restful interface and a webservice interface or a high-speed service interface for displaying enterprise positions, which are used for providing customizable parameters for mobile end apps and pc ends based on a full-text search server solr; the method comprises the following specific steps:
s1, constructing an import template: a user self-defines a multi-data-source heterogeneous data import template and imports data into a full-text search server solr;
s2, configuring a full-text search server solr import task;
s3, user-defined query parameters: based on the file, the user defines the parameter information according to the requirement and sets the cascade relation among all the parameter information, if the parameter information is related to the longitude and latitude, the adopted parameter type is location; the parameter information comprises the number of parameters, the type of the parameters, the name of the parameters and whether the parameters need to be filled or not;
s4, a user selects and generates a restful interface and a webservice interface or a high-speed service interface as required; the restful interface and the webservice interface or the high-speed service interface are generated respectively based on the geodesist () method and the spatial function of the solr, and a space search interface is provided for a user.
2. The method for providing map space data based on full text search according to claim 1, wherein the specific steps of constructing the import template in step S1 are as follows:
s101, configuring source database information: integrating multiple data sources, and configuring the integrated data into a file;
s102, customizing the imported fields: and mapping and corresponding the imported fields and the SOLR variable of the full-text search server.
3. The method for providing map space data based on full text search according to claim 1 or 2, wherein the full text search server solr is configured in step S2 to import the task periodically or manually as required, and the method monitors the condition of the imported task in real time and provides error log query.
4. The method for providing map space data based on full text search of claim 3, wherein the source database comprises a relational database and a non-relational database.
5. The method for providing map space data based on full text search of claim 4, wherein the relational database comprises Oracle, mysql and DB2; the non-relational database adopts MongoDB.
6. A system for providing map space data based on full text search is characterized by comprising a data import module, a full text search server solr, a custom parameter module and an interface generation module, wherein the data import module transmits data to the full text search server solr, and the full text search server solr and the custom parameter module respectively transmit the data interface generation module;
the data import module is used for importing data into a full-text search server solr according to a multi-data-source heterogeneous data import template defined by a user;
the full-text search server solr is used for receiving and storing the data imported by the data import module;
the user-defined parameter module is used for defining the number of parameters, the types of the parameters, the names of the parameters and information on whether the parameters need to be filled according to the needs of a user, and a cascade relation is set among the parameters;
the interface generating module is used for selectively generating a restful interface and a webservice interface or a high-speed service interface according to the user requirement, and the restful interface and the webservice interface or the high-speed service interface are generated respectively based on the model () method and the spatial function of the solr, so that a space search interface is provided for the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910384467.3A CN110134728B (en) | 2019-05-09 | 2019-05-09 | Method and system for providing map space data based on full text search |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910384467.3A CN110134728B (en) | 2019-05-09 | 2019-05-09 | Method and system for providing map space data based on full text search |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110134728A CN110134728A (en) | 2019-08-16 |
| CN110134728B true CN110134728B (en) | 2023-02-14 |
Family
ID=67576835
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910384467.3A Active CN110134728B (en) | 2019-05-09 | 2019-05-09 | Method and system for providing map space data based on full text search |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110134728B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110879857B (en) * | 2019-11-27 | 2023-11-07 | 苏交科集团股份有限公司 | Tunnel operation data analysis method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106708996A (en) * | 2016-12-19 | 2017-05-24 | 北京天广汇通科技有限公司 | Method and system for full text search of relational database |
| CN106713332A (en) * | 2016-12-30 | 2017-05-24 | 山石网科通信技术有限公司 | Network data processing method, device and system |
| WO2018176139A1 (en) * | 2017-03-28 | 2018-10-04 | Open Text Sa Ulc | Integration services systems, methods and computer program products for ecm-independent etl tools |
-
2019
- 2019-05-09 CN CN201910384467.3A patent/CN110134728B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106708996A (en) * | 2016-12-19 | 2017-05-24 | 北京天广汇通科技有限公司 | Method and system for full text search of relational database |
| CN106713332A (en) * | 2016-12-30 | 2017-05-24 | 山石网科通信技术有限公司 | Network data processing method, device and system |
| WO2018176139A1 (en) * | 2017-03-28 | 2018-10-04 | Open Text Sa Ulc | Integration services systems, methods and computer program products for ecm-independent etl tools |
Non-Patent Citations (1)
| Title |
|---|
| Solr在乐龄易购网站中的应用;蔡宇晶等;《铁路计算机应用》;20161025(第10期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110134728A (en) | 2019-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11249969B2 (en) | Data storage method and apparatus, and storage medium | |
| WO2018005834A1 (en) | Vehicle data aggregation and analysis platform providing dealership service provider dashboard | |
| CN107515878B (en) | Data index management method and device | |
| CN107229718B (en) | Method and device for processing report data | |
| CN104123374A (en) | Method and device for aggregate query in distributed databases | |
| US20170068902A1 (en) | Modeling of Geospatial Location Over Time | |
| CN112632136A (en) | Data statistical analysis method and device, electronic equipment and storage medium | |
| CN113986933A (en) | Materialized view creating method and device, storage medium and electronic equipment | |
| CN110706125A (en) | Water conservancy big data analysis information service system and platform service system | |
| CN110134728B (en) | Method and system for providing map space data based on full text search | |
| CN111949831A (en) | Graphic database establishing method and device and readable storage medium | |
| CN115344207A (en) | Data processing method and device, electronic equipment and storage medium | |
| US10182307B2 (en) | System for providing location-based social networking services to users of mobile devices | |
| CN112506887A (en) | Vehicle terminal CAN bus data processing method and device | |
| CN112256488A (en) | Method and device for acquiring cloud data and data storage architecture of cloud service | |
| CN116680315A (en) | Data offline processing method and device, electronic equipment and storage medium | |
| Antunes et al. | Semantic-based publish/subscribe for M2M | |
| CN115982133A (en) | Data processing method and device | |
| US20210141791A1 (en) | Method and system for generating a hybrid data model | |
| WO2022220982A1 (en) | Database query execution on multiple databases | |
| CN115017185A (en) | Data processing method, device and storage medium | |
| CN112650777A (en) | Data warehouse manufacturing method and device, terminal equipment and computer storage medium | |
| US20190098442A1 (en) | Method of operating a device, the device shown carrying out the method, and a system including the deice and a server in a system providing location-based social networking services to users of mobile devices | |
| CN111797166A (en) | Quasi-real-time resume data synchronization method and device, electronic equipment and medium | |
| US20220075764A1 (en) | Comparison of database data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |