CN112364189A - Electronic certificate application method based on ES service - Google Patents

Electronic certificate application method based on ES service Download PDF

Info

Publication number
CN112364189A
CN112364189A CN202011276589.XA CN202011276589A CN112364189A CN 112364189 A CN112364189 A CN 112364189A CN 202011276589 A CN202011276589 A CN 202011276589A CN 112364189 A CN112364189 A CN 112364189A
Authority
CN
China
Prior art keywords
data
index
query
information
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011276589.XA
Other languages
Chinese (zh)
Other versions
CN112364189B (en
Inventor
王国栋
李双梁
宁方刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Cloud Information Technology Co Ltd
Original Assignee
Inspur Cloud Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Cloud Information Technology Co Ltd filed Critical Inspur Cloud Information Technology Co Ltd
Priority to CN202011276589.XA priority Critical patent/CN112364189B/en
Publication of CN112364189A publication Critical patent/CN112364189A/en
Application granted granted Critical
Publication of CN112364189B publication Critical patent/CN112364189B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides an electronic license application method based on ES service, belonging to the technical field of retrieval and query, and based on the national standard specification related to the electronic license, starting from the practical application of the electronic license, the method analyzes the data characteristics and the service scene of the electronic license, splits the data field of the electronic license according to the subsequent application characteristics of each part of the electronic license data, and designs the data structure stored in the ES in a flat manner, thereby realizing the storage of the electronic license in the ES, and realizing the quick query and the real-time statistics of the electronic license based on the characteristic that the ES queries quickly under large data volume.

Description

Electronic certificate application method based on ES service
Technical Field
The invention relates to a retrieval and query technology, in particular to an electronic license application method depending on ES service.
Background
The issuing of 6 electronic certificate national standards, such as GB/T36901-.
In addition, the access specifications of national government affairs service platforms such as 'C0126 + 2018 national government affairs service platform data exchange and sharing interface standard' provide a standard basis for the cross-layer data exchange of the electronic certificate, provide standard support for the data sharing application of the electronic certificate across departments and regions, and accelerate the integration and sharing of certificate type government affair information resources.
The establishment and the perfection of the electronic license standard specification accelerate the data aggregation of the electronic license library, the data volume of the electronic license library continuously increases, and meanwhile, the query requirements of users increase, which puts higher requirements on the data storage capacity of the electronic license library and the capacity of providing retrieval service for the outside.
The traditional mode of single-library single-table or sub-library and sub-table storage of electronic certificates has certain problems when a large number of electronic certificates are gathered. In the mode of single database and single table, when the data volume reaches a certain threshold value, the data capacity is gradually reduced; secondly, when the data is large in a single record, the same storage space can only store relatively few rows, which can cause extra I/O overhead and reduce the data storage performance; under the mode of sub-database and sub-table, the single-table pressure can be solved, but for the aspect of statistics of each dimensionality of the aggregated data, the problems that all related sub-tables need to be traversed, and bottleneck exists in the aspects of difficulty, performance and instantaneity of statistics are solved, and the method is not beneficial to business application under the condition of ultra-large data volume.
In summary, the storage model of the single-library single table and the model of the sub-library and sub-table have the problems of statistical performance and real-time performance, and the performance problem becomes more obvious as the data volume increases.
Disclosure of Invention
In order to solve the technical problems, the invention provides an electronic license application method based on ES service, which combines the requirements of the relevant national standard specification of the electronic license and the analysis of the data characteristics and application scenes of the electronic license, establishes an ES-based storage model of the electronic license and provides support for the real-time retrieval and multi-dimensional statistics of the electronic license.
The method is based on the analysis of the characteristics and the application scene of the electronic license data, and the flat structured design of the electronic license data is carried out based on the business, and the information of each statistical dimension of the electronic license is contained, so that the electronic license can be rapidly inquired and counted in real time under different conditions under large data volume.
The technical scheme of the invention is as follows:
an application method of electronic certificate based on ES service,
comprises the following steps:
1) the data characteristics of the electronic certificate are analyzed in combination with standard specifications and actual business requirements, and an index structure of the electronic certificate in the es is determined;
2) designing a model of data entry es based on the determined storage index;
3) and based on the existing license data in the es, corresponding query and statistical operation are carried out on the license data by combining the statistics of each dimension and the conditions of quick query.
Further, in the above-mentioned case,
dividing a storage index structure of the electronic certificate in the es into three parts, namely basic information, service information and file information:
1) the basic information is an object structure and comprises all metadata information, license definition mechanism codes and division codes of a license issuing department in the standard GB 36903;
2) selecting a nested (array) structure of the service information, wherein the nested structure comprises more than one object structure data and corresponds to different service sub-items in each service information;
3) the file information is an object structure and comprises id and file type of the license file in the file storage system.
Description of index design:
1) reducing the physical storage size of each record, wherein all non-time fields in the es index adopt keywords;
2) all time fields in the es index adopt long timestamps;
3) the doc _ id of each record in the es index corresponds to the certificate identification one by one, so that the uniqueness of the certificate stored in the es is ensured;
4) an es template is designed by utilizing an alias mechanism of es, and data recorded in es are divided according to time by adopting uniform aliases, so that uniform management of sub-index storage data and es indexes is realized;
5) each index designs 1 main fragment and 1 copy fragment;
6) in order to ensure readability and complexity of es adding, deleting, modifying and checking requests, all es requests are realized by using restApi.
Description of the basic information Structure:
1) for the associated query with poor support, the design of the index should contain the search field of the license (e.g.: license identification, license type code, license approach department, holder name, etc.) and statistical fields of the license (such as: belonging zone codes, definition mechanism codes, license states, etc.);
2) all basic information of the electronic certificate comes from the standard GB36903, and is packaged into an index structure, so that the standard property of data in es is ensured, and key information required by query and statistics is provided;
3) and adding license to define the division to which the organization code and the issuing department belong.
Description of service information structure:
1) for different types of electronic certificates, service sub-items contained in service information are different, but the sub-items have uniform attributes: chinese name, English name, value and type; the universal attribute is packaged into an object which corresponds to different business sub-items, and then the different objects are stored in the nested state, so that the uniform packaging of different business information of different types of electronic certificates can be realized, and the structured storage of data in es is completed;
2) and for the stored extended information, corresponding aggregation query is carried out according to specific services, and the query and statistical requirements of specific service information based on a specific electronic license are met.
Description of the file information structure:
1) for the certificate file, the certificate file is stored in a separate file system in a base64 mode;
2) the es index associates electronic certificate entity files by encapsulating ids and file types in the file storage system.
Using multiple indices and aliases
Establishing a template for the index of es, applying an index rule of the template as a uniform prefix +, wherein in each data entry request, the index name of the request consists of a prefix specified in the template and a timestamp in a current request yyyy-MM format, so that the data in es is automatically stored in an index-dividing manner according to time, the data distribution is dispersed, and the query and statistical pressure is reduced;
the template is uniformly named, and in the query and statistics request, the alias in the es template is uniformly used by the index name, so that uniform query and statistics on the data of multiple indexes in es can be realized.
Data entry and transaction control
Firstly, basic packaging is carried out on electronic certificate data through an electronic certificate system;
after the electronic certificate system finishes corresponding business logic, converting a business object into a json string corresponding to an es index structure, uniformly packaging structure data into json, and requesting es through restApi to realize data entry es;
the certificate data entry es is completed in the last step of the business logic;
and (4) throwing an exception after the es entry fails so as to ensure the consistency of the data in the relational database and the es when the es is combined with the adding, deleting and modifying logic of the relational database.
Establishing an es statistical model
1) Querying using replicas
Using the copy in the index to carry out query and statistics;
2) full index queries using aliases
Based on the alias specified in the es template, uniformly querying and counting each sub-index through restApi;
3) aggregation condition unified packaging
Integrating polymerization conditions, uniformly packaging the polymerization conditions in a static json file, and distinguishing the polymerization conditions through different keys; after the system is started, reading the json into a static area, taking out an aggregation condition according to a corresponding key when complex aggregation query is carried out, and acquiring statistical data through a restApi request es;
4) processing es responses
Unified conversion of all responses to json format
For the query service, all certificate data are required to be returned, and post request departments are performed through doc _ ids (certificate identifiers) of the certificate data to realize accurate query;
for the returned basic information, the basic information in the returned information is directly adopted;
for the service information, the json array is traversed, and the json array is encapsulated again to be json of key-value;
for the file information, the file system is requested through the returned file id, base64 is obtained, and the base is packaged into a new json. Finally, uniformly packaging the json of the three parts for a service system to use;
for the statistical service, specific license data does not need to be returned, the size is set to be 0, a post or get request of a _ search is carried out, then doc _ count in a corresponding group is taken out according to specific aggregation conditions, simple statistical calculation is carried out, and the result is packaged into json for a service system to use.
The invention has the advantages that
1. And a large amount of convergence of the electronic certificates is supported.
And the sub-index structure design is adopted, so that the aggregation of a large amount of license data is supported.
2. And fast query and statistics of the electronic certificate are supported.
The electronic certificate is structurally stored in es, aggregate query under different conditions is utilized, the statistical result of each dimension can be rapidly obtained under the condition of full data volume, the traditional branch table design is compared, the complex branch table design and the query method for polling all the branch tables are avoided, and the expansibility and the performance are obviously improved. By utilizing the common _ search request, the target data requirement can be quickly searched in a large amount of data, and compared with single-table query, the performance is obviously improved; compared with the sub-table query, the method avoids the design of a complex query algorithm and supports the query of all fields under the full amount of data.
3. A mode of storing the electronic certificate in the es is provided.
The index structure in the invention can realize the structured storage of the electronic license in es, and simultaneously, the invention adopts a mode (the character string is keyword and the time is long timestamp) common to each system for the type of each field, so that the invention can be applied to the system which has quick query and statistical dependence on the license data.
Drawings
FIG. 1 is a schematic of a license index structure;
FIG. 2 is a data entry es flow diagram;
FIG. 3 is a schematic diagram of simplified aggregated query condition authoring with static json.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.
By the invention, an electronic license application model which is based on the ES service and accords with the national standard specification can be established for gathering and sharing the electronic license. In the model, based on the service characteristics of each data item of the electronic certificate, the es index is structurally designed (basic information, service information and file information), the gathering and sharing scenes of each part of structured data are analyzed, the field of each part of data is further refined, the electronic certificate can be structurally stored in the es, the retrieval efficiency is improved by using the characteristics of the es service, and the statistics and the retrieval of each certificate in each dimension are realized. By the method and the device, the electronic certificate can be quickly retrieved and counted under different service scenes, and the application of the electronic certificate is supported.
The method is based on the national standard specification related to the electronic license, analyzes the data characteristics and the service scene of the electronic license from the practical application of the electronic license, splits the data field of the electronic license according to the subsequent application characteristics of each part of the electronic license data, and designs the data structure stored in the ES in a flattened way, thereby realizing the storage of the electronic license in the ES, and realizing the quick query and the real-time statistics of the electronic license based on the characteristic that the ES queries quickly under large data volume.
The process of the invention is divided into three steps: firstly, combining the national standard specification and the actual business requirement, analyzing the data characteristics of the electronic certificate, and determining the index structure of the electronic certificate in the es; secondly, designing a model of data entry es based on the determined storage index; thirdly, based on the existing license data in the es, corresponding query and statistic operation are carried out on the license data by combining the statistics of all dimensions and the conditions of quick query.
1. electronic certificate storage structure design in es
According to the definition of national standard of electronic certificates, each electronic certificate has a certificate identifier, and one electronic certificate can be uniquely determined through the identifier; the structured data of the license is divided into basic information, service information and file information:
1) the basic information is the common attribute of different types of electronic certificates and has the same data characteristics and retrieval requirements.
2) The business information is composed of different business sub-items, each sub-item has general attributes (Chinese name, English name, value and type), and different types of electronic certificates contain different business information.
3) And for the file information, the electronic license file is an OFD standard file.
In the model, a storage index structure of the electronic certificate in the es is divided into three parts, namely basic information, service information and file information:
1) the basic information is object structure, which contains all metadata information, license definition organization code and license issue department division code in national standard GB36903
2) Service information selection nested structure, wherein the nested structure comprises a plurality of object structure data corresponding to different service sub-items in each service information
3) The file information is an object structure and comprises id and file type of the license file in the file storage system.
Description of index design:
1) in order to ensure the accuracy of data query and statistics in es and reduce the physical storage size of each record, all non-time fields in the es index adopt keywords
2) In order to ensure the universality of data in es in different systems, facilitate the conversion application of data time data among different systems and avoid query and statistical errors caused by time zone conversion, all time fields in the es index adopt long timestamps
3) The doc _ id of each record in the es index corresponds to the certificate identification one by one, so that the uniqueness of the certificate stored in es is ensured, and the situation that multiple records may be stored in es by one certificate due to repeated addition and deletion operations and data errors are caused is avoided
4) An es template is designed by utilizing an alias mechanism of es, and the data recorded into es are divided according to time by adopting uniform aliases, so that the uniform management of sub-index storage data and es indexes is realized
5) Each index designs 1 main fragment and 1 copy fragment
6) In order to ensure readability and complexity of es adding, deleting, modifying and checking requests, all es requests are realized by using restApi.
Description of the basic information Structure:
1) es is different from a relational database, and for poor support of associated query, the design of index should be flattened to ensure that all required fields can be covered;
2) all basic information of the electronic certificate comes from the national standard GB36903, and is packaged into an index structure, so that the standard of data in es is ensured, and key information required by query and statistics is provided
3) The license definition organization code and the division of the issuing department are added, thereby meeting the requirement that some businesses count according to the division or the committee
Description of service information structure:
1) for different types of electronic certificates, service sub-items contained in service information are different, but the sub-items have uniform attributes: chinese name, English name, value, type. The universal attribute is packaged into one object corresponding to different business sub-items, and then the different objects are stored in the nested state, so that the uniform packaging of different business information of different types of electronic certificates can be realized, and the structured storage of data in es is completed
2) For the stored extended information, corresponding aggregation query can be carried out according to specific services, and the query and statistical requirements of specific service information based on specific electronic certificates are met
Description of the file information structure:
1) for the certificate file, because the storage occupation is large, the certificate file is generally stored in a separate file system in the form of base64
2) The es index associates electronic license entity files by encapsulating ids and file types in a file storage system
2. Establishing certificate data entry es model
1) Using multiple indices and aliases
The total amount of data of the electronic certificate is very large, and the number of the single-index storage documents is limited, so that the electronic certificate is not suitable for storage of the data amount.
The method comprises the steps of establishing a template for indexes of es, applying an index rule of the template to be a uniform prefix (such as license), forming an index name of a request in each request for inputting data (such as license _2020-07) by a prefix specified in the template and a timestamp in a current request yyyyy-MM (a specific timestamp can be changed according to actual requirements), realizing automatic indexing storage of data in the es according to time, dispersing data distribution, and reducing query and statistical pressure.
The template is uniformly named, and in the query and statistics request, the alias in the es template is uniformly used by the index name, so that uniform query and statistics on the data of multiple indexes in es can be realized.
2) Data entry and transaction control
Firstly, the electronic certificate data is basically packaged (can be structured formats such as self-defined business objects, json, map and the like) through an electronic certificate system
After the electronic certificate system completes corresponding business logic, business objects are converted into json strings corresponding to the es index structures, structural data are packaged into json in a unified mode, and then es is requested through restApi, so that data entry es is achieved.
Because es does not support transactions, in order to ensure data consistency, license data entry es should be completed in the last step of the business logic.
And (4) throwing an exception after the es entry fails so as to ensure the consistency of the data in the relational database and the es when the es is combined with the adding, deleting and modifying logic of the relational database.
3. Establishing an es statistical model
1) Querying using replicas
The copies in the index are used for inquiring and counting, so that the read-write separation of the data in the es is realized, the es inquiry pressure is reduced, and the write-in, inquiry and counting rates are improved
2) Full index queries using aliases
Based on the alias specified in the es template, the unified query and statistics can be performed on each sub-index through restApi, and the problem that all tables need to be polled in the traditional sub-table statistics and query is solved
3) Aggregation condition unified packaging
For some complex aggregation conditions, problems of complex logic, low readability and difficult maintenance exist in calling the self-contained javaApi of the es and self-assembly json conditions, and the application difficulty is high for statistics which are diverse in requirements and frequently changed.
In the model, complex and fussy aggregation conditions are integrated, uniformly packaged in a static json file and distinguished through different keys. After the system is started, the json is read into the static area, and when complex aggregation query is carried out, aggregation conditions are taken out according to corresponding keys, and statistical data are obtained through a restApi request es. (for example, a certain license is counted according to partitions, the aggregation condition is mainly that terms aggregation is carried out according to partition codes in an index, the aggs condition is prepared and written into the static json, and only the static json is needed to directly take out and assemble in the corresponding aggregation query logic, so that the preparation of complicated conditions is avoided).
4) Processing es responses
Unified conversion of all responses to json format
For the query service, all the license data are required to be returned, and the post request department is carried out through doc _ id (license identifier) of the license data to realize accurate query. For the returned basic information, the basic information in the returned information can be directly adopted; for the service information, the json array is traversed, and the json array is encapsulated again to be json of key-value; for the file information, the file system can be requested through the returned file id, base64 is obtained, and the base is packaged as a new json. And finally, uniformly packaging the three json parts for a service system to use.
For the statistical service, specific license data does not need to be returned, the size is set to be 0, the post request of the _ search is carried out, then doc _ count in the corresponding group is taken out according to specific aggregation conditions, simple statistical calculation is carried out, and the result is packaged into json for the service system to use.
The index partitioning strategy under a large amount of data solves the problem that es has no affairs and causes data inconsistency when being combined with a traditional relational database. The aggregation condition is written into the static json and is directly taken out from the static area during query, so that the complex compiling and maintenance of the aggregation condition are avoided.
The above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (9)

1. An application method of an electronic certificate depending on ES service is characterized in that,
comprises the following steps:
1) the data characteristics of the electronic certificate are analyzed in combination with standard specifications and actual business requirements, and an index structure of the electronic certificate in the es is determined;
2) designing a model of data entry es based on the determined storage index;
3) and based on the existing license data in the es, corresponding query and statistical operation are carried out on the license data by combining the statistics of each dimension and the conditions of quick query.
2. The method of claim 1,
dividing a storage index structure of the electronic certificate in the es into three parts, namely basic information, service information and file information:
1) the basic information is an object structure and comprises all metadata information, license definition mechanism codes and division codes of a license issuing department in the standard GB 36903;
2) selecting a nested (array) structure of the service information, wherein the nested structure comprises more than one object structure data and corresponds to different service sub-items in each service information;
3) the file information is an object structure and comprises id and file type of the license file in the file storage system.
3. The method of claim 1,
description of index design:
1) reducing the physical storage size of each record, wherein all non-time fields in the es index adopt keywords;
2) all time fields in the es index adopt long timestamps;
3) the doc _ id of each record in the es index corresponds to the certificate identification one by one, so that the uniqueness of the certificate stored in the es is ensured;
4) an es template is designed by utilizing an alias mechanism of es, and data recorded in es are divided according to time by adopting uniform aliases, so that uniform management of sub-index storage data and es indexes is realized;
5) each index designs 1 main fragment and 1 copy fragment;
6) in order to ensure readability and complexity of es adding, deleting, modifying and checking requests, all es requests are realized by using restApi.
4. The method of claim 2,
description of the basic information Structure:
1) for poor support of the associated query, the design of the index should include a retrieval field of the license and a statistical field of the license;
2) all basic information of the electronic certificate comes from the standard GB36903, and is packaged into an index structure, so that the standard property of data in es is ensured, and key information required by query and statistics is provided;
3) and adding license to define the division to which the organization code and the issuing department belong.
5. The method of claim 2,
description of service information structure:
1) for different types of electronic certificates, service sub-items contained in service information are different, but the sub-items have uniform attributes: chinese name, English name, value and type; the universal attribute is packaged into an object which corresponds to different business sub-items, and then the different objects are stored in the nested state, so that the uniform packaging of different business information of different types of electronic certificates can be realized, and the structured storage of data in es is completed;
2) and for the stored extended information, corresponding aggregation query is carried out according to specific services, and the query and statistical requirements of specific service information based on a specific electronic license are met.
6. The method of claim 2,
description of the file information structure:
1) for the certificate file, the certificate file is stored in a separate file system in a base64 mode;
2) the es index associates electronic certificate entity files by encapsulating ids and file types in the file storage system.
7. The method of claim 1,
using multiple indices and aliases
Establishing a template for the index of es, applying an index rule of the template as a uniform prefix +, wherein in each data entry request, the index name of the request consists of a prefix specified in the template and a timestamp in a current request yyyy-MM format, so that the data in es is automatically stored in an index-dividing manner according to time, the data distribution is dispersed, and the query and statistical pressure is reduced;
the template is uniformly named, and in the query and statistics request, the alias in the es template is uniformly used by the index name, so that uniform query and statistics on the data of multiple indexes in es can be realized.
8. The method of claim 7,
data entry and transaction control
Firstly, basic packaging is carried out on electronic certificate data through an electronic certificate system;
after the electronic certificate system finishes corresponding business logic, converting a business object into a json string corresponding to an es index structure, uniformly packaging structure data into json, and requesting es through restApi to realize data entry es;
the certificate data entry es is completed in the last step of the business logic;
and (4) throwing an exception after the es entry fails so as to ensure the consistency of the data in the relational database and the es when the es is combined with the adding, deleting and modifying logic of the relational database.
9. The method of claim 1,
establishing an es statistical model
1) Querying using replicas
Using the copy in the index to carry out query and statistics;
2) full index queries using aliases
Based on the alias specified in the es template, uniformly querying and counting each sub-index through restApi;
3) aggregation condition unified packaging
Integrating polymerization conditions, uniformly packaging the polymerization conditions in a static json file, and distinguishing the polymerization conditions through different keys; after the system is started, reading the json into a static area, taking out an aggregation condition according to a corresponding key when complex aggregation query is carried out, and acquiring statistical data through a restApi request es;
4) processing es responses
Unified conversion of all responses to json format
For the query service, all certificate data are required to be returned, and post request departments are performed through doc _ ids (certificate identifiers) of the certificate data to realize accurate query;
for the returned basic information, the basic information in the returned information is directly adopted;
for the service information, the json array is traversed, and the json array is encapsulated again to be json of key-value;
for the file information, the file system is requested through the returned file id, base64 is obtained, and the base is packaged into a new json. Finally, uniformly packaging the json of the three parts for a service system to use;
for the statistical service, specific license data does not need to be returned, the size is set to be 0, a post or get request of a _ search is carried out, then doc _ count in a corresponding group is taken out according to specific aggregation conditions, simple statistical calculation is carried out, and the result is packaged into json for a service system to use.
CN202011276589.XA 2020-11-16 2020-11-16 Electronic certificate application method based on ES service Active CN112364189B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011276589.XA CN112364189B (en) 2020-11-16 2020-11-16 Electronic certificate application method based on ES service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011276589.XA CN112364189B (en) 2020-11-16 2020-11-16 Electronic certificate application method based on ES service

Publications (2)

Publication Number Publication Date
CN112364189A true CN112364189A (en) 2021-02-12
CN112364189B CN112364189B (en) 2023-02-21

Family

ID=74515707

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011276589.XA Active CN112364189B (en) 2020-11-16 2020-11-16 Electronic certificate application method based on ES service

Country Status (1)

Country Link
CN (1) CN112364189B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108509437A (en) * 2017-02-24 2018-09-07 南京烽火星空通信发展有限公司 A kind of ElasticSearch inquiries accelerated method
CN110413496A (en) * 2019-07-29 2019-11-05 福建南威软件有限公司 A method of realizing that the operation data modularization of electronics license is collected
CN110609945A (en) * 2018-05-29 2019-12-24 优信拍(北京)信息科技有限公司 Method, device and system for inquiring second-hand car service data
US20200267160A1 (en) * 2019-02-15 2020-08-20 Sailpoint Technologies, Inc. Systems and methods for searching in identity management artificial intelligence systems
CN111881309A (en) * 2020-07-30 2020-11-03 浪潮云信息技术股份公司 Electronic certificate retrieval method, device and computer readable medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108509437A (en) * 2017-02-24 2018-09-07 南京烽火星空通信发展有限公司 A kind of ElasticSearch inquiries accelerated method
CN110609945A (en) * 2018-05-29 2019-12-24 优信拍(北京)信息科技有限公司 Method, device and system for inquiring second-hand car service data
US20200267160A1 (en) * 2019-02-15 2020-08-20 Sailpoint Technologies, Inc. Systems and methods for searching in identity management artificial intelligence systems
CN110413496A (en) * 2019-07-29 2019-11-05 福建南威软件有限公司 A method of realizing that the operation data modularization of electronics license is collected
CN111881309A (en) * 2020-07-30 2020-11-03 浪潮云信息技术股份公司 Electronic certificate retrieval method, device and computer readable medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LU HAN: "Design and Implementation of Elasticsearch for Media Data", 《2020 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION (ICCEA)》 *
国伟: "基于网证的电子证照亮证服务关键技术研究", 《警察技术》 *
谷宁静: "上海人社电子证照系统架构设计", 《计算机应用与软件》 *

Also Published As

Publication number Publication date
CN112364189B (en) 2023-02-21

Similar Documents

Publication Publication Date Title
US10657116B2 (en) Create table for exchange
CN104794123B (en) A kind of method and device building NoSQL database indexes for semi-structured data
US8924373B2 (en) Query plans with parameter markers in place of object identifiers
US7366708B2 (en) Mechanism to efficiently index structured data that provides hierarchical access in a relational database system
US20160253382A1 (en) System and method for improving a query response rate by managing a column-based store in a row-based database
US7761455B2 (en) Loading data from a vertical database table into a horizontal database table
US9946752B2 (en) Low-latency query processor
US9836519B2 (en) Densely grouping dimensional data
CN108874971A (en) A kind of tool and method applied to the storage of magnanimity labeling solid data
US20080281784A1 (en) Query handling in databases with replicated data
US11216516B2 (en) Method and system for scalable search using microservice and cloud based search with records indexes
WO2020135613A1 (en) Data query processing method, device and system, and computer-readable storage medium
CN109947796B (en) Caching method for query intermediate result set of distributed database system
CA2461871C (en) An efficient index structure to access hierarchical data in a relational database system
CN111506559A (en) Data storage method and device, electronic equipment and storage medium
JP4483034B2 (en) Heterogeneous data source integrated access method
CN102890678A (en) Gray-code-based distributed data layout method and query method
US11868328B2 (en) Multi-record index structure for key-value stores
US20060235820A1 (en) Relational query of a hierarchical database
CN112231351A (en) Real-time query method and device for PB-level mass data
US11928113B2 (en) Structure and method of aggregation index for improving aggregation query efficiency
Jianmin et al. An improved join‐free snowflake schema for ETL and OLAP of data warehouse
CN103345527B (en) Intelligent data statistical system
CN116821139B (en) Mixed load method and system for partition table design based on distributed database
CN114064660A (en) Data structured analysis method based on ElasticSearch

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant