CN114564485A - User data processing method based on Elastic Search - Google Patents
User data processing method based on Elastic Search Download PDFInfo
- Publication number
- CN114564485A CN114564485A CN202210456607.5A CN202210456607A CN114564485A CN 114564485 A CN114564485 A CN 114564485A CN 202210456607 A CN202210456607 A CN 202210456607A CN 114564485 A CN114564485 A CN 114564485A
- Authority
- CN
- China
- Prior art keywords
- user data
- index
- request
- elastic search
- data object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a user data processing method based on Elastic Search, which comprises the steps of carrying out corresponding user data object operation on a target structured database according to a user data object change request when the user data object change request is monitored; and initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request. The data retrieval method has the advantages that the structured database is used for storing the user data objects, the requirement of data consistency is guaranteed, the problem of insufficient data retrieval capacity under the requirement of guaranteeing dynamic expansion attributes and strong consistency of data is solved by integrating the storage of the structured database and the strong distributed data retrieval capacity of Elastic Search, and the performance guarantee of the data under the use frequency is guaranteed.
Description
Technical Field
The invention relates to the technical field of information, in particular to a user data processing method based on Elastic Search.
Background
Along with the scale-up of enterprises and the scale-up of application systems, the user identity data as the core of an enterprise is also becoming huge, and meanwhile, the user identity data as the core of an enterprise needs to provide data services for various systems, the access request for obtaining user identity information is getting larger and larger, and because the user identity information is often dynamically changed, such as: the mailbox of the user is changed, and the like, so how to improve the access efficiency of the user data under the condition of ensuring the consistency of mass user data becomes a pain point for providing effective guarantee for enterprises by the system.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a user data processing method based on Elastic Search, so as to overcome a problem in the prior art that access efficiency is limited to ensure consistency of user data due to continuous change of user data.
The embodiment of the invention provides a user data processing method based on Elastic Search, which comprises the following steps:
when a user data object change request is monitored, carrying out corresponding user data object operation on a target structured database according to the user data object change request;
and initiating an index adjustment request to an Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request.
Optionally, the type of the user data object change request includes: the method for initiating an index adjustment request to an Elastic Search according to the user data object change request comprises the following steps:
monitoring and determining the type of the user data object change request through a section of the Spring Boot;
and initiating an index adjustment request corresponding to the type to the Elastic Search.
Optionally, when the type of the user data object change request is a modification request, the updating the Elastic Search data index of the user data object according to the index adjustment request includes:
acquiring index configuration information corresponding to the user data object, wherein the index configuration information is used for representing an index field corresponding to the user data object;
judging whether an index field corresponding to the data item which is changed correspondingly to the modification request exists in the index configuration information or not;
and when the index configuration information has an index field corresponding to the data item which is changed corresponding to the modification request, updating the index field according to the changed user data.
Optionally, the method further comprises:
and when the index configuration information does not have an index field corresponding to the data item which is changed corresponding to the modification request, maintaining the Elastic Search data index of the user data object unchanged.
Optionally, when the type of the user data object change request is an addition request, the updating the Elastic Search data index of the user data object according to the index adjustment request includes:
acquiring index configuration information corresponding to the user data object, wherein the index configuration information is used for representing an index field corresponding to the user data object;
extracting data items of indexes to be established from the newly added request according to the index configuration information;
and establishing an Elastic Search data index of the user data object in the Elastic Search according to the data item to be indexed.
Optionally, when the type of the user data object change request is a delete request, the updating, according to the index adjustment request, the Elastic Search data index of the user data object includes:
and deleting the Elastic Search data index of the user data object corresponding to the deletion request in the Elastic Search.
Optionally, the method further comprises:
receiving a user data query request, and initiating the user data query request to an Elastic Search through the monitoring of a section of Spring Boot, wherein the user data query request comprises: an Elastic Search data index of the target user data object;
judging whether a historical data query request matched with the user data query request exists in a historical query request set of Elastic Search;
when a historical data query request matched with the user data query request exists in the historical query request set of the Elastic Search, feeding back a first query result corresponding to the historical data query request to a user;
when the historical data query request matched with the user data query request does not exist in the historical query request set of the Elastic Search, the Elastic Search is facilitated to execute the user data query request, and a second query result is obtained and fed back to the user.
An embodiment of the present invention further provides an Elastic Search-based user data processing apparatus, including:
the first processing module is used for carrying out corresponding user data object operation on a target structured database according to a user data object change request when the user data object change request is monitored;
and the second processing module is used for initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request.
An embodiment of the present invention further provides an electronic device, including: the device comprises a memory and a processor, wherein the memory and the processor are connected with each other in a communication way, the memory stores computer instructions, and the processor executes the computer instructions so as to execute the method provided by the embodiment of the invention.
Embodiments of the present invention also provide a computer-readable storage medium, which stores computer instructions for causing a computer to execute the method provided by the embodiments of the present invention.
The technical scheme of the invention has the following advantages:
the embodiment of the invention provides a user data processing method based on Elastic Search, which comprises the steps of carrying out corresponding user data object operation on a target structured database according to a user data object change request when the user data object change request is monitored; and initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request. By monitoring the change request of the user data object, corresponding index processing is carried out through the Elastic Search when the retrieval user data object changes, and the storage of the user data object is carried out through the structured database, so that the requirement of data consistency is guaranteed, the problem of insufficient data retrieval capacity under the requirement of guaranteeing dynamic expansion attribute and strong consistency of data is solved through integrating the storage of the structured database and the strong distributed data retrieval capacity of the Elastic Search, and the performance guarantee of the data under the use frequency is guaranteed.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a user data processing method in an embodiment of the present invention;
fig. 2 is a schematic diagram of a specific working process of a service data write operation in an embodiment of the present invention;
fig. 3 is a schematic diagram of a specific working process of a service data read operation in the embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a user data processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.
Along with the scale-up of enterprises and the scale-up of application systems, the user identity data as the core of an enterprise is also becoming huge, and meanwhile, the user identity data as the core of an enterprise needs to provide data services for various systems, the access request for obtaining user identity information is getting larger and larger, and because the user identity information is often dynamically changed, such as: the change of the user mailbox, and the like, so how to improve the user data access efficiency under the condition of ensuring the consistency of mass user data becomes a pain point for providing effective guarantee for enterprises by the system.
Based on the foregoing problem, an embodiment of the present invention provides a user data processing method based on Elastic Search, and as shown in fig. 1, the user data processing method based on Elastic Search includes:
step S101: and when the user data object change request is monitored, carrying out corresponding user data object operation on the target structured database according to the user data object change request.
The type of the user data object change request comprises the following steps: a new request, a modification request and a deletion request, wherein the new request is a user data object newly added in the user data management system, and comprises the following steps: when adding user information of a new user, a change request triggered by establishing a corresponding retrieval index for the user data object is needed, so that the corresponding user information can be conveniently and quickly found based on the retrieval index in the following. The modification request is a change request triggered when user information of an existing user data object in the system is changed, such as: user mailbox information changes, etc. The deletion request is a change request triggered when an existing user data object in the system is deleted, such as: a change request triggered when logging off a user account.
Specifically, a new operation, a modification operation or a deletion operation of the corresponding user data object is performed in the structured database according to the types of the different change requests.
Step S102: and initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request.
Specifically, a dynamic extension field is specified on a business entity of user data of the user data object in a comment mode, and the extension field is stored in a structured database in a JSON format character string, so that the user data of each user data object can be retrieved from the structured database later. In order to facilitate the retrieval system to build a data index in Elastic Search according to the definition of the user data object in advance and the basic attribute and the extended attribute of the object. The extension field mentioned in the embodiment of the invention is an extension field aiming at a user data object, the extension field is the extension of user attributes, such as birthday, telephone number, mail and the like, and the extension field has the function of adding other field attributes to the user data after the system is established, expanding a user object model and facilitating the retrieval of the user data.
By executing the above steps, the user data processing method based on the Elastic Search provided by the embodiment of the present invention monitors the change request of the user data object, performs corresponding index processing through the Elastic Search when the retrieved user data object changes, and stores the user data object through the structured database, thereby ensuring the requirement of data consistency, and thus by integrating the storage of the structured database and the strong distributed data retrieval capability of the Elastic Search, solving the problem of insufficient data retrieval capability under the requirement of ensuring the dynamic expansion attribute and the strong consistency of the data, and ensuring the performance guarantee of the data under the use frequency.
Specifically, in an embodiment, the initiating an index adjustment request to the Elastic Search according to the user data object change request in step S102 includes the following steps:
step S201: and monitoring and determining the type of the user data object change request through a section of the Spring Boot.
Step S202: and initiating an index adjustment request corresponding to the type to the Elastic Search.
Specifically, the system monitors whether the current request type is newly added, modified or deleted through a cutting plane of the Spring Boot, so that a corresponding index adjustment request can be initiated according to the monitored request type. Wherein, the index adjustment request also correspondingly comprises: an index adding request, an index modifying request and an index deleting request.
Specifically, in an embodiment, when the type of the user data object change request is a modification request, the updating the Elastic Search data index of the user data object according to the index adjustment request in step S102 includes the following steps:
step S301: and acquiring index configuration information corresponding to the user data object.
The index configuration information is used for representing index fields corresponding to the user data objects.
Specifically, an index configuration table is established in advance in the system, and index configuration information corresponding to different user data objects is stored in the index configuration table.
Step S302: and judging whether an index field corresponding to the data item which is changed corresponding to the modification request exists in the index configuration information.
And when the index configuration information has the index field corresponding to the data item which is changed corresponding to the modification request, updating the index field according to the changed user data. And when the index configuration information does not have the index field corresponding to the data item which is changed corresponding to the modification request, maintaining the Elastic Search data index of the user data object unchanged.
Illustratively, because only part of the user data is related to the corresponding Elastic Search data index, when the user data is changed, it needs to be determined whether the changed data item is in the index field, if the changed data item is in the index field, it indicates that the original data index cannot correctly retrieve the new user data due to the change of the data item, so that the corresponding index field needs to be modified according to the extension field of the changed data, and if the changed data item is not in the index field, it indicates that the change of the data does not affect the retrieval of the whole user data object, so that the Elastic Search data index does not need to be updated. Therefore, in the process of dynamic change of the user data, the Elastic Search data index can be adjusted in real time according to the changed content of the user data, so that the retrieval efficiency of the user data object is ensured, and the use experience of a user is improved.
Specifically, in another embodiment, when the type of the user data object change request is a new addition request, the updating the Elastic Search data index of the user data object according to the index adjustment request in step S102 includes the following steps:
step S401: and acquiring index configuration information corresponding to the user data object.
The index configuration information is used for representing index fields corresponding to the user data objects. For details, refer to the related description of step S301, and the details are not repeated herein.
Step S402: and extracting the data items to be indexed from the newly-added request according to the index configuration information.
Step S403: and establishing an Elastic Search data index of the user data object in the Elastic Search according to the data item to be indexed.
Illustratively, the index field specified by the user data object in the index configuration information is composed of the basic attribute and the extended attribute of the user data, and then the data item to be indexed is the basic attribute and the extended attribute data of the user data. The base attribute and extended attribute (JSON format) data of the user data are then indexed in an Elastic Search. The index establishment of the user data object is realized, the index establishment of the user data object is carried out according to the preset index configuration information, the index consistency of the user data object is guaranteed, and the subsequent retrieval of the user data object is facilitated.
Specifically, in another embodiment, when the type of the user data object change request is a delete request, the updating the Elastic Search data index of the user data object according to the index adjustment request in step S102 includes:
step S501: and deleting the Elastic Search data index of the user data object corresponding to the deletion request in the Elastic Search.
Specifically, when the user data object is deleted in the structured database, the redundancy of the Elastic Search data index is reduced and the retrieval efficiency of the user data object is improved by synchronously deleting the corresponding data index.
Illustratively, as shown in fig. 2, the main process of the service data write operation is as follows:
1. when a user initiates an object adding, modifying and deleting request to the system, the system encapsulates the corresponding extension field into a JSON object according to the object definition
2. The system carries out corresponding processing (adding, modifying, deleting and the like) operation on the structured database
3. The system initiates an index adjustment request to an Elastic Search
4. The system monitors through the section of the Spring Boot to acquire whether the request is newly added/modified or deleted
5. If the operation type is: adding and modifying, reading the index configuration table, obtaining the data item needing to establish the index, initiating an index establishment request to the Elastic Search, establishing the basic attribute and the extended attribute (JSON format) of the object, and establishing the index in the Elastic Search
6. If the operation type is: and if the data index is deleted, an index deletion request is sent to the Elastic Search, and the corresponding data index is deleted.
The index configuration table is a database table, is created when the system is deployed, data maintenance is carried out through a management background, the data index is obtained by inquiring data in the database table, the updating index is obtained by comparing whether corresponding index fields exist or not, if not, the updating index is updated, and if yes, the updating index is not updated.
Specifically, in an embodiment, the method for processing user data based on Elastic Search according to the embodiment of the present invention further includes the following steps:
step S103: receiving a user data query request, and initiating the user data query request to an Elastic Search through the monitoring of the section of the Spring Boot.
Wherein, the user data query request comprises: the Elastic Search data index of the target user data object.
Step S104: and judging whether a historical data query request matched with the user data query request exists in the historical query request set of the Elastic Search.
The historical query request set stores query requests which are obtained by a user after the user data object retrieval in the system and corresponding query results.
Specifically, when a historical data query request matched with a user data query request exists in a historical query request set of Elastic Search, feeding a first query result corresponding to the historical data query request back to a user; when the historical data query request matched with the user data query request does not exist in the historical query request set of the Elastic Search, the Elastic Search is facilitated to execute the user data query request, and a second query result is obtained and fed back to the user. And updating the user data query request and the second query result to the historical query request set so as to improve the subsequent query efficiency of the user data object.
Illustratively, as shown in fig. 3, the main process of the business data read operation is as follows:
1. a user initiates a data query request to the system,
2. monitoring through a Spring Boot section, initiating a query request to Elastic Search, and matching the query request with a historical query request set to determine whether the query request is completely matched or not;
3. if the query result is completely matched with the query result, obtaining a first result according to the historical query result and the technical query result, if the query result is not completely matched with the technical query result, re-executing a second result obtained by the query, and feeding the first result or the second result of the query back to the user;
4. and if the query structure is not completely matched with the query structure, updating the historical query request set with the second result of the query structure.
The invention provides a user data processing method based on Elastic Search, which is a method for realizing distributed reading of a database in a Java program.
The invention appoints dynamic extension field (the extension field is stored in the database in JSON format character string) through the Mybatis frame and Java technique on the service entity through annotation mode, at the same time, when the object to be searched is changed, the invention monitors the section through Spring Boot, when the corresponding object to be searched is changed, the invention processes the corresponding Elastic Search index processing. Meanwhile, during object retrieval, monitoring is carried out through a section of Spring Boot, and data retrieval is handed to Elastis Search, so that the purpose of data retrieval is achieved.
According to the invention, on the basis of Spring boot section monitoring, the storage of a structured database and the strong distributed data retrieval capability of Elastic Search are integrated, so that the problem of insufficient data retrieval capability under the requirement of ensuring dynamic expansion attribute and strong consistency of data is solved, the read-write separation of the data is realized through the distributed data retrieval capability, and meanwhile, the performance guarantee of the data under the use frequency is ensured.
By executing the above steps, the user data processing method based on the Elastic Search provided by the embodiment of the present invention monitors the change request of the user data object, performs corresponding index processing through the Elastic Search when the retrieved user data object changes, and stores the user data object through the structured database, thereby ensuring the requirement of data consistency, and thus by integrating the storage of the structured database and the strong distributed data retrieval capability of the Elastic Search, solving the problem of insufficient data retrieval capability under the requirement of ensuring the dynamic expansion attribute and the strong consistency of the data, and ensuring the performance guarantee of the data under the use frequency.
An embodiment of the present invention further provides an Elastic Search based user data processing apparatus, as shown in fig. 4, the Elastic Search based user data processing apparatus includes:
the first processing module 101 is configured to, when a user data object change request is monitored, perform corresponding user data object operation on the target structured database according to the user data object change request. For specific contents, refer to the related description of step S101 in the above method embodiment, and are not described again here.
The second processing module 102 is configured to initiate an index adjustment request to the Elastic Search according to the user data object change request, so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request. For details, refer to the related description of step S102 in the above method embodiment, and no further description is given here.
Further functional descriptions of the modules are the same as those of the corresponding method embodiments, and are not repeated herein.
Through the cooperative cooperation of the above components, the user data processing apparatus based on the Elastic Search provided in the embodiment of the present invention, through monitoring the change request of the user data object, performs corresponding index processing through the Elastic Search when the retrieved user data object changes, and performs storage of the user data object through the structured database, thereby ensuring the requirement of data consistency, so as to solve the problem of insufficient data retrieval capability under the requirement of ensuring dynamic expansion attribute and strong consistency of data by integrating the storage of the structured database and the strong distributed data retrieval capability of the Elastic Search, and ensure the performance guarantee of the data under the use frequency.
There is also provided an electronic device according to an embodiment of the present invention, as shown in fig. 5, the electronic device may include a processor 901 and a memory 902, where the processor 901 and the memory 902 may be connected by a bus or in another manner, and fig. 5 takes the example of being connected by a bus as an example.
The memory 902, which is a non-transitory computer readable storage medium, may be used for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the methods in the method embodiments of the present invention. The processor 901 executes various functional applications and data processing of the processor by executing non-transitory software programs, instructions and modules stored in the memory 902, that is, implements the methods in the above-described method embodiments.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor 901, and the like. Further, the memory 902 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 902 may optionally include memory located remotely from the processor 901, which may be connected to the processor 901 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more modules are stored in the memory 902, which when executed by the processor 901 performs the methods in the above-described method embodiments.
The specific details of the electronic device may be understood by referring to the corresponding related descriptions and effects in the above method embodiments, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, and the implemented program can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (10)
1. A user data processing method based on Elastic Search is characterized by comprising the following steps:
when a user data object change request is monitored, carrying out corresponding user data object operation on a target structured database according to the user data object change request;
and initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request.
2. The method of claim 1, wherein the type of user data object change request comprises: the method for initiating an index adjustment request to an Elastic Search according to the user data object change request comprises the following steps:
monitoring and determining the type of the user data object change request through a section of the Spring Boot;
and initiating an index adjustment request corresponding to the type to the Elastic Search.
3. The method of claim 2, wherein when the type of the user data object change request is a modification request, the updating the Elastic Search data index of the user data object according to the index adjustment request comprises:
acquiring index configuration information corresponding to the user data object, wherein the index configuration information is used for representing an index field corresponding to the user data object;
judging whether an index field corresponding to the data item which is changed correspondingly to the modification request exists in the index configuration information;
and when the index configuration information has an index field corresponding to the data item which is changed corresponding to the modification request, updating the index field according to the changed user data.
4. The method of claim 3, further comprising:
and when the index configuration information does not have an index field corresponding to the data item which is changed corresponding to the modification request, maintaining the Elastic Search data index of the user data object unchanged.
5. The method of claim 2, wherein when the type of the user data object change request is an add request, the updating the Elastic Search data index of the user data object according to the index adjustment request comprises:
acquiring index configuration information corresponding to the user data object, wherein the index configuration information is used for representing an index field corresponding to the user data object;
extracting data items of indexes to be established from the newly added request according to the index configuration information;
and establishing an Elastic Search data index of the user data object in the Elastic Search according to the data item to be indexed.
6. The method of claim 2, wherein when the type of the user data object change request is a delete request, the updating the Elastic Search data index of the user data object according to the index adjustment request comprises:
and deleting the Elastic Search data index of the user data object corresponding to the deletion request in the Elastic Search.
7. The method of claim 1, further comprising:
receiving a user data query request, and initiating the user data query request to an Elastic Search through the monitoring of a section of Spring Boot, wherein the user data query request comprises: an Elastic Search data index of the target user data object;
judging whether a historical data query request matched with the user data query request exists in a historical query request set of Elastic Search;
when a historical data query request matched with the user data query request exists in the historical query request set of the Elastic Search, feeding back a first query result corresponding to the historical data query request to a user;
when the historical data query request matched with the user data query request does not exist in the historical query request set of the Elastic Search, the Elastic Search is facilitated to execute the user data query request, and a second query result is obtained and fed back to the user.
8. An Elastic Search based user data processing apparatus, comprising:
the first processing module is used for carrying out corresponding user data object operation on a target structured database according to a user data object change request when the user data object change request is monitored;
and the second processing module is used for initiating an index adjustment request to the Elastic Search according to the user data object change request so that the Elastic Search updates the Elastic Search data index of the user data object according to the index adjustment request.
9. An electronic device, comprising:
a memory and a processor communicatively coupled to each other, the memory having stored therein computer instructions, the processor performing the method of any of claims 1-4 by executing the computer instructions.
10. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210456607.5A CN114564485A (en) | 2022-04-28 | 2022-04-28 | User data processing method based on Elastic Search |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210456607.5A CN114564485A (en) | 2022-04-28 | 2022-04-28 | User data processing method based on Elastic Search |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114564485A true CN114564485A (en) | 2022-05-31 |
Family
ID=81720993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210456607.5A Pending CN114564485A (en) | 2022-04-28 | 2022-04-28 | User data processing method based on Elastic Search |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114564485A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA3153839A1 (en) * | 2014-03-27 | 2015-09-27 | GroupBy Inc. | Methods of augmenting search engines for ecommerce information retrieval |
| CN106960007A (en) * | 2017-02-28 | 2017-07-18 | 北京京东尚科信息技术有限公司 | A kind of data-updating method, device and electronic equipment |
| CN109241182A (en) * | 2018-08-14 | 2019-01-18 | 中国平安人寿保险股份有限公司 | Big data real-time synchronization method, device, computer equipment and storage medium |
| CN110543512A (en) * | 2018-05-29 | 2019-12-06 | 优信拍（北京）信息科技有限公司 | Information synchronization method, device and system |
| CN111428114A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Index creating method and device for Elasticissearch search engine |
| CN111460023A (en) * | 2020-04-29 | 2020-07-28 | 上海东普信息科技有限公司 | Service data processing method, device, equipment and storage medium based on elastic search |
| CN113094370A (en) * | 2021-04-13 | 2021-07-09 | 北京精鸿软件科技有限公司 | Data index construction method and device, storage medium and electronic equipment |
| CN114153856A (en) * | 2021-11-24 | 2022-03-08 | 中国工商银行股份有限公司 | Host data double-writing method and device |
-
2022
- 2022-04-28 CN CN202210456607.5A patent/CN114564485A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA3153839A1 (en) * | 2014-03-27 | 2015-09-27 | GroupBy Inc. | Methods of augmenting search engines for ecommerce information retrieval |
| CN106960007A (en) * | 2017-02-28 | 2017-07-18 | 北京京东尚科信息技术有限公司 | A kind of data-updating method, device and electronic equipment |
| CN110543512A (en) * | 2018-05-29 | 2019-12-06 | 优信拍（北京）信息科技有限公司 | Information synchronization method, device and system |
| CN109241182A (en) * | 2018-08-14 | 2019-01-18 | 中国平安人寿保险股份有限公司 | Big data real-time synchronization method, device, computer equipment and storage medium |
| CN111428114A (en) * | 2020-03-27 | 2020-07-17 | 中国工商银行股份有限公司 | Index creating method and device for Elasticissearch search engine |
| CN111460023A (en) * | 2020-04-29 | 2020-07-28 | 上海东普信息科技有限公司 | Service data processing method, device, equipment and storage medium based on elastic search |
| CN113094370A (en) * | 2021-04-13 | 2021-07-09 | 北京精鸿软件科技有限公司 | Data index construction method and device, storage medium and electronic equipment |
| CN114153856A (en) * | 2021-11-24 | 2022-03-08 | 中国工商银行股份有限公司 | Host data double-writing method and device |
Non-Patent Citations (3)
| Title |
|---|
| 唐成: "《PostgreSQL修炼之道》", 30 September 2020, 机械工业出版社 * |
| 李晓林 等: "《面向数据密集型应用的云计算》", 30 April 2019, 国防工业出版社 * |
| 赵炯 等: "《中国战略性新兴产业研究与发展》", 30 June 2019, 机械工业出版社 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9792340B2 (en) | Identifying data items | |
| CN109947668B (en) | Method and device for storing data | |
| CN107832406B (en) | Method, device, equipment and storage medium for removing duplicate entries of mass log data | |
| US20170031948A1 (en) | File synchronization method, server, and terminal | |
| CN110019211A (en) | The methods, devices and systems of association index | |
| CN112800287B (en) | Full-text indexing method and system based on graph database | |
| CN109299157B (en) | Data export method and device for distributed big single table | |
| CN114116613A (en) | Metadata query method, equipment and storage medium based on distributed file system | |
| CN108614837B (en) | File storage and retrieval method and device | |
| CN107480205B (en) | Method and device for partitioning data | |
| CN114490527B (en) | Metadata retrieval method, system, terminal and storage medium | |
| CN112100152B (en) | Service data processing method, system, server and readable storage medium | |
| CN109947729B (en) | Real-time data analysis method and device | |
| CN111654532A (en) | Centralized management system, method and device for configuration files | |
| CN110515979B (en) | Data query method, device, equipment and storage medium | |
| CN107181773A (en) | Data storage and data managing method, the equipment of distributed memory system | |
| CN114398520A (en) | Data retrieval method, system, device, electronic equipment and storage medium | |
| EP3649532B1 (en) | Methods, systems, databases and network nodes of data communication networks for handling data posts | |
| CN110263060B (en) | ERP electronic accessory management method and computer equipment | |
| CN111753141B (en) | Data management method and related equipment | |
| CN114564485A (en) | User data processing method based on Elastic Search | |
| CN113760600B (en) | Database backup method, database restoration method and related devices | |
| CN112711572B (en) | Online capacity expansion method and device suitable for database and table division | |
| CN111061719B (en) | Data collection method, device, equipment and storage medium | |
| CN113495891A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220531 |