WO2021012553A1

WO2021012553A1 - Data processing method and related device

Info

Publication number: WO2021012553A1
Application number: PCT/CN2019/120960
Authority: WO
Inventors: 张松松; 冯承勇
Original assignee: 深圳壹账通智能科技有限公司
Priority date: 2019-07-25
Filing date: 2019-11-26
Publication date: 2021-01-28
Also published as: CN110489417A; CN110489417B

Abstract

A data processing method and a related device. The method comprises: when receiving a storage request for storing target data from a client, performing field analysis on the target data; if on the basis of a field analysis result, it is detected that a target index does not exist in a preset index storage area, determine, on the basis of semantic information, the storage structure type to which the target data belongs, and send an index request for creating the target index to a preconnected search server, and when the target index returned by the search server is received, storing the target data according to the target index. The method can create the target index according to the storage structure type to which the target data belongs, and can improve the index creation efficiency.

Description

A data processing method and related equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910679327.9, and the application name is "a data processing method and related equipment" on July 25, 2019, the entire content of which is incorporated into this application by reference in.

Technical field

This application relates to the field of data processing technology, and in particular to a data processing method and related equipment.

Background technique

At present, many data management platforms can provide the function of querying target data through keywords. If you need to use the target data query function, you first need to create an index corresponding to the target data in the storage area corresponding to the server. After the index is created, you can query the target data through keywords. Among them, the keyword is obtained by performing word segmentation processing on the target data.

The storage of target data in traditional services is generally stored in relational databases, such as MySql and Oracle. If the server creates an index corresponding to the target data through a relational database to realize the query function of the target data, a set of database services needs to be maintained, and the unstructured target data cannot be well segmented to create an index. Therefore, how to create an index more efficiently and store the target data so as to realize the query of the target data has become an urgent problem to be solved.

Summary of the invention

The embodiment of the present application provides a data processing method and related equipment, which is beneficial to improve the efficiency of index creation.

In the first aspect, an embodiment of the present application provides a data processing method, which is applied to a server, and the method includes:

Receiving a storage request for storing target data from a client, where the storage request includes the target data;

Performing field analysis on the target data to obtain a field analysis result, the field analysis result including the field corresponding to the target data and the semantic information of the field;

Detecting whether there is a target index corresponding to the field in the preset index storage area;

If it is detected that the target index does not exist in the preset index storage area, determine the storage structure type to which the target data belongs based on the semantic information;

Send an index request for creating a target index to the pre-connected search server, the index request carrying the storage structure type and the target data, so that the search server can create the target data according to the index request A target index matching the storage structure type;

Receiving the target index returned by the search server, and storing the target data according to the target index.

In a second aspect, an embodiment of the present application provides a data processing device, which includes a module for executing the method of the first aspect.

In a third aspect, an embodiment of the present application provides a server, the server includes a processor, a network interface, and a memory, the processor, the network interface, and the memory are connected to each other, wherein the network interface is controlled by the processor Used to send and receive messages, the memory is used to store a computer program that supports the server to execute the above method, the computer program includes program instructions, and the processor is configured to call the program instructions to execute the method of the above first aspect.

In a fourth aspect, an embodiment of the present application provides a computer non-volatile readable storage medium, the computer non-volatile readable storage medium stores a computer program, the computer program includes program instructions, and the program instructions When executed by a processor, the processor is caused to execute the method of the first aspect.

In the embodiment of the present application, the server can create a target index according to the storage structure type to which the target data belongs to prevent the splitting of unnecessary fields, which is beneficial to improve the efficiency of index creation.

Description of the drawings

FIG. 1 is a schematic flowchart of a data processing method provided by an embodiment of the present application;

2 is a schematic flowchart of another data processing method provided by an embodiment of the present application;

FIG. 3 is a schematic block diagram of a data processing device provided by an embodiment of the present application;

Fig. 4 is a schematic block diagram of a server provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

Referring to Fig. 1, Fig. 1 is a schematic flowchart of a data processing method provided by an embodiment of the present application. The method is applied to a server and can be executed by the server. As shown in the figure, the data processing method may include:

101: Receive a storage request for storing target data from a client, where the storage request includes the target data.

102: Perform field analysis on the target data to obtain a field analysis result, where the field analysis result includes the field corresponding to the target data and the semantic information of the field.

The above-mentioned server may be a server corresponding to the data management platform, and the server may be one server or a server cluster composed of multiple servers, and the server may provide related services of data management. For example, the data management platform may be a log platform, and the log cloud platform may provide a log query function through keywords. Wherein, the client can be an application or website corresponding to the log platform, or a terminal device installed with the log platform application or opening the log platform website. In one embodiment, the target data may be unstructured data.

103: Detect whether there is a target index corresponding to the field in the preset index storage area, and if it is detected that the target index does not exist in the preset index storage area, determine the storage structure type to which the target data belongs based on semantic information.

Among them, in order for the server to realize the query function of the target data, the server needs to create an index corresponding to the target data in the index storage area in advance. After the index is created, the target data can be queried by keywords, where the index and the keyword have a corresponding relationship . In one embodiment, the preset index storage area includes at least one index, and each index corresponds to a keyword. In response to this situation, when the server receives a storage request for storing target data from the client, it may perform field analysis on the target data to obtain at least one field corresponding to the target data. Further, the above-mentioned at least one field can be compared with the pre-stored keywords of each index, and if any field in the at least one field matches a keyword of any index, it is determined that there is a preset index storage area Target index.

On the contrary, if the server detects that there is no field matching the keyword of any index in the at least one field, it determines that the target index does not exist in the preset index storage area.

Among them, the foregoing storage structure types may include keyword types and word segmentation types. In one embodiment, when the server detects that there is no target index in the preset index storage area, it can detect the semantic information of the target data corresponding to each field, and if it is detected based on the semantic information that the target data corresponds to any field for complete matching Search, the storage structure type to which the target data belongs is determined as the keyword type.

If it is detected that any field corresponding to the target data is used for fuzzy matching search based on the semantic information, the storage structure type to which the target data belongs is determined as the word segmentation type. Among them, the field used for complete matching search can be called the first field, and the first field is unique. For example, the semantic information of the first field can represent the user name, certificate number, etc., and each user corresponds to only one user name. And the certificate number; among them, the field used for fuzzy search can be called the second field, and the semantic information of the second field is not unique. For example, the semantic information of the second field can represent the company name, etc., and the company name can correspond to Multiple users. In this way, the server can create different storage structures according to different target data, which can avoid the search server from splitting unnecessary characters when creating the target index, and can effectively improve the efficiency of data processing.

104: Send an index request for creating a target index to the pre-connected search server. The index request carries the storage structure type and target data, so that the search server can create a target matching the storage structure type for the target data according to the index request index.

105: Receive the target index returned by the search server, and store the target data according to the target index.

In one embodiment, a configuration file for the search server may be pre-configured, and the configuration file contains the address, port, protocol, connection timeout period, the number of routes of the protocol, and the maximum number of connections related to the connection to the search server. Further, when the server detects that the search server is started, it can register with the search server based on the configuration file, so as to realize subsequent data interaction with the search server, that is, establish a connection with the search server.

Wherein, the search server may be ElasticSearch, which is a search server based on Lucene. It provides a full-text search engine with distributed multi-user capabilities, based on a RESTful web interface. Elasticsearch is developed in Java and released as an open source under the terms of the Apache license. It is a popular enterprise search engine. Designed for cloud computing, it can achieve real-time search, stable, reliable, fast, easy to install and use.

In one embodiment, after the server determines the storage structure type to which the target data belongs, it may send an index request for creating a target index to the search server to which the connection is established. The index request includes the storage structure type of the target data and the target data. Further, the search server can automatically create a target index matching the storage structure type for the target data based on the target data and the storage structure type, and return the target index to the server. After the server receives the target index returned by the search server, it can store the target data in the storage area corresponding to the target index, and assign keywords to the target data, so that the keyword can be subsequently used to query the target data. Wherein, the storage area corresponding to the target index may be a disk or a folder.

In one embodiment, the above data processing method can be applied to a plug-in corresponding to a data management platform, and the plug-in is inserted into the search server. Exemplarily, the data management platform is a log platform, and the plug-in can create a folder of its own service under the service folder of the search server. The folder includes the log cloud plug-in in the form of a jar package and the current plug-in Configuration files required by the operation information and log platform. Among them, the operation information includes: the description information of the plug-in, which is used to describe the role of the plug-in; the version information of the plug-in; the name of the plug-in displayed in the search server; the entrance of the plug-in, the java version information used by the plug-in; The corresponding specific version.

In one embodiment, if it is detected that there is a target index in the aforementioned preset index storage area, the target data may be directly stored in the target index.

Referring to Figure 2, Figure 2 is a schematic flowchart of another data processing method provided by an embodiment of the present application. The method can be executed by a server. As shown in the figure, the data processing method can include:

201: When receiving a storage request for storing target data from a client, perform field analysis on the target data to obtain a field analysis result. The field analysis result includes the field corresponding to the target data and the semantic information of the field.

202: Detect whether there is a target index corresponding to the field in the preset index storage area, and if it is detected that the target index does not exist in the preset index storage area, determine the storage structure type to which the target data belongs based on semantic information.

203: Send an index request for creating a target index to the pre-connected search server. The index request carries the storage structure type and target data, so that the search server can create a target matching the storage structure type for the target data according to the index request. index.

204: Receive the target index returned by the search server, and store the target data according to the target index.

For the specific implementation manners of step 201 to step 204 above, reference may be made to the related description of step 101 to step 105 in the above embodiment, which will not be repeated here.

205: Send update instruction information for the target data to the foregoing client, where the update instruction information is used to instruct the client to update the target data according to a preset update strategy.

In one embodiment, the aforementioned preset update strategy may include a delayed update strategy or a time update strategy, where the aforementioned delayed update strategy is used to instruct the client to update the target data when a trigger operation for the target data is detected; the time update The strategy is used to instruct the client to update the target data after a preset time. The trigger operation may be a search operation for searching target data, a viewing operation for viewing target data, etc., or any other operation for target data, which is not specifically limited in this application.

In one embodiment, the preset time can be 0s, 1s, etc., which can be preset by the developer by default, or can be selected by the user according to their own needs. Or, after the preset time has been determined, the user can also adjust the preset time according to his own needs. Among them, the 0s can be understood as refreshing immediately.

Exemplarily, the above-mentioned preset update strategy is a time update strategy, which is used to instruct the client to update the target data after 0s. In this case, after the client receives the update instruction information for the target data, it can Update the target data immediately.

In one embodiment, when the aforementioned preset update strategy is a delayed update strategy, the aforementioned delayed update strategy is used to instruct the client to update the target data when it detects a viewing operation for the target data. Wherein, the viewing operation may be, for example, a touch operation on a viewing button, or a voice signal used to view target data, and so on. In this way, there is no need to update the target data immediately, which consumes a lot of hardware performance. Delayed refresh will refresh the target data next time there is a trigger operation to ensure the protection of hardware performance and users can query the saved target data in time.

In one embodiment, after sending an index request for creating a target index to a pre-connected search server, if the target index returned by the search server is not received within a preset time, a preset index may be generated, and based on the preset index Set index to store the target data

In one embodiment, the waiting time (ie, preset time) for waiting for the search server to return the target index can be preset, and when an index request for creating the target index is sent to the pre-connected search server, a timer is started for timing, If it is detected that the current duration corresponding to the timer is greater than or equal to the waiting duration, and the returned target index has not been received, a preset index may be obtained, and the target data may be stored in the storage area corresponding to the preset index.

In an embodiment, after the server generates a preset index, it can also create an asynchronous thread for receiving the target index returned by the search server, that is, start a new thread for continuing to wait for the search server to return the target index. Further, if the server receives the target index returned by the search server through the aforementioned asynchronous thread, the preset index is updated through the target index, and the target data is stored according to the target index.

In one embodiment, a callback listener may be registered in advance for the event of receiving the target index returned by the search server. When the server does not receive the target index returned by the search server within a preset time, the callback listener may be opened (ie, create One of the aforementioned asynchronous threads) is used to receive the target index returned by the search server.

In one embodiment, the data processing method in the embodiment of the present application is applied to a server cluster, and the server cluster is deployed with N nodes (such as N servers). In this case, before sending the index request for creating the target index to the pre-connected search server, the target data can be determined based on the number of nodes in the server cluster. The number of secondary movies, and the number of primary and secondary movies corresponding to each node are added to the index request, and sent to the search server. Further, after receiving the index request, the search server can slice the target data according to the number of primary and secondary slices corresponding to each node, and create a target index corresponding to each node. After the creation is completed, The target index is returned to the corresponding node. In this way, the number of primary and secondary slices can be set according to the number of deployed nodes in the cluster, which effectively reduces the waste of hardware resources caused by the excessive number of secondary slices.

Exemplarily, when there are N nodes, when the number of target data is determined based on the number of nodes in the server cluster, the number of primary and secondary pieces corresponding to each node can be based on the secondary piece of the second node The number is the same as the number of main slices of the first node, the number of secondary slices of the third node is the same as the number of main slices of the second node, and so on to determine the number of main slices and auxiliary slices corresponding to each node. Among them, the main film and the secondary film store the same data, which can prevent data loss caused by hardware problems.

In the embodiment of the present application, the server may not need to update the target data immediately, which consumes a large amount of hardware performance, which is beneficial to both the protection of the hardware performance and the timeliness of the user inquiring about the target data.

The embodiment of the present application also provides a data processing device. The device includes a module for executing the method described in FIG. 1 or FIG. 2, and is configured on a server. Specifically, refer to FIG. 3, which is a schematic block diagram of a data processing apparatus provided by an embodiment of the present application. The data processing device of this embodiment includes:

The communication module 30 is configured to receive a storage request for storing target data from a client, where the storage request includes the target data;

The processing module 31 is configured to perform field analysis on the target data to obtain a field analysis result, where the field analysis result includes a field corresponding to the target data and semantic information of the field;

The processing module 31 is further configured to detect whether there is a target index corresponding to the field in the preset index storage area, and if it is detected that the target index does not exist in the preset index storage area, based on the semantic information Determine the storage structure type to which the target data belongs;

The communication module 30 is further configured to send an index request for creating a target index to the pre-connected search server, and receive the target index returned by the search server, and the index request carries the storage structure type and the target index. The target data, so that the search server can create a target index matching the storage structure type for the target data according to the index request;

The processing module 31 is further configured to store the target data according to the target index.

In one embodiment, the processing module 31 is specifically configured to determine the storage structure type to which the target data belongs as the key if the field corresponding to the target data is detected based on the semantic information for complete matching search. Word type.

In one embodiment, the processing module 31 is specifically further configured to determine the storage structure type to which the target data belongs if it is detected based on the semantic information that the field corresponding to the target data is used for fuzzy matching search Word segmentation type.

In one embodiment, the communication module 30 is further configured to send update instruction information for the target data to the client after storing the target data in the target index, and the update instruction information is used Instruct the client to update the target data according to a preset update strategy.

In one embodiment, the preset update strategy includes a delayed update strategy or a time update strategy, wherein the delayed update strategy is used to instruct the client to update the target when a trigger operation for target data is detected. Data; the time update strategy is used to instruct the client to update the target data after a preset time.

In one embodiment, the processing module 31 is further configured to send an index request for creating a target index to a pre-connected search server, if the target index returned by the search server is not received within a preset time When indexing, a preset index is generated, and the target data is stored according to the preset index.

In one embodiment, the processing module 31 is further configured to create an asynchronous thread for receiving the target index returned by the search server after generating a preset index; if the search server is received through the asynchronous thread When returning to the target index, the preset index is updated through the target index, and the target data is stored according to the target index.

It should be noted that the functions of each functional module of the data processing device described in the embodiment of the present application can be specifically implemented according to the method in the method embodiment described in FIG. 1 or FIG. 2. For the specific implementation process, refer to FIG. 1 or FIG. The related description of the method embodiment of 2 will not be repeated here.

In the embodiment of the present application, when the communication module 30 receives a storage request for storing target data from the client, the processing module 31 performs field analysis on the target data, obtains the field corresponding to the target data and the semantic information of the field, and detects the prediction Assuming whether there is a target index corresponding to the field in the index storage area, if it is detected that the target index does not exist in the preset index storage area, the storage structure type to which the target data belongs is determined based on the semantic information, and the pre-connected search is performed through the communication module 30 The server sends an index request for creating a target index, and then receives the target index returned by the search server, and stores the target data according to the target index through the processing module 31. With the embodiment of the present application, the target index can be created according to the storage structure type to which the target data belongs to prevent the splitting of unnecessary fields, which is beneficial to improve the efficiency of index creation.

Please refer to FIG. 4. FIG. 4 is a schematic block diagram of a server according to an embodiment of the present application. As shown in FIG. 4, the server includes a processor 401, a memory 402, and a network interface 403. The processor 401, the memory 402, and the network interface 403 may be connected by a bus or in other ways. In FIG. 4 shown in the embodiment of the present application, the connection by a bus is taken as an example. The network interface 403 is controlled by the processor to send and receive messages, the memory 402 is used to store a computer program, and the computer program includes program instructions, and the processor 401 is used to execute the program instructions stored in the memory 402. The processor 401 is configured to call the program instructions to execute: when receiving a storage request for storing target data from a client through the network interface 403, perform field analysis on the target data to obtain a field analysis result , The field analysis result includes the field corresponding to the target data and the semantic information of the field; detecting whether the target index corresponding to the field exists in the preset index storage area; if it is detected in the preset index storage area If the target index does not exist, the storage structure type to which the target data belongs is determined based on the semantic information; an index request for creating a target index is sent to the pre-connected search server through the network interface 403, and the index request carries all The storage structure type and the target data, so that the search server can create a target index matching the storage structure type for the target data according to the index request; and receive the return from the search server through the network interface 403 The target index, and the target data is stored according to the target index.

In one embodiment, the processor 401 is specifically configured to determine that the storage structure type to which the target data belongs is the key if it is detected based on the semantic information that the field corresponding to the target data is used for complete matching search. Word type.

In one embodiment, the processor 401 is specifically further configured to determine that the storage structure type to which the target data belongs is if it is detected based on the semantic information that the field corresponding to the target data is used for fuzzy matching search Word segmentation type.

In one embodiment, the network interface 403 is further configured to send update instruction information for the target data to the client after storing the target data in the target index, and the update instruction information is used Instruct the client to update the target data according to a preset update strategy.

In one embodiment, the processor 401 is further configured to send an index request for creating a target index to a pre-connected search server, if the target index returned by the search server is not received within a preset time When indexing, a preset index is generated, and the target data is stored according to the preset index.

In an embodiment, the processor 401 is further configured to create an asynchronous thread for receiving the target index returned by the search server after generating a preset index; if the search server is received through the asynchronous thread When returning to the target index, the preset index is updated through the target index, and the target data is stored according to the target index.

It should be understood that in the embodiment of the present application, the processor 401 may be a central processing unit (Central Processing Unit, CPU), and the processor 401 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs). ), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 402 may include a read-only memory and a random access memory, and provides instructions and data to the processor 401. A part of the memory 402 may also include a non-volatile random access memory. For example, the memory 402 may also store device type information.

In specific implementation, the processor 401, memory 402, and network interface 403 described in the embodiment of the present application can execute the implementation described in the method embodiment described in FIG. 1 or FIG. The implementation of the data processing device described in the embodiment of the present application will not be repeated here.

In another embodiment of the present application, a computer non-volatile readable storage medium is provided. The computer non-volatile readable storage medium stores a computer program. The computer program includes program instructions. When executed by the processor, it is realized: when a storage request for storing target data is received from a client, the target data is subjected to field analysis to obtain a field analysis result, and the field analysis result includes the data corresponding to the target data. Field and semantic information of the field; detect whether there is a target index corresponding to the field in the preset index storage area; if it is detected that the target index does not exist in the preset index storage area, based on the semantic information Determine the storage structure type to which the target data belongs; send an index request for creating a target index to a pre-connected search server, where the index request carries the storage structure type and the target data, so that the search server can follow The index request creates a target index matching the storage structure type for the target data; receives the target index returned by the search server, and stores the target data according to the target index.

The computer non-volatile readable storage medium may be the internal storage unit of the server described in any of the foregoing embodiments, such as the hard disk or memory of the server. The computer non-volatile readable storage medium may also be an external storage device of the server, such as a plug-in hard disk equipped on the server, a smart memory card (Smart Media Card, SMC), and a secure digital (Secure Digital) , SD) card, flash card (Flash Card), etc. Further, the computer non-volatile readable storage medium may also include both an internal storage unit of the server and an external storage device. The computer non-volatile readable storage medium is used to store the computer program and other programs and data required by the server. The computer non-volatile readable storage medium can also be used to temporarily store data that has been output or will be output.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

The above-disclosed are only part of the embodiments of this application. Of course, it cannot be used to limit the scope of rights of this application. Those of ordinary skill in the art can understand all or part of the process for implementing the above-mentioned embodiments and make them in accordance with the claims of this application. The equivalent changes still fall within the scope of the invention.

Claims

A data processing method, characterized in that the method includes:

Receiving a storage request for storing target data from a client, where the storage request includes the target data;

Performing field analysis on the target data to obtain a field analysis result, the field analysis result including the field corresponding to the target data and the semantic information of the field;

Detecting whether there is a target index corresponding to the field in the preset index storage area;

If it is detected that the target index does not exist in the preset index storage area, determine the storage structure type to which the target data belongs based on the semantic information;

Send an index request for creating a target index to the pre-connected search server, the index request carrying the storage structure type and the target data, so that the search server can create the target data according to the index request A target index matching the storage structure type;

Receiving the target index returned by the search server, and storing the target data according to the target index.
The method according to claim 1, wherein the determining the storage structure type to which the target data belongs based on the semantic information comprises:

If it is detected based on the semantic information that the field corresponding to the target data is used for complete matching search, the storage structure type to which the target data belongs is determined as the keyword type.
The method according to claim 1, wherein the determining the storage structure type to which the target data belongs based on the semantic information comprises:

If it is detected that the field corresponding to the target data is used for fuzzy matching search based on the semantic information, the storage structure type to which the target data belongs is determined as the word segmentation type.
The method according to any one of claims 1 to 3, wherein after storing the target data in the target index, the method further comprises:

Sending update instruction information for the target data to the client, where the update instruction information is used to instruct the client to update the target data according to a preset update strategy.
The method according to claim 4, wherein the preset update strategy comprises a delayed update strategy or a time update strategy, wherein the delayed update strategy is used to instruct the client to detect a trigger for target data During operation, the target data is updated; the time update strategy is used to instruct the client to update the target data after a preset time.
The method according to any one of claims 1-5, wherein after the sending an index request for creating a target index to a pre-connected search server, the method further comprises:

If the target index returned by the search server is not received within a preset time, a preset index is generated, and the target data is stored according to the preset index.
The method according to claim 1, wherein the method is applied to a server cluster including at least one node, and the sending an index request for creating a target index to a pre-connected search server comprises:

When sharding the target data is determined based on the number of nodes in the server cluster, the number of primary and secondary slices corresponding to each node in the at least one server;

Generate an index request for creating a target index according to the number of main and secondary films corresponding to each node, and send the index request to the pre-connected search server, so that the search server receives the index request Then, the target data is fragmented according to the number of primary and secondary fragments corresponding to each node, and a target index corresponding to each node is created.
A data processing device, characterized in that the device includes:

A communication module, configured to receive a storage request for storing target data from a client, where the storage request includes the target data;

A processing module, configured to perform field analysis on the target data to obtain a field analysis result, where the field analysis result includes a field corresponding to the target data and semantic information of the field;

The processing module is further configured to detect whether there is a target index corresponding to the field in the preset index storage area, and if it is detected that the target index does not exist in the preset index storage area, determine based on the semantic information The storage structure type to which the target data belongs;

The communication module is further configured to send an index request for creating a target index to a pre-connected search server, and receive the target index returned by the search server, and the index request carries the storage structure type and the Target data, so that the search server can create a target index matching the storage structure type for the target data according to the index request;

The processing module is further configured to store the target data according to the target index.
The device according to claim 8, wherein the processing module is specifically configured to: if a field corresponding to the target data is detected based on the semantic information for a complete matching search, then the target data belongs to The storage structure type is determined as the keyword type.
The device according to claim 8, wherein the processing module is further specifically configured to, if a field corresponding to the target data is detected for fuzzy matching search based on the semantic information, then assign the target data to The storage structure type is determined as the word segmentation type.
The device according to any one of claims 8-10, wherein the communication module is further configured to send update instruction information for the target data to the client, and the update instruction information is used to indicate The client terminal updates the target data according to a preset update strategy.
The device according to claim 11, wherein the preset update strategy comprises a delayed update strategy or a time update strategy, wherein the delayed update strategy is used to instruct the client to detect a trigger for target data During operation, the target data is updated; the time update strategy is used to instruct the client to update the target data after a preset time.
The device according to any one of claims 8-12, wherein the processing module is further configured to: if the target index returned by the search server is not received within a preset time through the communication module At the time, a preset index is generated, and the target data is stored according to the preset index.
8. The device according to claim 8, wherein the device is applied to a server cluster including at least one node, and the processing module is further specifically configured to determine that the target data is fragmented based on the number of nodes in the server cluster When the number of primary and secondary pieces corresponding to each node in the at least one server, an index request for creating a target index is generated according to the number of primary and secondary pieces corresponding to each node; The communication module is further configured to send the index request to the pre-connected search server, so that the search server, after receiving the index request, compares the target with the number of primary and secondary movies corresponding to each node The data is fragmented, and a target index corresponding to each node is created.
A server, characterized by comprising a processor, a memory, and a network interface, the processor, the memory, and the network interface are connected to each other, wherein the memory is used to store a computer program, and the computer program includes a program Instructions, the processor is configured to call the program instructions to execute: when receiving a storage request for storing target data from a client through the network interface, perform field analysis on the target data to obtain a field Parsing result, the field parsing result includes the field corresponding to the target data and the semantic information of the field; detecting whether there is a target index corresponding to the field in the preset index storage area; if it is detected that the preset index is stored If the target index does not exist in the area, the storage structure type to which the target data belongs is determined based on the semantic information; an index request for creating a target index is sent to a pre-connected search server through the network interface, and the index The request carries the storage structure type and the target data, so that the search server can create a target index matching the storage structure type for the target data according to the index request; receiving the storage structure type through the network interface Search for the target index returned by the server, and store the target data according to the target index.
The server according to claim 15, wherein the processor is specifically configured to: if a field corresponding to the target data is detected based on the semantic information for a complete matching search, then the target data belongs to The storage structure type is determined as the keyword type.
The server according to claim 15, wherein the processor is further specifically configured to: if a field corresponding to the target data is detected for fuzzy matching search based on the semantic information, then assign the target data to The storage structure type is determined as the word segmentation type.
The server according to any one of claims 15-17, wherein the processor is further configured to send update instruction information for the target data to the client through the network interface, and the update instruction The information is used to instruct the client to update the target data according to a preset update strategy.
The server according to claim 18, wherein the preset update strategy comprises a delayed update strategy or a time update strategy, wherein the delayed update strategy is used to instruct the client to detect a trigger for target data During operation, the target data is updated; the time update strategy is used to instruct the client to update the target data after a preset time.
A computer nonvolatile readable storage medium, wherein the computer nonvolatile readable storage medium stores a computer program, and the computer program is executed by a processor to implement any one of claims 1 to 7 The method described.