CN118260457A - Data processing method, device, server, client, medium and program product - Google Patents
Data processing method, device, server, client, medium and program product Download PDFInfo
- Publication number
- CN118260457A CN118260457A CN202410361149.6A CN202410361149A CN118260457A CN 118260457 A CN118260457 A CN 118260457A CN 202410361149 A CN202410361149 A CN 202410361149A CN 118260457 A CN118260457 A CN 118260457A
- Authority
- CN
- China
- Prior art keywords
- asset
- search
- data
- server
- asset data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 43
- 238000006243 chemical reaction Methods 0.000 claims abstract description 37
- 238000000034 method Methods 0.000 claims abstract description 30
- 238000012545 processing Methods 0.000 claims description 21
- 230000003993 interaction Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000010276 construction Methods 0.000 claims description 5
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000012827 research and development Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000670 limiting effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011165 process development Methods 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9038—Presentation of query results
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data processing method, a device, a server, a client, a medium and a program product, and relates to the technical field of big data, wherein the method comprises the following steps: constructing a search query instruction according to the user input information; sending the search query instruction to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format; acquiring an initial query result from a target search server, and performing format conversion on the initial query result to convert asset data corresponding to a target storage format into asset data query results based on asset types; and sending the asset data query result to the client corresponding to the user input information. The method solves the problem that the uncertain multi-attribute document cannot be comprehensively searched by a searching mechanism based on attributes or attribute sets in the prior art.
Description
Technical Field
The present application relates to the field of big data technologies, and in particular, to a data processing method, device, server, client, medium, and program product.
Background
The research and development process of large financial enterprises is a complex and systematic process, and research and development personnel need to inquire a plurality of asset documents in the research and development stage to meet research and development requirements, such as document assets like design documents, development code assets, test process assets, and various types of financial research and development assets like standard definition and specification assets.
The general search operation is popular in the enterprise level range at present by using a distributed search server (ELASTICSEARCH, ES), but the search mechanism is limited to the attribute or attribute set, and because the uncertain multi-attribute situation may exist in different asset types in the financial enterprise, the property data of the uncertain attribute is difficult to comprehensively search based on the search mode of the specific attribute or attribute set, which obviously cannot meet the requirement of the large financial enterprise on general search of the uncertain multi-attribute document, thereby indirectly influencing the research and development efficiency.
Disclosure of Invention
The application provides a data processing method, a device, a server, a client, a medium and a program product, which are used for solving the problem that the prior art is difficult to carry out general search on uncertain multi-attribute documents, thereby influencing the research and development efficiency of financial enterprises.
In a first aspect, the present application provides a data processing method, applied to a server, including:
Constructing a search query instruction according to the user input information;
The search query instruction is sent to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format;
Acquiring the initial query result from the target search server, and performing format conversion on the initial query result to convert asset data corresponding to the target storage format into asset data query results based on asset types;
And sending the asset data query result to a client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
In one embodiment, the target storage format includes at least one of the following format items: a first format item corresponding to the asset attribute identifier, a second format item corresponding to the first asset attribute value, and a third format item corresponding to the asset type.
In one embodiment, the format converting the initial query result includes:
Respectively extracting data information carried by each format item in the initial query result, and respectively determining an asset attribute identifier, a first asset attribute value and an asset type contained in the initial query result according to the data information;
binding the asset attribute identifier and the first asset attribute value for each asset type to obtain a second asset attribute value;
And obtaining the asset data query result after format conversion according to the asset type and the second asset attribute value.
In one embodiment, before constructing the search query instruction according to the user input information, the method further comprises:
Responding to an asset data retrieval request initiated by a client to acquire user input information;
The construction of the search query instruction according to the user input information comprises the following steps:
And determining information to be queried according to the user input information, and constructing the search query instruction according to the information to be queried.
In one embodiment, the user input information includes a predefined search expression;
The obtaining user input information includes: and analyzing parameter information carried by the data retrieval request, and acquiring a predefined search expression from an analysis result, wherein the search expression is used for determining the information to be queried.
In a second aspect, a data processing method is provided, applied to a client, and includes:
receiving user input information and generating an asset data retrieval request according to the user input information;
Initiating the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server, wherein the target search server stores various asset data according to a target storage format, and enables the server to perform format conversion on the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and acquiring the asset data query result, and displaying the asset data in the asset data query result according to the asset type.
In one embodiment, the displaying the asset data in the asset data query result according to the asset type includes:
And selecting and determining a corresponding display template from preset display templates according to the asset types, and displaying the asset data corresponding to the asset types according to the display template.
In a third aspect, there is provided a data processing apparatus, for use with a server, comprising:
a building module configured to build a search query instruction according to user input information;
The query module is used for sending the search query instruction to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format;
the conversion module is used for acquiring the initial query result from the target search server and converting the format of the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and the sending module is used for sending the asset data query result to the client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
In a fourth aspect, a data processing apparatus is provided, applied to a client, including:
the interaction module is used for receiving user input information and generating an asset data retrieval request according to the user input information;
the request module is configured to initiate the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server, wherein the target search server stores various asset data according to a target storage format, and enables the server to perform format conversion on the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and the display module is used for acquiring the asset data query result and displaying the asset data in the asset data query result according to the asset type.
In a fifth aspect, there is provided a server comprising: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
The processor executes computer-executable instructions stored in the memory to implement the data processing method provided in the first aspect.
In a sixth aspect, there is provided a client, including: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the data processing method provided in the second aspect.
In a seventh aspect, there is provided a computer-readable storage medium having stored therein computer-executable instructions for implementing the data processing method provided in the first aspect, when executed by a processor of a server, or for implementing the data processing method provided in the second aspect, when executed by a processor of a client.
An eighth aspect provides a computer program product comprising a computer program which when executed by a processor of a server implements the data processing method provided in the first aspect above, or which when executed by a processor of a client implements the data processing method provided in the second aspect above.
According to the data processing method, the device, the server, the client, the medium and the program product, the search query instruction is constructed according to the user input information, the search query instruction can be a query script generated according to the user input information, a specific format is not required to be limited, the search query is initiated to the search server according to the search query instruction, the index document format is redefined in the search server to store all types of asset data, the initial query result is obtained from the search server, meanwhile, the format conversion is carried out, so that the asset data in the specific format is converted into asset data query results based on the asset type, and the client displays the data. The user can match the matched asset data in all the indexed documents without specific limitation, so that the problem that the uncertain multi-attribute documents cannot be comprehensively searched by the existing searching mechanism based on the attribute or the attribute set can be effectively solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
FIG. 1 is a schematic flow chart of a data processing method according to an embodiment of the present application;
fig. 2 is a schematic flow chart of step S103 in fig. 1;
FIG. 3 is a flowchart illustrating another data processing method according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating another data processing method according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a possible scenario provided by an embodiment of the present application;
FIG. 6 is a flowchart illustrating another data processing method according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;
FIG. 8 is a schematic diagram of another data processing apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a server according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a client according to an embodiment of the present application.
Specific embodiments of the present application have been shown by way of the above drawings and will be described in more detail below. The drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but rather to illustrate the inventive concepts to those skilled in the art by reference to the specific embodiments.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.
It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with related laws and regulations and standards, and provide corresponding operation entries for the user to select authorization or rejection.
ELASTICSEARCH (ES), a distributed search and analysis engine that uses JS object profiles (JavaScript Object Notation, JSON) for data indexing via hypertext transfer protocol (Hypertext Transfer Protocol, HTTP), i.e., implementing data indexing via key-value format search restrictions.
Based on the current data storage and indexing mode, when a user has a search requirement on certain or some asset data, the user needs to give a determined attribute value or attribute set in a search expression to realize the search on the corresponding asset data, taking the search on the asset data of a logic system type as an example, the user needs to give attribute information such as a specific system identifier, a name, an abbreviation, a manager and the like, and for the uncertain multi-attribute asset data, because the uncertain multi-attribute asset data cannot give specific attribute information, the search mode based on the specific attribute information easily causes that the asset data of the logic system type cannot be comprehensively searched or the asset data of other asset types is searched, and obviously, the query result obtained by adopting the search mode is difficult to meet the acquisition requirement of a developer on the asset data. It is to be understood that the above-described exemplary logic systems generally refer to systems comprised of logic circuits, program code or algorithms, etc. for performing specific computing, control or communication functions. Logic systems have wide application in different fields and applications, such as artificial intelligence, information technology, engineering control, and the like.
In view of this, the data processing method, device, server, client, medium and program product provided by the application construct a search query instruction at the HTTP server according to the user input information, where the search query instruction may be a query script generated for the user input information, without limiting a specific format, and initiate a search query to a search server, where an index document format is redefined to store asset data of each type, and obtain an initial query result from the search server while performing format conversion, so as to convert asset data of a specific format into asset data query results based on asset types, and perform data presentation by the client. The user can match the matched asset data in all the indexed documents without specific limitation, so that the problem that the uncertain multi-attribute documents cannot be comprehensively searched by the existing searching mechanism based on the attribute or the attribute set can be effectively solved.
The following describes the technical scheme of the present application and how the technical scheme of the present application solves the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 is a schematic flow chart of a data processing method according to an embodiment of the present application, where the method is applied to a server, and the server may be an HTTP server, and this embodiment is described by taking an HTTP server as an example, and in other situations, the method may also be another server, and the server type is not limited in particular. As shown in fig. 1, the method may include the following steps S101-S104.
Step S101, a search query instruction is constructed according to user input information.
In this embodiment, the search query instruction may be a query script generated for user input information, without limiting a specific format.
In this embodiment, the user input information may be obtained from an HTTP client, and the user initiates the asset data query request at the HTTP client and generates the user input information. Alternatively, the user input information may not carry any attribute information, such as information of a system name, an identification, and the like. For example, only asset type information can be carried in the user input information, for example, the asset type is a logic system, even the asset type information is not carried, the semantic text is adopted to describe the function information of the asset data to be queried, the asset type is identified according to the semantic text, and a search query instruction is constructed, so that the asset data in the corresponding asset type is comprehensively searched.
Step S102, the search query instruction is sent to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; and the target search server stores various asset data according to a target storage format.
In the related art, data is usually stored in the search server in the form of key value pairs (attribute identifier-attribute value), so that the search query instruction must carry corresponding attribute information, and the search query server queries asset data corresponding to the attribute according to the search query instruction, but in practical application, one asset document (i.e., asset data) may have a plurality of uncertain attribute information, and when a user uses any attribute information to query, the user may not query corresponding asset data, or may query asset data of other asset types by mistake.
In this embodiment, the target search server may be an ES or other search servers, and by defining a target storage format, the physical storage form of the asset data in the search server is improved, so as to achieve the purpose of supporting comprehensive searching of the asset data.
Next, a further description of the target storage format may include one or more of the following: a first format item corresponding to the asset attribute identifier, a second format item corresponding to the first asset attribute value, and a third format item corresponding to the asset type.
It is understood that attributes, i.e., specific information describing characteristics of an asset, may be various attribute fields of the asset, such as name, size, identification, abbreviation, etc. Illustratively, the asset data target storage format in the target search server may be as follows:
Attribute identifiers (fields): type, identity, abbreviated name, english name, manager; attribute values (values): logical system; XXX-001, abbreviated system name A, system name B, system English name C, zhang Sanx (xx 12 XXX); asset type definition (type): a logic system.
In this example, type represents an asset type definition, corresponding to a third format item to which the asset type corresponds; fields represents an array of original asset attribute identifier sets, where bit 0 may be a fixed value_type, representing asset type; values represent an array of sets of values for the original asset attributes, bit 0 may be fixed to the value of the asset type, consistent with the asset type definition value.
Compared with the storage format adopted in the related art, the attribute identifier, the attribute value and the asset type are set to three format items, and even if the user input information does not carry attribute information or does not carry a complete attribute set, the search server can search comprehensive asset data in the corresponding asset type according to the fallen asset type or the fallen attribute array, and the false search situation of generating data of different asset types is reduced. In addition, through the mode, key and value separation can be realized, the negative effect that a single object is stored into a unique attribute in a JSON format and an attribute title pollutes a search result is solved, and the search is more comprehensive.
Step S103, the initial query result is obtained from the target search server, and format conversion is carried out on the initial query result so as to convert asset data corresponding to a target storage format into asset data query results based on asset types.
In this embodiment, in order to facilitate the presentation of data at the client, after the initial query result is obtained, the data in the target storage format is converted into the JSON array format. Illustratively, assume that the asset data query results include 2:
Asset type (type) logic system; attribute values (values): XXX-001; an administrator: zhang Sanx (xx 12 xxx); system name: a system name B; english name: english name C; abbreviation name: abbreviation name a;
(two) asset type (type): a logic system; attribute values (values): identification: XXX-002; an administrator: litetral (xx 12 xxx); system name: a system name b; english name: english name c; abbreviation name: abbreviation name a.
In this example, the return result set is converted to JSON array format, i.e., in the form of type-values, where type is an asset type definition and values are key: value sets representing the entirety of pairs of asset attribute/value pairs.
And step S104, the asset data query result is sent to the client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
In one implementation, the HTTP server encapsulates the converted document object back to the client (encapsulates the converted document object into an HTTP response, which may be by setting response header information, status codes, etc., or uses an HTTP response body to carry the document object data). And the client selects a corresponding template according to the document type and displays corresponding asset data.
Next, this embodiment further describes a format conversion process for the initial query result, and in one implementation, as shown in fig. 2, the format conversion of the initial query result includes the following steps S103a-S103c:
step S103a, respectively extracting data information carried by each format item in the initial query result, and respectively determining an asset attribute identifier, a first asset attribute value and an asset type contained in the initial query result according to the data information.
Specifically, the initial query result extracted from Es, namely the original document corresponding to the target storage format, is converted into JSON object format by determining the asset attribute identifier, the first asset attribute value and the asset type corresponding to the target storage format.
Step S103b, binding the asset attribute identifier and the first asset attribute value for each asset type, to obtain a second asset attribute value; and step S103c, obtaining the asset data query result after format conversion according to the asset type and the second asset attribute value.
As can be seen from the above examples, the second asset attribute value, i.e., the binding result between the first asset attribute value and the attribute identifier. Through the format conversion process, the asset data can be stored in the search server in a specific physical storage document format, and meanwhile, the display at the user side is facilitated through the reverse conversion process.
Fig. 3 is a schematic diagram of another data processing method according to an embodiment of the present application, where, based on the foregoing embodiment, the present embodiment may effectively improve data query efficiency by first determining information to be queried and constructing a search query instruction according to the information to be queried. Specifically, before the step S101 constructs the search query instruction according to the user input information, the following step S301 may be further included, and the step S101 may be further divided into the step S101a.
Step S301, responding to an asset data retrieval request initiated by a client, and acquiring user input information.
In this embodiment, the asset data retrieval request may be transmitted via an HTTP request, or may be transmitted using another data transmission protocol.
Step S101a, determining information to be queried according to the user input information, and constructing the search query instruction according to the information to be queried.
In this embodiment, the request information of the user is not required to adopt specific attribute information, but considering that the actual application may have the situation that the request information uses generalized language, by first determining the information to be queried and constructing a search query instruction, optionally, a natural language model may be adopted to identify (query terms in) the information input by the user, so as to determine the information to be queried, construct a search query instruction, and transmit the search query instruction to a search server for data query.
Optionally, the user input information comprises a predefined search expression; the step S301 of acquiring the user input information may include the following steps: and analyzing parameter information carried by the data retrieval request, and acquiring a predefined search expression from an analysis result, wherein the search expression is used for determining the information to be queried.
In this embodiment, the predefined search expression may be a search expression input by the user at random, or may be a search expression input based on a predefined template. Wherein the person skilled in the art can adapt the predefined templates in combination with the actual application and the prior art.
Specifically, after receiving a data retrieval request, the HTTP server obtains a parameter part from the request, which generally includes a query parameter in a uniform resource locator (Uniform Resource Locator, URL), a parameter in a request header, and the like, analyzes the parameter information to obtain a search expression transmitted by the client, and determines data to be queried according to the search expression.
By the technical scheme, the information to be queried is determined according to the search expression of the user, and the search query instruction is constructed according to the information to be queried, so that the data query efficiency can be effectively improved.
Fig. 4 is a flowchart of another data processing method according to an embodiment of the present application, where the method may be applied to a client, as shown in fig. 4, and the method includes steps S401 to S403:
step S401, receiving user input information and generating an asset data retrieval request according to the user input information.
Alternatively, the user input information may carry a predefined search expression.
Step S402, initiating the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server, wherein the target search server stores various asset data according to a target storage format, and enables the server to perform format conversion on the initial query result so as to convert the asset data corresponding to the target storage format into an asset data query result based on asset types;
Step S403, acquiring the asset data query result, and displaying the asset data in the asset data query result according to the asset type.
In one embodiment, the step S403 of displaying the asset data in the asset data query result according to the asset type may include the following steps: and selecting and determining a corresponding display template from preset display templates according to the asset types, and displaying the asset data corresponding to the asset types according to the display template. By the method, the client can select the corresponding template according to the document type and display the corresponding asset data, so that visual display and interaction of the data are realized. This way, the user experience can be improved, making it easier for the user to understand and manipulate the data.
It should be noted that, the data processing method provided in this embodiment is the opposite technical solution of the method provided in the foregoing embodiment, and its implementation principle and technical effect are similar, and are not described herein again.
In one possible application scenario, as shown in fig. 5, the application scenario includes a browser-side component 10 and a server-side component 20, where the browser-side component 10 (i.e., HTTP client) may include an input interaction component 11 (i.e., interaction module 801), and a result presentation component 12 (i.e., presentation module 803); the server side components may include an HTTP service component (i.e., an HTTP server side) including an HTTP interactive service module 22, a search request module 23, and a result conversion module 24, and a search server 21 (e.g., an elastic search). Wherein, the input interaction component 11 is used for the user to select the asset type, input the search expression and generate the search request; a results presentation component 12 operable to present the retrieved results data items (obtained from the server component 20) in a particular template (pagination) in the web page according to the asset type; the HTTP interaction service module 22 is configured to receive search request data transmitted from the browser; a search request module 23, operable to construct a search query instruction and initiate a search request for an elastic search; a result conversion module 24 operable to convert the standard object document into a physical storage document format stored by the elastic search, and to perform the inverse conversion of the above conversion; an elastic search engine 21 may be used to embody the indexing of the asset physical storage documents.
Alternatively, the elastic search defines a storage document model of the asset document AssetDoc and a presentation model of the asset item ASSETITEM, wherein the storage document model is used for storing the asset document AssetDoc in an actual physical storage format of the file in the elastic search, in other words, the elastic search uses a target storage format, and specific examples can be seen in examples of the target storage format in the above embodiments; the presentation model is used for converting the storage document model into JSON format data, and specific examples can be found in the JSON array format examples in the above embodiments, which are not described herein.
Optionally, in converting AssetDoc to ASSETITEM, the following steps may be included: extracting AssetDoc the original document from Es; converting AssetDoc into JSON object format; creating ASSETITEM objects; assigning a type to ASSETITEMTYPE attributes; the values attribute of AssetDoc is traversed circularly and fields i, values i can be fetched in pairs in order starting from the index, forming a map.entry format, and the Map objects written to the values of ASSETITEM are stored in key-value pairs. Thus, the format conversion from the target storage format to the JSON array can be realized.
After explaining the framework of the application scenario, the technical solution of the present application is briefly described below with possible query examples, and as shown in fig. 6, the data processing flow may include the following steps:
step 1, an HTTP client can input a search expression through a user and can be used for determining content to be queried input by the user;
step 2, the HTTP client can determine the range of the type of the search asset through user selection, and generate and initiate an asset data search request to the HTTP server;
Step 4, the HTTP server receives the request sent by the client and analyzes the parameters;
Step 5, the HTTP server builds an elastic search query script (namely a search query instruction) and initiates a query request to the elastic search (carrying the search query instruction);
step 7, the HTTP server responds to a returned result (corresponding to the target storage format) of the elastic search;
Step 8, the HTTP server extracts the returned document object (usually a list, namely an initial query result);
step 9, the HTTP server performs format conversion on the document object according to the format conversion mode;
Step 10, the HTTP server packages the converted document object (namely the asset data query result) and returns the packaged document object to the client;
And step 11, the client selects a corresponding template according to the document type and displays corresponding asset data.
Compared with the search limitation of a search server to the traditional key-value format in the related art, the full text search of the multi-type assets with uncertain attributes can be more simply realized through the system after model conversion, and the full text search is returned and presented in the JSON format familiar to the developer, so that the general search purpose is achieved, and meanwhile, the habit of the developer is complied, and the development efficiency of the developer based on asset data is improved; through key and value separation strategy, the negative effect that a single object is stored into a unique attribute in a JSON format and an attribute title pollutes a search result is avoided; in this embodiment, whether to search the attribute type or not or simply search the full text of the attribute value can be effectively controlled, meanwhile, the construction logic of the query script of the general search is simplified, and the full text search can be completed by using a unified universal format.
Fig. 7 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present application, where the apparatus includes a building module 701, a query module 702, a conversion module 703 and a sending module 704, where,
A construction module 701 configured to construct a search query instruction according to user input information;
The query module 702 is configured to send the search query instruction to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format;
A conversion module 703, configured to obtain the initial query result from the target search server, and perform format conversion on the initial query result, so as to convert the asset data corresponding to the target storage format into an asset data query result based on an asset type;
And the sending module 704 is configured to send the asset data query result to the client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
In one embodiment, the target storage format includes at least one of the following format items: a first format item corresponding to the asset attribute identifier, a second format item corresponding to the first asset attribute value, and a third format item corresponding to the asset type.
In one embodiment, the conversion module includes:
The extraction and determination unit is used for respectively extracting the data information carried by each format item in the initial query result and respectively determining an asset attribute identifier, a first asset attribute value and an asset type contained in the initial query result according to the data information;
a binding unit configured to bind the asset attribute identifier and the first asset attribute value for each of the asset types, to obtain a second asset attribute value;
and the conversion unit is used for obtaining the asset data query result after format conversion according to the asset type and the second asset attribute value.
In one embodiment, the apparatus further comprises:
The acquisition module is used for responding to an asset data retrieval request initiated by the client and acquiring user input information;
The construction module 701 is specifically configured to determine information to be queried according to the user input information, and construct the search query instruction according to the information to be queried.
In one embodiment, the user input information includes a predefined search expression;
the acquisition module is specifically configured to parse parameter information carried by the data retrieval request, and acquire a predefined search expression from the parsing result, where the search expression is used to determine the information to be queried.
The device provided by the embodiment of the application can be used for executing the technical scheme of the embodiment of the data processing method, and the implementation principle and the technical effect are similar and are not repeated here.
FIG. 8 is a schematic diagram of a data processing apparatus according to an embodiment of the present application, as shown in FIG. 8, including an interaction module 801,
An interaction module 801 arranged to receive user input information, the user input information comprising a predefined search expression, and to generate an asset data retrieval request in dependence on the user input information;
A request module 802 configured to initiate the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server; the target search server stores various asset data according to a target storage format, and performs format conversion on the initial query result so as to convert the asset data corresponding to the target storage format into an asset data query result based on an asset type;
And the display module 803 is configured to acquire the asset data query result and display the asset data in the asset data query result according to the asset type.
In one embodiment, the display module 803 is specifically configured to select and determine a corresponding display template from preset display templates according to the asset type, and display the asset data corresponding to the asset type according to the display template.
The device provided by the embodiment of the application can be used for executing the technical scheme of the embodiment of the data processing method, and the implementation principle and the technical effect are similar and are not repeated here.
It should be noted that, it should be understood that the division of the modules of the above apparatus is merely a division of a logic function, and may be fully or partially integrated into a physical entity or may be physically separated. And these modules may all be implemented in software in the form of calls by the processing element; or can be realized in hardware; the method can also be realized in a form of calling software by a processing element, and the method can be realized in a form of hardware by a part of modules. For example, the conversion module 703 may be a processing element that is set up separately, may be implemented in a chip of the above-described apparatus, or may be stored in a memory of the above-described apparatus in the form of program codes, and the functions of the conversion module 703 may be called and executed by a processing element of the above-described apparatus. The implementation of the other modules is similar. In addition, all or part of the modules can be integrated together or can be independently implemented. The processing element here may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in a software form.
In a fifth aspect, there is provided a server comprising: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
The processor executes the computer-executable instructions stored in the memory to implement the data processing method.
The device provided by the embodiment of the application can be used for executing the technical scheme of the embodiment of the data processing method, and the implementation principle and the technical effect are similar and are not repeated here.
In a sixth aspect, there is provided a terminal device, including: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
The processor executes the computer-executable instructions stored in the memory to implement the data processing method.
The device provided by the embodiment of the application can be used for executing the technical scheme of the embodiment of the data processing method, and the implementation principle and the technical effect are similar and are not repeated here.
Fig. 9 is a schematic structural diagram of a server according to an embodiment of the present application. As shown in fig. 9, the server may include: a transceiver 91, a processor 92, a memory 93.
Processor 92 executes computer-executable instructions stored in memory that cause processor 92 to perform the data processing method of the embodiment shown in fig. 1-3. The processor 92 may be a general-purpose processor including a central processing unit CPU, a network processor (network processor, NP), etc.; but may also be a digital signal processor DSP, an application specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component.
The memory 93 is coupled to the processor 92 via a system bus and communicates with each other, and the memory 103 is used for storing computer program instructions.
Transceiver 91 may be used to receive user input from a client or to transmit the asset data query results to a client.
The system bus may be a peripheral component interconnect (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The system bus may be classified into an address bus, a data bus, a control bus, and the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus. The transceiver is used to enable communication between the database access device and other computers (e.g., clients, read-write libraries, and read-only libraries). The memory may include random access memory (random access memory, RAM) and may also include non-volatile memory (non-volatile memory).
The server provided by the embodiment of the application can be the HTTP server in the embodiment.
Fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 10, the client may include: a transceiver 101, a processor 102, a memory 103.
Processor 102 executes computer-executable instructions stored in memory that cause processor 102 to perform the data processing scheme in the embodiment shown in fig. 4.
The memory 103 is coupled to the processor 102 via a system bus and communicates with each other, and the memory 103 is adapted to store computer program instructions.
Transceiver 101 may be used to receive user input from a client or to transmit the asset data query results to a client.
The client provided by the embodiment of the application can be the HTTP client in the embodiment.
The embodiment of the application also provides a chip for running the instruction, and the chip is used for executing the technical scheme of the data processing method in any embodiment.
The embodiment of the application also provides a computer readable storage medium, in which computer executable instructions are stored, when the computer executable instructions run on a server, at least one processor of the server executes the technical scheme of the data processing method of the embodiment of fig. 1-3, or when the computer executable instructions run on a client, at least one processor of the client executes the technical scheme of the data processing method of the corresponding embodiment of fig. 4.
Embodiments of the present application also provide a computer program product, where the computer program product includes a computer program stored in a computer readable storage medium, and at least one processor of a server may read the computer program from the computer readable storage medium, where the at least one processor may implement a technical solution of a data processing method according to the embodiment of fig. 1 to 3 when the computer program is executed, or where at least one processor of a client may read the computer program from the computer readable storage medium, where the at least one processor may implement a technical solution of a data processing method according to the embodiment of fig. 4 when the computer program is executed.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, e.g., the division of modules is merely a logical function division, and there may be additional divisions of actual implementation, e.g., multiple modules may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or modules, which may be in electrical, mechanical, or other forms.
The modules illustrated as separate components may or may not be physically separate, and components shown as modules may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to implement the solution of this embodiment.
In addition, each functional module in the embodiments of the present application may be integrated in one processing unit, or each module may exist alone physically, or two or more modules may be integrated in one unit. The units formed by the modules can be realized in a form of hardware or a form of hardware and software functional units.
The integrated modules, which are implemented in the form of software functional modules, may be stored in a computer readable storage medium. The software functional modules described above are stored in a storage medium and include instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or processor to perform some of the steps of the methods of the various embodiments of the application.
It should be appreciated that the Processor may be a central processing unit (Central Processing Unit, abbreviated as CPU), or may be other general purpose Processor, digital signal Processor (DIGITAL SIGNAL Processor, abbreviated as DSP), application SPECIFIC INTEGRATED Circuit (ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution.
The memory may comprise a high-speed RAM memory, and may further comprise a non-volatile memory NVM, such as at least one magnetic disk memory, and may also be a U-disk, a removable hard disk, a read-only memory, a magnetic disk or optical disk, etc.
The bus may be an industry standard architecture (Industry Standard Architecture, ISA) bus, an external device interconnect (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, the buses in the drawings of the present application are not limited to only one bus or to one type of bus.
The storage medium may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an Application SPECIFIC INTEGRATED Circuits (ASIC). Of course, the processor and the storage medium may reside as discrete components in an electronic control unit or master control device.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the method embodiments described above may be performed by hardware associated with program instructions. The foregoing program may be stored in a computer readable storage medium. The program, when executed, performs steps including the method embodiments described above; and the aforementioned storage medium includes: various media that can store program code, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.
Claims (13)
1. A data processing method, applied to a server, comprising:
Constructing a search query instruction according to the user input information;
The search query instruction is sent to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format;
Acquiring the initial query result from the target search server, and performing format conversion on the initial query result to convert asset data corresponding to the target storage format into asset data query results based on asset types;
And sending the asset data query result to a client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
2. The method of claim 1, wherein the target storage format comprises at least one of the following format items: a first format item corresponding to the asset attribute identifier, a second format item corresponding to the first asset attribute value, and a third format item corresponding to the asset type.
3. The method according to claim 1 or 2, wherein said format converting the initial query result comprises:
Respectively extracting data information carried by each format item in the initial query result, and respectively determining an asset attribute identifier, a first asset attribute value and an asset type contained in the initial query result according to the data information;
binding the asset attribute identifier and the first asset attribute value for each asset type to obtain a second asset attribute value;
And obtaining the asset data query result after format conversion according to the asset type and the second asset attribute value.
4. The method of claim 1 or 2, further comprising, prior to constructing the search query instruction from the user input information:
Responding to an asset data retrieval request initiated by a client to acquire user input information;
The construction of the search query instruction according to the user input information comprises the following steps:
And determining information to be queried according to the user input information, and constructing the search query instruction according to the information to be queried.
5. The method of claim 4, wherein the user input information comprises a predefined search expression;
The obtaining user input information includes: and analyzing parameter information carried by the data retrieval request, and acquiring a predefined search expression from an analysis result, wherein the search expression is used for determining the information to be queried.
6. A data processing method, applied to a client, comprising:
receiving user input information and generating an asset data retrieval request according to the user input information;
Initiating the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server, wherein the target search server stores various asset data according to a target storage format, and enables the server to perform format conversion on the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and acquiring the asset data query result, and displaying the asset data in the asset data query result according to the asset type.
7. The method of claim 6, wherein the presenting the asset data in the asset data query results according to the asset type comprises:
And selecting and determining a corresponding display template from preset display templates according to the asset types, and displaying the asset data corresponding to the asset types according to the display template.
8. A data processing apparatus, for use with a server, comprising:
a building module configured to build a search query instruction according to user input information;
The query module is used for sending the search query instruction to a target search server, so that the target search server performs full-text search according to the search query instruction to obtain an initial query result; the target search server stores various asset data according to a target storage format;
the conversion module is used for acquiring the initial query result from the target search server and converting the format of the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and the sending module is used for sending the asset data query result to the client corresponding to the user input information, so that the client displays the asset data in the asset data query result according to the asset type.
9. A data processing apparatus, for application to a client, comprising:
the interaction module is used for receiving user input information and generating an asset data retrieval request according to the user input information;
the request module is configured to initiate the asset data retrieval request to a server, so that the server obtains the user input information according to the asset data retrieval request, constructs a search query instruction according to the user input information, and obtains an initial query result according to interaction with a target search server, wherein the target search server stores various asset data according to a target storage format, and enables the server to perform format conversion on the initial query result so as to convert asset data corresponding to the target storage format into asset data query results based on asset types;
and the display module is used for acquiring the asset data query result and displaying the asset data in the asset data query result according to the asset type.
10. A server, comprising: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
The processor executes computer-executable instructions stored in the memory to implement the data processing method of any one of claims 1-5.
11. A client, comprising: a processor, and a memory communicatively coupled to the processor;
The memory stores computer-executable instructions;
The processor executes computer-executable instructions stored in the memory to implement the data processing method of claim 6 or 7.
12. A computer-readable storage medium, in which computer-executable instructions are stored, which when executed by a processor of a server are adapted to implement the data processing method according to any one of claims 1-5, or the data processing method according to claim 6 or 7 by a processor of a client.
13. A computer program product comprising a computer program which, when executed by a processor of a server, implements the data processing method according to any of claims 1-5 or which, when executed by a processor of a client, implements the data processing method according to claim 6 or 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410361149.6A CN118260457A (en) | 2024-03-27 | 2024-03-27 | Data processing method, device, server, client, medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410361149.6A CN118260457A (en) | 2024-03-27 | 2024-03-27 | Data processing method, device, server, client, medium and program product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118260457A true CN118260457A (en) | 2024-06-28 |
Family
ID=91612377
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410361149.6A Pending CN118260457A (en) | 2024-03-27 | 2024-03-27 | Data processing method, device, server, client, medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118260457A (en) |
-
2024
- 2024-03-27 CN CN202410361149.6A patent/CN118260457A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6761112B2 (en) | Methods and systems for server-side rendering of native content for presentation | |
| US20190251087A1 (en) | Method and apparatus for providing aggregate result of question-and-answer information | |
| US11386169B1 (en) | Navigation through a collection of electronic documents | |
| JP7330891B2 (en) | System and method for direct in-browser markup of elements in Internet content | |
| CN112868004B (en) | Resource recommendation method and device, electronic equipment and storage medium | |
| US20150234927A1 (en) | Application search method, apparatus, and terminal | |
| US8984414B2 (en) | Function extension for browsers or documents | |
| US11561810B2 (en) | Automated command assistance for a cloud service | |
| JP2013541793A (en) | Multi-mode search query input method | |
| CN103136228A (en) | Image search method and image search device | |
| US8959083B1 (en) | Searching using social context | |
| EP3738048B1 (en) | Recommending visual and execution templates to enable automation of control and data exploration across systems | |
| CN105550206B (en) | The edition control method and device of structured query sentence | |
| US10417058B1 (en) | Method and system for executing application programming interface (API) requests based on parent-child object relationships | |
| WO2011116082A2 (en) | Indexing and searching employing virtual documents | |
| CN106471497A (en) | Auxiliary using context browses | |
| CN112256772A (en) | Data service method, device and readable storage medium | |
| US20140101249A1 (en) | Systems and Methods for Managing and Presenting Information | |
| US9529922B1 (en) | Computer implemented systems and methods for dynamic and heuristically-generated search returns of particular relevance | |
| CN111209325A (en) | Service system interface identification method, device and storage medium | |
| CN111488386B (en) | Data query method and device | |
| CN113656737A (en) | Webpage content display method and device, electronic equipment and storage medium | |
| US20110099134A1 (en) | Method and System for Agent Based Summarization | |
| US20090049034A1 (en) | Ontology system providing enhanced search capability | |
| US20140012876A1 (en) | Finding services in a service registry system of a service-oriented architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |