CN114168599A - Data summarizing method and device and terminal equipment - Google Patents

Data summarizing method and device and terminal equipment Download PDF

Info

Publication number
CN114168599A
CN114168599A CN202111550275.9A CN202111550275A CN114168599A CN 114168599 A CN114168599 A CN 114168599A CN 202111550275 A CN202111550275 A CN 202111550275A CN 114168599 A CN114168599 A CN 114168599A
Authority
CN
China
Prior art keywords
data
service
information
service data
piece
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111550275.9A
Other languages
Chinese (zh)
Inventor
方嘉俊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pingan Payment Technology Service Co Ltd
Original Assignee
Pingan Payment Technology Service Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pingan Payment Technology Service Co Ltd filed Critical Pingan Payment Technology Service Co Ltd
Priority to CN202111550275.9A priority Critical patent/CN114168599A/en
Publication of CN114168599A publication Critical patent/CN114168599A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application is applicable to the technical field of data processing, and provides a data summarizing method, a data summarizing device and terminal equipment, wherein the method comprises the following steps: acquiring service data and determining effective information of each piece of data in the service data; generating a summary template according to the effective information; determining a service identifier corresponding to each piece of data in the service data according to the summarizing template and a preset template engine; summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification. The data summarization method provided by the application improves the summarization efficiency of the data.

Description

Data summarizing method and device and terminal equipment
Technical Field
The present application belongs to the technical field of data processing, and in particular, to a data summarizing method, apparatus, terminal device, and computer-readable storage medium.
Background
In the existing system architecture (such as an order and bill type system), due to the diversity of business transaction channels, a large amount of business data can be generated, and the business data are randomly stored in a database or other storage units and are not classified uniformly, so that the collection and the summary processing of mass data are always important problems.
In an existing data summarization method, a summarization condition is usually set in advance through a Structured Query Language (SQL), that is, the summarization condition is fixed, and then business data is summarized and summarized according to the summarization condition. Therefore, when the service data needs to be summarized by the new summary condition, the corresponding processing logic of the service data needs to be implemented in the system in advance in an encoding manner. Therefore, the existing data summarizing method has the problems of small application range, complex operation and low efficiency.
Disclosure of Invention
The embodiment of the application provides a data summarizing method and device, terminal equipment and a computer readable storage medium, and can solve the problems of small application range, complex operation and low efficiency in the prior art.
In a first aspect, an embodiment of the present application provides a data summarization method, including:
acquiring service data and determining effective information of each piece of data in the service data;
generating a summary template according to the effective information;
determining a service identifier corresponding to each piece of data in the service data according to the summarizing template;
summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification.
Optionally, the obtaining the service data and determining valid information of each piece of data in the service data includes:
determining a summary scene corresponding to the service data according to the parameter information; the parameter information is input by a user;
and obtaining the effective information of the service data according to the summary scene and the corresponding relation between the preset summary scene and the effective information.
Optionally, the obtaining the service data and determining valid information of each piece of data in the service data includes:
acquiring original information of each piece of data in the service data;
standardizing the original information according to a preset rule to obtain standard information of the service data;
and comparing the standard information with a plurality of pieces of historical effective information stored in advance one by one, and obtaining the effective information of the service data according to the comparison result.
Optionally, the comparing the standard information with a plurality of pieces of historical effective information stored in advance one by one, and obtaining the effective information of the service data according to the comparison result, includes:
when detecting that the plurality of pieces of history effective information have the history effective information which is completely the same as the standard information, determining the standard information as the effective information;
correspondingly, the generating a summary template according to the effective information includes:
and determining a summary template corresponding to the effective information according to the corresponding relation between the pre-stored effective historical information and the historical summary template.
Optionally, the determining, according to the summary template, a service identifier corresponding to each piece of data in the service data includes:
obtaining a plurality of characteristic information of each piece of data according to the summarizing template and the preset template engine;
and combining the plurality of characteristic information to obtain a service identifier corresponding to each piece of data.
Optionally, after the summarizing the service data according to the service identifier to obtain a service data table, the method further includes:
and storing the service identification and the service data table in a database in a correlation manner.
Optionally, after the summarizing the service data according to the service identifier to obtain a service data table, the method further includes:
receiving a data query request; the data query request carries a target service identifier;
and acquiring a target service data table corresponding to the target service identifier from the database based on the target service identifier, and displaying the target service data table.
In a second aspect, an embodiment of the present application provides a data summarization apparatus, including:
the first acquisition unit is used for acquiring service data and determining effective information of each piece of data in the service data;
the first generating unit is used for generating a summary template according to the effective information;
a first determining unit, configured to determine, according to the summary template, a service identifier corresponding to each piece of data in the service data;
the first processing unit is used for summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification.
In a third aspect, an embodiment of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor, when executing the computer program, implements the steps of the data summarization method according to any one of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the data summarizing method according to any one of the first aspect.
In a fifth aspect, an embodiment of the present application provides a computer program product, which when run on a terminal device, enables the terminal device to execute the data summarization method according to any one of the above first aspects.
Compared with the prior art, the embodiment of the application has the advantages that:
according to the data summarizing method provided by the embodiment of the application, by determining the effective information of each piece of data in the obtained service data, the summarizing condition, namely the summarizing template, corresponding to the effective information of the service data can be directly generated according to the effective information of the service data, and the method is simple to operate without pre-coding; and then, the service identifier of each piece of data in the service data can be determined according to the summarizing template, so that the data with the same service identifier can be summarized to obtain a service data table. In the data summarization method provided by the application, the summarization template is not fixed and can be flexibly changed according to the effective information of the acquired service data, the application range is wide, and the data summarization efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a flowchart illustrating an implementation of a data summarization method according to an embodiment of the present application;
fig. 2 is a flowchart illustrating a specific implementation of S101 in the data summarization method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating an implementation of a data summarization method according to another embodiment of the present application;
fig. 4 is a flowchart illustrating a specific implementation of S103 in the data summarization method according to an embodiment of the present application;
FIG. 5 is a schematic structural diagram of a data summarization apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.
Referring to fig. 1, fig. 1 is a flowchart illustrating an implementation of a data summarization method according to an embodiment of the present application. An execution main body of the data summarization method provided by the embodiment of the application is terminal equipment. The terminal device can be a smart phone, a tablet computer or a desktop computer.
As shown in fig. 1, the data summarization method provided in an embodiment of the present application may include S101 to S104, which are detailed as follows:
in S101, service data is acquired, and valid information of each piece of data in the service data is determined.
In the embodiment of the application, when a user needs to summarize a large amount of data, a first preset operation can be executed. The first preset operation may be set according to actual needs, and is not limited herein, for example, the first preset operation may be clicking a first preset control, that is, if the terminal device detects that the user clicks the first preset control on the terminal device, it is considered that the first preset operation is detected, that is, a large amount of data needs to be summarized, so that the terminal device may obtain the service data and determine effective information of each piece of data in the service data.
Of course, the first preset operation may also be a time-triggered operation, and the terminal device may be configured with a corresponding data processing flow during running, where the data processing flow includes trigger nodes of a plurality of key events, where the key events include data summarization events, and in this case, if the terminal device detects that the trigger node associated with the data summarization event is reached, the operations in steps S101 to S104 are executed to perform the summarization operation on the service data.
It should be noted that the service data includes a plurality of pieces of data, and each piece of data may include user information and service information. The user information can be a user number or a user name, and the user number can be a user mobile phone number, an identity card number or a user serial number. Wherein, the user serial number refers to the member number of the user in the preset APP. The service information may include, but is not limited to: service type, service time, service amount, service location, service number, and the like.
In an implementation manner of the embodiment of the application, the terminal device may obtain the service data in advance, store the service data in its own database, and directly obtain the service data from its own database when the terminal device detects the first preset operation.
In another implementation manner of the embodiment of the present application, the terminal device may obtain the service data in real time through a server connected to the terminal device in wireless communication/wired communication. The server can be a computer or a notebook, a cloud server and other devices.
In some possible implementation manners, in order to improve the working efficiency of the terminal device, the data in the database is summarized at regular time, and the terminal device may acquire the service data at preset time intervals and perform the operations of steps S101 to S104. In an exemplary embodiment, each company performs related arrangement and summarization on each business of the company in units of months, so that the preset time interval may be set to one month.
It should be noted that the valid information determined by the terminal device specifically refers to valid information corresponding to all data in the service data acquired by the terminal device, that is, the valid information of each piece of data in the service data is uniform. The valid information refers to key information of all data in the service data or data exceeding a preset number threshold, such as user information, service amount and the like.
For example, assuming that the terminal device obtains three pieces of data, one piece of data includes information such as a service type, a service time, a service number, and user information corresponding to the data, another piece of data includes information such as a service type, a service time, a service number, a service amount, and user information corresponding to the data, and another piece of data includes information such as a service type, a service time, a service number, a service location, and user information corresponding to the data, valid information corresponding to service data formed by the three pieces of data may be: the service type, the service time and the user information corresponding to the data.
In this embodiment of the present application, the valid information corresponding to the service data may be: the service type, the service time and the user information corresponding to each piece of data may also be: the type of service, the amount of service, and the time of service, which are not limited herein.
For example, taking the business data as the order data as an example, each piece of data in the order data includes: the terminal device can determine the user number, the consumption type and the consumption time as effective information of the order data, and can also determine the consumption type, the consumption time and the consumption amount as effective information of the order data.
It should be noted that, in different application scenarios, the effective information of the service data required by the terminal device is also different, so in an embodiment of the present application, the terminal device may specifically determine the effective information of the service data through steps S201 to S202 shown in fig. 2, which are detailed as follows:
in S201, determining a summary scene corresponding to the service data according to the parameter information; the parameter information is obtained by user input.
In S202, the effective information of the service data is obtained according to the summary scene and the corresponding relationship between the preset summary scene and the effective information.
In an implementation manner of this embodiment, a plurality of second preset controls may be provided in a preset APP about data summarization installed on a terminal device, and each second preset control may correspond to a preset parameter. For example, assuming that a first preset control a1, a first preset control a2 and a first preset control A3 are provided in the preset APP, and the preset parameters include a time parameter, a money amount parameter and a time + money amount parameter, the terminal device may set the preset parameter corresponding to the first preset control a1 as the time parameter, the preset parameter corresponding to the first preset control a2 as the money amount parameter, and the preset parameter corresponding to the first preset control A3 as the time + money amount parameter.
It should be noted that each preset parameter corresponds to a preset summary scene. The preset summary scenarios include, but are not limited to: a time summary scenario, a sum summary scenario, and a time + sum summary scenario. The time summarizing scene refers to a scene in which the terminal device needs to summarize the service data according to the time of data generation of each user. The sum summary scene refers to a scene in which the terminal device needs to summarize the service data according to the sum generated by the data corresponding to each user. The time + money sum scene means that the terminal equipment needs to sum the service data according to the time of generating data by different users and the money generated by the data. Therefore, the preset summarizing scene corresponding to the time parameter may be a time summarizing scene, the preset summarizing scene corresponding to the money amount parameter may be a money amount summarizing scene, and the preset summarizing scene corresponding to the time + money amount parameter may be a time + money amount summarizing scene.
Based on this, when detecting that the user clicks a second preset control in the preset APP, the terminal device may acquire parameter information corresponding to the control, and determine a summary scene corresponding to the service data according to a corresponding relationship between the preset parameter and the preset summary scene.
In another implementation manner of this embodiment, the user may directly input parameter information within the preset APP, such as "time", "amount", or "time + amount". After detecting the parameter information, the terminal device may directly determine a summary scene corresponding to the service data according to the obtained parameter information.
In this embodiment, different preset summary scenes may correspond to different effective information. The valid information includes but is not limited to: the first valid information, the second valid information and the third valid information. The first effective information includes: the service type, the service time and the user information corresponding to each piece of data, and the second effective information includes: the service type, the service amount and the user information corresponding to each piece of data, and the third effective information comprises: service type, service time, and service amount. The time summarizing scene refers to a scene that the terminal device needs to summarize the service data according to the time of the data generated by each user, the money summarizing scene refers to a scene that the terminal device needs to summarize the service data according to the money generated by the service data corresponding to each user, and the time + money summarizing scene refers to a scene that the terminal device needs to summarize the service data according to the time of the data generated by each user and the money generated by the data. The terminal device may perform association storage on the preset corresponding relationship between the preset summary scene and the valid information.
Based on this, after determining the summary scene corresponding to the service data, the terminal device may determine the effective information of the service data according to the preset corresponding relationship between the preset summary scene and the effective information.
In another embodiment of the present application, since each piece of service data has a different format and contains different original information, in order to obtain uniform valid information, the terminal device may specifically execute steps S301 to S303 shown in fig. 3, which are described as follows:
in S301, original information of each piece of data in the service data is obtained.
In S302, the original information is standardized according to a preset rule, so as to obtain standard information of the service data.
In S303, the standard information is compared with a plurality of pieces of historical effective information stored in advance one by one, and the effective information of the service data is obtained according to the comparison result.
The preset rule may be set according to actual needs, and is not limited herein, and for example, the preset rule may be: the data information of each piece of data in the service data uniformly comprises information such as service type, service time, service amount, user information corresponding to the data and the like.
It should be noted that, when some data in the service data does not have the certain information, the terminal device may set a field corresponding to the certain information in the standard information of the service data to null (null) to indicate that the certain data in the service data does not have the certain information.
The original information includes but is not limited to: the service location, the service number, the service type, the service time, the service amount and the user information corresponding to the data corresponding to each piece of data.
In this embodiment, because the original information of each piece of data in the service data is obtained from other devices, the format of the original information provided by the other devices does not conform to the format required by the terminal device, and invalid information may exist in the original information, the terminal device needs to perform normalization processing on the original information of each piece of data in the obtained service data to obtain standard information required by the terminal device.
In this embodiment, the terminal device may compare the standard information of the service data with a plurality of pieces of historical valid information stored in advance in the terminal device one by one, so as to obtain a comparison result. The comparison result comprises a first comparison result and a second comparison result, the first comparison result is used for describing that the standard information is completely the same as certain historical effective information, and the second comparison result is used for describing that the standard information is not completely the same as a plurality of pieces of historical effective information.
It should be noted that the standard information of the service data may include a plurality of pieces of sub information that are not empty, such as user information, service type, service time, service amount, and the like, and each piece of history valid information may also include a plurality of pieces of history sub information, such as history user information, history service type, history service time, and the like. Therefore, the terminal device can compare the sub information which is not empty in the standard information of the service data with the history sub information in each history effective information one by one. And the terminal equipment determines to obtain a first comparison result when detecting that all pieces of sub information which are not empty in the standard information are completely the same as all pieces of historical sub information of certain historical effective information. And the terminal equipment determines to obtain a second comparison result when detecting that all pieces of sub information which are not empty in the standard information are not completely the same as all pieces of history sub information of any history effective information.
In an embodiment of the application, when detecting that each piece of sub information not empty in the standard information is the same as each piece of history sub information in a certain piece of history valid information, the terminal device indicates that the standard information is completely the same as the history valid information, that is, a first comparison result is obtained, and therefore, the terminal device can directly determine the standard information as valid information.
In another embodiment of the present application, when detecting that each piece of sub information not empty in the standard information is not identical to each piece of history sub information in any one piece of history valid information, the terminal device indicates that the standard information is not identical to all pieces of history valid information, and obtains the second comparison result, so that the terminal device can obtain the same piece of history sub information as each piece of sub information not empty in the standard information in all pieces of history valid information, and determine valid information of service data according to the occurrence frequency of each piece of same history sub information.
In an implementation manner of this embodiment, the terminal device may determine all the same history sub information as valid information of the service data.
In another implementation manner of this embodiment, after obtaining the occurrence frequency of each identical history sub-information, the terminal device may sort each identical history sub-information in order from high to low in the occurrence frequency. After sorting, the terminal device may determine the history sub information ranked in the top by a preset number as the effective information of the service data. The preset number may be set according to actual needs, and is not limited herein, and for example, the preset number may be set to three.
For example, it is assumed that the first historically valid information may include three pieces of historical sub-information, namely historical user information, historical service time and historical service type, the second historically valid information may include three pieces of historical sub-information, namely historical service time, historical service type and historical service amount, and the third historically valid information may include four pieces of historical sub-information, namely historical user information, historical service time, historical service type and historical service location. With reference to S202, since the standard information includes four pieces of sub information, i.e., the service type, the service time, the service amount, and the user information corresponding to the data, the terminal device may determine that the history sub information, which is the same as each piece of sub information in the standard information, in the plurality of pieces of history valid information is: historical user information, historical service time, historical service type and historical service amount. At this time, the terminal device may calculate the frequency of occurrence of each identical history sub-information: the historical user information appears 2 times, the historical service time appears 3 times, the historical service type appears 3 times, and the historical service amount appears 1 time. When the preset number is three, it may be determined that the valid information includes: user information, service type and service time.
In S102, a summary template is generated according to the valid information.
In the embodiment of the application, after the terminal device obtains the effective information of each piece of data in the service data, the terminal device can determine the attributes of multiple dimensions corresponding to the effective information, and generate the summarizing template according to the attributes of the multiple dimensions. And the attribute is used for representing the corresponding property of each piece of sub information in the effective information. For example, it is assumed that valid information of a certain piece of data is specifically: the user information is name zhang san, the service time is july twenty days, and the service type is life consumption, then the terminal device can determine that the attributes of the multiple dimensions corresponding to the valid information are respectively: name, business time, and business type. The effective information of a certain piece of data is assumed to be specifically: the user information is a mobile phone number 139XXXXXXXX, the service time is june twenty days, and the service type is life consumption, then the terminal device may determine that the attributes of multiple dimensions corresponding to the valid information are: mobile phone number, service time and service type.
At this time, the attributes of the multiple dimensions corresponding to the valid information are respectively the feature information: name, service time and service type, therefore, the summary template generated by the terminal device may be: $ { userId } __ $ { period } _ $ bizType }.
In some possible embodiments, it is assumed that the attributes of the multiple dimensions corresponding to the valid information are: name, service time and service amount, the summary template generated by the terminal device may be: $ userId _ $ period _ $ month }.
In other possible embodiments, it is assumed that the attributes of the multiple dimensions corresponding to the valid information are: the mobile phone number, the service time, the service type and the service amount, the summary template generated by the terminal device may be: $ { userPhone } _$ { period } _$ $ { bizType } _$ $ { monetary }.
In an embodiment of the present application, in combination with S303, the terminal device may store a correspondence between the history valid information and the history summarizing template in advance, so that after determining the valid information of the service data according to the history valid information, the terminal device may determine the summarizing template corresponding to the valid information of the service data according to the correspondence between each piece of history valid information and the history summarizing template stored in advance.
In an implementation manner of this embodiment, in combination with S303, when detecting that the standard information of the service data is completely the same as a certain history valid information, the terminal device may directly determine a history summary template corresponding to the history valid information that is completely the same as the standard information as a summary template corresponding to the valid information.
In S103, a service identifier corresponding to each piece of data in the service data is determined according to the summary template.
In an embodiment of the present application, the terminal device may determine a service identifier corresponding to each day of data in the service data according to the summary template and the preset template engine.
In practice, the template engine is provided to separate the user interface from the business data (content), and can generate a document in a specific format, for example, the template engine for a website generates a standard HTML document.
In an implementation manner of this embodiment, the preset template engine may be a freemarker, and the freemarker is a general tool for generating a text in a specific format based on a template file.
In an embodiment of the present application, the terminal device may specifically obtain the service identifier through steps S401 to S402 shown in fig. 4, which are detailed as follows:
in S401, a plurality of feature information of each piece of data is obtained according to the summary template and the preset template engine.
In this embodiment, after the terminal device obtains the summary template, each piece of data may be sequentially imported into the summary template, and multiple pieces of feature information of each piece of data are obtained under the driving of the preset template engine. Specifically, after each piece of data is sequentially imported into the summarizing template, the terminal device can drive the summarizing template with the data by using a preset template engine, so that a plurality of pieces of feature information corresponding to each piece of data are extracted.
For example, assuming that the summary template is $ { userId } __ $ { period } _ bizType }, a piece of data is specifically represented as: the service number XXX, the user information is user a, the service time is october twenty days, the service type is life consumption, the service amount is 200 yuan, and the service location is XX city, then the corresponding characteristic information is: user information: user a, service time: august, service type: and (4) living and consumption.
In S402, the multiple pieces of feature information are combined to obtain a service identifier corresponding to each piece of data.
In this embodiment, in combination with S401, the plurality of feature information corresponding to one piece of data are user information, service time, service type, and service amount, so that the terminal device may combine the feature information according to a combination manner in which the user information is a first order, the service type is a second order, and the service time is a third order, to obtain a service identifier corresponding to the piece of data. For example, if the user information corresponding to a certain piece of data is user a, the service type is life consumption, and the service time is january, the corresponding service identifier is: user a _ life consumption _ january.
For example, taking service data as order data as an example, assuming that the database includes order data of each user in any consumption type (such as air ticket, hotel, etc.) in one year, and valid information corresponding to all the order data is user information, consumption type and consumption time, the service identifier corresponding to the first piece of order data may be: the service identifier corresponding to the second piece of order data of the user a _ air ticket _ august may be: the service identifier corresponding to the third piece of order data of the user a _ air ticket _ august may be: the service identifier corresponding to the fourth order data of the user b _ hotel _ august may be: user b _ air ticket _ august.
In S104, summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification.
In the embodiment of the application, after the terminal device obtains the service identifier corresponding to each piece of data, the terminal device can directly perform summary processing on the service data according to the service identifier, classify all pieces of data with the same service identifier into one type, and sequentially form the service detail list, so that the service detail lists with a plurality of different service identifiers can be obtained.
For example, taking the service data as the order data as an example, it is assumed that the service identifier corresponding to the first piece of order data is: the user a _ air ticket _ august, and the service identifier corresponding to the second piece of order data is as follows: and the service identifier corresponding to the third order data is as follows: the user b _ hotel _ august, and the service identifier corresponding to the fourth order data is as follows: the user b _ air ticket _ august, the terminal device may identify the service as: the first order data and the second order data of the user a _ air ticket _ august are classified into one class, and the service identifier is formed as follows: a business list of a user a _ air ticket _ august; the terminal device may also separately identify the service as: the third piece of order data of the user b _ Hotel _ August is classified into one type, and the service identifier is formed as follows: a service detail table of a user b _ Hotel _ August; the terminal device may also separately identify the service as: the order data of the user b _ air ticket _ august on the fourth day are classified into one class, and the service identifier is formed as follows: and the business list of the user b _ air ticket _ august.
In an embodiment of the present application, after obtaining the service detail table, the terminal device may determine the service identifier of the service detail table as a table name of the service detail table, and store the table name in the database, so as to facilitate subsequent query.
In another embodiment of the present application, the terminal device may store the service detail table and the service identifier corresponding to the service detail table in association with each other in the database.
In another embodiment of the present application, after the terminal device obtains the service detail table, when a relevant person needs to query service data corresponding to a certain user, a data query request may be triggered.
In this embodiment, the data query request triggered by the terminal device detecting the relevant person may be: and detecting that the related personnel trigger a second preset operation. The second preset operation may be determined according to actual requirements, and is not limited herein. For example, the second preset operation may be to click a third preset control, that is, if the terminal device detects that the related person clicks the third preset control, the terminal device considers that the second preset operation is triggered, that is, the terminal device considers that the related person is detected to trigger the data query request.
In an implementation manner of this embodiment, relevant personnel may directly input their relevant service identifiers on a display interface of the terminal device, that is, a data query request is triggered.
After receiving the data query request, the terminal device may extract the target service identifier from the data query request, determine the target service detail list corresponding to the target service identifier according to the corresponding relationship between each service identifier and the service detail list, and display the target service detail list. At this time, the relevant person can view the target service list.
For example, assuming that a relevant person needs to query service data about a hotel when a user a is in august, the "user a _ hotel _ august" may be directly input on a display interface of the terminal device, and when the terminal device receives a service identifier of the "user a _ hotel _ august", the service detail table with a table name of "user a _ hotel _ august" may be determined to have service data required by the relevant person according to the service identifier, and the service detail table is displayed.
As can be seen from the above, according to the data summarization method provided by the embodiment of the application, by determining the effective information of each piece of data in the obtained service data, the summarization condition, i.e., the summarization template, corresponding to the effective information of the service data can be directly generated according to the effective information of the service data, and therefore, pre-coding is not required, and the operation is simple; and then, the service identifier of each piece of data in the service data can be determined according to the summarizing template, so that the data with the same service identifier can be summarized to obtain a service data table. In the data summarization method provided by the application, the summarization template is not fixed and can be flexibly changed according to the effective information of the acquired service data, the application range is wide, and the data summarization efficiency is improved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
Corresponding to the data summarization method described in the foregoing embodiments, fig. 5 shows a block diagram of a data summarization device provided in an embodiment of the present application, and for convenience of description, only the portions related to the embodiment of the present application are shown. Referring to fig. 5, the data summarization apparatus 500 includes: a first acquisition unit 51, a first generation unit 52, a first determination unit 53, and a first processing unit 55. Wherein:
the first obtaining unit 51 is configured to obtain service data and determine valid information of each piece of data in the service data.
The first generating unit 52 is configured to generate a summary template according to the valid information.
The first determining unit 53 is configured to determine, according to the summary template, a service identifier corresponding to each piece of data in the service data.
The first processing unit 54 is configured to perform summarization processing on the service data according to the service identifier to obtain a service data table; the service data table is composed of various data with the same service identification.
In an embodiment of the present application, the first obtaining unit 51 specifically includes: a second determination unit and a third determination unit. Wherein:
the second determining unit is used for determining a summary scene corresponding to the service data according to the parameter information; the parameter information is obtained by user input.
And the third determining unit is used for obtaining the effective information of the service data according to the summary scene and the corresponding relation between the preset summary scene and the effective information.
In an embodiment of the present application, the first obtaining unit 51 specifically includes: the device comprises a second acquisition unit, a second processing unit and a fourth determination unit. Wherein:
the second obtaining unit is used for obtaining the original information of each piece of data in the service data.
And the second processing unit is used for carrying out standardization processing on the original information according to a preset rule to obtain standard information of the service data.
The fourth determining unit is used for comparing the standard information with a plurality of pieces of historical effective information stored in advance one by one, and obtaining the effective information of the service data according to the comparison result.
In an embodiment of the application, the fourth determining unit specifically includes: a fifth determination unit.
The fifth determining unit is configured to determine the standard information as the valid information when detecting that there is history valid information identical to the standard information in the plurality of history valid information.
Accordingly, the first generating unit 52 specifically includes: a sixth determination unit.
And the sixth determining unit is used for determining the summarizing template corresponding to the effective information according to the corresponding relation between the pre-stored effective historical information and the historical summarizing template.
In an embodiment of the present application, the first determining unit 53 specifically includes: a seventh determining unit and a combining unit. Wherein:
and the seventh determining unit is used for obtaining a plurality of characteristic information of each piece of data according to the summarizing template and the preset template engine.
The combination unit is used for combining the plurality of characteristic information to obtain the service identifier corresponding to each piece of data.
In one embodiment of the present application, the data summarization device 500 further comprises: and a memory unit.
The storage unit is used for storing the service identification and the service data table into a database in a correlation manner.
In one embodiment of the present application, the data summarization device 500 further comprises: a receiving unit and a display unit. Wherein:
the receiving unit is used for receiving a data query request; the data query request carries a target service identifier.
And the display unit is used for acquiring a target service data table corresponding to the target service identifier from the database based on the target service identifier and displaying the target service data table.
As can be seen from the above, according to the data summarization device provided in the embodiment of the present application, by determining the effective information of each piece of data in the obtained service data, a summarization condition, i.e., a summarization template, corresponding to the effective information of the service data can be directly generated according to the effective information of the service data, and therefore, pre-coding is not required, and the operation is simple; and then, the service identifier of each piece of data in the service data can be determined according to the summarizing template, so that the data with the same service identifier can be summarized to obtain a service data table. In the data summarization method provided by the application, the summarization template is not fixed and can be flexibly changed according to the effective information of the acquired service data, the application range is wide, and the data summarization efficiency is improved.
Fig. 6 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 6, the terminal device 6 of this embodiment includes: at least one processor 60 (only one shown in fig. 6), a memory 61, and a computer program 62 stored in the memory 61 and executable on the at least one processor 60, wherein the processor 60 executes the computer program 62 to implement the steps in any of the above-described data summarization method embodiments.
Those skilled in the art will appreciate that fig. 6 is only an example of the terminal device 6, and does not constitute a limitation to the terminal device 6, and may include more or less components than those shown, or combine some components, or different components, such as an input/output device, a network access device, and the like.
The Processor 60 may be a Central Processing Unit (CPU), and the Processor 60 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may in some embodiments be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6 in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are equipped on the terminal device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 61 is used for storing an operating system, an application program, a BootLoader (BootLoader), data, and other programs, such as program codes of the computer program. The memory 61 may also be used to temporarily store data that has been output or is to be output.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in any of the above data summarizing method embodiments may be implemented.
The embodiment of the present application provides a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in any of the above data summarization method embodiments when executed.
It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in any of the above data summarizing method embodiments may be implemented.
The embodiment of the present application provides a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in any of the above data summarization method embodiments when executed.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one first processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed data summarization device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims (10)

1. A method for summarizing data, comprising:
acquiring service data and determining effective information of each piece of data in the service data;
generating a summary template according to the effective information;
determining a service identifier corresponding to each piece of data in the service data according to the summarizing template;
summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification.
2. The data summarization method of claim 1, wherein the obtaining the service data and determining the valid information of each piece of data in the service data comprises:
determining a summary scene corresponding to the service data according to the parameter information; the parameter information is input by a user;
and obtaining the effective information of the service data according to the summary scene and the corresponding relation between the preset summary scene and the effective information.
3. The data summarization method of claim 1, wherein the obtaining the service data and determining the valid information of each piece of data in the service data comprises:
acquiring original information of each piece of data in the service data;
standardizing the original information according to a preset rule to obtain standard information of the service data;
and comparing the standard information with a plurality of pieces of historical effective information stored in advance one by one, and obtaining the effective information of the service data according to the comparison result.
4. The data summarization method of claim 3, wherein comparing the standard information with a plurality of pre-stored historical effective information one by one, and obtaining the effective information of the service data according to the comparison result, comprises:
when detecting that the plurality of pieces of history effective information have the history effective information which is completely the same as the standard information, determining the standard information as the effective information;
the generating a summary template according to the effective information includes:
and determining a summary template corresponding to the effective information according to the corresponding relation between the pre-stored effective historical information and the historical summary template.
5. The data summarization method of claim 1, wherein the determining the service identifier corresponding to each piece of data in the service data according to the summarization template comprises:
obtaining a plurality of characteristic information of each piece of data according to the summarizing template and a preset template engine;
and combining the plurality of characteristic information to obtain a service identifier corresponding to each piece of data.
6. The data summarization method according to any one of claims 1 to 5, wherein after the summarizing the service data according to the service identifier to obtain a service data table, the method further comprises:
and storing the service identification and the service data table in a database in a correlation manner.
7. The data summarization method according to claim 6, wherein after the summarization processing is performed on the service data according to the service identifier to obtain a service data table, the method further comprises:
receiving a data query request; the data query request carries a target service identifier;
and acquiring a target service data table corresponding to the target service identifier from the database based on the target service identifier, and displaying the target service data table.
8. A data summarization device, comprising:
the first acquisition unit is used for acquiring service data and determining effective information of each piece of data in the service data;
the first generating unit is used for generating a summary template according to the effective information;
a first determining unit, configured to determine, according to the summary template, a service identifier corresponding to each piece of data in the service data;
the first processing unit is used for summarizing the service data according to the service identification to obtain a service data table; the service data table is composed of various data with the same service identification.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the data summarization method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the data summarization method according to any one of claims 1 to 7.
CN202111550275.9A 2021-12-17 2021-12-17 Data summarizing method and device and terminal equipment Pending CN114168599A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111550275.9A CN114168599A (en) 2021-12-17 2021-12-17 Data summarizing method and device and terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111550275.9A CN114168599A (en) 2021-12-17 2021-12-17 Data summarizing method and device and terminal equipment

Publications (1)

Publication Number Publication Date
CN114168599A true CN114168599A (en) 2022-03-11

Family

ID=80487152

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111550275.9A Pending CN114168599A (en) 2021-12-17 2021-12-17 Data summarizing method and device and terminal equipment

Country Status (1)

Country Link
CN (1) CN114168599A (en)

Similar Documents

Publication Publication Date Title
CN108427705B (en) Electronic device, distributed system log query method and storage medium
CN111782943A (en) Information recommendation method, device, equipment and medium based on historical data record
CN110532799B (en) Data desensitization control method, electronic device and computer readable storage medium
CN110597511B (en) Page automatic generation method, system, terminal equipment and storage medium
CN103077344A (en) Terminal and method for providing risk of application using the same
CN108388512B (en) Data processing method and server
CN109740129B (en) Report generation method, device and equipment based on blockchain and readable storage medium
CN111130987A (en) Automatic acquisition method and device for AWR report, electronic equipment and storage medium
CN109491733B (en) Interface display method based on visualization and related equipment
CN103279576A (en) Method for carrying out a distributed search
CN115329177A (en) Data processing method, device, storage medium and program product
KR101614890B1 (en) Method of creating multi tenancy history, server performing the same and storage media storing the same
CN109544207A (en) A kind of information processing method, storage medium and server
CN113609409A (en) Method and system for recommending browsing information, electronic device and storage medium
CN111767481B (en) Access processing method, device, equipment and storage medium
CN116993523A (en) Configurable account checking method, device, equipment and storage medium
CN111142863A (en) Page generation method and device
CN114168599A (en) Data summarizing method and device and terminal equipment
CN112052267B (en) Data query method, equipment, server and storage medium
CN114742547A (en) Internet online collection control method, device, medium and electronic equipment
CN113901046A (en) Virtual dimension table construction method and device
CN114237798A (en) Data processing method, device, server and storage medium
US20150169776A1 (en) System and method for displaying contextual data respective of events
CN112612817A (en) Data processing method and device, terminal equipment and computer readable storage medium
CN109828983A (en) PG data base processing method, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination