CN115204251A - Data processing method and device, electronic equipment and storage medium - Google Patents

Data processing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN115204251A
CN115204251A CN202210554125.3A CN202210554125A CN115204251A CN 115204251 A CN115204251 A CN 115204251A CN 202210554125 A CN202210554125 A CN 202210554125A CN 115204251 A CN115204251 A CN 115204251A
Authority
CN
China
Prior art keywords
information
terminal
category set
data
target object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210554125.3A
Other languages
Chinese (zh)
Inventor
王彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
Original Assignee
China Construction Bank Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Construction Bank Corp filed Critical China Construction Bank Corp
Priority to CN202210554125.3A priority Critical patent/CN115204251A/en
Publication of CN115204251A publication Critical patent/CN115204251A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application relates to the technical field of data analysis, and discloses a data processing method, a data processing device, electronic equipment and a storage medium, which are used for reducing the data processing amount of a management terminal. In the application, a target instruction is generated based on user requirements, and the target instruction is issued to each terminal; receiving a first information table reported by each terminal, and classifying first data in the first information table reported by each terminal to obtain at least one category set; for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set; summarizing each sorted category set to obtain a summary table; and the summary table is sent to each terminal, so that each terminal processes the target object based on the summary table. The management terminal only needs to collect the data required by the user and reported by each terminal, and sends the collected summary list to each terminal, so that the data processing amount of the management terminal is reduced.

Description

Data processing method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of data analysis technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.
Background
With the rapid development of data analysis, more and more organizations need to be managed by the management end. For example, a certificate Authority may require management of four thousand to five thousand listed companies. Since each organization has huge business data, a large amount of data is stored across organizations for the management end, and the management end is difficult to manage all the data.
Disclosure of Invention
The application aims to provide a data processing method, a data processing device, an electronic device and a storage medium, which are used for reducing the data processing amount of a management end.
In a first aspect, an embodiment of the present application provides a data processing method, where the method includes:
generating a target instruction based on user requirements, and issuing the target instruction to each terminal;
receiving a first information table reported by each terminal, and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise an identity of a target object obtained by a terminal through screening according to the target instruction and first information associated with the identity, and each category set comprises the identity of the target object and the first information associated with the identity;
for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set;
summarizing each sorted category set to obtain a summary table; the summary table comprises target objects reported by the terminals, identity marks of the target objects at the terminals, and first information related to the identity marks;
and sending the summary table to each terminal so that each terminal processes the target object based on the summary table.
In the application, the instruction is generated based on the requirement of the user and is used for indicating the terminal to report the data required by the user, so that the data volume reported by each terminal is reduced; in the application, the management terminal only needs to collect the data required by the user and reported by each terminal, and sends the collected collection table to each terminal, so that the data processing amount of the management terminal is reduced.
In some possible embodiments, before performing the classification processing on the first data in the first information table reported by each terminal, the method further includes:
for each first information in the first information table, determining an attribute of the first information;
if the attribute of the first information is a character, determining a preset zone bit according to the meaning of the character representation;
taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information; the preset zone bit is used for sequencing first information with characters as attributes in the first data in the category set.
In the application, the first information with the replacement attribute of the characters is taken as the preset mark, so that the first information can be conveniently sequenced.
In some possible embodiments, for each category set, the sorting, according to a preset order, first information in first data in the category set includes:
determining a sorting mode of the preset sequence according to the category of the category set;
and sorting the first information in the category set according to the sorting mode of the preset sequence.
In the present application, in order to facilitate the screening out of the specified first information according to the order, the first information is sorted in a preset order.
In some possible embodiments, before the classifying the first data in the first information table reported by each terminal to obtain at least one category set, the method further includes:
and performing deduplication processing on the first data in the first information table reported by each terminal to obtain deduplicated first data.
In the method and the device, before the first data are classified, the first data are subjected to deduplication operation, so that the data unicity is guaranteed, and the data volume is further reduced for the subsequent generation of the summary table.
In some possible embodiments, the summarizing each sorted category set to obtain a summary table includes:
extracting a target object in the first information table reported by each terminal, and performing duplicate removal operation on the target object;
extracting the identity of the target object in the first information table reported by each terminal;
for each target object, determining first information associated with the identity of the target object from each category set, and summarizing the first information associated with the identity of the target object determined from each category set to obtain summarized first information;
the de-duplicated target object, the identity of the target object in the first information table reported by each terminal, and the summarized first information form the summary table.
In the method and the device, a summary table is generated according to the target object after the duplication removal, the identity of the target object in the first information table reported by each terminal and the summarized first information, and each terminal is convenient to screen out the target user according to the summary table.
In a second aspect, the present application further provides a data processing apparatus, comprising:
the command issuing module is used for generating a target command based on user requirements and issuing the target command to each terminal;
the receiving module is used for receiving a first information table reported by each terminal and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise an identity of a target object obtained by a terminal through screening according to the target instruction and first information associated with the identity, and each category set comprises the identity of the target object and the first information associated with the identity;
the sorting module is used for sorting the first information in the first data in the category sets according to a preset sequence aiming at each category set to obtain a sorted category set;
the summarizing module is used for summarizing each sorted category set to obtain a summarizing table; the summary table comprises target objects reported by the terminals, identity marks of the target objects at the terminals, and first information related to the identity marks;
and the summary table issuing module is used for issuing the summary table to each terminal so that each terminal processes the target object based on the summary table.
In some possible embodiments, before the receiving module performs the classification processing on the first data in the first information table reported by each terminal, the receiving module is further configured to:
for each first information in the first information table, determining an attribute of the first information;
if the attribute of the first information is a character, determining a preset zone bit according to the meaning represented by the character;
taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information; the preset zone bit is used for sequencing first information with characters as attributes in first data in the category set.
In some possible embodiments, the sorting module, when sorting the first information in the first data in the category sets according to a preset order for each category set, is configured to:
determining a sorting mode of the preset sequence according to the category of the category set;
and sorting the first information in the category set according to the sorting mode of the preset sequence.
In some possible embodiments, before the receiving module performs classification processing on the first data in the first information table reported by each terminal to obtain at least one category set, the receiving module is further configured to:
and performing duplicate removal processing on the first data in the first information table reported by each terminal to obtain the duplicate-removed first data.
In some possible embodiments, the summarization module, when performing summarization on each sorted category set to obtain a summary table, is configured to:
extracting a target object in the first information table reported by each terminal, and performing duplicate removal operation on the target object;
extracting the identity of the target object in the first information table reported by each terminal;
for each target object, determining first information associated with the identity of the target object from each category set, and summarizing the first information associated with the identity of the target object determined from each category set to obtain summarized first information;
the de-duplicated target object, the identity of the target object in the first information table reported by each terminal, and the summarized first information form the summary table.
In a third aspect, another embodiment of the present application further provides an electronic device, including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform any one of the methods provided by the embodiments of the first aspect of the present application.
In a fourth aspect, another embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and the computer program is configured to cause a computer to execute any one of the methods provided in the first aspect of the present application.
In a fifth aspect, another embodiment of the present application further provides a computer program product, including: computer program code for causing a computer to perform any of the methods provided in embodiments of the first aspect of the present application when said computer program code is run on a computer.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is an application scenario diagram of a data processing method according to an embodiment of the present application;
fig. 2 is an overall flowchart of a data processing method according to an embodiment of the present application;
fig. 3 is a schematic diagram of an instruction input interface of a data processing method according to an embodiment of the present application;
fig. 4 is a first information representation intention of a data processing method according to an embodiment of the present application;
fig. 5 is a schematic flowchart illustrating a process of sorting first information in a data processing method according to an embodiment of the present application;
fig. 6 is a first information representation intention after replacing first information with a flag bit in a data processing method according to an embodiment of the present application;
fig. 7 is an intention to update first information in a data processing method according to an embodiment of the present application;
fig. 8 is a first information representation intention received by a data processing method according to an embodiment of the present application;
FIG. 9 is a schematic diagram illustrating a classification process of a data processing method according to an embodiment of the present application;
fig. 10 is a schematic diagram of a data processing method according to an embodiment of the present application, which is directed to a first information sorting;
fig. 11 is a schematic flowchart of obtaining a summary table in a data processing method according to an embodiment of the present application;
fig. 12 is a schematic diagram of a summary table of a data processing method according to an embodiment of the present application;
fig. 13 is another schematic diagram of a summary table of a data processing method according to an embodiment of the present application;
fig. 14 is a schematic storage diagram of a data processing method according to an embodiment of the present application;
fig. 15 is a schematic diagram of a data processing method according to an embodiment of the present application;
fig. 16 is a schematic view of an electronic device according to a data processing method provided in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions in the embodiments of the present application will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application. In the present application, the embodiments and features of the embodiments may be arbitrarily combined with each other without conflict. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
The terms "first" and "second" in the description and claims of the present application and the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the term "comprises" and any variations thereof, which are intended to cover non-exclusive protection. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The term "a plurality" in the present application may mean at least two, for example, two, three or more, and the embodiments of the present application are not limited.
In the technical scheme, the data acquisition, transmission, use and the like meet the requirements of relevant national laws and regulations.
The inventor researches and discovers that with the rapid development of data analysis, the organizations which the management end needs to manage are increased. Taking a certificate authority as an example, four thousand to five thousand listed companies need to be managed. Since each organization has huge business data, a large amount of data is stored across organizations for the management end, and the management end is difficult to manage all the data.
In view of the above, the present application provides a data processing method, an apparatus, an electronic device and a storage medium, which are used to solve the above problems. The inventive concept of the present application can be summarized as follows: generating a target instruction based on user requirements, and issuing the target instruction to each terminal; receiving a first information table reported by each terminal, and classifying first data in the first information table reported by each terminal to obtain at least one category set; for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set; summarizing each sorted category set to obtain a summary table; and the summary table is issued to each terminal, so that each terminal processes the target object based on the summary table.
For convenience of understanding, a data processing method provided by the embodiments of the present application is described in detail below with reference to the accompanying drawings:
fig. 1 is a diagram of an application scenario of the data processing method in the embodiment of the present application. The figure includes: server 10, memory 20, terminal 30; wherein:
the server 10 is a server at a management end, and the server 10 generates a target instruction based on a user requirement and sends the target instruction to each terminal 30; receiving a first information table reported by each terminal 30, and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise the identity of the target object and the first information related to the identity, which are obtained by the terminal through screening according to the target instruction, and each category set comprises the identity of the target object and the first information related to the identity; for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set; summarizing each sorted category set to obtain a summary table, and storing the summary table in a memory 20; the summary table includes the target object reported by each terminal 30, the identity of the target object at each terminal, and the first information associated with the identity; and issuing the summary table to each terminal 30, so that each terminal 30 processes the target object based on the summary table.
The description in this application only details a single server 10, memory 20, terminal 30, but it will be understood by those skilled in the art that the illustrated server 10, memory 20, terminal 30 are intended to represent the operations of the server 10, memory 20, terminal 30 that are involved in the technical aspects of this application. And is not meant to imply a limitation on the number, type or location of servers 10, memories 20, terminals 30, etc. It should be noted that the underlying concepts of the example embodiments of the present application may not be altered if additional modules are added or removed from the illustrated environments. In addition, it is understood by those skilled in the art that the above-mentioned data transmission and reception also need to be realized through a network.
It should be noted that the storage in the embodiment of the present application may be, for example, a cache system, or a hard disk storage, a memory storage, and the like. In addition, the data processing method provided by the application is not only suitable for the application scenario shown in fig. 1, but also suitable for any device with data processing requirements.
As shown in fig. 2, an overall flowchart of a data processing method provided in an embodiment of the present application is shown, where:
in step 201: generating a target instruction based on user requirements, and issuing the target instruction to each terminal;
in step 202: receiving a first information table reported by each terminal, and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise the identity of the target object and the first information related to the identity, which are obtained by the terminal through screening according to the target instruction, and each category set comprises the identity of the target object and the first information related to the identity;
in step 203: for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set;
in step 204: summarizing each sorted category set to obtain a summary table; the summary table comprises target objects reported by all terminals, identity marks of the target objects at all terminals and first information related to the identity marks;
in step 205: and sending the summary table to each terminal so that each terminal processes the target object based on the summary table.
In the application, the instruction is generated based on the requirement of the user and is used for indicating the terminal to report the data required by the user, so that the data volume reported by each terminal is reduced; in the application, the management terminal only needs to collect the data required by the user and reported by each terminal, and sends the collected collection table to each terminal, so that the data processing amount of the management terminal is reduced.
For ease of understanding, the steps in fig. 2 are described in detail below:
1. target instruction issue
In the embodiment of the application, in order to avoid burden on the management terminal caused by processing a large amount of data at one time, the management terminal server can generate the target instruction based on the requirement of the user and issue the target instruction to each terminal.
In some embodiments, as shown in fig. 3, in the terminal device at the management end, a user may input a requirement of the user on an instruction input interface, and the server generates a corresponding target instruction according to the requirement of the user and issues the target instruction to each terminal.
For example: if the user wants to inquire the credit investigation condition of the target object of each terminal, the user can input the following information in the instruction input interface: inquiring the credit investigation of the target object; the server generates a target instruction corresponding to the credit investigation query and sends the instruction to each terminal.
2. Receiving a first information table
The first information table provided in the embodiment of the present application includes first data, where the first data includes an identity of a target object obtained by a terminal through screening according to a target instruction and first information associated with the identity.
For example: the target instruction is to query the credit investigation condition of the target object of each terminal, and then each terminal screens out the first data from the respective corresponding database, as shown in fig. 4, the terminal 1 screens out the identity of the target object in the terminal 1 and the first information associated with the identity according to the instruction, and the first information at this time is the credit investigation condition of the target object; the terminal 2 obtains the identity of the target object of the terminal 2 and the first information (credit investigation condition of the target object) associated with the identity by screening according to the instruction; and the terminal 1 and the terminal 2 report the obtained first information table to the management terminal.
In some embodiments, after receiving the first information table reported by each terminal, the management end needs to perform the steps shown in fig. 5 in real time in order to facilitate subsequent sorting of the first information with characters as the attribute in the first data in the category set:
in step 501: determining the attribute of the first information aiming at each first information in the first information table;
in step 502: if the attribute of the first information is a character, determining a preset zone bit according to the meaning represented by the character;
in step 503: and taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information.
For example: for the received first information tables reported by the terminal 1 and the terminal 2, where the first information represents the credit investigation condition of the target object, the flag bit 1 is used to represent that the credit of the user is good, and the flag bit 0 is used to represent that the user has the credit problem, and then the new first information table with the flag replacing the original first information is shown in fig. 6.
In the application, a target instruction is issued by a user, and the terminal is instructed to report a first information table based on the target instruction; in order to facilitate a user to inquire the condition of the latest data in real time, each terminal can monitor the first information of the target object of the terminal in real time after reporting the first information table, if the target object with the changed first information exists, the target object and the associated first information are reported to the management terminal, and the management terminal updates the first information table corresponding to the terminal according to the target object reported by the terminal and the first information.
For example: as shown in fig. 7, a terminal 1 and a terminal 2 report a first information table to a management end, the terminal 1 detects that the first information of a target object B changes after the first information table is reported, and reports the target object B and the first information associated with the target object B to the management end, and the management end updates the first information table corresponding to the terminal 1 according to the target object and the first information reported by the terminal 1.
3. Classification of
Since one management end manages multiple terminals simultaneously, if a user wants to invoke a certain class of users, a large workload is brought to the management end, and therefore, in the embodiment of the application, in order to facilitate the user to invoke interested users according to the class, the first data in the first information table needs to be classified; because data reported by multiple terminals may be repeated, in order to ensure data unicity, in the present application, before performing classification processing on first data in a first information table, deduplication processing is first performed on the first data in the first information table reported by each terminal, so as to obtain deduplicated first data.
Then, the first data in the first information table reported by each terminal is classified to obtain at least one category set, wherein each category set comprises the identity of the target object and the first information associated with the identity.
For example: as shown in fig. 8, the management terminal receives the first information tables reported by the terminal 1 and the terminal 2, determines that there is no duplicate data in the first information tables reported by the terminal 1 and the terminal 2, and then performs classification processing on the first information tables reported by the terminal 1 and the terminal 2 to obtain the category set 1 and the category set 2 shown in fig. 9.
In some embodiments, in order to facilitate a user to search for users of the same category, after the classification processing is performed on the first information table, a sorting mode of a preset sequence is determined according to categories of the category set; and sorting the first information in the category set according to a sorting mode of a preset sequence. Wherein, the sequencing mode comprises: sorted from large to small and sorted from small to large.
For example: as shown in fig. 10, category 1 is sorted from small to large and category 2 is sorted from large to small as shown in fig. 9.
4. Summary of the invention
In this embodiment of the present application, for convenience of querying by a user and for convenience of processing a target object by each terminal, after each category set is sorted, each category set needs to be summarized to obtain a summary table, which may be specifically implemented as the steps shown in fig. 11:
in step 1101: extracting a target object in a first information table reported by each terminal, and performing duplicate removal operation on the target object;
in step 1102: extracting the identity of a target object in a first information table reported by each terminal;
in step 1103: for each target object, determining first information associated with the identity of the target object from each category set, and summarizing the first information associated with the identity of the target object determined from each category set to obtain summarized first information;
in step 1104: and the de-duplicated target object, the identity of the target object in the first information table reported by each terminal and the summarized first information form a summary table.
It should be noted that, the execution sequence of steps 1101, 1102, and 1103 in fig. 11 is not limited in the present application, and fig. 11 is only an example, and a technician may set the execution sequence according to needs, and certainly may perform the execution sequence simultaneously.
It should be noted that, since the sorting order of each category set pair is different, when generating the summary table, the summary table corresponding to the user requirement may be generated according to the requirement of the user, for example: the aggregation processing is performed for the category 1 and the category 2 in fig. 10, the category 1 indicates the credit investigation situation of the target object, and the user pays more attention to the credit investigation situation of the target object in the terminal 1, so that when aggregation is performed, aggregation is performed in the order of the terminals 1 in the category 1, and a summary table as shown in fig. 12 is obtained. Of course, after obtaining the summary table, the user may also sort the summary table according to the required categories, for example: for the summary table shown in fig. 12, the user pays more attention to the amount of money stored in the terminal 2 at this time, and the user may sort the amount of money stored in the terminal 2 based on the summary table shown in fig. 12, so as to obtain the summary table shown in fig. 13.
In the present application, in order to save storage space, after obtaining the summary table, the summary table is stored in the form of a bitmap, and for easy understanding, the following describes a manner of storing the bitmap:
in the conventional database, if an attribute (male and female, right and wrong, whether or not, etc.) of an object is stored, a field is required to be used, usually at least 1 byte, and if 2000 attributes are stored, 2000 bytes are required. To save space, a 2000-bit (bit) sting field may be used in this application, where each bit represents a simple attribute (male or female, right or wrong, yes or no, etc.), thereby compacting storage space.
For example: as shown in fig. 14, table a is a conventional storage manner, and table B is a bitmap storage manner adopted in the present application, so that it can be seen that the storage space is greatly saved.
5. Issue summary table
In the present application, in obtaining the summary table shown in fig. 13, it is stored in the form of a bitmap as shown in fig. 14. The user can screen out the interested target object by screening the summary table. In order to facilitate the self-checking of each terminal, after the summary table is obtained, the summary table is issued to each terminal, and each terminal processes the target object according to the summary table.
For example: the summary table shown in fig. 13 is sent to the terminal 1 and the terminal 2, the terminal 1 determines that the credit of the target object a at the terminal 1 is good according to the summary table, and determines that the target object a has the credit problem at the terminal 2, so that the terminal 1 can mark the credit of the target object a as having the hidden credit problem at the terminal.
As shown in fig. 15, based on the same inventive concept, a data processing apparatus 1500 is proposed, including:
the instruction issuing module 15001 is used for generating a target instruction based on user requirements and issuing the target instruction to each terminal;
a receiving module 15002, configured to receive the first information table reported by each terminal, and perform classification processing on first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise an identity of a target object obtained by a terminal through screening according to the target instruction and first information associated with the identity, and each category set comprises the identity of the target object and the first information associated with the identity;
a sorting module 15003, configured to sort, for each category set, first information in first data in the category set according to a preset order, so as to obtain a sorted category set;
a summarizing module 15004, configured to summarize each sorted category set to obtain a summary table; the summary table comprises target objects reported by the terminals, identity marks of the target objects at the terminals, and first information related to the identity marks;
a summary table issuing module 15005, configured to issue the summary table to each terminal, so that each terminal processes a target object based on the summary table.
In some possible embodiments, before the receiving module performs the classification processing on the first data in the first information table reported by each terminal, the receiving module is further configured to:
for each first information in the first information table, determining an attribute of the first information;
if the attribute of the first information is a character, determining a preset zone bit according to the meaning of the character representation;
taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information; the preset zone bit is used for sequencing first information with characters as attributes in first data in the category set.
In some possible embodiments, the sorting module, when performing sorting on the first information in the first data in the category sets according to a preset order for each category set, is configured to:
determining a sorting mode of the preset sequence according to the category of the category set;
and sorting the first information in the category set according to the sorting mode of the preset sequence.
In some possible embodiments, before the receiving module performs classification processing on the first data in the first information table reported by each terminal and obtains at least one category set, the receiving module is further configured to:
and performing duplicate removal processing on the first data in the first information table reported by each terminal to obtain the duplicate-removed first data.
In some possible embodiments, the summarization module performs summarization on each sorted category set, and when obtaining the summary table, the summarization module is configured to:
extracting a target object in the first information table reported by each terminal, and performing duplicate removal operation on the target object;
extracting the identity of the target object in the first information table reported by each terminal;
for each target object, determining first information associated with the identity of the target object from each category set, and summarizing the first information associated with the identity of the target object determined from each category set to obtain summarized first information;
the de-duplicated target object, the identity of the target object in the first information table reported by each terminal, and the summarized first information form the summary table.
Having described the data processing method and apparatus of the exemplary embodiments of the present application, an electronic device according to another exemplary embodiment of the present application is next described.
As will be appreciated by one skilled in the art, aspects of the present application may be embodied as a system, method or program product. Accordingly, various aspects of the present application may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible implementations, an electronic device according to the present application may include at least one processor, and at least one memory. Wherein the memory stores program code which, when executed by the processor, causes the processor to perform the steps of the data processing method according to various exemplary embodiments of the present application described above in the present specification.
The electronic apparatus 130 according to this embodiment of the present application is described below with reference to fig. 16. The electronic device 130 shown in fig. 16 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 16, the electronic device 130 is represented in the form of a general electronic device. The components of the electronic device 130 may include, but are not limited to: the at least one processor 131, the at least one memory 132, and a bus 133 that connects the various system components (including the memory 132 and the processor 131).
Bus 133 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.
The memory 132 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 1321 and/or cache memory 1322, and may further include Read Only Memory (ROM) 1323.
Memory 132 may also include a program/utility 1325 having a set (at least one) of program modules 1324, such program modules 1324 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may comprise an implementation of a network environment.
The electronic device 130 may also communicate with one or more external devices 134 (e.g., keyboard, pointing device, etc.), with one or more devices that enable a user to interact with the electronic device 130, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 130 to communicate with one or more other electronic devices. Such communication may occur via input/output (I/O) interfaces 135. Also, the electronic device 130 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 136. As shown, network adapter 136 communicates with other modules for electronic device 130 over bus 133. It should be understood that although not shown in FIG. 16, other hardware and/or software modules may be used in conjunction with electronic device 130, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
In some possible embodiments, various aspects of a data processing method provided by the present application may also be implemented in the form of a program product including program code for causing a computer device to perform the steps of a data processing method according to various exemplary embodiments of the present application described above in this specification when the program product is run on the computer device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The program product for data processing of the embodiments of the present application may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on an electronic device. However, the program product of the present application is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the consumer electronic device, partly on the consumer electronic device, as a stand-alone software package, partly on the consumer electronic device and partly on a remote electronic device, or entirely on the remote electronic device or server. In the case of remote electronic devices, the remote electronic devices may be connected to the consumer electronic device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external electronic device (e.g., through the internet using an internet service provider).
It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functions of two or more units described above may be embodied in one unit, according to embodiments of the application. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.
Further, while the operations of the methods of the present application are depicted in the drawings in a particular order, this does not require or imply that these operations must be performed in this particular order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (11)

1. A method of data processing, the method comprising:
generating a target instruction based on user requirements, and issuing the target instruction to each terminal;
receiving a first information table reported by each terminal, and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise an identity of a target object obtained by a terminal through screening according to the target instruction and first information associated with the identity, and each category set comprises the identity of the target object and the first information associated with the identity;
for each category set, sorting first information in first data in the category set according to a preset sequence to obtain a sorted category set;
summarizing each sorted category set to obtain a summary table; the summary table comprises target objects reported by the terminals, identity marks of the target objects at the terminals, and first information related to the identity marks;
and issuing the summary table to each terminal so that each terminal processes the target object based on the summary table.
2. The method according to claim 1, wherein before the classifying the first data in the first information table reported by each terminal, the method further comprises:
for each first information in the first information table, determining an attribute of the first information;
if the attribute of the first information is a character, determining a preset zone bit according to the meaning represented by the character;
taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information; the preset zone bit is used for sequencing first information with characters as attributes in the first data in the category set.
3. The method according to claim 1, wherein the sorting the first information in the first data in the category sets according to a preset order for each category set comprises:
determining a sorting mode of the preset sequence according to the category of the category set;
and sorting the first information in the category set according to the sorting mode of the preset sequence.
4. The method according to claim 1, wherein before the classifying the first data in the first information table reported by each terminal to obtain at least one category set, the method further comprises:
and performing duplicate removal processing on the first data in the first information table reported by each terminal to obtain the duplicate-removed first data.
5. The method according to claim 1, wherein the aggregating each sorted category set to obtain an aggregate table comprises:
extracting a target object in the first information table reported by each terminal, and performing duplicate removal operation on the target object;
extracting the identity of the target object in the first information table reported by each terminal;
for each target object, determining first information associated with the identity of the target object from each category set, and summarizing the first information associated with the identity of the target object determined from each category set to obtain summarized first information;
the de-duplicated target object, the identity of the target object in the first information table reported by each terminal, and the summarized first information form the summary table.
6. A data processing apparatus, characterized in that the apparatus comprises:
the command issuing module is used for generating a target command based on user requirements and issuing the target command to each terminal;
the receiving module is used for receiving a first information table reported by each terminal and classifying first data in the first information table reported by each terminal to obtain at least one category set; the first data in the first information table comprise an identity of a target object obtained by a terminal through screening according to the target instruction and first information associated with the identity, and each category set comprises the identity of the target object and the first information associated with the identity;
the sorting module is used for sorting the first information in the first data in the category sets according to a preset sequence aiming at each category set to obtain a sorted category set;
the summarizing module is used for summarizing each sorted category set to obtain a summarizing table; the summary table comprises target objects reported by the terminals, identity marks of the target objects at the terminals, and first information related to the identity marks;
and the summary table issuing module is used for issuing the summary table to each terminal so that each terminal processes the target object based on the summary table.
7. The apparatus of claim 6, wherein before the receiving module performs the classification processing on the first data in the first information table reported by each terminal, the receiving module is further configured to:
for each first information in the first information table, determining an attribute of the first information;
if the attribute of the first information is a character, determining a preset zone bit according to the meaning represented by the character;
taking the preset zone bit as new first information, and replacing the first information in the first information table with the new first information; the preset zone bit is used for sequencing first information with characters as attributes in the first data in the category set.
8. The apparatus according to claim 6, wherein the sorting module, when performing sorting of the first information in the first data in the category sets according to the preset order for each category set, is configured to:
determining a sorting mode of the preset sequence according to the category of the category set;
and sorting the first information in the category set according to the sorting mode of the preset sequence.
9. An electronic device comprising at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to implement the method of any one of claims 1 to 5.
10. A computer storage medium, characterized in that it stores a computer program for enabling a computer to perform the method according to any one of claims 1 to 5.
11. A computer program product, the computer program product comprising: computer program code which, when run on a computer, causes the computer to perform the method of any of the preceding claims 1 to 5.
CN202210554125.3A 2022-05-19 2022-05-19 Data processing method and device, electronic equipment and storage medium Pending CN115204251A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210554125.3A CN115204251A (en) 2022-05-19 2022-05-19 Data processing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210554125.3A CN115204251A (en) 2022-05-19 2022-05-19 Data processing method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115204251A true CN115204251A (en) 2022-10-18

Family

ID=83574346

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210554125.3A Pending CN115204251A (en) 2022-05-19 2022-05-19 Data processing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115204251A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116932115A (en) * 2023-07-25 2023-10-24 广州开得联智能科技有限公司 Data processing method, device, server and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110363645A (en) * 2019-06-18 2019-10-22 深圳壹账通智能科技有限公司 Asset data processing method, device, computer equipment and storage medium
CN111259045A (en) * 2020-01-17 2020-06-09 金证财富南京科技有限公司 Data processing method, device, server and medium
CN111555894A (en) * 2020-04-24 2020-08-18 北京达佳互联信息技术有限公司 Data processing method, device, equipment and storage medium
WO2021132927A1 (en) * 2019-12-27 2021-07-01 Samsung Electronics Co., Ltd. Computing device and method of classifying category of data
CN114490272A (en) * 2022-02-16 2022-05-13 中国工商银行股份有限公司 Data processing method and device, electronic equipment and computer readable storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110363645A (en) * 2019-06-18 2019-10-22 深圳壹账通智能科技有限公司 Asset data processing method, device, computer equipment and storage medium
WO2021132927A1 (en) * 2019-12-27 2021-07-01 Samsung Electronics Co., Ltd. Computing device and method of classifying category of data
CN111259045A (en) * 2020-01-17 2020-06-09 金证财富南京科技有限公司 Data processing method, device, server and medium
CN111555894A (en) * 2020-04-24 2020-08-18 北京达佳互联信息技术有限公司 Data processing method, device, equipment and storage medium
CN114490272A (en) * 2022-02-16 2022-05-13 中国工商银行股份有限公司 Data processing method and device, electronic equipment and computer readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116932115A (en) * 2023-07-25 2023-10-24 广州开得联智能科技有限公司 Data processing method, device, server and storage medium

Similar Documents

Publication Publication Date Title
CN107506451B (en) Abnormal information monitoring method and device for data interaction
US20220309053A1 (en) Method and apparatus of auditing log, electronic device, and medium
US20170279840A1 (en) Automated event id field analysis on heterogeneous logs
CN111190888A (en) Method and device for managing graph database cluster
CN110532322B (en) Operation and maintenance interaction method, system, computer readable storage medium and equipment
CN105512283A (en) Data quality management and control method and device
CN110688828A (en) File processing method and device, file processing system and computer equipment
CN106503274A (en) A kind of Data Integration and searching method and server
CN110941530B (en) Method, device, computer equipment and storage medium for acquiring monitoring data
CN104536965A (en) System and method for data query and presentation under big data condition
CN112306700A (en) Abnormal RPC request diagnosis method and device
CN113157659A (en) Log processing method and device
CN104881454A (en) Updating method and system of parameter
CN112988770A (en) Method and device for updating serial number, electronic equipment and storage medium
CN104657437A (en) Monitoring method and monitoring device for promotion status data
CN114157679A (en) Cloud-native-based distributed application monitoring method, device, equipment and medium
CN112732663A (en) Log information processing method and device
CN115204251A (en) Data processing method and device, electronic equipment and storage medium
CN113934733A (en) Problem positioning method, device, system, storage medium and electronic equipment
CN111752918A (en) Historical data interaction system and configuration method thereof
CN113705184B (en) Custom report generation method and device, storage medium and electronic equipment
CN114756301A (en) Log processing method, device and system
US20230342369A1 (en) Data processing method and apparatus, and electronic device and storage medium
JP2024509629A (en) Quantum car type component basic database creation method, device, electronic equipment, and storage medium
CN114911575A (en) ClickHouse cluster management method and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination