CN115238204A - Data transmission method and device, electronic equipment and storage medium - Google Patents
Data transmission method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115238204A CN115238204A CN202210868136.9A CN202210868136A CN115238204A CN 115238204 A CN115238204 A CN 115238204A CN 202210868136 A CN202210868136 A CN 202210868136A CN 115238204 A CN115238204 A CN 115238204A
- Authority
- CN
- China
- Prior art keywords
- data
- historical data
- reported
- target
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a data processing technology, and discloses a data reporting method, which comprises the following steps: acquiring data to be submitted and a historical data set, wherein each historical data in the historical data set has a corresponding submission time tag; screening the historical data in the historical data set according to the delivery time tag to obtain target historical data; and comparing the data to be submitted with target historical data, and screening newly increased and changed data in the data to be submitted according to a comparison result to submit. The invention also relates to a block chain technology, and the data to be reported can be stored in the block chain link point. The invention also provides a data reporting device, equipment and a medium. The invention can improve the efficiency of data reporting.
Description
Technical Field
The present invention relates to data processing technologies, and in particular, to a data reporting method and apparatus, an electronic device, and a storage medium.
Background
As the supervision of the financial industry is gradually improved, various supervision data (such as credit data) needs to be reported regularly.
However, the existing data reporting method cannot identify changed data, only reports all data, and has high data reporting resource consumption and long time, which results in low data reporting efficiency.
Disclosure of Invention
The invention provides a data reporting method, a data reporting device, electronic equipment and a storage medium, and mainly aims to improve the efficiency of data reporting.
Acquiring data to be submitted and a historical data set, wherein each historical data in the historical data set has a corresponding submission time tag;
screening the historical data in the historical data set according to the submission time label to obtain target historical data;
performing a first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set;
extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set;
comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set;
extracting data corresponding to each field in the change field set in the data to be reported to obtain change data;
and acquiring a delivery address, and utilizing the delivery address to report the newly added data and the changed datagram.
Optionally, the screening the historical data in the historical data set according to the delivery time tag to obtain target historical data includes:
screening the corresponding reporting time label with the latest time in the historical data set to obtain a target time label;
and selecting the historical data to which the target time tag belongs in the historical data set to obtain the target historical data.
Optionally, the performing a first set operation on all fields in the to-be-reported data and all fields in the target history data to obtain a new field set includes:
extracting all fields in the data to be reported to obtain a field set to be reported;
extracting all fields in the target historical data to obtain a historical field set;
and calculating the intersection of the field set to be reported and the history field set, and calculating the complement of the intersection in the field set to be reported to obtain the newly-added field set.
Optionally, the reporting the new data and the changed datagram by using the reporting address includes:
acquiring a reporting node set, wherein the reporting node set comprises addresses of different reporting nodes;
performing hash calculation on each submission node to obtain a corresponding node hash value; summarizing all the node hash values to obtain a node hash value set;
performing Hash calculation on the submission address to obtain a submission Hash value;
matching and screening all the submission nodes according to the submission hash values and the node hash value sets to obtain target submission nodes;
and sending the newly added data and the changed data to the submission address by using the target submission node.
Optionally, the matching and screening all the submission nodes according to the submission hash values and the node hash value sets to obtain target submission nodes includes:
constructing a hash value ring by using a preset numerical value interval;
mapping the reported hash value and each node hash value in the node hash value set to a corresponding point on the hash value ring;
screening adjacent points of the points corresponding to the reported hash values on the hash value ring in a preset direction, and determining the node hash values corresponding to the adjacent points as target node hash values;
and selecting the submission nodes corresponding to the hash values of the target nodes in all the submission nodes as target submission nodes.
Optionally, the sending, by the target delivery node, the new data and the changed data to the delivery address includes:
packaging the newly added data and the change data into a submission file in a preset format;
and sending the submission file to the submission address by using the target submission node.
Optionally, after the new data and the changed datagram are reported by using the reporting address, the method further includes:
replacing data corresponding to each field in the changed data with data corresponding to the same field in the target historical data to obtain first updated historical data;
summarizing the newly-added data and the first updated historical data to obtain second updated historical data;
and carrying out submission time marking on the second updating historical data by utilizing the data to be submitted, and adding the marked second updating historical data into the historical data set.
In order to solve the above problem, the present invention further provides a data reporting apparatus, comprising:
the newly-added data screening module is used for acquiring data to be reported and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label; screening the historical data in the historical data set according to the delivery time tag to obtain target historical data; performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set; extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
the change data screening module is used for performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set; comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set; extracting data corresponding to each field in the changed field set in the data to be reported to obtain changed data;
and the data reporting module is used for acquiring a reporting address and reporting the newly added data and the changed datagram by using the reporting address.
In order to solve the above problem, the present invention also provides an electronic device, including:
a memory storing at least one computer program; and
a processor executing the computer program stored in the memory to implement the data transmission method described above.
In order to solve the above problem, the present invention also provides a computer-readable storage medium having at least one computer program stored therein, the at least one computer program being executed by a processor in an electronic device to implement the data transmission method described above.
Extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data; extracting data corresponding to each field in the changed field set in the data to be reported to obtain changed data; reporting the newly added data and the changed datagram by using the reporting address; the newly added data and the changed data are identified by comparing with the historical submission data, and are submitted, so that all the data do not need to be submitted, the submission data amount is reduced, and the submission efficiency of the data is improved; therefore, the data delivery method, the data delivery device, the electronic equipment and the readable storage medium provided by the embodiment of the invention improve the efficiency of data delivery.
Drawings
Fig. 1 is a schematic flow chart of a data transmission method according to an embodiment of the present invention;
fig. 2 is a block diagram of a data reporting apparatus according to an embodiment of the present invention;
fig. 3 is a schematic internal structural diagram of an electronic device implementing a data transmission method according to an embodiment of the present invention;
the implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the invention.
The embodiment of the invention provides a data reporting method. The execution subject of the data transmission method includes, but is not limited to, at least one of electronic devices that can be configured to execute the method provided by the embodiments of the present application, such as a server, a terminal, and the like. In other words, the data transmission method may be performed by software or hardware installed in the terminal device or the server device, and the software may be a block chain platform. The server includes but is not limited to: the cloud server can be an independent server, or can be a cloud server providing basic cloud computing services such as cloud service, a cloud database, cloud computing, a cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, a Content Delivery Network (CDN), a big data and artificial intelligence platform, and the like.
Referring to fig. 1, a schematic flow chart of a data sending method according to an embodiment of the present invention is shown, in the embodiment of the present invention, the data sending method includes:
s1, data to be submitted and a historical data set are obtained, wherein each historical data in the historical data set has a corresponding submission time label.
In detail, in the embodiment of the present invention, the data to be reported is credit investigation data that needs to be reported, the history data is full-volume history data that is backed up after each report, and the report time tag is acquisition time of the report data corresponding to each report.
In another embodiment of the present invention, the data to be submitted may be stored in block link points, and the data access efficiency is improved by using the characteristic of high throughput of the block link points.
S2, screening the historical data in the historical data set according to the submission time labels to obtain target historical data.
In order to better detect the change of the data to be submitted compared with the historical data, the data to be submitted needs to be compared with the historical data of the latest submission backup, and therefore the historical data in the historical data set is screened according to the submission time tag.
In detail, in the embodiment of the present invention, the submission time tag corresponding to the time closest to the historical data set is filtered to obtain a target time tag; further, in the embodiment of the present invention, the historical data to which the target time tag belongs in the historical data set is selected to obtain the target historical data.
For example: the historical data set has two total delivery time tags '2021-12-25' and '2021-12-29', and the time 2021-12-29 corresponding to the delivery time tag '2021-12-29' is closest to the current time, so the target time tag is '2021-12-29'.
And S3, performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set.
In detail, the embodiment of the present invention performs a first set operation on all fields in the to-be-reported data and all fields in the target history data to obtain a new field set, including:
extracting all fields in the data to be submitted to obtain a field set to be submitted;
optionally, in the embodiment of the present invention, the data in the data to be submitted consists of the same field and a corresponding field value, and in order to filter newly added data in the data to be submitted, a difference between a field in the data to be submitted and a field in the target history data needs to be filtered and compared, so that all fields in the data to be submitted are extracted to obtain a set of fields to be submitted
Extracting all fields in the target historical data to obtain a historical field set;
optionally, in the embodiment of the present invention, data in the target history data is composed of the same field and a corresponding field value, and in order to filter and compare differences between fields in the data to be reported and fields in the target history data, all fields in the target history data are extracted, so that difference comparison between the fields is facilitated.
And calculating the intersection of the field set to be reported and the history field set, and calculating the complementary set of the intersection in the field set to be reported to obtain the newly-added field set.
Optionally, in an embodiment of the present invention, an intersection of the field set to be reported and the history field set is a common field in the field set to be reported and the history field set, and further, in order to calculate a newly added field in the target history data, a complementary set of the intersection in the field set to be reported is calculated, that is, other fields except the common field in the field set to be reported are calculated, so as to obtain the newly added field set.
According to the embodiment of the invention, all fields in the data to be submitted and all fields in the target historical data are subjected to first set operation, so that the fields which are newly added in the data to be submitted and compared with the target historical data are obtained.
And S4, extracting data corresponding to each field in the newly added fields in the data to be reported to obtain the newly added data.
In detail, in the embodiment of the present invention, data corresponding to each field in the newly added field in the to-be-submitted data is extracted, so as to obtain newly added data in the to-be-submitted data, which is compared with the target historical data.
And S5, performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set.
In detail, in the embodiment of the present invention, a second set operation is performed on all fields in the to-be-reported data and all fields in the target historical data, so as to obtain a repeated field set, where the second set operation includes:
and calculating the intersection of the field set to be reported and the history field set to obtain the repeated field set.
In the embodiment of the present invention, an intersection between the field set to be reported and the history field set is calculated, so as to obtain a common field in the field set to be reported and the history field set, and obtain the repeated field set. And further, whether field values corresponding to common fields in the data to be submitted and the target historical data are changed or not is checked, so that the common fields with the changed field values can be screened conveniently.
S6, comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set.
In the embodiment of the invention, in order to check whether the data corresponding to the repeated fields of the data to be reported and the data corresponding to the corresponding fields in the target historical data are changed, the data of each field in the repeated field set in the data to be reported and the data in the target historical data are compared to judge whether the data in the data to be reported and the data in the target historical data are consistent.
Specifically, in the embodiment of the present invention, the screening of the repeated field set according to the comparison result to obtain a changed field set includes:
and selecting fields with inconsistent comparison results in the repeated field set to obtain the changed field set.
In the embodiment of the invention, the comparison result is inconsistent with the field, namely the field value corresponding to the field in the data to be reported and the target historical data is changed and is a changed common field. And S7, extracting data corresponding to each field in the changed field set in the data to be reported to obtain changed data.
In detail, in the embodiment of the present invention, data corresponding to each field in the newly added field in the to-be-reported data is extracted, so as to obtain changed data, in which the data of the corresponding field in the to-be-reported data is changed, of the uploaded field in the target history data.
And S8, acquiring a delivery address, and utilizing the delivery address to report the newly added data and the changed datagram.
In the embodiment of the present invention, an submission node set is obtained, where the submission node set includes addresses of different submission nodes, and the submission nodes are message sending server nodes.
Performing hash calculation on each submission node to obtain a corresponding node hash value; and summarizing all the node hash values to obtain a node hash value set, and carrying out hash calculation on the delivery address to obtain a delivery hash value.
Further, the matching and screening of all the submission nodes according to the submission hash values and the node hash value sets to obtain target submission nodes in the embodiment of the present invention includes: constructing a hash value ring by using a preset numerical interval, mapping the reported hash value and each node hash value in the node hash value set to be a corresponding point on the hash value ring, screening adjacent points of the point corresponding to the reported hash value on the hash value ring in a preset direction, and determining the node hash value corresponding to the adjacent point as a target node hash value; and selecting the submission nodes corresponding to the target node hash values in all the submission nodes as target submission nodes. Optionally, the preset direction is a clockwise direction.
Optionally, the value interval for constructing the hash value ring in the embodiment of the present invention may be [0,2^32]. The embodiment of the invention connects the left end point and the right end point of the numerical interval into a ring to obtain the hash value ring. In order to ensure that the reported hash value and each node hash value in the node hash value set can be mapped on the hash value ring, in the embodiment of the present invention, a value corresponding to a right end point of the numerical interval is set to be greater than a maximum value of the reported hash value and the node hash value set, and a value corresponding to a left end point of the numerical interval is set to be less than a minimum value of the reported hash value and the node hash value set.
Furthermore, the embodiment of the present invention encapsulates the newly added data and the changed data into a delivery file with a preset format, and sends the delivery file to the delivery address by using the target delivery node, and selects the most suitable delivery node in real time for delivery by screening the delivery nodes, thereby avoiding the influence of the change of the delivery node on data delivery and improving the efficiency of data delivery.
In another embodiment of the present invention, after the new data and the changed datagram are reported by using the reporting address, the method further includes:
replacing data corresponding to each field in the changed data with data corresponding to the same field in the target historical data to obtain first updated historical data;
summarizing the newly-added data and the first updated historical data to obtain second updated historical data;
and carrying out submission time marking on the second updating historical data by using the data to be submitted, and adding the marked second updating historical data into the historical data set.
In another embodiment of the present invention, after the new data and the changed datagram are reported by using the reporting address, the method further includes:
acquiring a reporting processing result;
when the report processing result is report failure, acquiring a report failure reason;
and sending the reporting failure reason to preset terminal equipment of an exception handler.
Optionally, the terminal device in the embodiment of the present invention includes: intelligent terminals such as mobile phones, computers and tablets.
The embodiment of the invention monitors and screens the data to be reported, does not need to report the whole data, only needs to report the newly increased and changed data, reduces the resource consumption of data reporting, and simultaneously utilizes the dynamic reporting node to report, thereby avoiding the influence of the change of the reporting node on the data reporting and improving the efficiency of the data reporting.
FIG. 2 is a functional block diagram of the data reporting device of the present invention.
The apparatus 100 for sending data according to the present invention can be installed in an electronic device. According to the implemented functions, the data reporting apparatus may include a new data filtering module 101, a changed data filtering module 102, and a data reporting module 103, which may also be referred to as a unit, and refer to a series of computer program segments that can be executed by a processor of an electronic device and can perform fixed functions, and are stored in a memory of the electronic device.
In the present embodiment, the functions regarding the respective modules/units are as follows:
the newly added data screening module 101 is configured to obtain data to be submitted and a historical data set, where each historical data in the historical data set has a corresponding submission time tag; screening the historical data in the historical data set according to the delivery time tag to obtain target historical data; performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set; extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
the changed data screening module 102 is configured to perform a second set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a repeated field set; comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set; extracting data corresponding to each field in the change field set in the data to be reported to obtain change data;
the data reporting module 103 is configured to obtain a reporting address, and report the new data and the changed datagram by using the reporting address.
In detail, in the embodiment of the present invention, when the modules in the datagram device 100 are used, the same technical means as the above-mentioned data datagram method in fig. 1 is adopted, and the same technical effect can be produced, and the details are not repeated here.
Fig. 3 is a schematic structural diagram of an electronic device implementing a data transmission method according to the present invention.
The electronic device may comprise a processor 10, a memory 11, a communication bus 12 and a communication interface 13, and may further comprise a computer program, such as a datagram program, stored in the memory 11 and executable on the processor 10.
The memory 11 includes at least one type of readable storage medium, which includes flash memory, removable hard disk, multimedia card, card-type memory (e.g., SD or DX memory, etc.), magnetic memory, magnetic disk, optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device, for example a removable hard disk of the electronic device. The memory 11 may also be an external storage device of the electronic device in other embodiments, such as a plug-in mobile hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the electronic device. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device. The memory 11 may be used not only to store application software installed in the electronic device and various types of data, such as codes of a datagram program, but also to temporarily store data that has been output or will be output.
The processor 10 may be formed of an integrated circuit in some embodiments, for example, a single packaged integrated circuit, or may be formed of a plurality of integrated circuits packaged with the same function or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The processor 10 is a Control Unit (Control Unit) of the electronic device, connects various components of the electronic device by using various interfaces and lines, and executes various functions and processes data of the electronic device by running or executing programs or modules (e.g., a data distribution program, etc.) stored in the memory 11 and calling data stored in the memory 11.
The communication bus 12 may be a PerIPheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. The communication bus 12 is arranged to enable connection communication between the memory 11 and at least one processor 10 or the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
Fig. 3 shows only an electronic device having components, and those skilled in the art will appreciate that the structure shown in fig. 3 does not constitute a limitation of the electronic device, and may include fewer or more components than those shown, or some components may be combined, or a different arrangement of components.
For example, although not shown, the electronic device may further include a power supply (such as a battery) for supplying power to each component, and preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so that functions such as charge management, discharge management, and power consumption management are implemented through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure classification circuits, power converters or inverters, power status indicators, and the like. The electronic device may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.
Optionally, the communication interface 13 may include a wired interface and/or a wireless interface (e.g., WI-FI interface, bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices.
Optionally, the communication interface 13 may further include a user interface, which may be a Display (Display), an input unit (such as a Keyboard), and optionally, a standard wired interface and a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, or the like. The display, which may also be referred to as a display screen or display unit, is suitable, among other things, for displaying information processed in the electronic device and for displaying a visualized user interface.
It is to be understood that the embodiments described are illustrative only and are not to be construed as limiting the scope of the claims.
The datagram program stored in the memory 11 of the electronic device is a combination of a plurality of computer programs, and when running in the processor 10, can implement:
acquiring data to be submitted and a historical data set, wherein each historical data in the historical data set has a corresponding submission time tag;
screening the historical data in the historical data set according to the submission time label to obtain target historical data;
performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set;
extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set;
comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set;
extracting data corresponding to each field in the change field set in the data to be reported to obtain change data;
and acquiring a delivery address, and utilizing the delivery address to report the newly added data and the changed datagram.
Specifically, the processor 10 may refer to the description of the relevant steps in the embodiment corresponding to fig. 1 for a specific implementation method of the computer program, which is not described herein again.
Further, the electronic device integrated module/unit, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. The computer readable medium may be non-volatile or volatile. The computer-readable medium may include: any entity or device capable of carrying said computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM).
Embodiments of the present invention may also provide a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program may implement:
acquiring data to be submitted and a historical data set, wherein each historical data in the historical data set has a corresponding submission time tag;
screening the historical data in the historical data set according to the delivery time tag to obtain target historical data;
performing a first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set;
extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set;
comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set;
extracting data corresponding to each field in the changed field set in the data to be reported to obtain changed data;
and acquiring a delivery address, and utilizing the delivery address to report the newly added data and the changed datagram.
Further, the computer usable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the blockchain node, and the like.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus, device and method can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
The embodiment of the application can acquire and process related data based on an artificial intelligence technology. Among them, artificial Intelligence (AI) is a theory, method, technique and application system that simulates, extends and expands human Intelligence using a digital computer or a machine controlled by a digital computer, senses the environment, acquires knowledge and uses the knowledge to obtain the best result.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof.
The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
The block chain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, a consensus mechanism, an encryption algorithm and the like. A block chain (Blockchain), which is essentially a decentralized database, is a series of data blocks associated by using a cryptographic method, and each data block contains information of a batch of network transactions, so as to verify the validity (anti-counterfeiting) of the information and generate a next block. The blockchain may include a blockchain underlying platform, a platform product service layer, an application service layer, and the like.
Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms second, etc. are used to denote names, but not to denote any particular order.
Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (10)
1. A method for data reporting, the method comprising:
acquiring data to be submitted and a historical data set, wherein each historical data in the historical data set has a corresponding submission time tag;
screening the historical data in the historical data set according to the delivery time tag to obtain target historical data;
performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set;
extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set;
comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set;
extracting data corresponding to each field in the changed field set in the data to be reported to obtain changed data;
and acquiring a delivery address, and utilizing the delivery address to report the newly added data and the changed datagram.
2. The data delivery method of claim 1, wherein the filtering the historical data in the historical data set according to the delivery time tag to obtain the target historical data comprises:
screening the corresponding reporting time label with the latest time in the historical data set to obtain a target time label;
and selecting the historical data to which the target time tag belongs in the historical data set to obtain the target historical data.
3. The data transmission method of claim 1, wherein performing a first set operation on all fields in the data to be transmitted and all fields in the target history data to obtain a new field set comprises:
extracting all fields in the data to be reported to obtain a field set to be reported;
extracting all fields in the target historical data to obtain a historical field set;
and calculating the intersection of the field set to be reported and the history field set, and calculating the complementary set of the intersection in the field set to be reported to obtain the newly-added field set.
4. The method for sending datagrams as claimed in claim 1, wherein said sending the new data and the changed datagram using the sending address comprises:
acquiring a reporting node set, wherein the reporting node set comprises addresses of different reporting nodes;
performing hash calculation on each submission node to obtain a corresponding node hash value; summarizing all the node hash values to obtain a node hash value set;
performing Hash calculation on the submission address to obtain a submission Hash value;
matching and screening all the submission nodes according to the submission hash values and the node hash value sets to obtain target submission nodes;
and sending the newly added data and the changed data to the delivery address by using the target delivery node.
5. The data delivery method of claim 4, wherein said matching and screening all of said delivery nodes according to said delivery hash values and said node hash value set to obtain target delivery nodes comprises:
constructing a hash value ring by using a preset numerical value interval;
mapping the reported hash value and each node hash value in the node hash value set to a corresponding point on the hash value ring;
screening adjacent points of a point corresponding to the reported hash value on the hash value ring in a preset direction, and determining a node hash value corresponding to the adjacent points as a target node hash value;
and selecting the submission nodes corresponding to the target node hash values in all the submission nodes as target submission nodes.
6. The data delivery method of claim 4, wherein said sending the new addition data and the change data to the delivery address using the target delivery node comprises:
packaging the newly added data and the changed data into a submission file in a preset format;
and sending the submission file to the submission address by using the target submission node.
7. The data reporting method of any of claims 1 to 6, wherein after reporting the new addition data and the change datagram by using the reporting address, the method further comprises:
replacing data corresponding to each field in the changed data with data corresponding to the same field in the target historical data to obtain first updated historical data;
summarizing the newly-added data and the first updated historical data to obtain second updated historical data;
and carrying out submission time marking on the second updating historical data by using the data to be submitted, and adding the marked second updating historical data into the historical data set.
8. A data reporting device, comprising:
the newly-added data screening module is used for acquiring data to be reported and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label; screening the historical data in the historical data set according to the delivery time tag to obtain target historical data; performing first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a newly added field set; extracting data corresponding to each field in the newly added fields in the data to be reported to obtain newly added data;
the change data screening module is used for performing second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set; comparing whether the data of each field in the repeated field set in the data to be reported is consistent with the data in the target historical data or not, and screening the repeated field set according to the comparison result to obtain a changed field set; extracting data corresponding to each field in the change field set in the data to be reported to obtain change data;
and the data reporting module is used for acquiring a reporting address and reporting the newly added data and the changed datagram by using the reporting address.
9. An electronic device, characterized in that the electronic device comprises:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor;
wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the data transmission method of any of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out a data transmission method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210868136.9A CN115238204A (en) | 2022-07-22 | 2022-07-22 | Data transmission method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210868136.9A CN115238204A (en) | 2022-07-22 | 2022-07-22 | Data transmission method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115238204A true CN115238204A (en) | 2022-10-25 |
Family
ID=83674795
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210868136.9A Pending CN115238204A (en) | 2022-07-22 | 2022-07-22 | Data transmission method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115238204A (en) |
-
2022
- 2022-07-22 CN CN202210868136.9A patent/CN115238204A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112052370A (en) | Message generation method and device, electronic equipment and computer readable storage medium | |
| CN112115145A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN114881616A (en) | Business process execution method and device, electronic equipment and storage medium | |
| CN111694844A (en) | Enterprise operation data analysis method and device based on configuration algorithm and electronic equipment | |
| CN114491047A (en) | Multi-label text classification method and device, electronic equipment and storage medium | |
| CN114185895A (en) | Data import and export method and device, electronic equipment and storage medium | |
| CN112949278A (en) | Data checking method and device, electronic equipment and readable storage medium | |
| CN113868528A (en) | Information recommendation method and device, electronic equipment and readable storage medium | |
| CN111897856A (en) | Supervision message generation method and device, electronic equipment and readable storage medium | |
| CN113890712A (en) | Data transmission method and device, electronic equipment and readable storage medium | |
| CN113468175A (en) | Data compression method and device, electronic equipment and storage medium | |
| CN112464619A (en) | Big data processing method, device and equipment and computer readable storage medium | |
| CN115687384A (en) | UUID (user identifier) identification generation method, device, equipment and storage medium | |
| CN114185588A (en) | Incremental package generation method, device, equipment and storage medium | |
| CN114897624A (en) | Policy data merging method, device, equipment and storage medium | |
| CN115238204A (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN114817408A (en) | Scheduling resource identification method and device, electronic equipment and storage medium | |
| CN114490137A (en) | Service data real-time statistical method and device, electronic equipment and readable storage medium | |
| CN113918296A (en) | Model training task scheduling execution method and device, electronic equipment and storage medium | |
| CN113918305A (en) | Node scheduling method and device, electronic equipment and readable storage medium | |
| CN112686759A (en) | Account checking monitoring method, device, equipment and medium | |
| CN112685384A (en) | Data migration method and device, electronic equipment and storage medium | |
| CN114817207A (en) | Data pushing method and device, electronic equipment and storage medium | |
| CN115033605A (en) | Data query method and device, electronic equipment and storage medium | |
| CN114546854A (en) | Interface testing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |