CN107169854B - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN107169854B CN107169854B CN201610128412.2A CN201610128412A CN107169854B CN 107169854 B CN107169854 B CN 107169854B CN 201610128412 A CN201610128412 A CN 201610128412A CN 107169854 B CN107169854 B CN 107169854B
- Authority
- CN
- China
- Prior art keywords
- source file
- data stream
- file data
- stream
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
Abstract
The embodiment of the application discloses a data processing method and device. The method comprises the following steps: receiving a source file data stream; inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, wherein the memory channel comprises at least one data processing model, and the data processing model is a model established according to a preset mapping rule between the content of the source file data stream and the content of the target file data stream. By applying the data processing method provided by the embodiment of the application, when the source file data stream is received, the source file data is directly input into the memory for processing without storage of the database, so that the time wasted by reading and writing data by the database is saved, and the efficiency of processing the source file data by the server is improved.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method and an apparatus for data processing.
Background
At present, data processing technology occupies an important position in the field of internet technology, and with the continuous increase of data types and quantity, the requirements of the internet technology on the aspects of data source selection, data classification, data processing rate and the like are continuously increased.
The prior art methods for data processing are generally: firstly, a first server receives source file data sent by a second server, then the first server analyzes the source file data regularly, and writes the analyzed source file data into a database through the read-write function of the database, namely: and storing the analyzed source file data, and finally, processing the source file data in the memory by the first server to obtain target file data.
Although the foregoing prior art may enable a user to effectively obtain target file data, in some practical application scenarios, a server is required to process source file data in real time, and when processing data, the prior art needs to store the source file data through a read-write function of a database, so that a relatively long time needs to be consumed, which affects the efficiency of the server in processing data, that is: the method for processing data in the prior art cannot achieve the effect of processing data in real time.
Disclosure of Invention
In view of the foregoing problems, embodiments of the present application provide a data processing method, which is used to solve the problem that data cannot be processed in real time due to the need of saving data in a database when data is processed in the prior art.
A method of data processing, the method comprising:
receiving a source file data stream;
inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, wherein the memory channel comprises at least one data processing model, and the data processing model is a model established according to a preset mapping rule between the content of the source file data stream and the content of the target file data stream.
Preferably, prior to receiving the source file data stream, the method further comprises:
monitoring whether a source file data stream arrives, and if so, receiving the source file data stream; if not, the source file data stream continues to be monitored.
Preferably, the predetermined mapping rule includes:
acquiring a preset source file data stream and a preset target file data stream;
and taking the preset source file data stream as an input in a data processing model, taking the preset target file data stream as an output of the data processing model, and training the data processing model to obtain the data processing model.
Preferably, the receiving a source file data stream comprises:
a source file data stream sent by a specified server in a configuration file is received.
Preferably, after obtaining the target file data stream, the method further includes:
storing the source file data stream and/or the target file data stream.
Preferably, the source file data stream is a data stream in binary coded form.
A method of rate quotation, the method comprising:
a third party payment platform server receives a rate offer source file stream from a financial system connected with the third party payment platform;
and the third-party payment platform server inputs the rate offer source file stream into a memory channel, processes the rate offer source file stream by using a data processing model corresponding to the rate offer source file stream in the memory channel to obtain a target rate offer file stream, wherein the memory channel comprises at least one data processing model, and the data processing model is a model established according to a preset mapping rule between the content of the rate offer source file stream and the content of the target rate offer file stream.
An apparatus for data processing, the apparatus comprising:
a receiving unit and a processing unit, wherein:
the receiving unit is used for receiving a source file data stream;
the processing unit is configured to input the source file data stream into a memory channel, and process the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, where the memory channel includes at least one data processing model, and the data processing model is a model established according to a predetermined mapping rule between content of the source file data stream and content of the target file data stream.
Preferably, the apparatus further comprises a listening unit configured to:
monitoring whether a source file data stream arrives, and if so, receiving the source file data stream; if not, the source file data stream continues to be monitored.
Preferably, the receiving unit is specifically configured to:
a source file data stream sent by a specified server in a configuration file is received.
Preferably, the apparatus comprises a storage unit for:
storing the source file data stream and/or the target file data stream.
The method comprises the steps of receiving a source file data stream, inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream; the memory channel herein includes at least one data processing model, and the data processing model is a model established according to a predetermined mapping rule between the content of the source file data stream and the content of the destination file data stream. The beneficial effects obtained by applying the embodiment of the application are as follows: compared with the method for acquiring the target file data in the prior art, the method for acquiring the target file data directly processes the source file data stream in the memory after receiving the source file data stream, avoids the step that the data needs to be input into the database for storage before the data is processed in the prior art, and improves the efficiency of processing the data by the server.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart of a data processing method provided in embodiment 1 of the present application;
fig. 2 is a schematic diagram of a data processing method provided in embodiment 1 of the present application;
fig. 3 is a schematic flowchart of a data processing method provided in embodiment 1 of the present application;
fig. 4 is a schematic flowchart of a method for rate quotation according to embodiment 2 of the present application;
fig. 5 is a schematic structural diagram of a data processing apparatus according to embodiment 3 of the present application.
Detailed Description
In the background art, in many current internet application scenarios, a read-write function of a database is usually used to store source file data first, and then the source file data is processed in a memory after being stored, so as to obtain target file data; since the database is stored in the hard disk, a relatively long time is consumed when the source file data is stored using the read-write function of the database. In many practical application scenarios, the data is required to be processed in real time, for example, when the third-party payment platform executes the rate quotation, the third-party payment platform is required to perform the rate quotation on the user as real as possible, and at this time, the third-party payment platform needs to process the rate data in the rate file in real time after receiving the rate file sent by the bank or other financial institutions; however, in the prior art, when the source file data is processed, the database in the server stores the received source file data first, so that the source file data cannot be processed in real time. In view of the above problems, embodiments of the present application provide a method and an apparatus for data processing, which are used for implementing a server that processes source file data to process the source file data in real time.
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
Example 1
The data processing method provided by the embodiment of the application is used for improving the efficiency of processing the source file data by the server. The specific flow diagram of the method is shown in fig. 1, and the method specifically comprises the following steps:
step 101: a source file data stream is received.
In this step, the first server receives a source file data stream sent by the second server, for example, when the third-party payment platform executes the rate quotation, the server corresponding to the third-party payment platform first receives the rate file data stream sent by the bank or other financial institution servers, and then processes the data of the rate file according to a preset rule, and finally obtains the data for rate quotation.
Optionally, before the first server receives the source file data stream sent by the second server, the first server may start the message monitoring function, specifically, when it is monitored that the source file data sent by the second server has arrived, the first server receives the source file data stream, and if it is monitored that the source file data has not arrived, the first server continues to start the message monitoring function.
The purpose of the first server starting the message monitoring function is as follows: the first server can receive the source file data stream sent by the second server in time, and process the source file data stream in time after receiving the source file data stream, so that the efficiency of processing data by the first server is improved.
In the embodiments of the present application, the terms "first" and "second" in the "first server" and the "second server" do not have any special meaning, and are only used to distinguish different servers.
In the embodiment of the present application, the first server receives a source file data stream sent by the second server, and the source file data stream may be in binary coding or other coding forms.
Specifically, before the first server receives the source file data stream sent by the second server, the second server converts the source file data into a data stream in binary coding or other coding forms, and the first server and the second server need to agree on the writing format of the source file data stream, that is: the second server needs to write the source file data stream according to the agreed data format, so that the first server can more accurately and quickly parse the source file data when receiving the source file data stream.
In addition, when the first server receives the source file data sent by the second server, only the source file data sent by the designated server is received, usually to ensure the security of data transmission.
Optionally, before the first server receives the source file data sent by the second server, the first server needs to make an agreement with the second server, which may be embodied as: the configuration file in the first server contains the identification information of the second server, and similarly, the configuration file in the second server contains the identity of the first server.
Specifically, when a first server receives source file data sent by a certain server, the first server receives the source file data if the identification information is found to be the identification information of a corresponding second server in the configuration file according to the identification information of the server.
Specifically, when a first server receives source file data sent by a certain server, according to the identification information of the server, it is found that the identification information is not identification information of a corresponding second server in a configuration file, the first server refuses to receive the exchange rate file, or the first server refuses to receive the exchange rate file and simultaneously starts a protection mode, so as to prevent hackers or other servers from illegally obtaining the source file data stream, or illegally operating the first server.
Step 102: inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream.
The memory channel comprises at least one data processing model, wherein the data processing model is a model established according to a preset mapping rule between the content of the source file data stream and the content of the target file data stream.
The data processing model in this step is a model established according to a preset mapping rule between the content of the source file data stream and the content of the destination file data stream.
Optionally, the preset mapping rule may be: firstly, obtaining a preset source file data stream and a corresponding target data stream, then, taking the preset source file data stream as input data of a data processing model, taking the preset target file data stream as output data of the data processing model, training the data model, and finally obtaining the data processing model. For example: if the content of the preset source file data stream is "a ═ 20", and the content of the preset target data stream is "b ═ 15", the corresponding data processing model may be "b ═ a-5"; the process of acquiring the data processing model is only described as an example, and in the process of actually acquiring the model, the preset source file data stream and the target data stream for training the model are more complicated, and accordingly, the process of training the model is also more complicated.
In this step, the number of the data processing models in the first server is one or more, and fig. 2 is a schematic diagram of the first server processing the source file data stream according to the embodiment of the present application, where a memory of the first server has a plurality of data processing models, that is, a1 and a2 … … An are data processing models.
After the first server receives a source file data stream sent by the second server, the first server inputs the source file data stream into a memory channel in the first server, and selects a data processing model corresponding to the source file data stream according to the source file data stream.
Alternatively, the corresponding data processing model may be selected according to the service information corresponding to the source file data stream, for example, if the source file data stream is an exchange rate data stream for "export", a preset exchange rate processing model for "export" may be selected, and if the source file data stream is an exchange rate data stream for "import", a preset exchange rate processing model for "import" may be selected.
Alternatively, a corresponding data processing model may be selected according to a specific value corresponding to the source data stream, for example, if the source data stream received this time by the first server is "a-20", if the target file data stream obtained by the previous server calculation is "b-15", the source data received this time by the first server obtained by calculation is increased by 5 in comparison with the target file data received last time, and if it is specified that when the source data received this time is increased by 0-5 in comparison with the target file data, the model of the processing data is "b-b +0.3 a", the target file data obtained this time is "b-b +0.3 a-15 +0.3 × 20-21".
The source file data content, the target file data content and the data processing model are all exemplified, in practical application, the source file data content and the target file data content are more complex, the corresponding data processing model is also more complex, and no specific limitation is formed on the source file data content, the target file data content and the data processing model.
Optionally, after the first server obtains the target file data stream, the target data stream may be stored, and the obtained source file data stream may also be stored. Compared with the prior art, the source file data stream and the target file data stream are stored only after the first server obtains the target data, so that the data are stored, and the efficiency of processing the source file data by the first server is improved.
For more clearly explaining the embodiment of the present application, the following fully describes the method for processing data provided by the embodiment of the present application, and a specific work flow is shown in fig. 3:
step S301: a source file data stream is received, in particular, a first server receives a source file data stream sent by a second server.
Step S302: the message answering function is started, namely: the first server listens for the received message.
Step S303: judging whether a new message exists, namely monitoring the message received by the first server according to the step S302, if it is monitored that the source file data stream sent by the second server does not arrive, executing the step S304: continuing to start the message monitoring function; if it is monitored that the source file data stream sent by the second server arrives, step S305 is executed: executing a data processing model, namely: the received source incoming stream is immediately processed.
Step S306: and acquiring target resource data.
The method comprises the steps of receiving a source file data stream, inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream; the memory channel herein includes at least one data processing model, and the data processing model is a model established according to a predetermined mapping rule between the content of the source file data stream and the content of the destination file data stream. The application of the embodiment of the application has the following beneficial effects: compared with the method for acquiring the target file data in the prior art, the method for acquiring the target file data directly processes the source file data stream in the memory after receiving the source file data stream, and avoids the step that the data needs to be input into the database for storage before the data is processed in the prior art, namely: the time for reading and writing data in the database is saved, and the data processing efficiency of the server is improved.
Example 2
Embodiment 1 provides a data processing method, and based on the same inventive concept, embodiment 3 provides a rate quotation method, which is specifically used for rate quotation on a third-party payment platform.
In order to more clearly describe the application embodiment, it is necessary to first describe the third party payment platform and the method for rate quotation of the third party payment platform in the prior art, which specifically includes the following steps:
at present, when a user carries out related consumption on each large application platform on the network, the transaction amount is usually paid to a third-party payment platform firstly, and when the user receives transaction commodities or completes other related consumption, the third-party payment platform confirms the transaction amount on the third-party payment platform, and then the third-party payment platform transfers the transaction amount to a corresponding transaction merchant.
In the process that a user uses a third-party payment platform to conduct transaction, foreign currencies are circulated sometimes, and in order to guarantee the accuracy of transaction between users, the third-party payment platform needs to execute exchange rate quotation. In the prior art, the third party payment platform generally performs the following steps: the first step is as follows: a server of a third party payment platform receives a rate quotation source file from a financial system connected with the third party payment platform, wherein the rate quotation source file can be the increasing or decreasing amplitude of the rate of a foreign currency or the rate of the foreign currency at the current moment; the second step is that: the third party payment platform stores the rate quotation source file in a database, wherein the rate quotation source file is written into the database by mainly utilizing the reading and writing function of the database; the third step: after the source file of the rate quotation is stored, the data in the source file of the rate quotation is processed in the memory channel, thereby obtaining the data of the rate quotation.
The third-party payment platform in the prior art can guarantee the accuracy of foreign currency transaction between users, but before processing data in a rate offer source file, the rate offer source file needs to be stored by using the reading and writing function of a database, and usually, when the database reads and writes the file, each step needs to consume relatively long time, so that the third-party payment platform in the prior art cannot execute the rate offer in real time.
The method for rate quotation of the third-party payment platform provided by the embodiment of the application is specifically used for processing rate data to be processed in a memory of a server of the third-party payment platform and obtaining the rate quotation data. The specific flow diagram of the method is shown in fig. 4, and the specific steps of the method are as follows:
step 401: a third party payment platform server receives a rate offer source file stream from a financial system connected with the third party payment platform;
in this step, the server of the third party payment platform receives a stream of rate quotation source files sent by the relevant bank or financial institution (financial system connected to the third payment platform), where the content of the rate quotation source files may include the rate of foreign currency at the current time, for example, assuming that the rate between dollars and RMB at the current time is 6.771, that is, one dollar is exchanged for 6.771 RMB, the rate quotation source files at this time may include the rate between dollars and RMB at the current time; or the magnitude of the change in the rate between U.S. dollar and RMB in the last rate offer source file received by the third party payment platform, if the rate between U.S. dollar and RMB in the last rate offer source file was 6.689 and the rate between U.S. dollar and RMB at the current time was 6.771, i.e., 0.082 greater than the previous rate, then the rate offer source file may contain the increase in the rate between U.S. dollar and RMB at the current time of 0.082 greater than the previous rate, or 1.211% greater than the previous rate, etc.
Optionally, before the server of the third-party payment platform receives the rate offer source file sent by the relevant bank or financial institution, the server of the third-party payment platform may start the message monitoring function, that is, when it is monitored that the rate offer source file arrives, the rate offer source file is immediately received, and when it is monitored that the rate offer source file does not arrive, the third payment platform continues to start the message monitoring function.
When a related bank or financial institution sends a rate quotation source file stream to a third-party payment platform, related data in the rate quotation source file needs to be written according to a fixed data format, and the format needs the bank or financial institution to agree with the third-party payment platform, so that a server corresponding to the third-party payment platform can conveniently analyze the received rate quotation source file stream. For example, the format required in the rate offer source file stream is "a-1, b-6.689, a-b", that is, a represents dollars, b represents rmb, and the whole formula represents that $ 1 equals 6.689 rmb, the data in the format is sent to the server corresponding to the third party payment platform, because the bank or financial institution sending the rate offer source file stream has agreed the data writing format with the server corresponding to the third party payment platform in advance, the server can complete the parsing of the data stream after receiving the rate offer source file stream, thereby obtaining the data of the rate offer; the data format of "a-1, b-6.689, a-b" is only an exemplary illustration of the data format in the rate offer source file, and no limitation is made to the data format in the rate offer source file.
In this step, the server of the third party payment platform obtains the data of the source file stream of rate quotation, and the data can adopt binary codes or other representation modes to represent the content of the source file of rate quotation; the server is used for receiving the third-party payment platform of the related bank and financial institution, and is also a server agreed in advance by the third-party payment platform and the related bank and financial institution, so that the safety of data transmission is guaranteed.
It should be noted that, in practical application, the banks and financial institutions that each third party payment platform cooperates with are different, so to ensure the security of data, the third party payment platform may only transmit data with the banks or financial institutions in a configuration file, where the configuration file includes identification information of the banks or financial institutions that have a cooperative relationship with the third party payment platform, and the third party payment platform performs data transmission with the corresponding banks or financial institutions according to the identification information in the configuration file.
In the embodiment of the present application, the content of the rate offer source file stream received by the server of the third party payment platform may be the same as or similar to the content of the rate offer file stream in the prior art; in addition, the specific content included in the rate offer source file stream is only an exemplary description, and in practical applications, the related data included in the rate offer source file stream is more complex, and here, a simple example is performed only for the purpose of more clearly describing the scheme, but the content included in the rate offer source file stream is not limited.
Step 402: and the third-party payment platform server inputs the rate quotation source file stream into a memory channel, and processes the rate quotation source file stream by using a data processing model corresponding to the rate quotation source file stream in the memory channel to obtain a target rate quotation file stream.
The memory channel includes at least one data processing model that is established according to a predetermined mapping rule between the content of the source rate offer file stream and the content of the target rate offer file stream.
When a server of the third-party payment platform receives a rate offer source file sent by a related bank or financial institution, a proper rate offer model needs to be selected according to the rate offer source file.
Optionally, a corresponding data processing model may be selected according to the business type of the rate offer source file. For example, if the source file stream received by the server of the third party payment platform is for "export," a preset rate processing model for "export" may be selected, and if the rate quotation source file stream is for "import," a preset rate processing model for "import" may be selected.
Optionally, a corresponding data processing model may be selected according to the specific data of the rate quotation source file. For example, the last received rate offer data by the server of a third party payment platform indicates that "a-1, b-6.689, a-b", that is, the data indicates: when the specific content indicated by the last time the exchange rate data is received is that $ 1 is exchangeable for 6.689 yuan, if the data received by the server of the third party payment platform at the current time indicates "a ═ 1, b ═ 6.771, a ═ b", then according to the data obtained at the current time, the exchange rate offer model that can be selected is "w ═ b +0.013 b", that is, here, "a ═ 1, b ═ 6.689, b ═ 6.689" of the "a ═ b" received by the server of the third party payment platform is used as the exchange rate data to be processed, and "b ═ 6.689" is used as the input data of the selected exchange rate offer model, and the exchange rate between $ 1 and yuan in the third party payment platform at the current time is obtained as 6.775.
In practical applications, after receiving the data of the exchange rate sent by the bank or the financial institution, the third party payment platform processes the data to be processed according to the data and other factors, that is, the used model of the exchange rate offer is more complicated.
By applying the embodiment of the application, the server of the third payment platform receives the rate offer source file stream from the financial system connected with the third payment platform, inputs the rate offer source file stream into the memory channel, and processes the rate offer source file stream by using the data processing model corresponding to the rate offer source file stream in the memory channel to obtain the target rate offer file stream, wherein the memory channel comprises at least one data processing model, and the data processing model is a model established according to the predetermined mapping rule between the content of the rate offer source file stream and the content of the target rate offer file stream. The application of the embodiment of the application has the following beneficial effects: compared with the prior art, the method for rate quotation of the third-party payment platform has the advantages that after the rate quotation source file stream is received, the rate quotation source file stream is directly processed in the memory, so that the problem that the third-party payment platform needs to input the data into the database for storage before processing the rate quotation source file data in the prior art is solved, namely: the time for reading and writing data by the database is saved, and the efficiency of executing the rate quotation by the server of the third-party payment platform is improved.
Example 3
Embodiment 1 provides a data processing method, and accordingly, this embodiment correspondingly provides a data processing apparatus, which exists in a server that processes source file data, and a specific structural diagram of the apparatus is shown in fig. 5. The device specifically includes: a receiving unit 501 and a processing unit 502, wherein:
the receiving unit 501 may be configured to receive a source file data stream;
the processing unit 502 may be configured to input the source file data stream into a memory channel, and process the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, where the memory channel includes at least one data processing model, and the data processing model is a model established according to a predetermined mapping rule between content of the source file data stream and content of the target file data stream.
The specific working flow of the device embodiment is as follows: first, a receiving unit 501 in a server that processes source file data receives a source file data stream sent by another server, and then a processing unit 502 processes the source file data stream according to the received source file data stream and by using a data processing model corresponding to the source file data stream in a memory channel, so as to obtain a target file data stream.
There are many embodiments of the apparatus for processing a source file data stream, and in one embodiment, the apparatus further includes a listening unit 503, where the listening unit 503 may be configured to:
monitoring whether a source file data stream arrives, and if so, receiving the source file data stream; if not, the source file data stream continues to be monitored.
The monitoring unit 503 can remind the server that the source file data stream has arrived in real time, and enable the server to process the source file data stream in time, thereby improving the efficiency of processing the source file data stream.
In another embodiment, the receiving unit 501 is specifically configured to:
a source file data stream sent by a specified server in a configuration file is received.
The receiving unit 501 receives a source file data stream sent by a designated server, so as to ensure the security of data transmission and prevent other servers from performing illegal operations on the server processing the source file data.
In yet another embodiment, the apparatus includes a storage unit 504, the storage unit 504 is configured to:
storing the source file data stream and/or the target file data stream.
The storage unit 504 is configured to store the source file data and/or the destination file data stream after the server processes the received source file data stream, so as to avoid consuming a relatively long time for storing the source file data by the database when processing the source file data.
The beneficial effects obtained by applying the embodiment of the device are the same as or similar to the beneficial effects obtained by the embodiment of the method in embodiment 1, and are not repeated here for avoiding repetition.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method of data processing, the method comprising:
receiving a source file data stream;
inputting the source file data stream into a memory channel, and processing the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, wherein the memory channel comprises at least one data processing model, and the data processing model is obtained by training the content of the source file data stream as input data and the content of the target file data stream as output data;
the processing the source file data stream by using a data processing model corresponding to the source file data stream in a memory channel to obtain a target file data stream includes: inputting the source file data stream into the corresponding data processing model, so that the data processing model outputs the target file data stream.
2. The method of claim 1, wherein prior to receiving the source file data stream, the method further comprises:
monitoring whether a source file data stream arrives, and if so, receiving the source file data stream; if not, the source file data stream continues to be monitored.
3. The method of claim 1, wherein receiving the source file data stream comprises:
a source file data stream sent by a specified server in a configuration file is received.
4. The method of claim 1, wherein after obtaining the target file data stream, the method further comprises:
storing the source file data stream and/or the target file data stream.
5. The method of claim 1, wherein the source file data stream is a data stream in binary encoded form.
6. A method of rate quotation, the method comprising:
a third party payment platform server receives a rate offer source file stream from a financial system connected with the third party payment platform;
inputting the rate offer source file stream into a memory channel by a third-party payment platform server, and processing the rate offer source file stream by using a data processing model corresponding to the rate offer source file stream in the memory channel to obtain a target rate offer file stream, wherein the memory channel comprises at least one data processing model, and the data processing model is obtained by training the content of the rate offer source file stream as input data and the content of the target rate offer file stream as output data;
the processing the rate offer source file stream by using a data processing model corresponding to the rate offer source file stream in a memory channel to obtain a target rate offer file stream, including: and inputting the source file stream of the rate quotation into the corresponding data processing model so as to enable the data processing model to output the target rate quotation file stream.
7. An apparatus for data processing, the apparatus comprising:
a receiving unit and a processing unit, wherein:
the receiving unit is used for receiving a source file data stream;
the processing unit is configured to input the source file data stream into a memory channel, and process the source file data stream by using a data processing model corresponding to the source file data stream in the memory channel to obtain a target file data stream, where the memory channel includes at least one data processing model, and the data processing model is obtained by training the source file data stream as input data and the target file data stream as output data;
the processing unit is further configured to input the source file data stream into the corresponding data processing model, so that the data processing model outputs the target file data stream.
8. The apparatus of claim 7, further comprising a listening unit configured to:
monitoring whether a source file data stream arrives, and if so, receiving the source file data stream; if not, the source file data stream continues to be monitored.
9. The apparatus according to claim 7, wherein the receiving unit is specifically configured to:
a source file data stream sent by a specified server in a configuration file is received.
10. The apparatus of claim 7, comprising a storage unit to:
storing the source file data stream and/or the target file data stream.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610128412.2A CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610128412.2A CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107169854A CN107169854A (en) | 2017-09-15 |
| CN107169854B true CN107169854B (en) | 2021-04-02 |
Family
ID=59849807
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610128412.2A Active CN107169854B (en) | 2016-03-07 | 2016-03-07 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107169854B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704480A (en) * | 2018-06-21 | 2020-01-17 | 马上消费金融股份有限公司 | Streaming data processing method and system, electronic equipment and storage medium |
| CN110162333B (en) * | 2019-05-10 | 2023-05-05 | 中信银行股份有限公司 | Multi-service scene policy management platform based on Drools rule engine |
| CN111767129B (en) * | 2020-06-30 | 2021-10-29 | 深圳职业技术学院 | Data flow task processing device and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101399672A (en) * | 2008-10-17 | 2009-04-01 | 章毅 | Intrusion detection method for fusion of multiple neutral networks |
| CN101562539A (en) * | 2009-05-18 | 2009-10-21 | 重庆大学 | Self-adapting network intrusion detection system |
| CN102646332A (en) * | 2011-02-21 | 2012-08-22 | 日电（中国）有限公司 | Traffic state estimation device and method based on data fusion |
| CN103731298A (en) * | 2013-11-15 | 2014-04-16 | 中国航天科工集团第二研究院七〇六所 | Large-scale distributed network safety data acquisition method and system |
| CN105989179A (en) * | 2015-03-06 | 2016-10-05 | 北京邮电大学 | Financial data processing method and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5533188B2 (en) * | 2010-04-21 | 2014-06-25 | 富士通株式会社 | Financial data processing apparatus, financial data processing method, and financial data processing program |
| US20130159351A1 (en) * | 2011-12-14 | 2013-06-20 | International Business Machines Corporation | Asset Identity Resolution Via Automatic Model Mapping Between Systems With Spatial Data |
-
2016
- 2016-03-07 CN CN201610128412.2A patent/CN107169854B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101399672A (en) * | 2008-10-17 | 2009-04-01 | 章毅 | Intrusion detection method for fusion of multiple neutral networks |
| CN101562539A (en) * | 2009-05-18 | 2009-10-21 | 重庆大学 | Self-adapting network intrusion detection system |
| CN102646332A (en) * | 2011-02-21 | 2012-08-22 | 日电（中国）有限公司 | Traffic state estimation device and method based on data fusion |
| CN103731298A (en) * | 2013-11-15 | 2014-04-16 | 中国航天科工集团第二研究院七〇六所 | Large-scale distributed network safety data acquisition method and system |
| CN105989179A (en) * | 2015-03-06 | 2016-10-05 | 北京邮电大学 | Financial data processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107169854A (en) | 2017-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105337928B (en) | Method for identifying ID, safety protection problem generation method and device | |
| CN107679856B (en) | Transaction-based service control method and device | |
| JP6703013B2 (en) | Payment threshold acquisition method and device | |
| TW201802732A (en) | Method and device for controlling data risk | |
| CN107346463B (en) | Method and device for training risk control model and determining model input data | |
| CN107169854B (en) | Data processing method and device | |
| Martinčević et al. | FinTech revolution in the financial industry | |
| CN110930578A (en) | Voting method, equipment and medium based on block chain | |
| CN111127216A (en) | Method, equipment and medium for realizing bank financing product based on block chain | |
| CN109711986A (en) | A kind of token application and award method based on cloud storage plateform system | |
| CN106571946B (en) | Resource processing method and device | |
| CN113850066A (en) | Protocol text generation method, device and equipment | |
| CN112449021B (en) | Internet resource screening method and device | |
| CN108984606A (en) | A kind of company information classified display system and method | |
| CN112330373A (en) | User behavior analysis method and device and computer readable storage medium | |
| KR101701449B1 (en) | System for automatical selling exchange | |
| CN112967119A (en) | Bidding method, device and medium based on block chain | |
| CN109614548B (en) | Information display method and device based on service user number change rate and storage medium | |
| CN111177093A (en) | Method, device and medium for sharing scientific and technological resources | |
| CN111062764A (en) | Block chain-based electronic equity transaction method, equipment and medium | |
| CN104123634B (en) | A kind of data interaction device and method applied to mobile terminal | |
| CN110147999A (en) | A kind of transaction risk recognition methods and device | |
| CN111489249A (en) | Method, equipment and medium for constructing financial wind control alliance based on block chain | |
| CN105659267B (en) | Method and equipment for processing electronic money | |
| CN110442501A (en) | The method, apparatus and electronic equipment of analog service exception |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1244093 Country of ref document: HK |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200923 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200923 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |