CN115866048A - Data processing method and device, storage medium and electronic device - Google Patents
Data processing method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN115866048A CN115866048A CN202211522058.3A CN202211522058A CN115866048A CN 115866048 A CN115866048 A CN 115866048A CN 202211522058 A CN202211522058 A CN 202211522058A CN 115866048 A CN115866048 A CN 115866048A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- target data
- terminal
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data processing method and device, a storage medium and an electronic device, wherein the method comprises the following steps: receiving data transmitted by a target data interface; determining transmission information of data from the acquired configuration information of the target data interface, wherein the transmission information comprises parameter information of a first terminal, and the first terminal is a terminal to which data is to be sent; carrying out format conversion on the data according to the parameter information of the first terminal to obtain first target data; and monitoring the transmission of the target data under the condition of transmitting the first target data according to the parameter information of the first terminal. The invention solves the problem that the data can not be managed uniformly in the related technology.
Description
Technical Field
The embodiment of the invention relates to the field of data processing, in particular to a data processing method and device, a storage medium and an electronic device.
Background
With the increasing number of systems in enterprises, the phenomena of isolation, lack of sharing, isolation of business data, split information flow and the like are caused by different platforms, different technologies and different languages among the systems. Important business information can not smoothly flow between departments and between systems, and an integrated platform target of enterprise information concentration, management concentration and business concentration can not be realized, so that an information isolated island is formed. In addition, many modules exist in the system, and the modules are also required to be integrated with other external systems. In order to break information islands and solve system integration, many large enterprises purchase business integration software, and the adoption of the business integration software has the problems that: the price is high, the software purchasing cost is high, the operation and maintenance cost is high, the weight is large, the operation and maintenance are difficult (a professional operation and maintenance team is needed), and the method is not suitable for all enterprises or systems. Some enterprises adopt an open source Message Queue (MQ) to solve the integration problem between systems, and the MQ has the following problems: as the number of the interfaces to be connected is increased, a spider-web type relationship is formed, later maintenance is not convenient, each module is communicated with an external system independently when the internal system and the external system are connected in a butt joint mode, communication cost is increased, and a unified message monitoring function for centralized monitoring of messages is not provided.
Disclosure of Invention
The embodiment of the invention provides a data processing method and device, a storage medium and an electronic device, which at least solve the problem that data cannot be uniformly managed in the related art.
According to an embodiment of the present invention, there is provided a data processing method including: receiving data transmitted by a target data interface; determining transmission information of the data from the acquired configuration information of the target data interface, wherein the transmission information includes parameter information of a first terminal, and the first terminal is a terminal to which the data is to be sent; carrying out format conversion on the data according to the parameter information of the first terminal to obtain first target data; and monitoring the transmission of the target data under the condition that the first target data is transmitted according to the parameter information of the first terminal.
According to another embodiment of the present invention, there is provided a log storage apparatus including: the first receiving module is used for receiving data transmitted by the target data interface; a first determining module, configured to determine transmission information of the data from the acquired configuration information of the target data interface, where the transmission information includes parameter information of a first terminal, and the first terminal is a terminal to which the data is to be sent; the first conversion module is used for carrying out format conversion on the data according to the parameter information of the first terminal to obtain first target data; and the first monitoring module is used for monitoring the sending of the target data under the condition that the first target data is sent according to the parameter information of the first terminal.
In an exemplary embodiment, the first determining module includes one of: a first obtaining unit, configured to obtain transmission information of the data from configuration information of the target data interface when the configuration information of the target data interface is queried from a configuration information database according to interface information of the target data interface; and the second acquisition unit is used for inquiring the configuration information of the target data interface from the configuration information database and acquiring the transmission information of the data from the inquired configuration information of the target data interface under the condition that the configuration information of the target data interface is not inquired from the configuration information cache according to the interface information of the target data interface.
In an exemplary embodiment, the apparatus further includes: a first obtaining module, configured to obtain configuration information of N data interfaces before determining transmission information of the data from the obtained configuration information of the target data interface, to obtain N configuration information, where N is a natural number greater than or equal to 1, the target data interface is any one of the N data interfaces, and the configuration information of each data interface includes at least one of: interface name of the data interface, terminal information of a terminal connected with the data interface, and parameter information of data transmitted by the data interface; and the first storage module is used for storing the N pieces of configuration information into a configuration information database.
In an exemplary embodiment, the first monitoring module includes: a first extracting unit, configured to extract account information of the first terminal from parameter information of the first terminal; a first sending unit, configured to send the first target data according to the account information of the first terminal; a first receiving unit, configured to receive feedback information sent by the first terminal, where the feedback information includes information about whether an operation performed on the first target data by the first terminal is abnormal; and a first monitoring unit, configured to monitor sending of the first target data from the feedback information.
In an exemplary embodiment, the apparatus further includes: a second storage module, configured to, after monitoring sending of the first target data from the feedback information, correspondingly store the feedback information in a database in which the data and the first target data are correspondingly stored; and a first retransmission module, configured to retransmit the target data based on the urgency level of the first target data when it is determined from the feedback information that an operation performed by the first terminal on the first target data is abnormal.
In an exemplary embodiment, the first retransmission module includes: a third obtaining unit, configured to obtain the first target data from the database when the urgency level of the first data is greater than a preset urgency level; a first changing unit, configured to change parameter information of the first target data according to parameter information of the first terminal, to obtain second target data; a first sending unit, configured to send the second target data from the database to the first terminal.
In an exemplary embodiment, the apparatus further includes: and a third storage module, configured to, after determining the transmission information of the data from the acquired configuration information of the target data interface, store the transmission information of the data in a configuration information cache when the transmission information of the data is read from a configuration information database.
According to a further embodiment of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the steps of any of the above-mentioned method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
According to the invention, after the data is received from the target data interface, the configuration information of the target data interface is obtained, the configuration information comprises the parameter information of the first terminal to be sent, the data is converted into the data format which can be identified by the first terminal according to the parameter information, then the target data after the format conversion is sent to the first terminal, and whether the first terminal successfully receives the target data is monitored. Therefore, the unified management of the configuration information of the data interface can be realized, the format of the data is uniformly converted, the sending process of the data is uniformly monitored, the later-stage management and maintenance of the data are facilitated, and the data communication cost is reduced. Therefore, the problem that data cannot be uniformly managed in the related art can be solved.
Drawings
Fig. 1 is a block diagram of a hardware configuration of a mobile terminal of a data processing method according to an embodiment of the present invention;
FIG. 2 is a flow diagram of a data processing method according to an embodiment of the invention;
FIG. 3 is a flow diagram of a method of processing data by a data processing system according to an embodiment of the present invention;
fig. 4 is a block diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The following explains the related terms involved in the present embodiment:
and (3) message queue MQ: the container of the message is saved during the transmission of the message. The message queue manager acts as a man-in-the-middle in relaying a message from its source to its destination. The main purpose of the queues is to provide routing and guarantee delivery of messages; if the recipient is not available when the message is sent, the message queue will hold the message until it can be successfully delivered.
Name Remote Dictionary service (Remote Dictionary Server, redis): the system is an open source log type and Key-Value cache database which is written by using ANSIC language, supports network, can be based on memory and can be persisted, and provides an Application Program Interface (API) of multiple languages.
Configuring a platform: the platform for managing the constant information has the functions of adding, inquiring, modifying, deleting and the like, and provides an API (application program interface) for other systems to call.
The method embodiments provided in the embodiments of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the example of being operated on a mobile terminal, fig. 1 is a hardware structure block diagram of the mobile terminal of a data processing method according to an embodiment of the present invention. As shown in fig. 1, the mobile terminal may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), and a memory 104 for storing data, wherein the mobile terminal may further include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those of ordinary skill in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the mobile terminal. For example, the mobile terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the data processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In the present embodiment, a data processing method is provided, and fig. 2 is a flowchart of a data processing method according to an embodiment of the present invention, where as shown in fig. 2, the flowchart includes the following steps:
step 202, receiving data transmitted by a target data interface;
step 204, determining transmission information of data from the acquired configuration information of the target data interface, wherein the transmission information includes parameter information of a first terminal, and the first terminal is a terminal to which data is to be sent;
step 206, performing format conversion on the data according to the parameter information of the first terminal to obtain first target data;
and step 208, monitoring the transmission of the target data under the condition that the first target data is transmitted according to the parameter information of the first terminal.
Alternatively, the target data interface may be any of a plurality of data interfaces coupled to the MQ. Data is received from the message queue, the data including message data for the device internal module and the device external system. For example, the data may be synchronization data that needs to be synchronized to a downstream terminal in a data synchronization scenario; the data may also be order data in an online shopping scenario, and the order data needs to be sent to a downstream terminal. It should be noted that, during the transmission process, the data may be encrypted based on the actual usage scenario. For example, in a scenario involving the transmission of cryptographic account information, data needs to be encrypted.
Optionally, the configuration information of the target data interface may include parameter information of the first terminal, and may further include: parameter information of the sending terminal, an abnormal message included in the data transmission process, a data format conversion template, message queue-related information (e.g., address, name, retry number, user name, password), an internal message, an external message, etc. The configuration information has the functions of managing interface information of a plurality of constants in a centralized manner, flexibly modifying and taking effect in time (code modification is not needed), and abstracting reusable code by a public part (code development workload is saved). The parameter information of the first terminal comprises information such as an account number, a password, a name, an attribute and a data format supported by the first terminal.
Alternatively, the data may be format-converted in a data format supported by the first terminal. For example, the first terminal supports data in XML format, and the original format of the data is JSON format, the data may be converted into data in XML format. And then sending the data in the XML format to the first terminal, and processing the XML data after the first terminal receives the XML data. For example, operations of changing data, deleting data, and the like are performed in accordance with the data content in the XML data. In this embodiment, the result of processing the XML data by the first terminal may be supervised, for example, in the case that the XML data processing by the first terminal fails, the failure feedback information may be fed back to the supervision platform, and the supervision platform acquires the data from the database again for processing and then retransmits the data.
Optionally, when an abnormality (for example, a network disconnection) occurs in the first terminal, the target data cannot be received, and the supervision platform may learn that the target data is failed to be sent, and may also periodically resend the target data.
The execution subject of the above steps may be a server, a specific processor provided in the server, or a processor or processing device provided relatively independently from the server, but is not limited thereto.
Through the steps, after the data is received from the target data interface, the configuration information of the target data interface is obtained, the configuration information comprises parameter information of a first terminal to which the data is to be sent, the data is converted into a data format which can be identified by the first terminal according to the parameter information, then the target data after the format conversion is sent to the first terminal, and whether the first terminal successfully receives the target data is monitored. Therefore, the unified management of the configuration information of the data interface can be realized, the format of the data is uniformly converted, the sending process of the data is uniformly monitored, the later-stage management and maintenance of the data are facilitated, and the data communication cost is reduced. Therefore, the problem that data cannot be uniformly managed in the related art can be solved.
In an exemplary embodiment, determining the transmission information of the data from the acquired configuration information of the target data interface includes one of:
s11, acquiring transmission information of data from the configuration information of the target data interface under the condition that the configuration information of the target data interface is inquired from the configuration information database according to the interface information of the target data interface;
and S12, under the condition that the configuration information of the target data interface is not inquired from the configuration information cache according to the interface information of the target data interface, inquiring the configuration information of the target data interface from the configuration information database, and acquiring the transmission information of the data from the inquired configuration information of the target data interface.
Optionally, the interface information of the target data interface includes information such as an interface name and an interface model of the target data interface. For example, in the case where the configuration information is found in the database by the interface name, the account number and password of the downstream terminal of the data are acquired from the configuration information. And sending the target data to the downstream terminal for processing according to the account number and the password of the downstream terminal. When the interface information of the target data interface is first queried, the database needs to be queried.
And under the condition of inquiring the interface information of the target data interface for the second time, firstly inquiring in the configuration information cache, and under the condition of not inquiring the interface information, turning to the inquiry in the database. That is, in the case that the interface information of the target data interface is first queried in the database, the interface information may be cached in the configuration information cache, so as to facilitate the next query.
Through the embodiment, the interface information can be uniformly managed by inquiring the interface information in the database or the cache, so that the rapid conversion and transmission of the data are realized.
In an exemplary embodiment, before determining the transmission information of the data from the obtained configuration information of the target data interface, the method further includes:
s21, acquiring configuration information of N data interfaces to obtain N configuration information, wherein N is a natural number greater than or equal to 1, a target data interface is any one of the N data interfaces, and the configuration information of each data interface comprises at least one of the following: the interface name of the data interface, the terminal information of the terminal connected with the data interface, and the parameter information of the data transmitted by the data interface;
and S22, storing the N pieces of configuration information into a configuration information database.
Optionally, before querying the configuration information from the database or the cache, the configuration information of the interface connected to the message queue needs to be stored. And unified management is performed in the database, so that the query of the configuration information is facilitated. It should be noted that, in the database, each configuration information may be sorted according to the stored time sequence, or may be sorted based on the type of the data interface.
In one exemplary embodiment, in the case where the first target data is transmitted according to the parameter information of the first terminal, monitoring transmission of the first target data includes:
s31, extracting account information of the first terminal from the parameter information of the first terminal;
s32, sending first target data according to the account information of the first terminal;
s33, receiving feedback information sent by the first terminal, wherein the feedback information comprises information about whether the first terminal performs an operation on the first target data;
and S34, monitoring the transmission of the first target data from the feedback information.
Optionally, the account information of the first terminal includes information such as an account name and a password of the first terminal. For example, when the account name and password of the shopping account are extracted, the generated order information is sent to the shopping account for payment. And identifying whether the order information is correct or not in the shopping account, and performing payment operation. In case the payment is successful, a message of successful payment is uploaded to the background server. In the case of a payment failure, a payment failure message is uploaded to the background server. And the background server regenerates new order information in the database and sends the new order information to the shopping account for re-payment.
Through the embodiment, the data sent to the downstream is monitored, the running condition of the data at the downstream can be known in time, and the data is retransmitted in time under the condition of an error, so that the data processing efficiency is improved.
In one exemplary embodiment, after monitoring the transmission of the first target data from the feedback information, the method further comprises:
s41, correspondingly storing the feedback information into a database in which the data and the first target data are correspondingly stored;
and S42, in the case that the operation executed by the first terminal on the first target data is determined to be abnormal from the feedback information, retransmitting the target data based on the urgency level of the first target data.
Optionally, the data is stored in a database after it is acquired. After the data is subjected to format conversion, the converted first target data is stored in a database and is in a different field from the original data. After the first target data is sent, the operation information of the first target data sent by the first terminal is also stored in the database and is in a different field from the original data. The database comprises the original data, the first target data after format conversion and feedback information capable of reflecting the operation process executed by the downstream terminal on the first target data. Therefore, unified management and monitoring of data can be realized.
In one exemplary embodiment, in a case where it is determined from the feedback information that an abnormality occurs in an operation performed by the first terminal on the first target data, retransmitting the first target data based on the urgency of the first target data, includes:
s51, acquiring first target data from a database under the condition that the emergency degree of the first data is greater than a preset emergency degree;
s52, changing the parameter information of the first target data according to the parameter information of the first terminal to obtain second target data;
and S53, sending the second target data from the database to the first terminal.
Alternatively, the urgency of the first data may be preset. For example, the urgency level of the synchronization data is set to non-urgency data, and the alarm data is set to urgency data. And under the condition that the identification of the alarm data by the downstream first terminal is wrong, the first terminal sends the feedback information to the monitoring platform. And the monitoring platform directly acquires the original data of the alarm data from the database under the condition of determining the data is the emergency data, and sends the data to the first terminal after format conversion is carried out again, so that the timeliness of data sending can be ensured. For another example, in the case that the feedback information received from the first terminal indicates that the data is the synchronization data, the feedback information may be transmitted to the upstream terminal, and the upstream terminal retransmits the synchronization data, so that the accuracy of data transmission may be ensured.
It should be noted that the first terminal may also feed back the feedback information to the configuration information processing module through another data interface, and store the feedback information and the configuration information in a corresponding manner.
Through the embodiment, the data can be timely and effectively retransmitted through judging the data emergency degree, and the data processing efficiency is improved.
In an exemplary embodiment, after determining the transmission information of the data from the acquired configuration information of the target data interface, the method further includes:
and S61, storing the transmission information of the data into a configuration information cache when the transmission information of the data is read out from the configuration information database.
Optionally, after the transmission information is fetched from the database, the transmission information may be cached in the configuration information cache in real time, so that the data is directly fetched from the cache in the next use, the data reading speed is increased, and the data processing efficiency is improved.
The following describes the data processing method in this embodiment with reference to specific embodiments:
in this embodiment, a data processing system is used to perform data processing as an example, and as shown in fig. 3, the data processing system includes: the method comprises the following steps of integrating a platform, a monitoring platform and a configuration platform, wherein the interaction process among the integrating platform, the monitoring platform and the configuration platform comprises the following steps:
s301, receiving messages (corresponding to the data) from the message queue through an interface, wherein the messages comprise messages of an internal module and messages of an external system;
s302, inquiring configuration information of the interface from a configuration platform according to the interface name of the interface;
s303, the configuration platform has a cache function, firstly queries from a Redis cache, and queries from a configuration database if no data exists in the cache; the configuration information includes, for the interface: send, receive, exception message notification email template (subject, sender, receiver, content), message conversion template, message queue related information (address, name, number of retries, username, password), internal or external message, etc. The role of the configuration information includes: the constants are managed in a centralized manner, can be flexibly modified and take effect in time (code modification is not needed), and the reusable code is abstracted from the public part (code development workload is saved). The configuration platform adds, deletes and modifies related configuration information through pages, wherein the main item is an interface name, and the sub item is specific configuration information (in the form of key/value). A large item is created and then the sub-item content is configured.
S304-S305, storing the received message into a message database of the monitoring platform data, wherein the stored fields comprise the following transmission information of the interface: ID. Interface name, service ID, sender, receiver, original message body, receiving time, internal or external message, etc.;
s306, analyzing the message, and if the message is feedback information of the downstream system and the feedback information is abnormal information, sending a mail according to the related information of the mail template in the configuration to notify a related service party;
s307, converting the message format according to the configured conversion template, and converting the message format into a format required by the downstream; the format of the downstream requirements includes: JSON or XML format. In addition, different services and different system requirements are different, some systems have fixed format requirements, some necessary fields need to be filled by an integration platform, a mapping relation exists in the middle, and an integration group maintains the mapping relation.
S308, assembling the message according to the message queue connection information in the configuration information, wherein the password in the configuration information needs to be decrypted first and then the message is sent finally, and if the sending fails, the message is retransmitted according to the retransmission configuration in the configuration; for example, according to the message queue information in the configuration, a connection is established with the message queue server, and relevant information is stuffed into the message header and the message body. The encryption of the password in the configuration information is that an integration group generates a ciphertext according to a tool and then configures the ciphertext into a configuration platform; the purpose of encryption includes: because the configuration platform may be a common platform, it is preferable that sensitive information, such as passwords, not be kept in the clear for security reasons.
S309, updating the message record of S303, and updating the field by querying the field, where the queried field may include: interface name, service identification ID (upstream system settings), time range, transmission status, etc. The updated fields include: the converted message body, sending time, sending times, success and failure identification and the like; if the codes of the internal modules of the system have bugs, the data sent to the downstream external system has problems, the modification of the codes and the retransmission of the modified codes take a long time, and the message body can be modified from the monitoring center to be retransmitted in an emergency.
It should be noted that the feedback information may be determined by: the downstream system feeds back the processing result, and if the processing result is abnormal, the integrated platform needs to send the mail to a related party; alternatively, the next week the external system process failed, the upstream system is manually notified.
The embodiment collects the information of each system or module in a centralized way, and processes (receives, converts the format and forwards) uniformly; monitoring messages in a centralized manner, collecting storage information according to a uniform format, and providing information query and retransmission functions; the code development amount can be reduced, and the actions of format conversion or sending and receiving messages are all public codes; and centralized management of various configuration information can be realized, such as: and the connection information, the account number and the format conversion template of the MQ. Messages, message interfaces and related configurations are managed in a centralized mode, message format conversion is converted in a unified mode, on one hand, later maintenance can be facilitated, and on the other hand, an integrated group communicates with an external system in a unified mode, so that communication cost is effectively reduced; the messages are monitored in a centralized mode, all the messages can be inquired from one page, and the original messages can be retransmitted manually or retransmitted after the message bodies are modified under special scenes.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a data processing apparatus is further provided, and the apparatus is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 4 is a block diagram of a data processing apparatus according to an embodiment of the present invention, as shown in fig. 4, the apparatus including:
a first receiving module 42, configured to receive data transmitted by the target data interface;
a first determining module 44, configured to determine transmission information of the data from the obtained configuration information of the target data interface, where the transmission information includes parameter information of a first terminal, and the first terminal is a terminal to which the data is to be sent;
a first conversion module 46, configured to perform format conversion on the data according to the parameter information of the first terminal to obtain first target data;
a first monitoring module 48, configured to monitor sending of the target data when the first target data is sent according to the parameter information of the first terminal.
In an exemplary embodiment, the first determining module includes one of:
a first obtaining unit, configured to obtain transmission information of the data from configuration information of the target data interface when the configuration information of the target data interface is queried from a configuration information database according to interface information of the target data interface;
and the second acquisition unit is used for inquiring the configuration information of the target data interface from the configuration information database and acquiring the transmission information of the data from the inquired configuration information of the target data interface under the condition that the configuration information of the target data interface is not inquired from the configuration information cache according to the interface information of the target data interface.
In an exemplary embodiment, the apparatus further comprises:
a first obtaining module, configured to obtain configuration information of N data interfaces before determining transmission information of the data from the obtained configuration information of the target data interface, to obtain N configuration information, where N is a natural number greater than or equal to 1, the target data interface is any one of the N data interfaces, and the configuration information of each data interface includes at least one of: interface name of the data interface, terminal information of a terminal connected with the data interface, and parameter information of data transmitted by the data interface;
and the first storage module is used for storing the N pieces of configuration information into a configuration information database.
In an exemplary embodiment, the first monitoring module includes:
a first extracting unit, configured to extract account information of the first terminal from parameter information of the first terminal;
a first sending unit, configured to send the first target data according to the account information of the first terminal;
a first receiving unit, configured to receive feedback information sent by the first terminal, where the feedback information includes information about whether an operation performed on the first target data by the first terminal is abnormal;
and a first monitoring unit, configured to monitor sending of the first target data from the feedback information.
In an exemplary embodiment, the apparatus further comprises: a second storage module, configured to, after monitoring sending of the first target data from the feedback information, correspondingly store the feedback information in a database in which the data and the first target data are correspondingly stored;
and a first retransmission module, configured to retransmit the target data based on the urgency level of the first target data when it is determined from the feedback information that an operation performed by the first terminal on the first target data is abnormal.
In an exemplary embodiment, the first retransmission module includes:
a third obtaining unit, configured to obtain the first target data from the database when the urgency level of the first data is greater than a preset urgency level;
a first changing unit, configured to change parameter information of the first target data according to the parameter information of the first terminal, so as to obtain second target data;
a first sending unit, configured to send the second target data from the database to the first terminal.
In an exemplary embodiment, the apparatus further includes:
and a third storage module, configured to, after determining the transmission information of the data from the acquired configuration information of the target data interface, store the transmission information of the data in a configuration information cache when the transmission information of the data is read from a configuration information database.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, wherein the computer program is arranged to perform the steps of any of the above-mentioned method embodiments when executed.
In the present embodiment, the above-described computer-readable storage medium may be configured to store a computer program for executing the above steps.
In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention further provide an electronic device, comprising a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
In an exemplary embodiment, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
In an exemplary embodiment, the processor may be configured to execute the above steps by a computer program.
For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary embodiments, and details of this embodiment are not repeated herein.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented in a general purpose computing device, they may be centralized in a single computing device or distributed across a network of multiple computing devices, and they may be implemented in program code that is executable by a computing device, such that they may be stored in a memory device and executed by a computing device, and in some cases, the steps shown or described may be executed in an order different from that shown or described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps therein may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A data processing method, comprising:
receiving data transmitted by a target data interface;
determining transmission information of data from the acquired configuration information of the target data interface, wherein the transmission information comprises parameter information of a first terminal, and the first terminal is a terminal to which data is to be sent;
carrying out format conversion on the data according to the parameter information of the first terminal to obtain first target data;
and monitoring the transmission of the target data under the condition of transmitting the first target data according to the parameter information of the first terminal.
2. The method of claim 1, wherein determining the transfer information for the data from the retrieved configuration information for the target data interface comprises one of:
acquiring transmission information of data from the configuration information of the target data interface under the condition that the configuration information of the target data interface is inquired from the configuration information database according to the interface information of the target data interface;
and under the condition that the configuration information of the target data interface is not inquired from the configuration information cache according to the interface information of the target data interface, inquiring the configuration information of the target data interface from the configuration information database, and acquiring the transmission information of the data from the inquired configuration information of the target data interface.
3. The method of claim 1, wherein prior to determining the transfer information for the data from the retrieved configuration information for the target data interface, the method further comprises:
acquiring configuration information of N data interfaces to obtain N configuration information, wherein N is a natural number greater than or equal to 1, a target data interface is any one of the N data interfaces, and the configuration information of each data interface comprises at least one of the following: the interface name of the data interface, the terminal information of the terminal connected with the data interface, and the parameter information of the data transmitted by the data interface;
and storing the N pieces of configuration information into a configuration information database.
4. The method of claim 1, wherein monitoring the transmission of the first target data in case of transmitting the first target data according to the parameter information of the first terminal, comprises:
extracting account information of the first terminal from the parameter information of the first terminal;
sending first target data according to account information of a first terminal;
receiving feedback information sent by a first terminal, wherein the feedback information comprises information about whether the first terminal performs an operation on first target data;
the transmission of the first target data is monitored from the feedback information.
5. The method of claim 4, wherein after monitoring the transmission of the first target data from the feedback information, the method further comprises:
correspondingly storing the feedback information into a database in which the data and the first target data are correspondingly stored;
and in the case that the abnormality of the operation performed on the first target data by the first terminal is determined from the feedback information, retransmitting the target data based on the urgency level of the first target data.
6. The method of claim 5, wherein the retransmitting the first target data based on the urgency of the first target data in the case where it is determined from the feedback information that the operation performed by the first terminal on the first target data is abnormal, comprises:
acquiring first target data from a database under the condition that the emergency degree of the first data is greater than a preset emergency degree;
changing the parameter information of the first target data according to the parameter information of the first terminal to obtain second target data;
and sending the second target data to the first terminal from the database.
7. The method of claim 1, wherein after determining the transmission information of the data from the obtained configuration information of the target data interface, the method further comprises:
and in the case of reading the transmission information of the data from the configuration information database, storing the transmission information of the data into the configuration information cache.
8. A data processing apparatus, comprising:
the first receiving module is used for receiving data transmitted by the target data interface;
the first determining module is used for determining transmission information of data from the acquired configuration information of the target data interface, wherein the transmission information comprises parameter information of a first terminal, and the first terminal is a terminal to which the data is to be sent;
the first conversion module is used for carrying out format conversion on the data according to the parameter information of the first terminal to obtain first target data;
and the first monitoring module is used for monitoring the sending of the target data under the condition of sending the first target data according to the parameter information of the first terminal.
9. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, wherein the computer program, when being executed by a processor, carries out the method of any one of claims 1 to 7.
10. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program and the processor is arranged to execute the computer program to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211522058.3A CN115866048A (en) | 2022-11-30 | 2022-11-30 | Data processing method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211522058.3A CN115866048A (en) | 2022-11-30 | 2022-11-30 | Data processing method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115866048A true CN115866048A (en) | 2023-03-28 |
Family
ID=85668415
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211522058.3A Pending CN115866048A (en) | 2022-11-30 | 2022-11-30 | Data processing method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115866048A (en) |
-
2022
- 2022-11-30 CN CN202211522058.3A patent/CN115866048A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101371237B (en) | Performing message payload processing functions in a network element on behalf of an application | |
| CN101204039B (en) | System and method of device-to-server registration | |
| US20020107752A1 (en) | System and method for integrating web-originated orders with backend business systems | |
| CN111030784A (en) | Information synchronization method and device | |
| CN101194233A (en) | System and method of testing wireless component applications | |
| US8112481B2 (en) | Document message state management engine | |
| CN105791399B (en) | More trunk interconnection net big data method for pushing and system | |
| US6925488B2 (en) | Distributed intelligent information technology operations automation | |
| CN110688828A (en) | File processing method and device, file processing system and computer equipment | |
| CN103514156B (en) | A kind of method that network service text is translated in transmitting procedure | |
| US20210034338A1 (en) | Communications Enablement Platform, System, and Method | |
| CN1973282A (en) | System and method for managing a change to a cluster configuration | |
| CN111917630B (en) | Data transmission method, data transmission device, storage medium and electronic device | |
| CN114401284A (en) | Real-time data acquisition and transmission system and method for fixed pollution source treatment working condition | |
| US20020138605A1 (en) | Message tracking system and method | |
| CN111064638B (en) | Method, device, equipment and storage medium for testing e-mail protocol service | |
| CN114125049A (en) | Telemetry message processing method, device, equipment and storage medium | |
| US8234338B1 (en) | System and method for reliable message delivery | |
| US8767707B2 (en) | Monitoring a mobile data service associated with a mailbox | |
| WO2021068959A1 (en) | Data processing method and apparatus | |
| US20060218237A1 (en) | Wireless data device with confirmation and retry capabilities for pushed data | |
| CN115866048A (en) | Data processing method and device, storage medium and electronic device | |
| CN110825538A (en) | MQ-based method for dynamically interacting data by self-defining data types | |
| CN100407836C (en) | Method and system for testing short message central function | |
| US20070270169A1 (en) | Enhanced Wireless Short Message Service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |