CN109743134B - Quick data conversion and transmission system and method thereof - Google Patents
Quick data conversion and transmission system and method thereof Download PDFInfo
- Publication number
- CN109743134B CN109743134B CN201811606156.9A CN201811606156A CN109743134B CN 109743134 B CN109743134 B CN 109743134B CN 201811606156 A CN201811606156 A CN 201811606156A CN 109743134 B CN109743134 B CN 109743134B
- Authority
- CN
- China
- Prior art keywords
- data
- module
- sending
- strategy
- preparation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses a rapid data conversion and transmission system and a method thereof, comprising a data preparation module, a strategy selection module and a data processing and transmission module, wherein the modules realize data transmission through an input/output interface, the data preparation module is used for receiving external data information and data preprocessing, classifying data according to strategies and selecting a data processing server, and performing built-in optimization processing for data transmission; the strategy selection module is used for selecting an optimization strategy and strategy selection during data preparation and transmission to pre-classify and classify the messages and selecting a corresponding strategy of the data; and the data processing and sending module is used for receiving the strategy returned by the strategy selection module, carrying out sending preparation work and setting a sending strategy. The invention can improve the sending efficiency and the conversion rate, reduce the manual intervention and make the system more intelligent.
Description
Technical Field
The present invention relates to a data conversion and transmission system and method, and more particularly, to a fast data conversion and transmission system and method.
Background
The current data processing technology cannot dynamically change the processing flow and the processing result, the input and the flow at the early stage need to be determined in advance and then executed according to a template, and thus, the modification cannot be carried out midway; and the sending rate can not be dynamically optimized, if a problem occurs in sending, the system can not automatically shield the problem submodule, and the chain reaction is caused.
Disclosure of Invention
The invention aims to provide a rapid data conversion sending system and a method thereof, which solve the defects in the prior art.
The invention is realized by adopting the following technical scheme:
a rapid data conversion and transmission system is characterized by comprising a data preparation module, a strategy selection module and a data processing and transmission module, wherein data transmission is realized among the modules through an input and output interface, wherein:
the data preparation module is connected with the data processing and sending module and the strategy selection module through various output interfaces, the data processing and sending module is connected with the data processing and sending module and the connection strategy selection module through various input interfaces, and the strategy selection module is in butt joint with the data preparation module and the data processing and sending module through interfaces;
the data preparation module is used for receiving external data information and data preprocessing, receiving a return message of the strategy selection module, classifying data according to a strategy and selecting a data processing server, performing built-in optimization processing, receiving a message prepared by the data processing and sending module, and transmitting the data;
the strategy selection module is used for selecting an optimization strategy and strategy selection during data preparation and transmission, receiving messages from the data preparation module through identity authentication and security connection, pre-classifying and classifying the messages, and selecting a corresponding strategy of data;
the data processing and sending module is used for receiving the strategy returned by the strategy selection module, carrying out sending preparation work, setting the sending strategy, informing the data preparation module that the sending preparation is finished and the data can be transmitted.
Further, the server in the data preparation module performs primary screening and backup of data, performs expansion and backup of data in the whole server group, and after the data is screened, the data preparation module is communicated with the strategy selection module to perform strategy selection.
Further, the data preparation module receives the return message of the strategy selection module, classifies the data according to the strategy, selects the data processing server, performs built-in optimization processing, and after the strategy takes effect, the data preparation module is used for connecting the data processing and sending module and informing the data processing and sending module of completing the preparation.
Further, the optimization process includes: the server alternates time intervals, transmission frequency, number of retransmissions, and flow control.
Further, the strategy selection module performs identity verification after receiving the connection request of the data processing sending module, receives the message batch feature code after passing the verification, acquires the sending strategy of the message, and returns the sending strategy to the data processing sending module.
Further, after receiving the policy returned by the policy selection module, the data processing and sending module performs sending preparation work, and the setting of the sending policy includes: the number of times of retry of sending failure, sending interval time, monitoring the target address index state, telling the data preparation module that sending preparation is finished and data can be transmitted after the strategy takes effect.
Further, the data received and transmitted by the data processing and transmitting module comprises structured mail data, text data and unstructured video data.
Further, the data is of a short message type, and the strategy selection module returns a set short message preparation strategy to the data preparation module and records the current message batch feature code.
A quick data conversion sending method is characterized by comprising a data preparation module, a strategy selection module and a data processing sending module, wherein the modules carry out data transmission through various input and output interfaces, the data preparation module receives external data information and carries out data preprocessing, receives a return message of the strategy selection module, classifies data according to strategies and selects a data processing server, carries out built-in optimization processing, receives a message prepared by the data processing sending module, and carries out data transmission;
the strategy selection module selects an optimization strategy and a strategy selection during data preparation and transmission, receives a message from the data preparation module through identity authentication and security connection, pre-classifies and classifies the message, and selects a corresponding strategy of data;
the data processing and sending module receives the strategy returned by the strategy selection module, performs sending preparation work, sets the sending strategy, and informs the data preparation module that the sending preparation is completed and data can be transmitted.
Further, the data is transmitted to the data preparation module through an external channel, the server of the data preparation module is used for primarily screening and backing up the data, and the data is expanded and backed up in the whole server group; after the data are screened, the strategy selection module is communicated to select the strategy;
after receiving the contact requirement of the data preparation module, the policy selection module starts secure connection through authentication and receives the message from the data preparation module. And pre-classifying and classifying the messages, selecting a corresponding strategy of the data, and returning a set short message preparation strategy to the data preparation module if the message is of the short message type. Recording the current message batch feature code;
after receiving the return message of the strategy selection module, the data preparation module classifies the data according to the strategy and selects a data processing server, and performs built-in optimization processing, wherein the optimization processing comprises the following steps: the server rotates time interval, sending frequency, retransmission times and flow control, after the strategy takes effect, the server starts to butt joint the data processing and sending module and informs the sending module of completing the preparation;
the data processing and sending module performs identity verification after receiving the connection request of the data preparation module, performs data receiving preparation after the verification is passed, is connected with the strategy selection module, and sends the currently received message batch feature code;
the strategy selection module carries out identity verification after receiving the connection request of the data processing and sending module, receives data after the verification is passed, acquires the sending strategy of the message by the received message batch characteristic code and returns the sending strategy to the data processing and sending module;
after receiving the strategy returned by the strategy selection module, the data processing and sending module performs sending preparation work and sets a sending strategy, wherein the sending strategy comprises the following steps: sending the number of times of failed retries, sending interval time, monitoring the target address index state, and informing a data preparation module after a strategy takes effect, so that the data can be transmitted after the sending preparation is finished;
after receiving the message of completing the preparation of the sending module, the data preparation module starts to transmit data until the preparation is completed before sending, and formally starts to send data;
after the data is sent, the data processing and sending module informs the data preparation module that the data is sent completely, a communication channel between the data processing and sending module and the data preparation module is disconnected, then a sending report is generated, and after the data preparation module receives a message that the sending module sends the data completely, the data preparation module closes an external data feedback channel, so that the sending is finished.
The beneficial technical effects of the invention are as follows: the transmission efficiency and the conversion rate can be improved, manual intervention is reduced, and the system is more intelligent.
Drawings
FIG. 1 is a flow chart of the present invention.
Detailed Description
The invention will be better understood by the following description of embodiments thereof, but the applicant's specific embodiments are not intended to limit the invention to the particular embodiments shown, and any changes in the definition of parts or features and/or in the overall structure, not essential changes, are intended to define the scope of the invention.
A rapid data conversion and transmission system and a method thereof are provided, the system comprises: the system comprises a data preparation module, a strategy selection module and a data processing and sending module, wherein data is transmitted to the data preparation module through an external channel, primary screening and backup of the data are carried out through a server of the data preparation module, and the data are expanded and backed up in the whole server group; after the data are screened, the data preparation module is communicated with the strategy selection module to select the strategy.
After receiving the contact requirement of the data preparation module, the policy selection module starts secure connection through authentication and receives the message from the data preparation module. And pre-classifying and classifying the messages, selecting a corresponding strategy of the data, returning a set short message preparation strategy to the data preparation module if the message type is the short message type, and recording the current message batch feature code.
After receiving the return message from the policy selection module, the data preparation module classifies the data according to the policy and selects the data processing server, and performs some built-in optimization processing, such as server rotation time interval, transmission frequency, retransmission times, flow control, and the like. And after the strategy takes effect, starting to butt the data processing and sending module and informing the sending module of completing the preparation.
And the data processing and sending module performs identity verification after receiving the connection request of the data preparation module, performs data receiving preparation after the verification is passed, and is connected with the strategy selection module. And sending the currently received message batch feature code.
And the strategy selection module performs identity verification after receiving the connection request of the data processing and sending module, receives data after the verification is passed, acquires the sending strategy of the message by the received message batch characteristic code, and returns the sending strategy to the data processing and sending module.
After receiving the policy returned by the policy selection module, the data processing and sending module performs sending preparation work, and sets sending policies, such as sending failure retry times, sending interval time, target address index state monitoring, and the like. And after the strategy takes effect, the data preparation module is informed that the sending preparation is finished and the data can be transmitted.
And the data preparation module starts to transmit data after receiving the preparation completion message of the sending module, finishes the preparation before sending and formally starts to send the data.
After the data is sent, the data processing and sending module informs the data preparation module that the data is sent completely, disconnects a communication channel with the data preparation module, and then generates a sending report. And after receiving the message of finishing the sending by the sending module, the data preparation module closes an external data feedback channel until the sending is finished.
The present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and it is therefore intended that all such changes and modifications as fall within the true spirit and scope of the invention be considered as within the following claims.
Claims (1)
1. A quick data conversion sending method is characterized by comprising a data preparation module, a strategy selection module and a data processing sending module, wherein the modules carry out data transmission through various input and output interfaces, the data preparation module receives external data information and carries out data preprocessing, receives a return message of the strategy selection module, classifies data according to strategies and selects a data processing server, carries out built-in optimization processing, receives a message prepared by the data processing sending module, and carries out data transmission;
the strategy selection module selects an optimization strategy and a strategy selection during data preparation and transmission, receives a message from the data preparation module through identity authentication and security connection, pre-classifies and classifies the message, and selects a corresponding strategy of data;
the data processing and sending module receives the strategy returned by the strategy selection module, performs sending preparation work, sets a sending strategy, and informs the data preparation module that the sending preparation is finished and data can be transmitted;
the data is transmitted to the data preparation module through an external channel, the server of the data preparation module is used for primarily screening and backing up the data, and the data is expanded and backed up in the whole server group; after the data are screened, the strategy selection module is communicated to select the strategy;
after receiving the contact requirement of the data preparation module, the strategy selection module starts safe connection through identity authentication, receives the message from the data preparation module, pre-classifies and classifies the message, selects the corresponding strategy of the data, returns the set short message preparation strategy to the data preparation module if the message is of the short message type, and records the current message batch feature code;
after receiving the return message of the strategy selection module, the data preparation module classifies the data according to the strategy and selects a data processing server, and performs built-in optimization processing, wherein the optimization processing comprises the following 4 contents: the server rotates time interval, sending frequency, retransmission times and flow control, after the strategy takes effect, the server starts to butt joint the data processing and sending module and informs the sending module of completing the preparation;
the data processing and sending module performs identity verification after receiving the connection request of the data preparation module, performs data receiving preparation after the verification is passed, is connected with the strategy selection module, and sends the currently received message batch feature code;
the strategy selection module carries out identity verification after receiving the connection request of the data processing and sending module, receives data after the verification is passed, acquires the sending strategy of the message by the received message batch characteristic code and returns the sending strategy to the data processing and sending module;
after receiving the strategy returned by the strategy selection module, the data processing and sending module performs sending preparation work and sets a sending strategy, wherein the sending strategy comprises the following 3 contents: sending the number of times of failed retries, sending interval time, monitoring the target address index state, and informing a data preparation module after a strategy takes effect, so that the data can be transmitted after the sending preparation is finished;
after receiving the message of completing the preparation of the sending module, the data preparation module starts to transmit data until the preparation is completed before sending, and formally starts to send data;
after the data is sent, the data processing and sending module informs the data preparation module that the data is sent completely, a communication channel between the data processing and sending module and the data preparation module is disconnected, then a sending report is generated, and after the data preparation module receives a message that the sending module sends the data completely, the data preparation module closes an external data feedback channel, so that the sending is finished.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811606156.9A CN109743134B (en) | 2018-12-27 | 2018-12-27 | Quick data conversion and transmission system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811606156.9A CN109743134B (en) | 2018-12-27 | 2018-12-27 | Quick data conversion and transmission system and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109743134A CN109743134A (en) | 2019-05-10 |
| CN109743134B true CN109743134B (en) | 2021-06-15 |
Family
ID=66361327
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811606156.9A Active CN109743134B (en) | 2018-12-27 | 2018-12-27 | Quick data conversion and transmission system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109743134B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110505292A (en) * | 2019-08-13 | 2019-11-26 | 珠海格力电器股份有限公司 | Data transfer control method, device and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494911A (en) * | 2008-12-06 | 2009-07-29 | 中兴通讯股份有限公司 | Short message business center system having automatic majorization function and implementing method |
| CN102665187A (en) * | 2012-02-29 | 2012-09-12 | 华中科技大学 | Intelligent pipeline control method based on intelligent terminal |
| CN103457763A (en) * | 2013-08-15 | 2013-12-18 | 中电长城网际系统应用有限公司 | Multi-channel information distribution method and system based on strategies and automatic operation platform |
| CN104618878A (en) * | 2015-02-04 | 2015-05-13 | 苏州工业园区服务外包职业学院 | Short message gateway |
| CN107395695A (en) * | 2017-07-05 | 2017-11-24 | 上海精数信息科技有限公司 | Service push method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100377523C (en) * | 2003-10-28 | 2008-03-26 | 华为技术有限公司 | Data service information collecting device and charging method using same |
-
2018
- 2018-12-27 CN CN201811606156.9A patent/CN109743134B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101494911A (en) * | 2008-12-06 | 2009-07-29 | 中兴通讯股份有限公司 | Short message business center system having automatic majorization function and implementing method |
| CN102665187A (en) * | 2012-02-29 | 2012-09-12 | 华中科技大学 | Intelligent pipeline control method based on intelligent terminal |
| CN103457763A (en) * | 2013-08-15 | 2013-12-18 | 中电长城网际系统应用有限公司 | Multi-channel information distribution method and system based on strategies and automatic operation platform |
| CN104618878A (en) * | 2015-02-04 | 2015-05-13 | 苏州工业园区服务外包职业学院 | Short message gateway |
| CN107395695A (en) * | 2017-07-05 | 2017-11-24 | 上海精数信息科技有限公司 | Service push method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109743134A (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101557212B1 (en) | Method, sharing platform, and system for sharing image-editing action | |
| US5428771A (en) | Transparent transaction coordination between distributed networks having different communication protocols | |
| CN102171995B (en) | Method for processing packet when server fails and router thereof | |
| CN112423349B (en) | New energy big data platform data cleaning method and system | |
| CN109743134B (en) | Quick data conversion and transmission system and method thereof | |
| CN105100279A (en) | Control method and device for household appliance | |
| CN112261724A (en) | Intelligent workshop video monitoring data transmission method and system based on millimeter wave technology | |
| CN104579746A (en) | Method and device for controlling dual-link transmission | |
| CN103731465A (en) | Distributed system and transaction treatment method thereof | |
| JPH1056479A (en) | Packet communication system | |
| CN108055323B (en) | Communication method based on data link layer | |
| CN101252463A (en) | System and method for collocating traffic parameter | |
| CN102056095B (en) | Method, system and device for controlling short message transmitting flow rate | |
| CN110166479A (en) | A kind of method that Transmission system promotes UDP transmitting efficiency | |
| CN106251609A (en) | Intelligent robot and networking method, network sharing method and apparatus | |
| CN111601341A (en) | Digital asset information transmission method and system for block chain system | |
| CN109768850B (en) | Vehicle-mounted communication method and system | |
| CN110958139A (en) | Network control method, orchestrator, controller, and computer-readable storage medium | |
| CN112203359B (en) | Upstream supply chain information transmission method and system for block chain system | |
| CN112511638B (en) | Remote control method and system for processing organic solid waste based on Internet of things | |
| WO2018010384A1 (en) | System restoration method and device | |
| CN113448744B (en) | Application program selection method and device | |
| CN113708910A (en) | Remote control sewage treatment method and system | |
| CN105813040A (en) | Short message sending method, server and mobile terminal | |
| CN115021883B (en) | Signaling mechanism for application of federal learning in wireless cellular systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |