CN111045986A - Text-based intersystem data exchange method - Google Patents
Text-based intersystem data exchange method Download PDFInfo
- Publication number
- CN111045986A CN111045986A CN201911264421.4A CN201911264421A CN111045986A CN 111045986 A CN111045986 A CN 111045986A CN 201911264421 A CN201911264421 A CN 201911264421A CN 111045986 A CN111045986 A CN 111045986A
- Authority
- CN
- China
- Prior art keywords
- file
- transmission
- data exchange
- data
- text
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000005540 biological transmission Effects 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims abstract description 6
- 238000010276 construction Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a text-based intersystem data exchange method, comprising the following steps of S1: initially, defining a field input data dictionary file; s2: defining a transmission format definition file; constructing transmission data; s3: constructing a header line according to the transmission format definition file; constructing a detail statistical unit line according to the transmission format definition file; s4: generating a complete data exchange file; s5: judging whether a file which is not transmitted exists or not; s6: a receiving end receives a file; s7: and analyzing the file content according to the data dictionary and the format definition, and ending. The invention enables the transmitting and receiving parties to construct and analyze the content of the file and carry out subsequent processing through the definition of the data dictionary, the format definition of the transmission file, the definition of the return code, the return message, the detail line and the definition of the statistical unit line, and improves the integrity and the reliability of transmission through a file cache mechanism and a retransmission mechanism.
Description
Technical Field
The invention relates to the field of text intersystem data exchange, belongs to the field of text intersystem data, and particularly relates to a text-based intersystem data exchange method.
Background
The data exchange format is mainly used for information data exchange between different application systems and between different industry networks, exists as a common 'language' between the two, and is used as a basis for sharing data by two or more parties. Currently, data exchange between different application systems and between different servers has a plurality of formats, and is applied in different fields and different industries. Such as XML, JOSON, YAML, TOML, and other text-based data exchange formats.
The current data exchange technologies include a file mode, a database sharing data mode, a message mode, a WebService mode, and the like. The existing data exchange formats and exchange technologies have different application scenarios. The prior art scheme generally has the characteristics of overstaffed format and complex realization, and has higher requirements on developers and maintainers.
Therefore, a text-based intersystem data exchange method is provided.
Disclosure of Invention
The invention aims to provide a text-based intersystem data exchange method, which provides a data definition format which is easy to understand, strong in readability and intuitive in definition mode, and can resend a history data file which fails to be sent based on safe transmission realized by an FTP communication mode after a transmission result file is generated.
According to the scheme, various service fields are collected through a centralized data dictionary, the number and the data types can be expanded, and the data types are combined with a transmission format definition file. The data transmission and sharing among different systems are realized based on the transmission format definition file so as to solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme: s1: initially, defining a transmission field data dictionary file;
s2: defining a transmission format definition file; constructing transmission data;
s3: constructing a header line according to the transmission format definition file; constructing a detail line and a statistical unit line according to the transmission format definition file;
s4: generating a complete data exchange file;
s5: judging whether a file which is not transmitted exists or not;
s6: a receiving end receives a file;
s7: and analyzing the file content according to the data dictionary and the format definition, and ending.
Preferably, the construction of the transmission data includes a data acquisition result or a service processing result.
Preferably, if the file is determined to be not transmitted, the file that is not transmitted within the limited time needs to be transmitted preferentially, and then the file is received at the receiving end.
Preferably, if the file is determined to be not transmitted, the data exchange file needs to be transmitted, and then the file is received at the receiving end.
Preferably, the composition of the transmission file includes, but is not limited to: header line, detail line, and statistical unit line.
Preferably, the file transfer mechanism comprises: a file caching mechanism and a retransmission mechanism.
Compared with the prior art, the invention has the beneficial effects that:
the invention determines a definition mode of a dynamically expanded data dictionary and a definition mode of a format of a transmission file, proposes the structure of the transmission file, such as a header line, a detail line and a statistic unit line, and is based on a cache and retransmission mechanism of the file. The integrity and reliability of transmission are improved through a file caching mechanism and a retransmission mechanism.
Drawings
FIG. 1 is a schematic process flow diagram of a data exchange method according to the present invention;
fig. 2 is a schematic diagram of a processing flow after generating a complete data exchange file in the data exchange method of the present invention.
Detailed Description
In the following, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-2, the present invention provides a technical solution: s1: initially, defining a transmission field data dictionary file; s2: defining a transmission format definition file; constructing transmission data; s3: constructing a header line according to the transmission format definition file; constructing a detail line and a statistical unit line according to the transmission format definition file; s4: generating a complete data exchange file; s5: judging whether a file which is not transmitted exists or not; s6: a receiving end receives a file; s7: and analyzing the file content according to the data dictionary and the format definition, and ending.
The construction transmission data comprises a data acquisition result or a service processing result.
If the file is not transmitted, the file which is not transmitted within the limited time needs to be transmitted preferentially, and then the file is received at the receiving end.
If the file is not transmitted, the data exchange file needs to be transmitted, and then the file is received at the receiving end.
Each transmission file comprises three parts, namely a header line, a detail line and a statistical unit line. The fields are divided by special characters. Such as "|" or "^", "-", etc. 1: and the header line is used for defining whether the basic characteristics of the file to be transmitted are a normal result or an abnormal result, wherein the normal result file comprises a detail line and a statistical unit line, and if the normal result file is the abnormal result file, the transmission file does not comprise the detail line and the statistical unit line. 2: and the detail line records the details of transmission. And the receiving party of the data transmission analyzes the content of the detail line and performs subsequent conversion, combination, calculation and storage operations. 3: and a statistical unit row for recording the statistical unit corresponding to each field in the detail row, such as Percent, Page/s, and the like, wherein NA indicates that the field has no unit.
The composition of the transmission file includes, but is not limited to: a header line, where the header line includes fields of a server number (servId), an instance number (instId), an instance version number (instVersion), a task number (taskId), a timestamp (tmsamp), a transaction stream number (tranSqno), a return flag (retFlag), a return code (retCode), return information (retMesg), and detail line contents corresponding to service processing results with different detail lines are inconsistent, and the field contents and the sequence included in the detail line are defined in a transport format file, such as a file system name: fsLvPath; percentage of file system usage: fsusedRatio; file system mount point path: fsMountPath; file system size: and the fsLvVolume constructs the content of the detail line according to the format definition file. The statistical unit row records the statistical units of each field of the detail row, for example, for the above detail row, the corresponding statistical units are NA,%, NA, and GB, respectively.
The file transfer mechanism comprises: the file caching mechanism and the retransmission mechanism comprise the following processes: the name of the transmission file comprises time, such as I _ WK _ PID _1007_20191013162537. txt. And transmitting the result file through the FTP or other communication modes, and deleting the transmission file if the transmission is successful.
If the transmission fails, the file is retransmitted at fixed time intervals (such as 2 seconds), and if the transmission is not successful for more than a limited number of times (such as 5 times), the file is stored in a cache path.
After the communication is recovered, the cached files before the communication are preferably sent according to a principle of distance to near, such as 10 hours. The generated cache file is sent preferentially. And cleaning the overdue files by a cleaning program.
In order to better understand the technical solution of the present invention, it is added that the data dictionary set forth in the present invention is a text file, and the definition of each word includes four parts. Mainly chinese name, english name, data type, length, unit, as in the following example, in a digital dictionary file the annotation line starts with #.
The data dictionary is mainly used for summarizing fields and characteristics required to be transmitted, data types comprise char (character type), int (integer type), decimal (number representation mode for specifying integer digits and decimal digits), double (double precision floating point type) and boilen (Boolean type), and type expansion can be carried out according to requirements. The meaning and type of the service data of each data exchange are defined in the data dictionary, and are a subset of the information of the data dictionary.
As with the above example, the meaning of the tokenized field and the specification of the field may be written in the comment line, increasing the readability of the field definition in the dictionary. Comment line starts with #
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (6)
1. A text-based intersystem data exchange method is characterized by comprising the following steps:
s1: initially, defining a transmission field data dictionary file;
s2: defining a transmission format definition file; constructing transmission data;
s3: constructing a header line according to the transmission format definition file; constructing a detail line and a statistical unit line according to the transmission format definition file;
s4: generating a complete data exchange file;
s5: judging whether a file which is not transmitted exists or not;
s6: a receiving end receives a file;
s7: and analyzing the file content according to the data dictionary and the format definition, and ending.
2. A method of text-based intersystem data exchange according to claim 1, characterized in that: the construction transmission data comprises a data acquisition result or a service processing result.
3. A method of text-based intersystem data exchange according to claim 1, characterized in that: if the file is not transmitted, the file which is not transmitted within the limited time needs to be transmitted preferentially, and then the file is received at the receiving end.
4. A method of text-based intersystem data exchange according to claim 1, characterized in that: if the file is not transmitted, the data exchange file needs to be transmitted, and then the file is received at the receiving end.
5. A method of text-based intersystem data exchange according to claim 1, characterized in that: the composition of the transmission file includes, but is not limited to: header line, detail line, and statistical unit line.
6. A method for text based inter-system data exchange according to any one of claims 1-5, characterized in that: the file transfer mechanism comprises: a file caching mechanism and a retransmission mechanism.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911264421.4A CN111045986A (en) | 2019-12-10 | 2019-12-10 | Text-based intersystem data exchange method |
| SG10201913220RA SG10201913220RA (en) | 2019-12-10 | 2019-12-26 | A Method of Intersystem Data Exchange Based on Text |
| JP2019236544A JP2021093103A (en) | 2019-12-10 | 2019-12-26 | Method for data exchange between systems based on text |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911264421.4A CN111045986A (en) | 2019-12-10 | 2019-12-10 | Text-based intersystem data exchange method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111045986A true CN111045986A (en) | 2020-04-21 |
Family
ID=70235566
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911264421.4A Pending CN111045986A (en) | 2019-12-10 | 2019-12-10 | Text-based intersystem data exchange method |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP2021093103A (en) |
| CN (1) | CN111045986A (en) |
| SG (1) | SG10201913220RA (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060317A1 (en) * | 2003-09-12 | 2005-03-17 | Lott Christopher Martin | Method and system for the specification of interface definitions and business rules and automatic generation of message validation and transformation software |
| CN102843245A (en) * | 2011-06-20 | 2012-12-26 | 中兴通讯股份有限公司 | Method and device for interacting configuration data |
| CN106227575A (en) * | 2016-07-26 | 2016-12-14 | 浪潮通用软件有限公司 | A kind of method generated and resolve text |
| CN108920638A (en) * | 2018-07-02 | 2018-11-30 | 山东浪潮商用系统有限公司 | Web terminal data collector file method and device based on data dictionary configuration |
-
2019
- 2019-12-10 CN CN201911264421.4A patent/CN111045986A/en active Pending
- 2019-12-26 JP JP2019236544A patent/JP2021093103A/en active Pending
- 2019-12-26 SG SG10201913220RA patent/SG10201913220RA/en unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060317A1 (en) * | 2003-09-12 | 2005-03-17 | Lott Christopher Martin | Method and system for the specification of interface definitions and business rules and automatic generation of message validation and transformation software |
| CN102843245A (en) * | 2011-06-20 | 2012-12-26 | 中兴通讯股份有限公司 | Method and device for interacting configuration data |
| CN106227575A (en) * | 2016-07-26 | 2016-12-14 | 浪潮通用软件有限公司 | A kind of method generated and resolve text |
| CN108920638A (en) * | 2018-07-02 | 2018-11-30 | 山东浪潮商用系统有限公司 | Web terminal data collector file method and device based on data dictionary configuration |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2021093103A (en) | 2021-06-17 |
| SG10201913220RA (en) | 2021-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103699599B (en) | A kind of message reliable treatments support method based on Storm real-time streams Computational frame | |
| CN101277272B (en) | Method for implementing magnanimity broadcast data warehouse-in | |
| CN109034993A (en) | Account checking method, equipment, system and computer readable storage medium | |
| US20130006949A1 (en) | Systems and methods for data integrity checking | |
| CN102571966B (en) | Network transmission method for large extensible markup language (XML) document | |
| CN104092717B (en) | Message treatment method and system, message destination equipment | |
| CN110502583B (en) | Distributed data synchronization method, device, equipment and readable storage medium | |
| CN108038207A (en) | A kind of daily record data processing system, method and server | |
| CN108255621A (en) | A kind of MySQL incremental message analytic methods based on binlog | |
| CN109600375A (en) | Message tracing method, device, electronic equipment and storage medium | |
| CN112966529A (en) | Neural network machine translation training method, system, medium, equipment and application | |
| CN105989065B (en) | Flash data processing method and system | |
| CN102656860A (en) | Multi-granular stream processing | |
| CN114090529A (en) | Log management method, device, system and storage medium | |
| CN111045986A (en) | Text-based intersystem data exchange method | |
| CN103646015B (en) | Transmission, the method and system for receiving and transmitting XML message | |
| CN112015622A (en) | Message link tracking and monitoring method and system applied to business middle station | |
| CN116185298A (en) | Method for distributed storage of logs | |
| CN115098567B (en) | Low-code platform data transmission method based on BI platform | |
| CN112948410A (en) | Data processing method, device, equipment and medium | |
| CN114979307A (en) | Communication protocol analysis method, intelligent terminal and storage medium | |
| CN109361629A (en) | One kind being based on the big message method for reliable transmission of Kafka and system | |
| CN113342890A (en) | Method and system for realizing cross-security isolation gatekeeper database real-time synchronization | |
| CN113542406A (en) | Asynchronous processing system of intersystem messages | |
| CN110928839B (en) | International freight rate data storage method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200421 |