CN110737636B - Data import method, device and equipment - Google Patents
Data import method, device and equipment Download PDFInfo
- Publication number
- CN110737636B CN110737636B CN201910906522.0A CN201910906522A CN110737636B CN 110737636 B CN110737636 B CN 110737636B CN 201910906522 A CN201910906522 A CN 201910906522A CN 110737636 B CN110737636 B CN 110737636B
- Authority
- CN
- China
- Prior art keywords
- file
- files
- data
- markup language
- extensible markup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000008676 import Effects 0.000 title claims abstract description 29
- 238000012546 transfer Methods 0.000 claims abstract description 62
- 230000005540 biological transmission Effects 0.000 claims abstract description 38
- 238000012795 verification Methods 0.000 claims description 37
- 239000008280 blood Substances 0.000 claims description 9
- 210000004369 blood Anatomy 0.000 claims description 9
- 210000004204 blood vessel Anatomy 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000007689 inspection Methods 0.000 claims description 2
- 238000007726 management method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data import method, a data import device and data import equipment. Wherein the method comprises the following steps: selecting and reading files under a file transfer protocol directory for placing extensible markup language data files, parsing XML data files of different structures into a file format matching the file in the file transfer protocol directory, creating a table structure for the parsed XML data files, obtaining quantitative data of the XML data files after creating the table structure, and, based on the quantitative data, checking the accuracy of the XML data file after creating the table structure to obtain a check result, importing the XML data files of different structures, which pass the check result, into the file in the same file transmission protocol directory, the extensible markup language data files with different data structures can be placed in the file under the same file transfer protocol directory.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data importing method, apparatus and device.
Background
XML (Extensible Markup Language), a cross-platform in a network environment, content-dependent technology, is a powerful tool currently handling structured document information. The extensible markup language XML is the most common simple data storage language used today and can describe data using a series of simple custom tags.
The existing data import scheme generally requires that files placed in an FTP (File Transfer Protocol) directory are XML data files, and data structures of the XML data files placed in the same FTP directory need to be the same, so that it is impossible to place XML data files with different data structures into the same FTP directory.
Disclosure of Invention
In view of this, an object of the present invention is to provide a data importing method, apparatus and device, which can place xml data files with different data structures into a file in the same file transfer protocol directory.
According to an aspect of the present invention, there is provided a data importing method, including:
selecting and reading files in a file transfer protocol directory for placing extensible markup language data files;
analyzing extensible markup language data files with different structures into file formats matched with the selected and read files under the file transfer protocol directory;
creating a table structure for the XML data file which is analyzed into different structures matching the file format of the file under the selected and read file transmission protocol directory;
acquiring quantitative data of extensible markup language data files with different structures after a table structure is created;
according to the obtained quantitative data, carrying out accuracy verification on extensible markup language data files with different structures after the table structures are created to obtain verification results;
and importing extensible markup language data files with different structures, the verification results of which pass through accuracy verification, into files in the same file transfer protocol directory.
The parsing of the extensible markup language data files with different structures into a file format matching the selected and read file under the file transfer protocol directory comprises:
and analyzing the extensible markup language data files with different structures simultaneously or respectively into the same or different file formats matched with the selected and read files under the file transfer protocol directory.
Wherein the creating a table structure for the XML data files of different structures that are parsed into file formats that match the selected and read files under the file transfer protocol directory comprises:
and creating a table structure for the extensible markup language data file which is analyzed into different structures matched with the file format of the file under the selected and read file transmission protocol directory in a mode of adding fields in the table structure.
After the extensible markup language data files with different structures and the verification result of which passes the accuracy verification are imported into the files under the same file transfer protocol directory, the method further comprises the following steps:
generating a blood vessel view by the extensible markup language data files with different structures in the files imported to the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node and a storage node of the extensible markup language data file.
According to another aspect of the present invention, there is provided a data import apparatus including:
the system comprises a selection module, an analysis module, a creation module, an acquisition module, a verification module and an import module;
the selecting module is used for selecting and reading files in a file transfer protocol directory for placing extensible markup language data files;
the analysis module is used for analyzing the extensible markup language data files with different structures into a file format matched with the selected and read file under the file transfer protocol directory;
the creation module is used for creating a table structure for the extensible markup language data files which are analyzed into different structures which are matched with the file formats of the files under the selected and read file transmission protocol directory;
the acquisition module is used for acquiring quantitative data of the extensible markup language data files with different structures after the table structures are created;
the verification module is used for carrying out accuracy verification on extensible markup language data files with different structures after the table structures are established according to the acquired quantitative data to obtain verification results;
and the import module is used for importing the extensible markup language data files with different structures, the inspection results of which pass the accuracy verification, into the files in the same file transfer protocol directory.
The analysis module is specifically configured to:
and analyzing the extensible markup language data files with different structures simultaneously or respectively to obtain the same or different file formats matched with the selected and read files under the file transmission protocol directory.
The creating module is specifically configured to:
and creating a table structure for the extensible markup language data file which is analyzed into different structures matched with the file format of the file under the selected and read file transmission protocol directory in a mode of adding fields in the table structure.
Wherein, the data import device further comprises:
a generation module;
the generating module is used for generating the blood vessel views from the extensible markup language data files with different structures in the files imported into the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node and a storage node of the extensible markup language data file.
According to still another aspect of the present invention, there is provided a data import apparatus including:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a data import method as described in any one of the above.
According to still another aspect of the present invention, there is provided a computer-readable storage medium storing a computer program, wherein the computer program is configured to implement the data importing method according to any one of the above-mentioned items when executed by a processor.
It can be found that, according to the above scheme, the file under the file transmission protocol directory for placing the xml data file can be selected and read, and the xml data files with different structures can be analyzed to be matched with the file format of the file under the selected and read file transmission protocol directory, and a table structure can be created for the xml data files with different structures which are analyzed to be matched with the file format of the file under the selected and read file transmission protocol directory, and the quantitative data of the xml data files with different structures after the table structure is created can be obtained, and the xml data files with different structures after the table structure is created can be subjected to the accuracy check according to the obtained quantitative data to obtain the check result, and the xml data files with different structures of which the check result passes the accuracy check can be imported into the same file to be transmitted In the files under the transmission protocol directory, the extensible markup language data files with different data structures can be placed in the files under the same file transmission protocol directory.
Furthermore, the above scheme can analyze the extensible markup language data files with different structures simultaneously or respectively into the same or different file formats matching the selected and read file under the file transmission protocol directory, which is beneficial to placing the extensible markup language data files with different data structures into the file under the same file transmission protocol directory.
Furthermore, the above solution can create a table structure for the xml data file having different structures and being parsed into a file format matching the selected and read file under the file transfer protocol directory by adding a field in the table structure, which is advantageous in that the xml data file corresponding to the created table structure can be conveniently recorded and managed through the added field.
Furthermore, the scheme can generate the blood margin view by the extensible markup language data files with different structures which are imported into the files under the same file transfer protocol directory; the generated consanguinity view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file, so that the extensible markup language data files with different structures, which are imported into the file under the same file transmission protocol directory, can be conveniently classified and managed, and the management efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flowchart illustrating a data importing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a data importing method according to another embodiment of the present invention;
FIG. 3 is a schematic structural diagram of an embodiment of a data importing apparatus according to the present invention;
FIG. 4 is a schematic structural diagram of another embodiment of a data import apparatus according to the present invention;
fig. 5 is a schematic structural diagram of an embodiment of a data importing apparatus according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be noted that the following examples are only illustrative of the present invention, and do not limit the scope of the present invention. Similarly, the following examples are only some but not all examples of the present invention, and all other examples obtained by those skilled in the art without any inventive work are within the scope of the present invention.
The invention provides a data import method, which can realize that extensible markup language data files with different data structures are placed in files in the same file transfer protocol directory.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a data importing method according to an embodiment of the present invention. It should be noted that the method of the present invention is not limited to the flow sequence shown in fig. 1 if the results are substantially the same. As shown in fig. 1, the method comprises the steps of:
s101: and selecting and reading the file in the file transfer protocol directory for placing the extensible markup language data file.
In the present embodiment, the file transfer Protocol FTP is one of the protocols in the TCP/IP (Transmission Control Protocol/Internet Protocol) Protocol suite. The FTP protocol may comprise two components, one of which may be an FTP server and the other of which may be an FTP client. Wherein the FTP server is used for storing files, and the FTP client can be used for accessing resources located on the FTP server through an FTP protocol.
S102: and analyzing the extensible markup language data files with different structures into a file format matched with the selected and read file under the file transmission protocol directory.
The parsing of the xml data files with different structures into a file format matching the file under the selected and read file transfer protocol directory may include:
the XML data files with different structures are analyzed simultaneously or respectively to be matched with the same or different file formats of the file under the selected and read file transmission protocol directory, so that the advantage that the XML data files with different data structures are placed in the file under the same file transmission protocol directory is facilitated.
In this embodiment, an XML card may be added to the entry pop, and may be added after TXT (text document), and the import page into the graphical interface may be clicked.
In this embodiment, it may be required that the field structure in each XML file is different, or it may be required that the field structure in each XML file is the same, and only the file format of the XML file is required to match the file in the selected and read file transfer protocol directory, and the field structure form in each XML file is not limited.
In this embodiment, an entry may be newly added, an XML is newly added in the entry popup, and a mouse may be required to move into a hover (suspension) effect by clicking to enter an XML import task page.
In this embodiment, the XML import task page may include:
data source name: only XML data sources can be selected, and fuzzy search is supported;
file path: displaying a path under the selected data source and supporting fuzzy search;
storing to a partition: only the partition of Kudu (open source storage engine) can be selected to support fuzzy search;
previewing the imported file: when no XML file exists, the previewable file is displayed temporarily, and when the file exists, all XML files under the selected path are displayed, and the file name and the XML can be displayed.
S103: creating a table structure for the XML data file parsed into different structures matching the file format of the file under the selected and read file transfer protocol directory.
Wherein, the creating a table structure for the xml data file having different structures and being parsed into the file format matching the file under the selected and read file transfer protocol directory may include:
by adding fields in the table structure, the table structure is created for the extensible markup language data files with different structures which are analyzed into the file formats matched with the files under the selected and read file transmission protocol directory, so that the extensible markup language data files corresponding to the created table structure can be conveniently recorded and managed through the added fields.
In this embodiment, one xml data file creates one table structure, and the table structure created by each xml data file is different.
In this embodiment, a field may be added to the created table structure, and the added field facilitates recording and managing the xml data file corresponding to the created table structure, for example, what file the xml data file corresponding to the created table structure comes from, and the like.
In this embodiment, the data structure in a single XML file may require that the data structure in each single XML file requires that the structure of each row (column) is the same, or may require that the data structure in each single XML file requires that the structure of each column is different, which is not limited in the present invention.
In this embodiment, the header of the xml data file may not contain a special character or begin with a number, or may contain a special character or begin with a number, and the invention is not limited thereto.
S104: and acquiring quantitative data of the extensible markup language data files with different structures after the table structures are created.
In this embodiment, the quantitative data may be the data that exists in the form of quantity and thus can be measured, and the present invention is not limited thereto.
S105: and according to the acquired quantitative data, carrying out accuracy verification on the extensible markup language data files with different structures after the table structures are established to obtain a verification result.
In this embodiment, the accuracy of the xml data files with different structures after the table structure is created may be checked according to the preset file standards of the xml data files with different structures to obtain the check result, which is not limited in the present invention.
S106: and importing the extensible markup language data files with different structures, the verification results of which pass the accuracy verification, into the files in the same file transfer protocol directory.
After the extensible markup language data files with different structures, of which the checking results pass through the accuracy check, are imported into the files in the same file transfer protocol directory, the method further comprises the following steps:
generating a blood vessel view by the extensible markup language data files with different structures in the files imported to the same file transfer protocol directory; the generated consanguinity view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file, so that the extensible markup language data files with different structures, which are imported into the file under the same file transmission protocol directory, can be conveniently classified and managed, and the management efficiency is improved.
It can be found that, in this embodiment, the file under the file transfer protocol directory for placing the xml data file can be selected and read, and the xml data files of different structures can be parsed into the file format matching the file under the selected and read file transfer protocol directory, and a table structure can be created for the xml data files of different structures parsed into the file format matching the file under the selected and read file transfer protocol directory, and the quantitative data of the xml data files of different structures after the table structure is created can be obtained, and the xml data files of different structures after the table structure is created can be subjected to the accuracy verification according to the obtained quantitative data to obtain the verification result, and the xml data files of different structures after the verification result passes the accuracy verification can be imported into the same file In the file under the file transmission protocol directory, the extensible markup language data files with different data structures can be placed in the file under the same file transmission protocol directory.
Further, in this embodiment, the xml data files with different structures may be simultaneously or separately parsed into the same or different file formats matching the selected and read file under the file transfer protocol directory, which is advantageous in that the xml data files with different data structures may be placed into the file under the same file transfer protocol directory.
Further, in this embodiment, a table structure may be created for the xml data file having different structures and being parsed into a file format matching the file under the selected and read file transfer protocol directory by adding a field in the table structure, which is advantageous in that the xml data file corresponding to the created table structure can be conveniently recorded and managed through the added field.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a data importing method according to another embodiment of the present invention. In this embodiment, the method includes the steps of:
s201: and selecting and reading the file in the file transfer protocol directory for placing the extensible markup language data file.
As described above in S101, the description is omitted here.
S202: and analyzing the extensible markup language data files with different structures into a file format matched with the selected and read file under the file transmission protocol directory.
As mentioned above in S102, the description is omitted here.
S203: creating a table structure for the XML data file parsed into different structures that match the file format of the file under the selected and read file transfer protocol directory.
As described above in S103, which is not described herein.
S204: and acquiring quantitative data of the extensible markup language data files with different structures after the table structures are created.
As described above in S104, the description is omitted here.
S205: and according to the acquired quantitative data, carrying out accuracy verification on the extensible markup language data files with different structures after the table structures are created to obtain verification results.
As described above in S105, which is not described herein.
S206: and importing extensible markup language data files with different structures, the verification results of which pass through accuracy verification, into files in the same file transfer protocol directory.
As mentioned above in S106, it is not described herein.
S207: generating a blood margin view by using extensible markup language data files with different structures in the files imported into the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file.
It can be seen that, in this embodiment, the bloody border view can be generated from the xml data files of different structures imported into the file under the same file transfer protocol directory; the generated consanguinity view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file, so that the extensible markup language data files with different structures, which are imported into the file under the same file transmission protocol directory, can be conveniently classified and managed, and the management efficiency is improved.
The invention also provides a data import device which can realize that the extensible markup language data files with different data structures are placed in the file under the same file transfer protocol directory.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a data importing apparatus according to an embodiment of the present invention. In this embodiment, the data importing apparatus 30 includes a selecting module 31, an analyzing module 32, a creating module 33, an obtaining module 34, a verifying module 35, and an importing module 36.
The selecting module 31 is configured to select and read a file in a file transfer protocol directory for placing an xml data file.
The parsing module 32 is configured to parse the xml data files with different structures into a file format matching the selected and read file under the file transfer protocol directory.
The creating module 33 is configured to create a table structure for the xml data file parsed into different structures matching the file format of the file under the selected and read file transfer protocol directory.
The obtaining module 34 is configured to obtain quantitative data of the xml data files with different structures after the table structure is created.
The verification module 35 is configured to perform accuracy verification on the xml data files with different structures after the table structure is created according to the obtained quantitative data to obtain a verification result.
The import module 36 is configured to import xml data files with different structures whose check results pass the accuracy check into a file in the same file transfer protocol directory.
Optionally, the parsing module 32 may be specifically configured to:
and analyzing the extensible markup language data files with different structures simultaneously or respectively into the same or different file formats matched with the selected and read files under the file transfer protocol directory.
Optionally, the creating module 33 may be specifically configured to:
and creating a table structure for the XML data file which is analyzed into different structures matching the file format of the file under the selected and read file transfer protocol directory in a mode of adding fields in the table structure.
Referring to fig. 4, fig. 4 is a schematic structural diagram of another embodiment of a data importing device according to the present invention. Different from the previous embodiment, the data importing apparatus 40 of the present embodiment further includes a generating module 41.
The generating module 41 is configured to generate a blood vessel edge view from the xml data files with different structures imported into the file under the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file.
Each unit module of the data importing apparatus 30/40 may respectively execute the corresponding steps in the above method embodiments, and therefore, the detailed description of each unit module is omitted here, and please refer to the description of the corresponding steps above.
The present invention further provides a data importing apparatus, as shown in fig. 5, including: at least one processor 51; and a memory 52 communicatively coupled to the at least one processor 51; the memory 52 stores instructions executable by the at least one processor 51, and the instructions are executed by the at least one processor 51 to enable the at least one processor 51 to execute the data importing method.
Wherein the memory 52 and the processor 51 are coupled in a bus, the bus may comprise any number of interconnected buses and bridges, the buses coupling together one or more of the various circuits of the processor 51 and the memory 52. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 51 is transmitted over a wireless medium via an antenna, which further receives the data and passes the data to the processor 51.
The processor 51 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory 52 may be used to store data used by the processor 51 in performing operations.
The present invention further provides a computer-readable storage medium storing a computer program. The computer program realizes the above-described method embodiments when executed by a processor.
It can be found that, according to the above scheme, the file under the file transmission protocol directory for placing the xml data file can be selected and read, and the xml data files with different structures can be analyzed to be matched with the file format of the file under the selected and read file transmission protocol directory, and a table structure can be created for the xml data files with different structures which are analyzed to be matched with the file format of the file under the selected and read file transmission protocol directory, and the quantitative data of the xml data files with different structures after the table structure is created can be obtained, and the xml data files with different structures after the table structure is created can be subjected to the accuracy check according to the obtained quantitative data to obtain the check result, and the xml data files with different structures of which the check result passes the accuracy check can be imported into the same file to be transmitted In the files under the transmission protocol directory, the extensible markup language data files with different data structures can be placed in the files under the same file transmission protocol directory.
Furthermore, the above scheme can analyze the extensible markup language data files with different structures simultaneously or respectively into the same or different file formats matching the selected and read file under the file transmission protocol directory, which is beneficial to placing the extensible markup language data files with different data structures into the file under the same file transmission protocol directory.
Furthermore, the above solution may create a table structure for the xml data files having different structures parsed into the file format matching the selected and read file under the file transfer protocol directory by adding a field in the table structure, which is advantageous in that the xml data files corresponding to the created table structure can be conveniently recorded and managed through the added field.
Furthermore, the scheme can generate the blood vessel views of the extensible markup language data files with different structures, which are imported into the files in the same file transfer protocol directory; the generated consanguinity view comprises a source node, an intermediate node, a storage node and the like of the extensible markup language data file, so that the extensible markup language data files with different structures, which are imported into the file under the same file transmission protocol directory, can be conveniently classified and managed, and the management efficiency is improved.
In the several embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is only one type of logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each of the units may exist alone physically, or two or more units may be integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may substantially or partially contribute to the prior art, or all or part of the technical solution may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
The above description is only a part of the embodiments of the present invention, and not intended to limit the scope of the present invention, and all equivalent devices or equivalent processes performed by the present invention through the contents of the specification and the drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A data importing method, comprising:
selecting and reading files in a file transfer protocol directory for placing extensible markup language data files;
analyzing extensible markup language data files with different structures into file formats matched with the selected and read files under the file transfer protocol directory;
creating a table structure for the XML data files with different structures which are analyzed to be matched with the file formats of the files under the selected and read file transmission protocol directory;
acquiring quantitative data of extensible markup language data files with different structures after a table structure is created;
according to the obtained quantitative data, carrying out accuracy verification on extensible markup language data files with different structures after the table structures are created to obtain verification results;
and importing extensible markup language data files with different structures, the verification results of which pass through accuracy verification, into files in the same file transfer protocol directory.
2. The data importing method according to claim 1, wherein the parsing extensible markup language data files of different structures into a file format matching the file under the selected and read file transfer protocol directory includes:
and analyzing the extensible markup language data files with different structures simultaneously or respectively to obtain the same or different file formats matched with the selected and read files under the file transmission protocol directory.
3. The data import method according to claim 1, wherein the creating a table structure for the xml data file parsed into different structures matching the file format of the file under the selected and read file transfer protocol directory comprises:
and creating a table structure for the extensible markup language data file which is analyzed into different structures matched with the file format of the file under the selected and read file transmission protocol directory in a mode of adding fields in the table structure.
4. The data import method according to claim 1, further comprising, after importing the xml data files of different structures whose verification results pass the accuracy verification into the file under the same file transfer protocol directory:
generating a blood margin view by the extensible markup language data files with different structures in the files imported into the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node and a storage node of the extensible markup language data file.
5. A data importing apparatus, comprising:
the system comprises a selection module, an analysis module, a creation module, an acquisition module, a verification module and an import module;
the selection module is used for selecting and reading files in a file transfer protocol directory for placing extensible markup language data files;
the analysis module is used for analyzing the extensible markup language data files with different structures into a file format matched with the selected and read file under the file transfer protocol directory;
the creation module is used for creating a table structure for the extensible markup language data files which are analyzed into different structures matched with the file formats of the files under the selected and read file transfer protocol directory;
the acquisition module is used for acquiring quantitative data of the extensible markup language data files with different structures after the table structures are created;
the verification module is used for carrying out accuracy verification on the extensible markup language data files with different structures after the table structures are created according to the obtained quantitative data to obtain verification results;
and the import module is used for importing the extensible markup language data files with different structures, the inspection results of which pass the accuracy verification, into the files in the same file transfer protocol directory.
6. The data import apparatus according to claim 5, wherein the parsing module is specifically configured to:
and analyzing the extensible markup language data files with different structures simultaneously or respectively to obtain the same or different file formats matched with the selected and read files under the file transmission protocol directory.
7. The data importing device of claim 5, wherein the creating module is specifically configured to:
and creating a table structure for the XML data file which is analyzed into different structures matching the file format of the file under the selected and read file transmission protocol directory in a mode of adding fields in the table structure.
8. The data import apparatus according to claim 5, wherein the data import apparatus further comprises:
a generating module;
the generating module is used for generating the blood vessel views from the extensible markup language data files with different structures in the files imported into the same file transfer protocol directory; the generated blood margin view comprises a source node, an intermediate node and a storage node of the extensible markup language data file.
9. A data import apparatus, comprising:
at least one processor; and (c) a second step of,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data import method of any of claims 1 to 4.
10. A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the data importing method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910906522.0A CN110737636B (en) | 2019-09-24 | 2019-09-24 | Data import method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910906522.0A CN110737636B (en) | 2019-09-24 | 2019-09-24 | Data import method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110737636A CN110737636A (en) | 2020-01-31 |
| CN110737636B true CN110737636B (en) | 2022-07-22 |
Family
ID=69269459
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910906522.0A Active CN110737636B (en) | 2019-09-24 | 2019-09-24 | Data import method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110737636B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112883692B (en) * | 2020-10-23 | 2024-04-09 | 广州超深信息技术有限公司 | Automatic generation method of PPT data report |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8402001B1 (en) * | 2002-10-08 | 2013-03-19 | Symantec Operating Corporation | System and method for archiving data |
| CN102999329A (en) * | 2012-11-05 | 2013-03-27 | 浙江吉利汽车研究院有限公司杭州分公司 | Active directory interface developing method based on extensive markup language mapping configuration |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6996571B2 (en) * | 2002-06-28 | 2006-02-07 | Microsoft Corporation | XML storage solution and data interchange file format structure |
| US7017112B2 (en) * | 2003-02-28 | 2006-03-21 | Microsoft Corporation | Importing and exporting markup language data in a spreadsheet application document |
| US20050097128A1 (en) * | 2003-10-31 | 2005-05-05 | Ryan Joseph D. | Method for scalable, fast normalization of XML documents for insertion of data into a relational database |
| JP4690798B2 (en) * | 2005-07-05 | 2011-06-01 | 株式会社リコー | Network equipment |
| CN103428202B (en) * | 2013-07-24 | 2016-06-01 | 浙江大学 | Remotely-sensed data product based on FTP and XML monitors storage method automatically |
| CN103577599A (en) * | 2013-11-15 | 2014-02-12 | 北京邮电大学 | Method and device for storing local data through mobile terminal |
| US20150278386A1 (en) * | 2014-03-25 | 2015-10-01 | Syntel, Inc. | Universal xml validator (uxv) tool |
| CN109614159B (en) * | 2017-09-30 | 2022-01-28 | 北京国双科技有限公司 | Method and device for distributing and importing planning tasks |
| CN109670328B (en) * | 2018-12-25 | 2022-04-26 | 北京城市网邻信息技术有限公司 | Data processing method and device |
-
2019
- 2019-09-24 CN CN201910906522.0A patent/CN110737636B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8402001B1 (en) * | 2002-10-08 | 2013-03-19 | Symantec Operating Corporation | System and method for archiving data |
| CN102999329A (en) * | 2012-11-05 | 2013-03-27 | 浙江吉利汽车研究院有限公司杭州分公司 | Active directory interface developing method based on extensive markup language mapping configuration |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110737636A (en) | 2020-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110287069B (en) | ESB interface automatic test method, server and computer readable storage medium | |
| CN110162544B (en) | Heterogeneous data source data acquisition method and device | |
| US20110173153A1 (en) | Method and apparatus to import unstructured content into a content management system | |
| AU2014400621B2 (en) | System and method for providing contextual analytics data | |
| CN110798445B (en) | Public gateway interface testing method and device, computer equipment and storage medium | |
| CN114424257A (en) | Automatic rendering and extraction of form data using machine learning | |
| US9141251B2 (en) | Techniques for guided access to an external distributed file system from a database management system | |
| US20130346427A1 (en) | Method and procedure for unassisted data collection, extraction and report generation and distribution | |
| CN110019315A (en) | A kind of method and apparatus for the parsing of data blood relationship | |
| CN110737636B (en) | Data import method, device and equipment | |
| EP3220285A1 (en) | Data acquisition program, data acquisition method and data acquisition device | |
| US20150106279A1 (en) | Compliance as a service for an organization | |
| CN115033639A (en) | Method and related device for generating relation graph for data sharing among clusters | |
| CN112835901A (en) | File storage method and device, computer equipment and computer readable storage medium | |
| KR100762712B1 (en) | Method for transforming of electronic document based on mapping rule and system thereof | |
| US8856152B2 (en) | Apparatus and method for visualizing data | |
| US8938520B2 (en) | Methods and systems for smart adapters in a social media content analytics environment | |
| CN112632419A (en) | Domain name pre-resolution configuration method and device, computer equipment and storage medium | |
| CN109710634B (en) | Method and device for generating information | |
| JP2021140430A (en) | Database migration method, database migration system, and database migration program | |
| CN115759029A (en) | Document template processing method and device, electronic equipment and storage medium | |
| US20170242865A1 (en) | Data verification device | |
| CN111882419B (en) | Method and device for quality inspection of files and server | |
| AU2018313995B2 (en) | Systems and methods for providing globalization features in a service management application interface | |
| US20190228075A1 (en) | Changing a language for a user session replay |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |