CN110502520A - A kind of method of data loading, system, equipment and computer readable storage medium - Google Patents
A kind of method of data loading, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110502520A CN110502520A CN201910797401.7A CN201910797401A CN110502520A CN 110502520 A CN110502520 A CN 110502520A CN 201910797401 A CN201910797401 A CN 201910797401A CN 110502520 A CN110502520 A CN 110502520A
- Authority
- CN
- China
- Prior art keywords
- tool
- data
- stored
- field
- php
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
Abstract
This application discloses a kind of methods of data loading, comprising: is stored JSON text to server using PHP tool；The JSON text on server is parsed using Go tool, and each field that parsing obtains is stored into the middle table of Mysql database；When receiving field mapping directive, mapping relations are determined according to field mapping directive；Each field in middle table is stored according to mapping relations into the product table of Mysql database using Go tool.The application is put in storage using the parsing of Go tool processing data, greatly improves the efficiency of data loading link；Meanwhile using server and database as medium, the collaborative work of Go tool and PHP tool under same environment is realized, does not influence other links of original system.The application additionally provides the system, equipment and computer readable storage medium of a kind of data loading simultaneously, has above-mentioned beneficial effect.
Description
Technical field
This application involves website data field of storage, in particular to a kind of method of data loading, system, equipment and calculating
Machine readable storage medium storing program for executing.
Background technique
PHP is a kind of general open source scripting language, and introduction is fast, and development cost is low, and execution efficiency is high, and deployment is simple, mainly
Suitable for Website development field.Mysql is a Relational DBMS, is the best relationship number of website application aspect
According to base management system application software；Mysql is small in size, and speed is fast, and open source code, therefore many websites generally use PHP+
Mysql group development environment.
Website usually requires to store mass text data into database table, and scheme in the prior art is using PHP
Programming obtains data, extracts data with regular expression matching and is converted to JSON text, then parses the storage of JSON text by PHP
Into database, after pending data handles mapping relations well, database table is stored by the storing process of Mysql.
However, since support of the PHP to multithreading is not so good, and Mysql storing process does not also support multithreading, uses
PHP and storing process are very low by mass text storage efficiency into database table；Meanwhile it (such as reporting an error) feelings if there is interruption
Condition needs storing data again, and process is complicated.
Therefore, how to realize that non-structured big data is quickly put in storage is skill that those skilled in the art need to solve at present
Art problem.
Summary of the invention
The purpose of the application is to provide method, system, equipment and the computer readable storage medium of a kind of data loading, uses
It is quickly put in storage in the non-structured big data of realization.
In order to solve the above technical problems, the application provides a kind of method of data loading, this method comprises:
Receive the data to be stored of input；
JSON text is converted by the data to be stored using PHP tool, and the JSON text is stored to service
On device；
Each field that the JSON text on the server is parsed using Go tool, and parsing is obtained
It stores into the middle table of Mysql database；
When receiving field mapping directive, mapping relations are determined according to the field mapping directive；
Each of the middle table field is stored according to the mapping relations to described using the Go tool
In the product table of Mysql database.
It is optionally, described to convert JSON text for the data to be stored using PHP tool, comprising:
Receive the regular expression of input；
The data to be stored is extracted by the regular expression using the PHP tool, obtains necessary data；
The JSON text is converted by the necessary data using the PHP tool.
Optionally, after each field for obtaining parsing stores in the middle table to Mysql database, further includes:
The middle table is read using the PHP tool, and each of the middle table field is shown and is being grasped
Make on interface.
Optionally, each of the middle table field is being deposited according to the mapping relations using the Go tool
After storage is into the product table of the Mysql database, further includes:
The prompt information that output data storage is completed is to predeterminated position.
The application also provides a kind of system of data loading, which includes:
Receiving module, data to be stored for receiving input；
Conversion module, for converting JSON text for the data to be stored using PHP tool, and the JSON is literary
This is stored to server；
Parsing module, for being parsed using Go tool to the JSON text on the server, and will parsing
Obtained each field is stored into the middle table of Mysql database；
Determining module, for determining mapping relations according to the field mapping directive when receiving field mapping directive；
Memory module, for being closed each of the middle table field according to the mapping using the Go tool
System stores into the product table of the Mysql database.
Optionally, the conversion module includes:
Receiving submodule, regular expression for receiving input；
Extracting sub-module is obtained for extracting the data to be stored by the regular expression using the PHP tool
To necessary data；
Submodule is converted, for converting the JSON text for the necessary data using the PHP tool.
Optionally, further includes:
Display module, for reading the middle table using the PHP tool, and will be described in each of described middle table
Field is shown in operation interface.
Optionally, further includes:
Output module stores the prompt information completed to predeterminated position for output data.
The application also provides a kind of data loading equipment, which includes:
Memory, for storing computer program；
Processor realizes the step of the method for data loading as described in any of the above-described when for executing the computer program
Suddenly.
The application also provides a kind of computer readable storage medium, and calculating is stored on the computer readable storage medium
Machine program is realized as described in any of the above-described when the computer program is executed by processor the step of the method for data loading.
The method of data loading provided herein, comprising: receive the data to be stored of input；It will be to using PHP tool
Storing data is converted into JSON text, and JSON text is stored to server；Using Go tool to the JSON on server
Text is parsed, and each field that parsing obtains is stored into the middle table of Mysql database；It is reflected when receiving field
When penetrating order, mapping relations are determined according to field mapping directive；Using Go tool by each field in middle table according to mapping
Relationship is stored into the product table of Mysql database.
Technical solution provided herein, by being parsed using Go tool to the JSON text on server, and
Each field that parsing obtains is stored into the middle table of Mysql database, concurrency is supported using height, is suitble to processing big
The parsing storage of the Go tool processing data of data, greatly improves the efficiency of data loading link；Meanwhile by server and
Database realizes the collaborative work of Go tool and PHP tool under same environment as medium, does not influence other rings of original system
Section, is finally stored each field in middle table into the product table of Mysql database according to mapping relations using Go tool,
Further improve the efficiency of data loading.The application additionally provides the system, equipment and computer of a kind of data loading simultaneously
Readable storage medium storing program for executing has above-mentioned beneficial effect, and details are not described herein.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of the method for data loading provided by the embodiment of the present application；
Fig. 2 is a kind of flow chart of practical manifestation mode of S102 in a kind of method of data loading provided by Fig. 1；
Fig. 3 is a kind of relation schematic diagram of data loading process provided by the embodiments of the present application；
Fig. 4 is a kind of structure chart of the system of data loading provided by the embodiment of the present application；
Fig. 5 is the structure chart of the system of another kind data loading provided by the embodiment of the present application；
Fig. 6 is a kind of structure chart of data loading equipment provided by the embodiment of the present application.
Specific embodiment
The core of the application is to provide method, system, equipment and the computer readable storage medium of a kind of data loading, uses
It is quickly put in storage in the non-structured big data of realization.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
Referring to FIG. 1, Fig. 1 is a kind of flow chart of the method for data loading provided by the embodiment of the present application.
It specifically comprises the following steps:
S101: the data to be stored of input is received；
Website usually requires to store mass text data into database table, and PHP is not so good to the support of multithreading,
And Mysql storing process does not also support multithreading, and mass text is stored the efficiency into database table using PHP and storing process
Very low, this application provides a kind of methods of data loading, for solving the above problems.
S102: JSON text is converted by data to be stored using PHP tool, and JSON text is stored to server
On；
JSON (JavaScript Object Notation, JS object numbered musical notation) is a kind of data exchange lattice of lightweight
Formula, stores using the text formatting for being totally independent of programming language and indicates data, it is mentioned herein will be to using PHP tool
The purpose that storing data is converted into JSON text is, parses data to be stored convenient for machine, and effectively promote network transmission
Efficiency；
PHP tool mentioned herein is the tool write using PHP language, and PHP is a kind of general open source scripting language, is entered
Door is fast, and development cost is low, and execution efficiency is high, and deployment is simple, is suitable for Website development field, using PHP tool can quickly by
Data to be stored is converted into JSON text, and JSON text is stored to server；
Optionally, mentioned herein to convert JSON text for data to be stored using PHP tool, it is specific to may be
Step as shown in Figure 2, is illustrated below with reference to Fig. 2.
Referring to FIG. 2, a kind of practical manifestation mode of the Fig. 2 for S102 in a kind of method of data loading provided by Fig. 1
Flow chart.
Itself specifically includes the following steps:
S201: the regular expression of input is received；
S202: data to be stored is extracted by regular expression using PHP tool, obtains necessary data；
S203: JSON text is converted by necessary data using PHP tool.
Regular expression ((is claimed including general character (for example, letter between a to z) and spcial character to character string
For " metacharacter ")) operation a kind of logical formula, be exactly with predefined some specific characters and these specific characters
Combination, composition one " regular character string ", this " regular character string " is used to express a kind of filter logic to character string, just
Then expression formula is a kind of Text Mode, and matched one or more character strings are wanted in mode description when searching for text.
Based on, there may be noise data or other unnecessary datas, the application utilizes just in the data to be stored received
Then expression formula extracts data to be stored to obtain necessary data, finally converts JSON for necessary data using PHP tool
Text improves the precision of data, further improves the efficiency of data loading.
S103: parsing the JSON text on server using Go tool, and each field that parsing obtains is deposited
Storage is into the middle table of Mysql database；
Go tool mentioned herein is the tool according to Go language development, and Go language is a kind of static strong of Google exploitation
Type, compiled and hair style, and the programming language with garbage reclamation function, Go language is very efficient, and height is supported concurrently
Property, the application can be realized the fast resolving to JSON text on server, and each word that parsing is obtained using Go tool
Section is stored into the middle table of Mysql database, greatly improves the speed of data loading；
It optionally, can be with benefit after each field for obtaining parsing stores in the middle table to Mysql database
Middle table is read with PHP tool, and each field in middle table is shown in operation interface, allows the user to operating
The arrangement of mapping association relationship is carried out on interface to the field of display.
S104: when receiving field mapping directive, mapping relations are determined according to field mapping directive；
S105: each field in middle table is stored according to mapping relations to the production of Mysql database using Go tool
In product table.
Referring to FIG. 3, Fig. 3 is a kind of relation schematic diagram of data loading process provided by the embodiments of the present application；
As shown in figure 3, after PHP tool obtains external data and is converted into Json, by Json in the form of text file
It stores on server, it is powerful using Go tool then using the Json text on Go tool reading service device and after parsing
Each field data that concurrent capability obtains parsing is stored into the middle table of Mysql database；PHP tool is recycled to read
Field in the middle table of Mysql is shown in operation interface, allows the user to arrange mapping association pass in operation interface
System finally handles each field according to mapping relations using Go tool and stores into the product table of Mysql.
Optionally, each field in middle table is being stored according to mapping relations to Mysql database using Go tool
Product table in after, the prompt information completed can be stored with output data to predeterminated position, it is right in time to allow the user to
Storage data do corresponding processing.
Based on the above-mentioned technical proposal, the method for a kind of data loading provided herein, by utilizing Go tool to clothes
JSON text on business device is parsed, and each field that parsing obtains is stored into the middle table of Mysql database, benefit
The parsing storage that concurrency, the Go tool processing data for being suitble to processing big data are supported with height, greatly improves data and enters
The efficiency of library link；Meanwhile using server and database as medium, Go tool and PHP tool under same environment are realized
It cooperates, does not influence other links of original system, finally closed each field in middle table according to mapping using Go tool
System stores into the product table of Mysql database, further improves the efficiency of data loading.
Referring to FIG. 4, Fig. 4 is a kind of structure chart of the system of data loading provided by the embodiment of the present application.
The system may include:
Receiving module 100, data to be stored for receiving input；
Conversion module 200 for converting JSON text for data to be stored using PHP tool, and JSON text is deposited
On storage to server；
Parsing module 300, for being parsed using Go tool to the JSON text on server, and parsing is obtained
Each field is stored into the middle table of Mysql database；
Determining module 400, for determining mapping relations according to field mapping directive when receiving field mapping directive；
Memory module 500, for being stored each field in middle table to Mysql according to mapping relations using Go tool
In the product table of database.
Referring to FIG. 5, Fig. 5 is the structure chart of the system of another kind data loading provided by the embodiment of the present application.
The conversion module 200 may include:
Receiving submodule, regular expression for receiving input；
Extracting sub-module obtains necessary data for extracting data to be stored by regular expression using PHP tool；
Submodule is converted, for converting JSON text for necessary data using PHP tool.
The system can also include:
Display module for reading middle table using PHP tool, and each field in middle table is shown on operation circle
On face.
The system can also include:
Output module stores the prompt information completed to predeterminated position for output data.
Each component part in system above can be applied in embodiment below:
Receiving module receives the data to be stored of input；Conversion module is converted data to be stored to using PHP tool
JSON text, and JSON text is stored to server；Parsing module using Go tool to the JSON text on server into
Row parsing, and each field that parsing obtains is stored into the middle table of Mysql database；Display module utilizes PHP tool
Middle table is read, and each field in middle table is shown in operation interface；When receiving field mapping directive, determine
Module determines mapping relations according to field mapping directive；Memory module is using Go tool by each field in middle table according to reflecting
The relationship of penetrating is stored into the product table of Mysql database；The prompt information that the storage of output module output data is completed is to default position
It sets.
Referring to FIG. 6, Fig. 6 is a kind of structure chart of data loading equipment provided by the embodiment of the present application.
The data loading equipment 600 can generate bigger difference because configuration or performance are different, may include one or
More than one processor (central processing units, CPU) 622 (for example, one or more processors) and
Storage medium 630 (such as one or one of memory 632, one or more storage application programs 642 or data 644
The above mass memory unit).Wherein, memory 632 and storage medium 630 can be of short duration storage or persistent storage.It is stored in
The program of storage medium 630 may include one or more modules (diagram does not mark), and each module may include to dress
Series of instructions operation in setting.Further, central processing unit 622 can be set to communicate with storage medium 630, in number
It is operated according to the series of instructions executed in storage medium 630 on library facilities 600 are entered.
Data loading equipment 600 can also include one or more power supplys 626, one or more wired or nothings
Wired network interface 650, one or more input/output interfaces 658, and/or, one or more operating systems 641,
Such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
Step in the method for data loading described in above-mentioned Fig. 1 to Fig. 3 is based on shown in the Fig. 6 as data loading equipment
Structure realize.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed device, device and method, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the division of module,
Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple module or components can be with
In conjunction with or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed
Mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or module or
Communication connection can be electrical property, mechanical or other forms.
Module may or may not be physically separated as illustrated by the separation member, show as module
Component may or may not be physical module, it can and it is in one place, or may be distributed over multiple networks
In module.Some or all of the modules therein can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
If integrated module is realized and when sold or used as an independent product in the form of software function module, can
To be stored in a computer readable storage medium.Based on this understanding, the technical solution of the application substantially or
Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products
Out, which is stored in a storage medium, including some instructions are used so that a computer equipment
The whole of (can be personal computer, funcall device or the network equipment etc.) execution each embodiment method of the application
Or part steps.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory,
ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. are various can store program
The medium of code.
Above to method, system, equipment and the computer readable storage medium of a kind of data loading provided herein
It is described in detail.Specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality
The explanation for applying example is merely used to help understand the present processes and its core concept.It should be pointed out that for the art
For those of ordinary skill, under the premise of not departing from the application principle, can also to the application, some improvement and modification can also be carried out,
These improvement and modification are also fallen into the protection scope of the claim of this application.
It should also be noted that, in the present specification, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that
A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except there is also other identical elements in the process, method, article or equipment for including element.
Claims (10)
1. a kind of method of data loading characterized by comprising
Receive the data to be stored of input；
JSON text is converted by the data to be stored using PHP tool, and the JSON text is stored to server；
The each field for being parsed using Go tool to the JSON text on the server, and parsing being obtained is stored
Into the middle table of Mysql database；
When receiving field mapping directive, mapping relations are determined according to the field mapping directive；
Each of the middle table field is stored according to the mapping relations to the Mysql using the Go tool
In the product table of database.
2. the method according to claim 1, wherein described converted the data to be stored using PHP tool
For JSON text, comprising:
Receive the regular expression of input；
The data to be stored is extracted by the regular expression using the PHP tool, obtains necessary data；
The JSON text is converted by the necessary data using the PHP tool.
3. the method according to claim 1, wherein storing in each field for obtaining parsing to Mysql number
After in the middle table in library, further includes:
The middle table is read using the PHP tool, and each of the middle table field is shown on operation circle
On face.
4. the method according to claim 1, wherein using the Go tool by each of described middle table
After the field is stored according to the mapping relations into the product table of the Mysql database, further includes:
The prompt information that output data storage is completed is to predeterminated position.
5. a kind of system of data loading characterized by comprising
Receiving module, data to be stored for receiving input；
Conversion module for converting JSON text for the data to be stored using PHP tool, and the JSON text is deposited
On storage to server；
Parsing module for being parsed using Go tool to the JSON text on the server, and parsing is obtained
Each field store into the middle table of Mysql database；
Determining module, for determining mapping relations according to the field mapping directive when receiving field mapping directive；
Memory module, for being deposited each of the middle table field according to the mapping relations using the Go tool
Storage is into the product table of the Mysql database.
6. system according to claim 5, which is characterized in that the conversion module includes:
Receiving submodule, regular expression for receiving input；
Extracting sub-module, for extracting the data to be stored by the regular expression using the PHP tool, obtaining must
Want data；
Submodule is converted, for converting the JSON text for the necessary data using the PHP tool.
7. system according to claim 5, which is characterized in that further include:
Display module, for reading the middle table using the PHP tool, and by each of the middle table field
It is shown in operation interface.
8. system according to claim 5, which is characterized in that further include:
Output module stores the prompt information completed to predeterminated position for output data.
9. a kind of data loading equipment characterized by comprising
Memory, for storing computer program；
Processor realizes the method for the data loading as described in any one of Claims 1-4 when for executing the computer program
The step of.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program, realizing the method for data loading as described in any one of Claims 1-4 when the computer program is executed by processor
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910797401.7A CN110502520B (en) | 2019-08-27 | 2019-08-27 | Method, system and equipment for data warehousing and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910797401.7A CN110502520B (en) | 2019-08-27 | 2019-08-27 | Method, system and equipment for data warehousing and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502520A true CN110502520A (en) | 2019-11-26 |
| CN110502520B CN110502520B (en) | 2020-05-12 |
Family
ID=68588560
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910797401.7A Active CN110502520B (en) | 2019-08-27 | 2019-08-27 | Method, system and equipment for data warehousing and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502520B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339041A (en) * | 2020-03-10 | 2020-06-26 | 中国建设银行股份有限公司 | File parsing and warehousing and file generating method and device |
| CN113127484A (en) * | 2020-12-31 | 2021-07-16 | 重庆帮企科技集团有限公司 | Efficient and quick data storage method and device |
| CN113220695A (en) * | 2021-06-03 | 2021-08-06 | 中国农业银行股份有限公司 | Data storage method, device, equipment, medium and product |
| CN113326681A (en) * | 2021-05-25 | 2021-08-31 | 上海微盟企业发展有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN113342580A (en) * | 2021-07-06 | 2021-09-03 | 中国工商银行股份有限公司 | Data backup method, device and equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106649810A (en) * | 2016-12-29 | 2017-05-10 | 山东舜网传媒股份有限公司 | Ajax-based news webpage dynamic data grabbing method and system |
| EP3324325A4 (en) * | 2015-07-14 | 2018-05-23 | Tencent Technology (Shenzhen) Company Limited | Method, client, and system for testing application |
| US10037420B1 (en) * | 2017-05-17 | 2018-07-31 | American Express Travel Related Services Copmany, Inc. | Cardless transactions |
| CN110119423A (en) * | 2019-05-17 | 2019-08-13 | 厦门商集网络科技有限责任公司 | A kind of data analysis method and computer readable storage medium of configurableization |
-
2019
- 2019-08-27 CN CN201910797401.7A patent/CN110502520B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3324325A4 (en) * | 2015-07-14 | 2018-05-23 | Tencent Technology (Shenzhen) Company Limited | Method, client, and system for testing application |
| CN106649810A (en) * | 2016-12-29 | 2017-05-10 | 山东舜网传媒股份有限公司 | Ajax-based news webpage dynamic data grabbing method and system |
| US10037420B1 (en) * | 2017-05-17 | 2018-07-31 | American Express Travel Related Services Copmany, Inc. | Cardless transactions |
| CN110119423A (en) * | 2019-05-17 | 2019-08-13 | 厦门商集网络科技有限责任公司 | A kind of data analysis method and computer readable storage medium of configurableization |
Non-Patent Citations (2)
| Title |
|---|
| 吴详坤等: "基于Android平台的信息采集与远程显示系统研究", 《吉林大学学报》 * |
| 王琳珂: "基于开源平台的环境状况监测系统的设计与实现", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339041A (en) * | 2020-03-10 | 2020-06-26 | 中国建设银行股份有限公司 | File parsing and warehousing and file generating method and device |
| CN111339041B (en) * | 2020-03-10 | 2024-01-12 | 中国建设银行股份有限公司 | File analysis and storage method and device and file generation method and device |
| CN113127484A (en) * | 2020-12-31 | 2021-07-16 | 重庆帮企科技集团有限公司 | Efficient and quick data storage method and device |
| CN113326681A (en) * | 2021-05-25 | 2021-08-31 | 上海微盟企业发展有限公司 | Data processing method, device, equipment and computer readable storage medium |
| CN113220695A (en) * | 2021-06-03 | 2021-08-06 | 中国农业银行股份有限公司 | Data storage method, device, equipment, medium and product |
| CN113342580A (en) * | 2021-07-06 | 2021-09-03 | 中国工商银行股份有限公司 | Data backup method, device and equipment |
| CN113342580B (en) * | 2021-07-06 | 2024-02-27 | 中国工商银行股份有限公司 | Data backup method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502520B (en) | 2020-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110502520A (en) | A kind of method of data loading, system, equipment and computer readable storage medium | |
| AU2020299384B2 (en) | Predictive similarity scoring subsystem in a natural language understanding (NLU) framework | |
| US10789229B2 (en) | Determining a hierarchical concept tree using a large corpus of table values | |
| US8661023B1 (en) | Optimizing search query logic to speed retrieval | |
| US10409828B2 (en) | Methods and apparatus for incremental frequent subgraph mining on dynamic graphs | |
| US10303689B2 (en) | Answering natural language table queries through semantic table representation | |
| US20150178273A1 (en) | Unsupervised Relation Detection Model Training | |
| WO2020016794A1 (en) | Dictionary editing system integrated with text mining | |
| CN114595686B (en) | Knowledge extraction method, and training method and device of knowledge extraction model | |
| US11250044B2 (en) | Term-cluster knowledge graph for support domains | |
| CN108491326A (en) | Behavioral test recombination method, device and storage medium | |
| CN109871311A (en) | A kind of method and apparatus for recommending test case | |
| CN110502227A (en) | The method and device of code completion, storage medium, electronic equipment | |
| CN113220835A (en) | Text information processing method and device, electronic equipment and storage medium | |
| CN103869999A (en) | Method and device for sorting candidate items generated by input method | |
| CN114281968A (en) | Model training and corpus generation method, device, equipment and storage medium | |
| CN114579104A (en) | Data analysis scene generation method, device, equipment and storage medium | |
| CN108170661B (en) | Method and system for managing rule text | |
| JP2022510818A (en) | Transliteration of data records for improved data matching | |
| CN110309214B (en) | Instruction execution method and equipment, storage medium and server thereof | |
| WO2016093839A1 (en) | Structuring of semi-structured log messages | |
| KR20220050915A (en) | Rare topic detection using hierarchical clustering | |
| US20150046443A1 (en) | Document-based search with facet information | |
| CN111142871A (en) | Front-end page development system, method, equipment and medium | |
| US20220198153A1 (en) | Model training |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |