TWI549008B - A large number of data into the system and methods of screening management - Google Patents

Description

System and method for importing large amounts of data into screening management

The present invention relates to a system and method for importing data; in particular, a system and method for filtering and managing a large amount of data in a telecommunication service, through the number of characters, continuity and sorting method Filter into and manage.

In the pre-patent multimedia file classification method (application date: 2008/12/09, application number: 097147879), it is to automatically sort a large number of multimedia files using parameters such as EXIF information, image features and file attributes, and browse the screen. A classification label with a category name, a file name, a date parameter, and a file location is displayed, so that the user can conveniently manage and browse a large number of multimedia files.

The system and method for full-text search using the positional relationship of single words in the pre-patent case (application date: 2006/10/04, application number: 095136960) is a system for performing full-text search using the positional relationship of single words and The method is applied to a handheld data processing device having a dictionary function, and an index relationship is established through a dictionary database having a file number and a location number, when performing an index to be retrieved When the vocabulary search is performed, the file numbers including the words of the vocabulary to be searched are initially compared, and the position numbers of the words are successively compared to find the vocabulary file corresponding to the positional relationship of the words to be retrieved, and a search result is generated at the same time. A list that provides user-relevant search information for accurate search.

It can be seen that there are still many shortcomings in the above-mentioned methods of use, which is not a good design, but needs to be improved.

In view of the shortcomings derived from the above-mentioned conventional methods, the inventor of the present invention has improved and innovated, and after years of painstaking research, he finally succeeded in researching and developing this invention.

The purpose of this patent is that when a large number of commodity data are imported and different sources are used, and the format errors and data contents contain symbols or words that cannot be judged, the presentation interface is not presented in the method of screening this patent. Excessive but not absolutely accurate matching of successful results requires manual intervention into the backend platform for modification. Therefore, the invention adopts an index classification module to distinguish various types of data and establish an index value; the data screening module rejects the invalid data content; the data comparison module mainly distinguishes each category of data; the data management module crawls the data content and writes In each database, the final data extraction module reads the data of the host database according to the display interface requirements, and returns it to the display interface in sequence, which can greatly reduce the error of the content of the display interface, and the probability of the customer complaint case occurs. .

In the past, importing commodity data to the display interface relied on manual import and comparison, and it took a lot of time and manpower to consolidate, store and transport all kinds of commodity data, such as cloud, mobile phone or fixed network, for sale. The product page provides the correct product information. The invention can be combined with a demander definition mapping table to provide innovation The new self-service; and the data comparison module use the weighted formula to calculate the weight value; and the demander can modify and add the mapping table, and can directly add and update the product data content and category without directly changing the program, which can greatly improve The convenience of telecom business maintenance.

The system and method for importing a large amount of data into the screening management of the invention have the functions of graphics and automation, and have the advantages of timeliness, correctness, integration, efficiency and convenience, improve the correctness of data identification, and reduce the editing of a large number of commodities. Manpower and the convenience of greatly improving the management of telecommunication services can also be applied to other systems that require large amounts of data to be imported and duplicated.

The technical features provided by the present invention have the following advantages when compared with other conventional technologies:

1. The index classification module is used for intelligent classification judgment analysis to distinguish various types of data and improve data crawling efficiency.

2. Using the data filtering module to automatically filter invalid words or symbols according to the customized configuration, reducing the cost of manual filtering operations.

3. The data comparison module calculates the weight value through the weighted formula, and considers the three conditions of the same word number, the same word order, and the same word continuity as the word, and can quickly compare the matched data in a short time. As a result, the classification of the source commodity data is more accurately distinguished.

4. Using the setting mapping module to provide innovative self-service, you can flexibly add and update product content and categories without directly changing the program content, greatly improving the convenience of telecom business maintenance management.

5. The use of data management modules can reduce the labor cost burden of a large number of data files, so it will also reduce the return cases caused by human factors.

6. The data extraction module can be used to set the automatic scheduling, and the demand is transmitted directly to the module by the display interface. The touch group actively crawls the data from the host database and then returns the data, thereby reducing the amount of front-end product editing manpower and effectively reducing the company's manpower. cost.

100‧‧‧A large amount of data is transferred to the system for screening management

110‧‧‧Create index classification module

120‧‧‧Information screening module

130‧‧‧ data comparison module

140‧‧‧Set mapping module

150‧‧‧Data Management Module

160‧‧‧Data extraction module

170‧‧‧ Data Import Module

180‧‧‧ Data Audit Module

S210~S270‧‧‧ Process steps for importing large amounts of data into screening management

210, 220‧‧ ‧ database

230‧‧‧Host database

240‧‧‧Display interface

The technical contents of the present invention and the effects of the objects of the present invention can be further understood by referring to the detailed description of the present invention and the accompanying drawings. FIG. 1 is a schematic diagram of a system for importing and filtering a large amount of data into the present invention.

Figure 2 is a flow chart of a method for importing and filtering a large amount of data into the present invention.

Figure 3 is a diagram showing an embodiment of a system for importing and filtering large amounts of data into the present invention.

Figure 4 is a data calculation diagram of the method for importing and filtering a large amount of data into the screening management of the present invention.

Figure 5 is a data calculation diagram of the method for filtering and managing a large amount of data into the present invention.

Figure 6 is a data calculation diagram of the method for importing and filtering large amounts of data into the screening management of the present invention.

Figure 7 is a timing diagram of a system and method for large-scale data import and screening management of the present invention.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Hereinafter, the present invention will be further described with reference to the accompanying drawings: Referring to FIG. 1, FIG. 1 is a schematic diagram of a system for importing and filtering a large amount of data into the present invention. As shown in FIG. 1 , the method includes an index classification module 110, a data filtering module 120, a data review module 180, a data comparison module 130, a setting mapping module 140, a data management module 150, and a data extraction module. Group 160. The index classification module 110 receives the data and determines whether each index target has an index value, and the pre-built index target and the index value are stored in the database. Next, the data filtering module 120 sets the configuration and receives the data of the indexing classification module 110 for filtering. However, the data review module 180 receives the data of the data screening module 120, and the data is unrecognizable or garbled and actively establishes a review interface. The data matching module 130 receives the data of the data screening module 120 or the data review module 180, and performs cross-matching according to the data table of the setting mapping module 140. The setting mapping module 140 performs multi-layering by using program logic. The group is aggregated, and the data sheets of each module are pre-defined and converted into standard format data of the system. Then, the data management module 150 receives the data table of the setting mapping module 140 and the data comparison module 130, and classifies the feature names according to each data table field. Finally, the data extraction module 160 calls the data management module 150 and receives the data of the data management module 150, and then transmits the data back to the display interface 240.

The above index values can be further classified into a single value, a multi-value and a null value. The single value is that the target end does not need to be further parsed, and the multi-value system further includes other index values for the target end, and further analysis is needed, and the null value is the target. There are no other index values on the side and no further parsing is required.

Please refer to FIG. 2, which is a flow chart of a method for importing and filtering a large amount of data into the present invention. As shown in FIG. 1 and FIG. 2, the process steps may include: S210: The index establishment module 110 receives the data, establishes an index value and an index target end, and classifies the index target end name.

S220: The data filtering module 120 sets the configuration and receives the data of the indexing classification module 110 for filtering. If the judgment analysis is possible, the process proceeds to step S240: otherwise, step S230 is performed.

S230: The data review module 180 receives the data of the data screening module 120, and the data is incapable of judging analysis or garbled, and actively establishing a review interface for debugging.

The data comparison module 130 receives the data of the data screening module 120 or the data review module 180, and performs cross-matching according to the data table of the setting mapping module 140.

In S250, the setting mapping module 140 performs multi-layer group integration by using program logic, and pre-defines the data tables of each module, and converts into standard format data of the system.

S260: The data management module 150 receives the data table of the setting mapping module 140 and the data comparison module 130, and classifies the feature names according to each data table field.

The data extraction module 160 receives and performs batch delivery according to the display interface 240, receives the data of the data management module 150, and transmits the data back to the display interface 240.

The indexing classification module 110 pre-builds the index target end for The data comparison module 130 and the data management module 150 query the target string without the need to crawl the entire XML file in advance, and the index classification module 110 can improve the data crawling efficiency and store the result in the database. However, the data filtering module 120 customizes the configuration for data filtering, and is responsible for filtering and establishing a specific data string or symbol of the data transmitted by the index classification module 110, and pre-establishing the filtering data table including irrelevant symbols or words and the like. Or create a data sheet that needs to be replaced by a word or symbol to solve the data error caused by human factors; if the content of the data cannot be judged and most of them are garbled, the data screening module 120 will send the data to the data review module 180. Review actions to reduce the workload of customer service staff.

Then, the data comparison module 130 mainly performs the data comparison generating operation, and receives the information transmitted by the data filtering module 120 or the data review module 180 to generate corresponding data, and is defined according to the setting mapping module 140. The data sheets of the "Product Data Types" are cross-checked. The data source is the data filtering module 120, the data review module 180 and the data sent by the setting mapping module 140, and the compared data path is sent to the data management module 150 to be merged into the source type field. Different types are directly distinguished by the display interface 240, and the data management module 150 is notified. The comparison method is based on the product characteristics and the comparison process. The weight value formula of the invention has the highest total value of each consideration, and the goods are classified into the type, as shown by the following formula:

++β+γ=10

, which means If the calculated value is less than 0.1, take 0.1 directly; Express If the calculated value is less than 0.1, then take 0.1; Ws = weight value score sum; α, β, γ = weight factor; Q = order quality; Nd = index target data content to be compared to the same number of words; Ns=Set the number of keywords in the definition data table of the mapping module; = The order of the name of the data content of the index target is to be compared; = Set the keyword position order of the definition data table of the mapping module; S(Pd)=the data content of the index target end is the same as the name of the matching word; and the key of the definition data table of the Ps=setting mapping module Word continuity.

The setting mapping module 140 uses the program logic to perform multi-level group integration. The main functions pre-define the data table of each product data type and the data table of each index target processing for the data comparison module and the data management module. The group crawls the predetermined data and the specified placement location, and is in a standard format data acceptable to the system.

In addition, the data management module 150 receives the data table transmitted by the setting mapping module 140, performs feature name classification according to each data table field, and follows the data table cross-matching of each index target processing of the setting mapping module. The content of each product data is processed, and the fields of source type, destination name, destination data table, destination field, and retrieval processing are preset, and the XML product data to be crawled can be written into each database and data table. Finally, the data extraction module 160 reads the standardized product data from the host database according to the requirements of the display interface 240, and returns the data to the product areas of the display interface 240 according to the "source type" field of the host database. This distinguishes between various types of data products.

The present invention will be more clearly understood for the benefit of the present invention. Please refer to FIG. 3, which is a diagram of an embodiment of a system for importing and filtering large amounts of data into the present invention. As shown in Figures 1 to 3, the main steps are as follows. Completing the data of the host database in an automated manner in conjunction with the display interface 240 requirements:

1. The data import module 170 performs a scheduled scheduling job to capture XML data, classifies it into an entity location or a temporary storage of the database, and temporarily stores the database 210 as the commodity data to be classified.

2. The index classification module 110 is configured to receive the new data from the designated database 220, and notify the data screening module 120 to start its module to process the file. The operation includes:

(a) When there is a problem with the customer service staff transmitting the XML data format, an error message will be generated.

(b) An alarm message is generated when a network disconnection occurs or the database fails to respond.

(c) If new data is passed in, the specified database does not exist, or the specified index target is invalid, an error message is generated on the screen;

(d) When the process of receiving or updating the data fails or is incorrect, an error message is generated on the screen.

(e) When the receiving data import module 170 is completed, the data is classified according to its characteristics and imported into the relevant data tables of the database 220, and the classification is classified to determine whether it is necessary to further extract and establish Its index value.

(f) When receiving or updating the data, check whether the received data is complete. If it is not complete, an error message will be generated.

(g) When receiving other function module messages, display their messages directly on the screen.

(h) Daily use of Structured Query Language (Structured Query Language, SQL) Integration Services provides a scheduled scheduling function that receives and outputs data to the repository 220.

3. The data screening module 120 will crawl the product data and store it in the database 220 for screening operations. The operation includes: (a) the main function is to climb the product data and store it in the database 220 for screening operations. It is necessary to pre-establish a filter data table to filter out irrelevant content such as symbols or words that cannot be judged, or to create a data table of words or symbols that need to be replaced, and then automatically transfer the data to the next module for processing; (b) If the content of the data cannot be judged and most of them are garbled, the route is sent to the data review module 180 for audit reference, but this part of the data accounts for less than 1%; (c) provides the scheduled schedule check function, if other functions are needed in the job processing When the module cooperates, it generates a processing message, and issues an instruction to the relevant function module.

4. The data review module 180 receives the product data content of the data screening module 120. Most of the data content cannot be judged and is garbled. The number of documents to be reviewed is very small, and an audit interface is actively produced for the customer service personnel to perform the audit action.

5. The data comparison module 130 will perform the data comparison generation operation, and will receive the corresponding information by the data filtering module 120 or the data transmission module 180, and according to the setting mapping module 140 The data sheet of the product data type is cross-aligned, and the compared data path is sent to the data management module 150 to be merged into the source type field, and the comparison method is calculated by the weight value formula.

Please refer to FIG. 4 to FIG. 6 , which are diagrams for calculating the data of the method for filtering and managing a large amount of data into the present invention. As shown in FIG. 4 to FIG. 6 , the comparison method is calculated by a weight value formula, and is described by an embodiment. The steps are as follows:

i. The XML-type input product is cross-matched by the "data type data table" defined by the setting mapping module 140. For example, "asus tablet + mPro latest campus project offer monthly payment of 750" for data search terms for data comparison, assuming that the "alignment data table", the data retrieval condition characters are retrieved and the results are: " "iPad min tablet", "Easy FUN monthly payment 750", "Let's talk about monthly rent plan 750", "mPro450+3G183", and "flat + mPro750" and other results. Among them, the formula Nd/Ns is used as one of the weight value calculations. According to the rules, the “asus tablet + mPro latest campus project offer monthly payment 750” is dismantled and the number of identical words of the desired pair is matched. The ratio is “ iPad min tablet": 5/10, "Easy FUN monthly payment 750": 6/10, "Let's talk about monthly rent plan 750": 5/10, "mPro450+3G183": 7/13, and "flat + mPro750" :10/10. It can be seen from the above example that "flat plate + mPro750" has the highest calculation value in Nd/Ns.

Ii. The second stage is to use the “asus tablet + mPro latest campus project offer monthly payment 750” data retrieval term, which is in accordance with the position comparison of the same word in the string, with the formula Q ( As one of the weight value calculations, the results of the comparison are: "iPad min tablet": 0.09, "Easy FUN monthly payment 750": 0.18, "Let's talk about monthly rent plan 750": 0.12, "mPro450+3G183 ": 0.138, and "flat + mPro750": 0.3. It can be seen from the above example that "flat + mPro750" is in Q ( ) The highest value is calculated.

Iii. The third stage is to use the “asus tablet + mPro latest campus project offer monthly payment 750” data retrieval term, which is consistent with the continuous comparison score of the same word in the string, with the formula ( S ( Pd ) ) / Ps is one of the weight value calculations. The results of the comparison are: "iPad min tablet": 2/10, "Easy FUN monthly payment 750": 5/10, "Let's talk about monthly rent plan 750": 3/10, "mPro450+3G183": 4/13, and "flat + mPro750": 4/10. It can be seen from the above example that "Easy FUN Monthly Payment 750" has the highest calculation value at ( S ( Pd )) / Ps .

Iv. Finally, when returning the calculated values, the weight ratios are multiplied by the weighting factors, and the highest total value is used as the basis for selecting the data classification. The classification of the last selected data can be obtained as: +mPro750".

As described above, the process of calculating the weight value formula is as follows:

(a) The main function is to execute the data corresponding to the instruction transmitted by the job acceptance data screening module 120 or the data review module 180, and then according to the data sheet of the "various product data types" of the mapping module 140. Cross comparison.

(b) Multiplying the weighting factors according to the received weight ratios and using the highest total value as the basis for selecting the data classification, which can more effectively and accurately determine the type of the product data.

(c) Returning the data to the data management module 150 and consolidating it to the source type field, and notifying the data management module 150 that the processing has been completed.

(d) Provide a timed schedule check function. If other function modules are required to work in the process, a processing message is generated, and an instruction is issued and sent to the relevant function module.

(e) Display the specified message on the screen according to the requirements of other function modules, or notify its customer service by mail.

(f) According to the requirements of other functional modules, the error message is displayed on the screen, printed on the report, and recorded in the system event log database.

(g) According to the needs of the customer service staff, the system can record the event record, call record, and which XML product data is currently being processed in an unlimited number of times, and can generate reports at any time.

6. The setting mapping module 140 defines a data table of "each product data type" and a data table of "each index target definition processing" for the data comparison module 130 and the data management module 150 to compare data and specify placement. The location is written to the host repository and its operations include:

(a) a data table of "each commodity data type" and a data table of "each index target definition processing" are defined in advance, and the data table is read by the data comparison module 130 and the data management module 150, and further Processing the next stage, and during the writing process, if a data format error occurs, or any exception Error, that is, the error data is written into the data record.

(b) In the future, if the customer service staff has expanded or changed the product name requirements, the number and name of the field can be flexibly increased in this module without directly changing the program.

7. The data management module 150 extracts the product data to the host database 230 and needs to perform management actions, and determines the characteristics of the imported data, crawls the XML type of commodity data, and writes to each database and data table. Its operations include:

(a) All the product data in the host database can be managed according to the data table transmitted by the setting mapping module 140.

(b) After receiving the data of the database, according to the characteristics of the data, it is possible to determine which type of data table the data is stored in the host database.

(c) The data extraction module 160 can be provided with a large amount of correct data that has been filtered and compared, and the data extraction module 160 is provided to search the data table of the host database 230.

(d) An alarm message is generated when a network disconnection occurs or the database fails to respond.

(e) Daily use of structured query language; (Structured Query Language, SQL) Integration Services (Integration Services) provides timing scheduling to receive and output data.

8. The data extraction module 160 reads the standardized commodity data from the host database, and its operations include:

(a) batch delivery according to the requester's request for requisition according to the demand interface of the display interface 240, for subsequent extraction of the demand data of the host database, and The query results output a standard format and the data is passed back to the presentation interface 240.

(b) Automatically send a mail to inform the person that the application has been processed.

(c) If notified, the applicant will be automatically notified.

Please refer to FIG. 7. FIG. 7 is a timing diagram of a system and method for filtering and managing a large amount of data into the present invention. As shown in Figure 7, the data flow sequence diagram illustrates the order of calls between modules, sorted by call time, from top to bottom, from left to right. Transmitting a large amount of XML product data to the data import module 170, the data import module 170 will save a file to the physical location and start crawling the entire file to the database temporary storage, and the data import module 170 starts the call. The index classification module 110 is created, and then the index classification module 110 is configured to return a message to the data import module 170, requesting the data import module 170 to download the data to the database, and handing the data to the index classification module 110 for processing. The index classification module 110 determines whether the index target has a value, and can divide it into a single, multi-value or null value, establish a complete index table, and store the result in the database. The call data filtering module 120 continues to process, and the data filtering module 120 is responsible for replacing and filtering irrelevant content such as symbols or words that cannot be determined; and assuming that the general data is processed by the data filtering module 120, the data matching mode is continued. The group 130 sends the correct data to the data comparison module 130 and compares with the setting mapping module 140. If the data content is incorrectly modified, the data review module 180 is notified to enter the data editing process. The edited data is sent to the data comparison module 130 for processing.

The demander initially sets the corresponding data table of "each product data type" and "each index target definition processing" to the setting mapping module 140, and the setting mapping module 140 waits for the data comparison module 130 and management. Module 150 calls, returns the corresponding data table to the data comparison module 130 and data management Module 150.

If the display interface 240 begins to apply for the application, the recipient data extraction module 160 starts to call the data management module 150, and then the data management module 150 returns a message to the data extraction module 160, and the data extraction module 160 sends a short message to notify the The personnel has already processed the application case. After the processing is completed, the data management module 150 directly transmits the data to the data extraction module 160, and the data extraction module 160 transmits the data to the display interface 240.

The detailed description of the present invention is intended to be illustrative of a preferred embodiment of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.

To sum up, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of the past. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.

100‧‧‧A large amount of data is transferred to the system for screening management

110‧‧‧Create index classification module

120‧‧‧Information screening module

130‧‧‧ data comparison module

140‧‧‧Set mapping module

150‧‧‧Data Management Module

160‧‧‧Data extraction module

170‧‧‧ Data Import Module

180‧‧‧ Data Audit Module

Claims (15)

A system for importing a large amount of data into a screening management system, comprising at least: establishing an index classification module, receiving data and determining whether each target end has an index value, and pre-establishing an index target end and an index value are stored in the data base; The screening module sets the configuration and receives the data of the indexing classification module for filtering; a data review module receives the data of the data screening module, and the data is undeterminable or garbled, and actively establishes an audit. Interface; a data comparison module, receiving the data screening module or the data review module data, and performing cross-matching according to the data table of the set mapping module; the setting mapping module uses the program logic to perform multi-layer group Grouping and pre-defining the data sheets of each module and converting them into standard format data of the system; a data management module receiving the data table of the setting mapping module and the data of the matching module, according to each The data table field performs feature name classification; and a data extraction module performs batch delivery according to the display interface demand collection, and receives the data tube The data module, then the data transmitted back to some of the display interface. For example, the large amount of data mentioned in the first paragraph of the patent application is incorporated into the screening management system, wherein the index values are single value, multi-valued value and null value, and the single value is that the target end does not need further analysis. And the multi-value system further includes other index values for the target end, and needs further analysis, and the null value is the target. There are no other index values on the side and no further parsing is required. For example, the system for importing a large amount of data referred to in the first application of the patent scope includes a data import module, and the external data is transmitted to the index classification module, and the data import module performs timing scheduling. The job is to receive the data and classify it into an entity location or database for temporary storage. The system for importing a large amount of data as described in item 1 of the patent application into the screening management system, wherein the data matching module and the data management module receive the index values, and the returned data is stored in the database. For example, the large amount of data referred to in item 1 of the patent application is incorporated into the screening management system, wherein the data sheets are data sheets of various data types and data sheets processed by each target end, and the data matching modules are provided. And the data management module reads the predetermined data and specifies the placement location. The system for importing a large amount of data according to item 5 of the patent application scope into the screening management system, wherein the data management module pre-sets the data according to the cross-reference of the data table processed by each target end of the setting mapping module. Source type, destination name, destination data sheet, destination field or extraction processing field, and stored in each database and data sheet. A method for importing a large amount of data into a screening management, the steps of which at least include: (1) establishing an index classification module to receive data, and classifying the index target end name, and establishing an index value and an index target end; (2) data filtering mode The group sets the configuration and receives the data of the indexing classification module for filtering. If the judgment analysis can be performed, the following step 4 is performed; otherwise, the following step 3 is performed; (3) the data review module receives the data of the data screening module. And the information The system is unable to judge the analysis or garbled, and actively establishes the audit interface for debugging; (4) the data comparison module receives the data screening module or the data review module data, and according to a data sheet of the setting mapping module Perform cross-comparison; (5) set the mapping module to use the program logic to perform multi-level group integration, and pre-define the data table of each module, and convert it into standard format data of the system; (6) the data management module receives the setting The data table of the mapping module compares the data of the module with the data, and classifies the feature name according to each data table field; and (7) the data extraction module performs batch delivery according to the display interface demand, and receives the data management. The data of the module is then transmitted back to the display interface. The method for importing a large amount of data according to item 7 of the patent application into the screening management method, wherein the index value classification of the step (1) is a single value, a multi-value and a null value, and the single value is only the target end The single index value does not need to be further parsed, and the multi-value system further includes other index values for the target end, and needs to be further parsed, and the null value has no other index value for the target end, so no further parsing is needed. The method for importing a large amount of data according to item 7 of the patent application scope into the screening management method, wherein the data comparison module and the data management module receive the index values of the index target ends, and analyze and compare the results. Stored in the database. If the large amount of data mentioned in item 7 of the patent application scope is included in the screening management The method, wherein the step (4) further comprises: receiving, by the data matching module, the data screening module, the data review module and the setting mapping module, and transmitting the compared data to the data management The module, the data management module performs the classification and classification. For example, the method for importing a large amount of data according to item 7 of the patent application scope into the screening management method, wherein the comparison method of the step (4) is based on the data data and the comparison process, and the calculation of the weight value is performed, and The weight value is classified, and the weight value formula is as follows: ++β+γ=10 , which means If the calculated value is less than 0.1, take 0.1 directly; Express If the calculated value is less than 0.1, then take 0.1; Ws = weight value score sum; α, β, γ = weight factor; Q = order quality; Nd = index target data content to be compared to the same number of words; Ns=Set the number of keywords in the definition data table of the mapping module; = The order of the name of the data content of the index target is to be compared; = Set the keyword position order of the definition data table of the mapping module; S(Pd)=the data content of the index target end is the same as the name of the matching word; and the key of the definition data table of the Ps=setting mapping module Word continuity. If the large amount of data mentioned in item 7 of the patent application scope is included in the screening management The method, wherein the data management module performs feature name classification according to the setting mapping module, analyzes and judges the data delivery process, and stores the data record in the database. The method for importing a large amount of data according to item 7 of the patent application into the screening management method, wherein the step (7) of the data extraction module receives the external instruction for the collection batch to transmit the data according to the automatic scheduling. The method for importing a large amount of data as described in claim 12 of the patent application into the screening management method, wherein the determining data delivery process is performed according to the content set by the specific field name of the setting mapping module. The method for importing a large amount of data as described in claim 13 of the patent application into the screening management method, wherein the automatic scheduling refers to automatically executing the next process according to the planned process without manual intervention, including pooling requirements and batches. Processes for delivering, extracting data, identifying data content and types, and formalizing data.