CN111598535B - Basic material importing method, system and computer equipment - Google Patents

Basic material importing method, system and computer equipment Download PDF

Info

Publication number
CN111598535B
CN111598535B CN202010387537.3A CN202010387537A CN111598535B CN 111598535 B CN111598535 B CN 111598535B CN 202010387537 A CN202010387537 A CN 202010387537A CN 111598535 B CN111598535 B CN 111598535B
Authority
CN
China
Prior art keywords
data
imported
self
storing
character string
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010387537.3A
Other languages
Chinese (zh)
Other versions
CN111598535A (en
Inventor
夏波
王小佳
关山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Jingdiao Software Technology Co ltd
Original Assignee
Xi'an Jingdiao Software Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Jingdiao Software Technology Co ltd filed Critical Xi'an Jingdiao Software Technology Co ltd
Priority to CN202010387537.3A priority Critical patent/CN111598535B/en
Publication of CN111598535A publication Critical patent/CN111598535A/en
Application granted granted Critical
Publication of CN111598535B publication Critical patent/CN111598535B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/103Workflow collaboration or project management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2291User-Defined Types; Storage management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/252Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/186Templates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Abstract

The invention discloses a method, a system and computer equipment for importing base materials, wherein the method adopts a unified entry, so that maintenance personnel can switch operation entries frequently, and the probability of error occurrence is reduced; the template is introduced, and the Chinese and English headers are designed for the template, so that the recognition and the operation are convenient; providing a perfect data verification method, and effectively preventing error data from entering a system; the error data on-line correction scheme is provided, so that the error data can be corrected rapidly, and the maintenance efficiency is improved.

Description

Basic material importing method, system and computer equipment
Technical Field
The invention belongs to the field of workshop production equipment, and particularly relates to a method, a system and computer equipment for importing base materials.
Background
In the prior enterprises, a large amount of workshop informatization management systems are used for processing workshop flow operation, data circulation, information recording and other works. Large factories often contain a plurality of workshops, a plurality of workshops produce different materials, different parts and the like are used, in documents formed in the workshops, different types of base materials of different workshops often focus on inconsistency, so that different types of materials have different attribute information in the factory circulation process, namely, attribute fields of various types of materials are inconsistent, and an informatization system also needs to set different field information for different types when processing different base materials. Meanwhile, in the use process of the informatization management system, particularly in the initial use period, a large amount of basic materials used in workshops are required to be input into the system, the digitization of basic material information is realized, and a foundation is established for the smooth use of the informatization management system. In the process of inputting the basic material information, the input interface is required to be frequently switched due to inconsistent data fields of different types, and meanwhile, a large amount of data is faced, so that the time and the labor are consumed for manually inputting the data, and the basic material information is often required to be input for a long time.
In the early stage of enterprise informatization construction, a large amount of data of an import system often need to be identified and checked manually, the correctness of the data is judged from the import template, but the data is faced with a large amount of basic material data, meanwhile, different types of material information are faced with, the accurate input work of the basic material is difficult to finish through data arrangement, and particularly, a large amount of time and labor are consumed in the accuracy, repeatability and effectiveness of the basic material data, the whole informatization system implementation work is influenced, doubts are generated for the accuracy of the follow-up use of the basic material data, and the implementation of a pushing system is unfavorable.
Most manufacturers have an informatization system for assisting production management, and basic material information used in mass production is stored in the system, and is a necessary condition for the operation of the informatization system and an important data support for realizing workshop informatization management. The basic material data are basic data of the system, on one hand, the data volume of the basic data is particularly large, tens of thousands, hundreds of thousands or even millions, the data are often divided into a plurality of types according to types, and a great deal of manpower is required for maintenance. On the other hand, the accuracy of the data plays an important role in the smooth operation of the system, one important process in the operation of the workshop informatization system is material circulation, the accuracy of the basic material data has a great influence on the accuracy of the system, and the accuracy of the basic material data needs to be ensured when the basic material data is maintained.
The prior art scheme is as follows: and (3) maintaining multiple types of basic materials: the basic material information belongs to different types, has difference in attribute, is respectively managed and maintained in the use process, pays attention to realization of requirements in data maintenance, is easy to neglect convenience in use, and is often maintained in different types, so that the types are required to be frequently switched in the process of basic material maintenance, and data entry errors are easy to cause. The data accuracy checksum on-line correction method comprises the following steps: some methods for importing data are adopted, but the accuracy verification of the imported base materials is imperfect, so that the error data importing system is easy to cause hidden danger for the subsequent system operation, in addition, an online correction scheme for the error data is not provided, the data in the importing template must be modified to be imported again, and the method is repeated, so that the manpower and material resources are wasted.
The prior art scheme has the defects that: the existing basic material maintenance and management method has a plurality of inconveniences in actual production. The multi-type basic material information needs to be maintained from different management inlets, particularly system data entry personnel need to frequently switch system operation items, time and labor are consumed in the process, and manual operation is easy to bring in errors. The method for importing the data can be synchronously adopted, but in the process of importing the data, the system data importing is concerned with too much, and the accuracy verification of the imported data of the system lacks effective measures, so that error data is easy to enter the system, and the operation of the system is influenced. Meanwhile, when error data is found, only the data in the imported template can be modified for re-importing, and the method is repeated, so that the system application is not facilitated.
Disclosure of Invention
The invention aims to provide a method, a system and computer equipment for importing base materials, which are used for solving the problem that in the prior art, different types of base materials cannot be imported and processed uniformly.
In order to achieve the above purpose, the invention adopts the following technical scheme:
a method of introducing a base material, comprising the steps of:
1) The design of an import template is described, and import of all types of materials is set to be a uniform interface;
2) Storing the imported data in a cache, and sorting and converting the data;
3) Checking whether the current data processing logic is consistent with the template data or not, and performing matching check by using the imported template identification and the entered branching logic; checking whether the imported essential filling items of the basic data are complete and whether the essential filling items of the basic data accord with field rules;
4) Checking the correctness of the dictionary management relation between the fields and the database, and checking whether the imported basic data is filled in and consistent with the information maintained in the dictionary management;
5) Checking whether the data with the relation among the data accords with the rule;
6) Checking whether the data is unique;
7) Marking the result after data verification for subsequent display and processing;
8) The ID of the basic data in dictionary management is obtained, and the ID data in the dictionary management corresponding to the current data is obtained and stored in a cache when the type, subclass, fine classification, class, color and supplier rule verification is carried out, so that the subsequent data storage service is carried out;
9) The parsed basic data information, integer error data, character type error data ID information and the parsed result mark are returned to the UI in a Json format;
10 Analyzing the returned Json character string, if the analysis result is True, indicating that the analysis is correct and completed; otherwise, if False shows that the analysis fails, ending the data import and prompting an operator; after the analysis is correct, converting the tag field CheckBoxInfo, strIsExistInDataBase from a character format to a bool type, and then using the bool type for UI display;
11 The total number of errors is displayed, the total number information of the errors after various types of verification is judged, and the errors with the total number greater than zero are spliced into character strings to be displayed in a UI; error data background processing, namely displaying all data on a UI, acquiring specific information of each data error from an ID stored in a character string during analysis, and performing background rendering on the error information; error data remarking processing, namely when the UI performs data display, remarking information of data row error data is displayed in a remarking field, and is displayed by using a special color font, and remarking information of normal data is not displayed;
12 Correcting the imported abnormal data;
13 The data is transmitted into the background in the form of Json character strings for processing, wherein the data transmitted into the background is divided into three parts, namely new data, coverage data, and new data which are deleted before being added, and the data respectively correspond to various different processing conditions.
Specifically, step 1) specifically includes:
the template identification, the imported template is added with unique identification information, and the type of the current template is displayed on the first row of the table head of each type of imported template;
the method comprises the steps of configuring a header, wherein a template adopts double headers, a Chinese header is used for identifying and displaying the header, an English header is used for storing and identifying the header, a second behavior Chinese header and a third behavior English header of the template;
leading important fields, arranging the essential filling items and important identification information in the front, and performing red marking treatment on the head of the essential filling item list;
the method comprises the steps of unifying an import inlet, acquiring and processing import data of all material types in a unified public interface, and realizing data input by maintenance personnel of all types and departments by using the same inlet; .
Specifically, step 2) specifically includes:
acquiring template data, selecting an import template, analyzing the import template, and acquiring English headers and data items of the import template according to the import template and data processing requirements;
The template type is obtained, the unique identification of the template is used for identification, and the base material type is marked and used for subsequent data processing branch judgment;
removing blank data in the imported template data;
configuring a header relation, and configuring Chinese header character arrays and English header character arrays of different large basic data;
the header matching verification, according to the large-class identifier set by the template, acquiring a configured large-class English header, matching the English header of the current large class with the English header in the template, if the English header is consistent with the English header in the template, judging that the current imported template is correct, otherwise prompting prompt for checking whether the imported data and the imported template are matched, and ending the importing;
the table head dictionary management is used for carrying out matching, checking and marking, storing and using a character string array and a dictionary according to the corresponding relation between the English table head and the Chinese-English table head, wherein the table head dictionary management contains 4 character string data, is respectively corresponding relation between English table head information and Chinese-English table heads of all material types, and is used for guiding out configuration necessary conditions for checking the correctness of a template and data;
data caching, namely transmitting the data in the template into a data layer, and storing the data in an intermediate table for verification and storage processing;
code format conversion, namely code conversion is carried out on codes in imported data according to basic data format rules, the codes are converted into code formats which can be identified by an MES system, types are not distinguished, and the codes are converted by using the same set of rules;
Conversion rules are stored, code conversion rules are stored in configuration files and are stored in an XML form;
the method comprises the steps of configuring conversion rules, storing Code rules in an XML form, wherein the specific format is that tag CodereGulation, code is used for identifying internal information as the Code rules, and Id, codeType, code _Start and code_ End, length, PLMRegulation, K3Regulation are used for describing rule names, start numbers, end numbers, number lengths, PLM breakpoint rules and K3 breakpoint rules; the method comprises the steps of setting a self-increasing identifier, setting imported data, adding a unique self-increasing identifier, and setting the self-increasing identifier as integer data, wherein the self-increasing identifier is used for efficiently managing the band analysis data.
Specifically, step 4) is specifically as follows:
vendor field rule checking:
defining integer variables for storing the total number of non-conforming rules of provider field data in the imported data; correlating the provider name with the provider name in the provider database, and if the provider name is empty, judging that the provider is filled with errors, and storing the total number of the errors of the provider data in the integer variable;
defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the provider data does not accord with the rule in the imported data, storing the data self-increment IDs which do not accord with the rule of the provider in the character string variable, and separating a plurality of self-increment identifiers by commas;
Data type field rule checking:
defining integer variables, which are used for storing the total number of the data type field data in the imported data, wherein the data type field data does not accord with the rule, the type is maintained in a type dictionary management module, the type name is used for associating with the type name in a type data table, if the type is empty, the type is judged to be filled with errors, and the total number of the type data with errors is stored in the integer variables;
defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the type data does not accord with the rule in the imported data, storing the data self-increment IDs which do not accord with the type rule in the character string variable, and separating a plurality of self-increment identifiers by commas;
subclass field rule checking:
defining integer variables, which are used for storing the total number of the sub-class field data in the imported data, wherein the total number of the sub-class field data does not accord with the rule, the sub-class is maintained in a sub-class dictionary management module, the sub-class names in a sub-class database are correlated with the sub-class names, if the correlation result is empty, the sub-class filling errors are judged, and the total number of the sub-class data errors is stored in the integer variables;
defining a character string variable corresponding to the integer variable in the first step, wherein the character string variable is used for storing self-increment IDs of sub-class data in imported data, the self-increment IDs of the sub-class data are not in accordance with rules, the self-increment IDs of the sub-class data are stored in the character string variable, and comma separation is used among a plurality of self-increment identifiers;
And (3) checking a rule of a fine classification field:
defining integer variables, which are used for storing the total number of the non-conforming rules of the fine classification field data in the imported data, wherein the fine classification is maintained in a fine classification management module, the fine classification names in a fine classification database are used for associating the fine classification names, if the association results are empty, the fine classification is judged to be filled with errors, and the total number of the errors of the fine classification data is stored in the integer variables;
defining a character string variable corresponding to the integer variable in the first step, wherein the character string variable is used for storing self-increment IDs of the fine classification data in the imported data, the self-increment IDs of the fine classification data are stored in the character string variable, and comma separation is used among a plurality of self-increment identifiers;
category field rule checking:
defining integer variables for storing the total number of non-conforming rules of category field data in the imported data, wherein the category fields adopt: the method comprises the steps of dividing imported category data into two parts, namely a name and a category code for use when checking rules according to the forms of category names plus and minus, wherein the code is used for searching corresponding category information in a category field, the name is used for checking the searched data again, statistics is carried out on the data which are matched with errors, and the total number of the data is stored in integer variables;
Defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the category data in the imported data does not accord with the rule, storing the data self-increment IDs which do not accord with the category rule in the character string variable, and separating a plurality of self-increment identifiers by commas;
color field rule checking:
defining integer variables, which are used for storing the total number of the color field data in the imported data, which are not in accordance with the rule, associating the color names in the color database with the color full names, judging that the color is wrongly filled according to the association result if the association result is empty, and storing the total number of the color data in the integer variables;
defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing the self-increment ID of which the color data does not accord with the rule in the imported data, storing the self-increment ID of the data which does not accord with the color rule in the character string variable, and separating a plurality of self-increment identifiers by commas.
Specifically, step 5) specifically includes:
correlation checking between types, subclasses and subclasses:
defining integer variables for storing the total number of non-conforming rules of the relations among the types, subclasses and sub-class field data in the imported data; the relation among the types, the subclasses and the fine classifications is a tree structure, wherein the types comprise a plurality of subclasses, and the subclasses comprise a plurality of fine classifications; the total data summary number of which the relations among the types, the subclasses and the subclasses in the imported data are inconsistent with the relations set in the dictionary database is stored in the integer variable;
Defining a character string variable corresponding to the integer variable in the first step, and storing self-increment IDs of which the relations among the type, sub-class and fine classification field data in the imported data are not in accordance with rules; storing the data self-increment ID which does not accord with the rule in a character string variable, wherein comma separation is used among a plurality of self-increment identifiers;
and (3) checking the relation between the code and the type match:
defining integer variables for storing the total number of non-conforming rules of the relation between the codes and the type field data in the imported data; a constraint exists in the basic data, a code represents a type of material, the code and the type of the material in the imported data are matched and judged with the code and the type in the existing basic material data, the situation that the matching relation of the imported data is inconsistent with the relation in the database is screened out, and the total number of errors is stored in an integer variable;
defining a character string variable corresponding to the first integer variable, and storing a self-increment ID (identity) of which the relation between the code and the type field data in the imported data is not in accordance with a rule; the data self-increment ID which does not accord with the rule is stored in a character string variable, and comma separation is used among a plurality of self-increment identifiers.
Specifically, step 6) specifically includes:
Code and figure number uniqueness check:
defining integer variables for storing the total number of code and figure number fields already existing in the database in the imported data; in the basic data, uniquely determining a basic material type by using codes and figure numbers; performing association matching on the imported data and a basic material database, searching basic data with codes and figure numbers repeated simultaneously, counting the total number of repeated data, and storing the total number of errors in an integer scalar;
defining a character string variable corresponding to the first integer variable, and storing a self-increment ID of a code and a figure number field in the imported data, which is already existing in a database; storing the data self-increment ID which does not accord with the rule in a character string variable, wherein comma separation is used among a plurality of self-increment identifiers;
and (3) data complete matching verification:
defining integer variables for storing the total number of all fields of one row of data in the imported data, which are consistent with all the existing data in the database; the data with the same field information is not needed to be imported again, but is needed to be recorded, and the data is displayed to operators in the subsequent display;
defining a character string variable corresponding to the first integer variable, and importing self-increment IDs (identity) of all fields of one row of data in the data, which are consistent with the existing data in the database; the full-match data self-increment ID is stored in a character string variable, and comma separation is used between a plurality of self-increment identifiers.
Specifically, the step 7) specifically includes:
judging whether the imported data code and the figure number already exist or not:
matching in a basic database by using codes and drawing numbers of imported data, and using an AND matching method;
adding a data line marking field checkbox info for marking the state of the current data line, wherein the states are set to be True and False respectively, true represents that the current data is correct, and False represents that the current data has a problem;
adding a data line remark field: the data line remark field is added to explain the current data state, so that the data foreground can be conveniently displayed; if there are multiple problems with a line of data, then comma separation is used between the multiple notes.
Specifically, step 12) specifically includes:
the method comprises the steps of performing exception processing on imported data, screening out data with codes and picture numbers completely consistent with each other in the imported data, determining the imported data of a current code and picture number, and discarding all other data;
exception export, in which all or part of data with conflicting codes and figure numbers is not processed, and unprocessed data is exported;
the method comprises the steps of carrying out conflict processing on a database layer, popping up data of codes and picture numbers in an imported file, which are already existing in the database, displaying partial information in a main table, checking information of the currently imported codes and picture numbers, which are already existing in the database, and selecting to use the imported data to cover and update the data existing in the database or to keep the data in the database on each piece of main table information;
All the imported data are displayed, and the data import state is distinguished by using different background colors.
The other technical scheme provided by the invention is as follows:
a system for introducing a base material, comprising:
the template configuration related module is used for explaining the design of the imported template and setting the importing of all types of materials as a uniform interface;
the data primary processing module is used for storing the imported data in a cache, and sorting and converting the data;
the essential item data checking module is used for checking important and essential data in the current imported data and ensuring the integrity of the data;
the database layer checking module is used for checking the correctness of the management relationship between the fields and the database dictionary;
the association relation checking module is used for checking whether the data with the association exist among the association relation checking modules accords with the rule;
the base material uniqueness checking module is used for checking whether the data are unique or not;
the data marking module is used for marking the result after data verification and used for subsequent display and processing;
the data acquisition module is used for acquiring the ID of the basic data in dictionary management;
the return foreground processing module is used for returning the analyzed basic data information, the integer error data, the character error data ID information and the analysis result mark to the UI in a Json format;
The data processing module is used for analyzing the returned Json character string and converting the marking field CheckBoxInfo, strIsExistInDataBase from a character format to a bool type;
the data display module is used for displaying the total number of errors, processing the background of the error data and processing remarking the error data;
an exception handling module for correcting the imported exception data
And the data importing module is used for importing the data into the background in the form of Json character strings for processing.
The invention provides a further technical scheme that:
a computer device comprising a memory and a processor, in which a computer processing program is placed, the processor being responsible for executing the whole process and steps of the computer program operating in the correct flow and manner and for realizing the basic material data importation.
Compared with the prior art, the invention has the following advantages:
according to the method for importing the basic material, the unified maintenance entrance is provided, and the template identification is used for distinguishing, so that the operation of frequently switching the maintenance interface in the manual maintenance process is avoided, the occurrence of errors is reduced, and the data maintenance is efficiently and accurately realized.
The method for importing the basic material provides a perfect verification method such as filling item verification, association relation verification and the like, realizes strict control of the accuracy of the input system data, and prevents error data from being processed into the system, thereby influencing the operation of the system.
The method for importing the basic material provides an online error data correction method, and can be used for correcting abnormal error data through the online error correction method, so that the error correction efficiency is improved.
The method for importing the basic material adopts a template importing method, and the template is provided with Chinese and English headers, so that the recognition and the operation are convenient, the convenience of maintenance personnel is considered, and the accuracy and the timeliness of system analysis data are also considered.
The method for importing the basic material provides a perfect data verification method and effectively prevents error data from entering the system.
According to the method for importing the base material, different verification rules, association field relation verification rules, dictionary management base material properties and the like are set for different fields, meanwhile, when abnormal conditions occur, an on-line processing means for abnormal data is provided, the problem of manual verification of the data is avoided, a method for correcting the data of the wrong base material is provided, and the data accuracy of the base material is improved.
The method for importing the basic material adopts a specific XML format to maintain the material format conversion, is convenient for format maintenance and is beneficial to code conversion of a system. The system verification is considered from aspects of uniqueness, imperfection, relevance and the like, and error data is prevented from entering the system. The reasons of the error abnormal data are remarked clearly, and the page is displayed, so that the error data can be checked conveniently. The error data export processing is provided, and error data which cannot be determined temporarily can be exported temporarily, and the normal import of normal data is not affected by the subsequent processing.
According to the method for importing the base materials, the data are processed by using the importing templates of different base materials, the unified processing flow is adopted to process the data, the perception difference among the types of the base materials is reduced, the data are imported only by using unified inlets according to different types of templates, different types and different departments, the background is used for automatically distinguishing the types, and meanwhile, the importing mode is adopted to improve the efficiency of inputting the data.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention. In the drawings:
FIG. 1 is a block diagram of a base material import system according to an embodiment of the present invention;
FIG. 2 is a detailed view of the step 1) of the method of introducing the embodiment of the present invention;
FIG. 3 is a detailed view of the step 2) of the method of introducing the embodiment of the present invention;
FIG. 4 is a detailed view of the introduction method step 3) according to the embodiment of the present invention;
FIG. 5 is a detailed view of the step 4) of the method of introducing an embodiment of the present invention;
FIG. 6 is a detailed view of the introduction method step 5) according to the embodiment of the present invention;
FIG. 7 is a detailed view of the introduction method step 6) according to the embodiment of the present invention;
FIG. 8 is a detailed view of the introduction method step 7) according to the embodiment of the present invention;
FIG. 9 is a detailed view of the step 12) of the method of introducing an embodiment of the present invention;
in the figure: the system comprises a template configuration related module 1, a data primary processing module 2, a data checking module 3 of filling items, a database layer checking module 4, an association relation checking module 5, a base material uniqueness checking module 6, a data marking module 7, a data obtaining module 8, a return foreground processing module 9, a data processing module 10, a data display module 11, an exception processing module 12 and a data importing module 13.
Detailed Description
The invention will be described in detail below with reference to the drawings in connection with embodiments. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other.
The following detailed description is exemplary and is intended to provide further details of the invention. Unless defined otherwise, all technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments in accordance with the invention.
As shown in fig. 1, the system for importing basic data is divided into thirteen processing modules, namely a template configuration correlation module 1, a data primary processing module 2, a data checking module 3 with filling items, a database layer checking module 4, an association relation checking module 5, a basic material uniqueness checking module 6, a data marking module 7, a data obtaining module 8, a return foreground processing module 9, a data processing module 10, a data display module 11, an exception processing module 12 and a data importing module 13.
The following describes the 13-stage technical scheme of the basic data import process in detail.
1. Template configuration related module
The template configuration is related, the design of the imported template is described, the importing of all types of materials is set to be a uniform interface, the steps are shown in fig. 2, and the details of the steps are as follows:
(1) And (5) template identification. The import template is added with unique identification information, and the type of the current template is displayed in the first row of the table head of each type of import template, such as 'base material-part import', 'base material-group part import', 'base material-tool import', and the like. The types of the templates are marked, and it is clear that the types are different due to field differences, so that the template fields of different types have differences, the processing logic is the same, but the processing fields have differences and must be treated differently.
(2) And (5) configuring a header. The template adopts double headers, the Chinese headers are used for identifying and displaying the headers, the English headers are used for storing and identifying the headers, different functions are respectively exerted, the Chinese headers are used for the second behavior of the template, and the English headers are used for the third behavior.
(3) Important fields are pre-arranged. The necessary filling items and important identification information are arranged in the front, and the head of the table of the necessary filling items is subjected to red marking treatment, for example, the type, the subtype type, the subdivision type, the code and the category are set as the necessary filling items, and the bottom color is red.
(4) And uniformly introducing the water into the inlet. The imported data of all material types are acquired and processed in a unified common interface, and maintenance personnel of all types and departments use the same portal to realize data input. And setting unified import inlets, operating different departments by using the same import module for different material types, and calling any type of import template on a basic material management interface.
2. Data primary processing module
And (3) data primary processing, namely storing the imported data in a cache, and sorting and converting the data, wherein the steps are shown in fig. 3. The detailed design scheme of each step is as follows:
(1) Template data is obtained. And selecting 'importing basic data' in a basic material management interface, and selecting an imported template according to a prompting flow. After operation, the import template is analyzed, and English headers and data items of the import template are taken according to the import template and data processing requirements.
(2) And obtaining the template type. And identifying by means of the unique identification of the template, marking the type of the base material, and judging the type of the base material by using the base material for subsequent data processing branches.
(3) Invalid data is removed. And removing blank line data in the imported template data.
(4) The header relationship is configured. And configuring Chinese header character arrays and English header character arrays of different large basic data.
(5) And (5) checking the matching of the header. And acquiring configured large English headers according to large class identifiers set by the template, matching the large English headers with the English headers in the template by using the English headers of the current large class, if the English headers are consistent with the English headers in the template, considering that the current imported template is correct, otherwise prompting a prompt for checking whether the imported data are matched with the imported template, and ending the importing.
(6) And (5) managing a header dictionary. The corresponding relation between the English header and the Chinese-English header for matching, checking and marking is stored and used by using a character string array and a dictionary, and the character string array and the dictionary contain 4 character string data, are respectively corresponding relation between English header information and Chinese-English header of each material type, and are necessary conditions for checking template correctness and data derivation configuration. For example, it may be defined as string [ ] "mat_type" ],...
(7) And (5) caching data. And transmitting the data in the template into a data layer, and storing the data in an intermediate table for checksum storage processing.
(8) And (5) code format conversion. And code format conversion, namely performing code conversion on codes in imported data according to basic data format rules, converting the codes into a code format which can be identified by an MES system, and converting the codes by using the same set of rules without distinguishing types. When the code format is converted, firstly, the code break point is removed, converted into a pure digital number, and whether the current code has a matched conversion rule or not is judged by using the conversion rule, and the judgment is carried out according to the code start bit, the code end bit and the code length.
a. When the conversion rule exists, the PLMRegication breakpoint rule is used for resetting the breakpoint of the current code, and a new code is generated.
b. And if the conversion rule does not exist, the original imported data is kept unchanged.
(9) And storing conversion rules. The transcoding rules are stored in a configuration file, stored in XML format, in a specific resolvable format.
(10) And (5) converting rule configuration. The Code rule is stored in the form of XML, and the specific format is that the tag CodereGulation, code is used for identifying the internal information as the Code rule, and Id, codeType, code _Start and code_ End, length, PLMRegulation, K3Regulation are used for describing rule names, start numbers, end numbers, number lengths, PLM breakpoint rules and K3 breakpoint rules.
And setting a self-increasing mark. The method comprises the steps of setting imported data, adding a unique self-increasing identifier, and setting the imported data as integer data, wherein the unique self-increasing identifier is used for efficiently managing the band analysis data.
3. Necessarily filling item data checking module
The checking of the padding is to check the important and necessary data in the current imported data, so as to ensure the integrity of the data. The procedure is as in fig. 4. The detailed scheme of each step is as follows:
(1) Checking whether the current data processing logic is consistent with the template data. And performing matching verification by using the imported template identification and the entered branching logic. Because each data importing page is different, different types of data adopt different imported data of entrance, before data importing processing, the current data template, data, processing logic and entrance need to be judged, and the data is allowed to be imported only under the condition that all the data are consistent, otherwise, abnormal prompts are output.
(2) Checking whether the imported essential data filling item fills in the complete and accords with the field rule.
a. Code padding checking
<1>. Define integer variables for storing the number of empty code-filled fields in the imported data. And the number of the necessary filling items which are empty can be found through verification and is stored in empty field variables set by each field.
And (2) defining a character string variable corresponding to the first integer variable, and storing a data self-increasing identification that a code filling item field in the imported data is empty. If the number of the field filling items which are needed to be filled in is judged to be null and is not 0, searching the data of which the current field is not null, storing the self-increasing identification in the corresponding character string variable, and separating a plurality of self-increasing identifications by commas.
b. Type fill-in check
<1>. Define integer variables for storing the number of type fill fields in the imported data that are empty. And the number of the necessary filling items which are empty can be found through verification and is stored in empty field variables set by each field.
And (2) defining a character string variable corresponding to the first integer variable, and storing the data self-increasing identification that the type filling item field in the imported data is empty. If the number of the field filling items which are needed to be filled in is judged to be null and is not 0, searching the data of which the current field is not null, storing the self-increasing identification in the corresponding character string variable, and separating a plurality of self-increasing identifications by commas.
c. Subdivision type fill-in check
<1>. Define integer variables for storing the number of subdivision type fill-in fields in the imported data that are empty. And the number of the necessary filling items which are empty can be found through verification and is stored in empty field variables set by each field.
And (2) defining a character string variable corresponding to the first integer variable, and storing the data self-increasing identification that the subdivision type filling item field is empty in the imported data. If the number of the field filling items which are needed to be filled in is judged to be null and is not 0, searching the data of which the current field is not null, storing the self-increasing identification in the corresponding character string variable, and separating a plurality of self-increasing identifications by commas.
d. Class fill-in checking
<1>. Define integer variables for storing the number of empty class fill fields in the imported data. And the number of the necessary filling items which are empty can be found through verification and is stored in empty field variables set by each field.
And (2) defining a character string variable corresponding to the first integer variable, and storing the data self-increasing identification that the type filling item field in the imported data is empty. If the number of the field filling items which are needed to be filled in is judged to be null and is not 0, searching the data of which the current field is not null, storing the self-increasing identification in the corresponding character string variable, and separating a plurality of self-increasing identifications by commas.
4. Database layer verification module
The database layer verification realizes the correctness verification of the management relationship between the fields and the database dictionary, and the steps are as shown in fig. 5: the detailed design scheme of each step is as follows:
(1) And checking whether the imported basic data is filled in to be consistent with the information maintained in the dictionary management.
a. Vendor field rule checking
<1>. Define integer variables for storing the total number of provider field data non-compliance rules in the import data. The vendor field may be empty, but must be maintained in the vendor management module, and the vendor name in the vendor database is used to correlate the vendor name, and if empty, the vendor is judged to be filling in error according to the correlation result. The total number of errors in the vendor data is stored in the integer variable.
<2>. Define a string variable corresponding to the first integer variable for storing a self-increment ID in which the provider data does not conform to the rule in the imported data. And (3) consistent with the method for judging that the supplier does not accord with the rule in the previous step, storing the data self-increment ID which does not accord with the rule of the supplier in a character string variable, and separating a plurality of self-increment identifiers by commas.
b. Data type field rule check
<1>. Define integer variables for storing the total number of data type field data non-conforming rules in the imported data. The type must be maintained in the type dictionary management module, the type name is used for associating with the type name in the type data table, and the type is judged to be filled with errors if the association result is empty. The total number of errors in the type data is stored in the integer variable.
<2>. Define the character string variable corresponding to the first step integer variable for storing the self-increment ID of which the type data does not conform to the rule in the imported data. And (3) consistent with the method for judging the type is not in accordance with the rule in the previous step, storing the data self-increment ID which is not in accordance with the rule of the type in a character string variable, and separating a plurality of self-increment identifiers by commas.
c. Subclass field rule checking
<1>. Define integer variables for storing the total number of non-conforming rules of the sub-class field data in the imported data. The subclass must be maintained in the subclass dictionary management module, the subclass names in the subclass database are associated by using the subclass full names, and if the associated result is empty, the subclass is judged to be filled with errors. The total number of errors in the child data is stored in the integer variable.
<2>. Defining a string variable corresponding to the first integer variable for storing a self-increment ID in which the sub-class data in the imported data does not conform to the rule. And (3) consistent with the method for judging whether the subclass is in accordance with the rule in the previous step, storing the data self-increment ID which is in accordance with the rule of the subclass in a character string variable, and separating a plurality of self-increment identifiers by commas.
d. Fine classification field rule checking
<1>. Define integer variables for storing the total number of disagreements of the fine classification field data in the imported data. The fine classification must be maintained in the fine classification management module, the fine classification name is used for associating the fine classification name in the fine classification database, and if the association result is empty, the fine classification is judged to be filled with errors. The total number of misclassified data errors is stored in the integer variable.
<2>. Defining a string variable corresponding to the first integer variable for storing a self-increment ID in which the fine classification data in the imported data does not conform to the rule. And (3) consistent with the method for judging the non-conforming rule of the fine classification in the previous step, storing the data self-increment ID which does not conform to the fine classification rule in a character string variable, and separating a plurality of self-increment identifiers by commas.
e. Class field rule checking
<1>. Define integer variables for storing the total number of non-conforming rules of category field data in import data. The category field takes the form of a specific format (category name+ "," +category code), and when checking the rule, the imported category data is split according to the method, and is divided into a name part and a category code part for use. The codes are used for searching corresponding category information in the category field, the names are used for checking the searched data again, statistics is carried out on the data which are matched with errors, and the total number of the data is stored in integer variables.
<2>. Defining a string variable corresponding to the first integer variable for storing a self-increment ID in which the category data in the imported data does not conform to the rule. And (3) consistent with the method for judging the non-conforming rule of the category in the previous step, storing the data self-increment ID which does not conform to the rule of the category in a character string variable, and separating a plurality of self-increment identifiers by commas.
f. Color field rule checking
<1>. Define integer variables for storing the total number of non-conforming rules of color field data in imported data. The color field may be empty, but must be maintained in the color management module, and the color name in the color database is used to correlate the color name, and if the correlation result is empty, the color is judged to be filled in error. The total number of color data errors is stored in the integer variable.
<2>. Defining a string variable corresponding to the first integer variable for storing a self-increment ID in which color data in the imported data does not conform to a rule. And (3) consistent with the method for judging the color non-conforming to the rule in the previous step, storing the data self-increasing ID which does not conform to the color rule in a character string variable, and separating a plurality of self-increasing identifiers by commas.
5. Association relation checking module
And checking whether the data with the connection between each other accords with the rule. The steps are as shown in FIG. 6: the detailed scheme of each step is as follows:
(1) Correlation verification between types, subclasses, and subclasses
<1>. Define integer variables for storing the total number of non-conforming rules of relationships between types, sub-types, and sub-class field data in imported data. The relation among the types, the subclasses and the subclasses is a tree structure, wherein the types comprise a plurality of subclasses, and the subclasses comprise a plurality of subclasses. The relationships among the types, subclasses and subclasses in the imported data must be identical to the relationships set in the dictionary database, and the total number of summaries is stored in the integer variable for the inconsistent data.
And (2) defining a character string variable corresponding to the integer variable of the first step, and storing the self-increment ID of which the relation among the type, the subclass and the finely classified field data in the imported data is not in accordance with the rule. And (3) consistent with the method for judging that the relation among the types, the subclasses and the subclasses is not in accordance with the rule in the previous step, storing the data self-increment ID which is not in accordance with the rule in a character string variable, and separating a plurality of self-increment identifiers by commas.
(2) Code and type matching relationship verification
<1>. Define integer variables for storing the total number of non-conforming rules for the relationship between the code and type field data in the imported data. The basic data has a constraint that one code represents one type of material, the condition that one material code belongs to multiple types cannot exist, the matching judgment is carried out on the material codes and types in the imported data and the codes and types in the existing basic material data, the condition that the matching relation of the imported data is inconsistent with the relation in the database is screened out, and the total number of errors is stored in an integer variable.
And (2) defining a character string variable corresponding to the first integer variable, and storing a self-increment ID of which the relation between the code and the type field data in the imported data is not in accordance with the rule. And (3) consistent with the method for judging that the relation between the code and the type field data is not in accordance with the rule in the previous step, storing the data self-increment ID which is not in accordance with the rule in a character string variable, and separating a plurality of self-increment identifiers by commas.
6. Uniqueness checking module
The base material uniqueness is checked to see fig. 7 for data uniqueness. The detailed scheme of each step is as follows:
(1) Code and figure uniqueness check
<1>. Define integer variables for storing the total number of code and drawing number fields already present in the database in the imported data. There is a constraint in the base data that the code and the drawing number are used to uniquely determine a base material type, which is unique identification information of the base material type, and the code and the drawing number cannot be repeated simultaneously in the system. And carrying out association matching on the imported data and a basic material database, searching basic data with codes and figure numbers repeated simultaneously, counting the total number of repeated data, and storing the total number of errors in an integer scalar.
<2>. Define a string variable corresponding to the first integer variable for storing the self-increment ID of the imported data where the code and drawing number fields already exist in the database. And consistent with the method for judging that the code and the drawing number fields in the imported data exist in the database in the previous step, storing the data self-increment ID which does not accord with the rule in the character string variable, and separating a plurality of self-increment identifiers by commas.
(2) Data all match verification
<1>. Define integer variables for storing the total number of all fields of a row of data in the imported data that are all identical to the data already in the database. And the data with the same field information is not imported again, but is recorded, and the data is required to be displayed to operators in the subsequent display.
And (2) defining a character string variable corresponding to the first integer variable, and importing self-increment IDs (identity) of all fields of one row of data in the data and all the data in the database. And (3) consistent with the method for judging that all fields of one line of data in the imported data are consistent with all existing data in the database in the previous step, storing the self-increment ID of the fully matched data in a character string variable, and separating a plurality of self-increment identifiers by commas.
7. Data marking module
The data marking is to mark the result after data verification for subsequent display and processing, and the steps are shown in fig. 8. The detailed scheme of each step is as follows:
(1) It is determined whether the imported data code and drawing number already exist. Matching is performed in a base database using the code and the drawing number of the imported data, and the and method is used, and means: during data processing, data query is carried out through two fields of the code and the drawing number, and the relation between the drawing number and the code during query is an 'AND' relation, namely the code and the drawing number can be completely matched in one piece of data, which represents that the current code and the drawing number already exist and is used for checking the uniqueness of the code and the drawing number. The code and the drawing number are unique identifiers of the basic data and cannot be repeated.
And adding a data line marking field CheckBoxInfo for marking the state of the current data line, wherein the states are respectively True and False, wherein True represents that the current line data is correct, no problem exists, and False represents that the current line data has a problem.
(2) And a data line remark field is added for explaining the current data state, so that the data foreground can be conveniently displayed. Remark field information is maintained in enumeration, including "code null", "type null", "sub-category null", "type, sub-category relationship error", "vendor data error", "color data error", "code and type match error", "template and type match error", "code and drawing number already present". The execution mode for filling the error line data marks and the error line data remark information is as follows:
a. error data marking and error data remarking
<1> when the data check must be filled, marking the error data line as False, and writing 'XX is empty' in the remark field, wherein XX can be code, type, subclass and category;
<2> database layer verification, for data that cannot be matched in the database, marking as False, and writing "XX matching error" in remark field, wherein XX can be type, subclass or vendor, color, etc.;
And when the association relation is verified, marking False for data with the association relation error, and writing an XX matching error in a remark field, wherein XX can be code and type, template and type and the like.
<4> at the time of the uniqueness check, for data which does not meet the uniqueness condition, it is marked as False, and "code and drawing number already exist" is remarked; if the current data is identical to all field information of the database data, the strIsExistInDataBase needs to be set to True in another tag field, and the notes are written with the identical data.
For data which does not belong to the above cases, namely, data which can be imported normally, the mark field is set to True, and remarks are written into "normal"; for the remark information checked above, if there are a plurality of problems in one line of data, commas and separation are used between the plurality of remark information.
8. Data acquisition module
(1) An ID of the base data in dictionary management is acquired. And when checking the type, subclass, fine classification, category, color and supplier rules, acquiring ID data in dictionary management corresponding to the current data, and storing the ID data in a cache to serve the subsequent data storage.
9. Returning to the foreground processing module
(1) And returning data. And returning the analyzed basic data information, integer error data, character error data ID information and analysis result marks to the UI in a Json format.
10. Data processing module
(1) The return value is parsed. Analyzing the returned Json character string, if the analysis result is True, indicating that the analysis is correct and completed; otherwise, false indicates that analysis fails, the data import is ended, and an operator is prompted.
(2) And (5) data conversion. After parsing is correct, the tag field CheckBoxInfo, strIsExistInDataBase is converted from character format to bool type for subsequent use in UI presentation.
11. Data display module
(1) The total number of errors is shown. Judging error total number information after various types of verification, splicing the error total number which is greater than zero into character strings, and displaying the character strings on a UI (user interface), wherein when the code necessary to fill the error total number is 10, the UI displays that the code with 10 pieces of data is empty, please correct-! ".
(2) Error data background processing. And displaying all data on the UI, acquiring specific information of each data error from the ID stored in the character string during analysis, and rendering the background of the error information into red.
(3) Error data remarking processing. When the UI performs data display, remark information of data line error data is displayed in a remark field, and is displayed by using a red font, and remark information of normal data is not displayed.
12. Exception handling module
Exception handling mainly provides an exception correction method, steps of which are shown in fig. 9.
The detailed scheme of each step is as follows:
(1) And importing data exception handling. And automatically popping up a conflict data processing page, screening out data with completely consistent codes and picture numbers in imported data, and processing the data, wherein the page can be displayed in a left part and a right part, the left part is displayed with repeated codes and picture numbers, the left part is clicked on a data row with the codes and the picture numbers, the right part is displayed with other field data of the data row with the codes and the picture numbers in a list manner, a selection frame is added on each row of data, an operator is required to determine the imported data of one current code and the picture number through the selection frame, and other data are completely discarded.
(2) And (5) exception derivation. The data with the conflict between the code and the figure number can be completely or partially processed temporarily, the export abnormal data is added at the bottom of the page, and the unprocessed data can be exported to the Excel file according to the format of the import data.
(3) Database layer conflict handling. After the last step is finished, clicking a determination button on the page to continue execution. The data of the code and the drawing number already existing in the database in the imported file is popped up and this part of the information is displayed in the main table. The existing data information of the current imported code and the chart number in the database can be checked by clicking on the main table expansion sub-table, and the imported data can be used for updating the existing data in the database or reserving the data in the database selectively on each piece of main table information.
(4) And (5) quick operation. The option of 'full coverage' is provided at the bottom of the page, and batch operation can be performed on the data.
(5) Abnormal data is exported. And providing export data at the bottom of the page, and exporting the current code, the figure number and repeated data information of the database into Excel, so as to be temporarily not processed.
(6) And importing data for display. After the process is executed, the data display main interface is popped up, and all imported data is displayed in the main interface. The data import status is distinguished using different background colors, wherein red represents abnormal data, green represents normally importable data, and default background color represents normal but uninfluenced data.
13. Data importing module
And (5) importing data. Clicking a data-importing button to import data into the background in the form of Json character strings for processing, wherein the data imported into the background is divided into three parts, namely new data, data coverage, data deletion and data addition, and data corresponding to various different processing conditions respectively, so as to complete data importing.
The other technical scheme of the invention is as follows: a computer device comprising a memory and a processor, in which a computer processing program is placed, the processor being responsible for executing the whole process and steps of the computer program operating in the correct flow and manner and for realizing the basic material data importation.
The basic material importing scheme, the device and the computer equipment are designed from the data importing template, and the basic material data is quickly and accurately imported into the informatization system through the processes of data acquisition, preliminary processing, verification, exception handling and the like, so that the operation is simple, the efficiency is high, the data is accurate, and great convenience is provided for the maintenance of actual production data.
It will be appreciated by those skilled in the art that the present invention can be carried out in other embodiments without departing from the spirit or essential characteristics thereof. Accordingly, the above disclosed embodiments are illustrative in all respects, and not exclusive. All changes that come within the scope of the invention or equivalents thereto are intended to be embraced therein.

Claims (10)

1. A method of introducing a base material, comprising the steps of:
1) The design of an import template is described, and import of all types of materials is set to be a uniform interface;
2) Storing the imported data in a cache, and sorting and converting the data;
3) Checking whether the current data processing logic is consistent with the template data, and allowing data to be imported under the condition of consistency, otherwise, outputting an abnormal prompt; checking whether the imported essential filling items of the basic data are complete and whether the essential filling items of the basic data accord with field rules;
4) Checking the correctness of the dictionary management relation between the fields and the database, and checking whether the imported basic data is filled in and consistent with the information maintained in the dictionary management;
5) Checking whether the data with the relation among the data accords with the rule;
6) Checking whether the data is unique;
7) Marking the result after data verification for subsequent display and processing;
8) The ID of the basic data in dictionary management is obtained, and the ID data in the dictionary management corresponding to the current data is obtained and stored in a cache when the type, subclass, fine classification, class, color and supplier rule verification is carried out, so that the subsequent data storage service is carried out;
9) The parsed basic data information, integer error data, character type error data ID information and the parsed result mark are returned to the UI in a Json format;
10 Analyzing the returned Json character string, if the analysis result is True, indicating that the analysis is correct and completed; otherwise, if False shows that the analysis fails, ending the data import and prompting an operator; after the analysis is correct, converting the tag field CheckBoxInfo, strIsExistInDataBase from a character format to a bool type, and then using the bool type for UI display;
11 The total number of errors is displayed, the total number information of the errors after various types of verification is judged, and the errors with the total number greater than zero are spliced into character strings to be displayed in a UI; error data background processing, namely displaying all data on a UI, acquiring specific information of each data error from an ID stored in a character string during analysis, and performing background rendering on the error information; error data remarking processing, namely when the UI performs data display, remarking information of data row error data is displayed in a remarking field, and is displayed by using a special color font, and remarking information of normal data is not displayed;
12 Correcting the imported abnormal data;
13 The data is transmitted into the background in the form of Json character strings for processing, wherein the data transmitted into the background is divided into three parts, namely new data, coverage data, and new data which are deleted before being added, and the data respectively correspond to various different processing conditions.
2. The method for introducing a base material according to claim 1, wherein step 1) specifically comprises:
the template identification, the imported template is added with unique identification information, and the type of the current template is displayed on the first row of the table head of each type of imported template;
the method comprises the steps of configuring a header, wherein a template adopts double headers, a Chinese header is used for identifying and displaying the header, an English header is used for storing and identifying the header, a second behavior Chinese header and a third behavior English header of the template;
leading important fields, arranging the essential filling items and important identification information in the front, and performing red marking treatment on the head of the essential filling item list;
the import portal is unified, import data acquisition and processing of all material types are placed in a unified public interface, and maintenance personnel of all types and departments use the same portal to realize data input.
3. The method for introducing a base material according to claim 1, wherein step 2) comprises:
Acquiring template data, selecting an import template, analyzing the import template, and acquiring English headers and data items of the import template according to the import template and data processing requirements;
the template type is obtained, the unique identification of the template is used for identification, and the base material type is marked and used for subsequent data processing branch judgment;
removing blank data in the imported template data;
configuring a header relation, and configuring Chinese header character arrays and English header character arrays of different large basic data;
the header matching verification, according to the large-class identifier set by the template, acquiring a configured large-class English header, matching the English header of the current large class with the English header in the template, if the English header is consistent with the English header in the template, judging that the current imported template is correct, otherwise prompting prompt for checking whether the imported data and the imported template are matched, and ending the importing;
the table head dictionary management is used for carrying out matching, checking and marking, storing and using a character string array and a dictionary according to the corresponding relation between the English table head and the Chinese-English table head, wherein the table head dictionary management contains 4 character string data, is respectively corresponding relation between English table head information and Chinese-English table heads of all material types, and is used for guiding out configuration necessary conditions for checking the correctness of a template and data;
Data caching, namely transmitting the data in the template into a data layer, and storing the data in an intermediate table for verification and storage processing;
code format conversion, namely code conversion is carried out on codes in imported data according to basic data format rules, the codes are converted into code formats which can be identified by an MES system, types are not distinguished, and the codes are converted by using the same set of rules;
conversion rules are stored, code conversion rules are stored in configuration files and are stored in an XML form;
the method comprises the steps of configuring conversion rules, storing Code rules in an XML form, wherein the specific format is that tag CodereGulation, code is used for identifying internal information as the Code rules, and Id, codeType, code _Start and code_ End, length, PLMRegulation, K3Regulation are used for describing rule names, start numbers, end numbers, number lengths, PLM breakpoint rules and K3 breakpoint rules; the method comprises the steps of setting a self-increasing identifier, setting imported data, adding a unique self-increasing identifier, and setting the self-increasing identifier as integer data, wherein the self-increasing identifier is used for efficiently managing the band analysis data.
4. The method of introducing a base material according to claim 1, wherein step 4) is specifically as follows:
vendor field rule checking:
defining integer variables for storing the total number of non-conforming rules of provider field data in the imported data; correlating the provider name with the provider name in the provider database, and if the provider name is empty, judging that the provider is filled with errors, and storing the total number of the errors of the provider data in the integer variable;
Defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the provider data does not accord with the rule in the imported data, storing the data self-increment IDs which do not accord with the rule of the provider in the character string variable, and separating a plurality of self-increment identifiers by commas;
data type field rule checking:
defining integer variables, which are used for storing the total number of the data type field data in the imported data, wherein the data type field data does not accord with the rule, the type is maintained in a type dictionary management module, the type name is used for associating with the type name in a type data table, if the type is empty, the type is judged to be filled with errors, and the total number of the type data with errors is stored in the integer variables;
defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the type data does not accord with the rule in the imported data, storing the data self-increment IDs which do not accord with the type rule in the character string variable, and separating a plurality of self-increment identifiers by commas;
subclass field rule checking:
defining integer variables, which are used for storing the total number of the sub-class field data in the imported data, wherein the total number of the sub-class field data does not accord with the rule, the sub-class is maintained in a sub-class dictionary management module, the sub-class names in a sub-class database are correlated with the sub-class names, if the correlation result is empty, the sub-class filling errors are judged, and the total number of the sub-class data errors is stored in the integer variables;
Defining a character string variable corresponding to the integer variable in the first step, wherein the character string variable is used for storing self-increment IDs of sub-class data in imported data, the self-increment IDs of the sub-class data are not in accordance with rules, the self-increment IDs of the sub-class data are stored in the character string variable, and comma separation is used among a plurality of self-increment identifiers;
and (3) checking a rule of a fine classification field:
defining integer variables, which are used for storing the total number of the non-conforming rules of the fine classification field data in the imported data, wherein the fine classification is maintained in a fine classification management module, the fine classification names in a fine classification database are used for associating the fine classification names, if the association results are empty, the fine classification is judged to be filled with errors, and the total number of the errors of the fine classification data is stored in the integer variables;
defining a character string variable corresponding to the integer variable in the first step, wherein the character string variable is used for storing self-increment IDs of the fine classification data in the imported data, the self-increment IDs of the fine classification data are stored in the character string variable, and comma separation is used among a plurality of self-increment identifiers;
category field rule checking:
defining integer variables for storing the total number of non-conforming rules of category field data in the imported data, wherein the category fields adopt: the method comprises the steps of dividing imported category data into two parts, namely a name and a category code for use when checking rules according to the forms of category names plus and minus, wherein the code is used for searching corresponding category information in a category field, the name is used for checking the searched data again, statistics is carried out on the data which are matched with errors, and the total number of the data is stored in integer variables;
Defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing self-increment IDs of which the category data in the imported data does not accord with the rule, storing the data self-increment IDs which do not accord with the category rule in the character string variable, and separating a plurality of self-increment identifiers by commas;
color field rule checking:
defining integer variables, which are used for storing the total number of the color field data in the imported data, which are not in accordance with the rule, associating the color names in the color database with the color full names, judging that the color is wrongly filled according to the association result if the association result is empty, and storing the total number of the color data in the integer variables;
defining a character string variable corresponding to the first integer variable, wherein the character string variable is used for storing the self-increment ID of which the color data does not accord with the rule in the imported data, storing the self-increment ID of the data which does not accord with the color rule in the character string variable, and separating a plurality of self-increment identifiers by commas.
5. The method for introducing a base material according to claim 1, wherein step 5) comprises:
correlation checking between types, subclasses and subclasses:
defining integer variables for storing the total number of non-conforming rules of the relations among the types, subclasses and sub-class field data in the imported data; the relation among the types, the subclasses and the fine classifications is a tree structure, wherein the types comprise a plurality of subclasses, and the subclasses comprise a plurality of fine classifications; the total data summary number of which the relations among the types, the subclasses and the subclasses in the imported data are inconsistent with the relations set in the dictionary database is stored in the integer variable;
Defining a character string variable corresponding to the integer variable in the first step, and storing self-increment IDs of which the relations among the type, sub-class and fine classification field data in the imported data are not in accordance with rules; storing the data self-increment ID which does not accord with the rule in a character string variable, wherein comma separation is used among a plurality of self-increment identifiers;
and (3) checking the relation between the code and the type match:
defining integer variables for storing the total number of non-conforming rules of the relation between the codes and the type field data in the imported data; a constraint exists in the basic data, a code represents a type of material, the code and the type of the material in the imported data are matched and judged with the code and the type in the existing basic material data, the situation that the matching relation of the imported data is inconsistent with the relation in the database is screened out, and the total number of errors is stored in an integer variable;
defining a character string variable corresponding to the first integer variable, and storing a self-increment ID (identity) of which the relation between the code and the type field data in the imported data is not in accordance with a rule; the data self-increment ID which does not accord with the rule is stored in a character string variable, and comma separation is used among a plurality of self-increment identifiers.
6. The method of introducing a base material according to claim 1, wherein step 6) comprises:
Code and figure number uniqueness check:
defining integer variables for storing the total number of code and figure number fields already existing in the database in the imported data; in the basic data, uniquely determining a basic material type by using codes and figure numbers; performing association matching on the imported data and a basic material database, searching basic data with codes and figure numbers repeated simultaneously, counting the total number of repeated data, and storing the total number of errors in an integer scalar;
defining a character string variable corresponding to the first integer variable, and storing a self-increment ID of a code and a figure number field in the imported data, which is already existing in a database; storing the data self-increment ID which does not accord with the rule in a character string variable, wherein comma separation is used among a plurality of self-increment identifiers;
and (3) data complete matching verification:
defining integer variables for storing the total number of all fields of one row of data in the imported data, which are consistent with all the existing data in the database; the data with the same field information is not needed to be imported again, but is needed to be recorded, and the data is displayed to operators in the subsequent display;
defining a character string variable corresponding to the first integer variable, and importing self-increment IDs (identity) of all fields of one row of data in the data, which are consistent with the existing data in the database; the full-match data self-increment ID is stored in a character string variable, and comma separation is used between a plurality of self-increment identifiers.
7. The method of introducing a base material according to claim 1, wherein step 7) comprises:
judging whether the imported data code and the figure number already exist or not:
matching in a basic database by using codes and drawing numbers of imported data, and using an AND matching method;
adding a data line marking field checkbox info for marking the state of the current data line, wherein the states are set to be True and False respectively, true represents that the current data is correct, and False represents that the current data has a problem;
adding a data line remark field: the data line remark field is added to explain the current data state, so that the data foreground can be conveniently displayed; if there are multiple problems with a line of data, then comma separation is used between the multiple notes.
8. The method of introducing a base material according to claim 1, wherein step 12) comprises:
the method comprises the steps of performing exception processing on imported data, screening out data with codes and picture numbers completely consistent with each other in the imported data, determining the imported data of a current code and picture number, and discarding all other data;
exception export, in which all or part of data with conflicting codes and figure numbers is not processed, and unprocessed data is exported;
The method comprises the steps of carrying out conflict processing on a database layer, popping up data of codes and picture numbers in an imported file, which are already existing in the database, displaying partial information in a main table, checking information of the currently imported codes and picture numbers, which are already existing in the database, and selecting to use the imported data to cover and update the data existing in the database or to keep the data in the database on each piece of main table information;
all the imported data are displayed, and the data import state is distinguished by using different background colors.
9. A system for introducing a base material, comprising:
the template configuration related module is used for explaining the design of the imported template and setting the importing of all types of materials as a uniform interface;
the data primary processing module is used for storing the imported data in a cache, and sorting and converting the data;
the essential item data checking module is used for checking important and essential data in the current imported data and ensuring the integrity of the data;
the database layer checking module is used for checking the correctness of the management relationship between the fields and the database dictionary;
the association relation checking module is used for checking whether the data with the association exist among the association relation checking modules accords with the rule;
The base material uniqueness checking module is used for checking whether the data are unique or not;
the data marking module is used for marking the result after data verification and used for subsequent display and processing;
the data acquisition module is used for acquiring the ID of the basic data in dictionary management;
the return foreground processing module is used for returning the analyzed basic data information, the integer error data, the character error data ID information and the analysis result mark to the UI in a Json format;
the data processing module is used for analyzing the returned Json character string and converting the marking field CheckBoxInfo, strIsExistInDataBase from a character format to a bool type;
the data display module is used for displaying the total number of errors, processing the background of the error data and processing remarking the error data;
the exception handling module is used for correcting the imported exception data;
and the data importing module is used for importing the data into the background in the form of Json character strings for processing.
10. A computer device comprising a memory and a processor, in which a computer processing program is placed, the processor being responsible for executing the computer program and for carrying out the method of introducing a base material according to any one of claims 1 to 8.
CN202010387537.3A 2020-05-09 2020-05-09 Basic material importing method, system and computer equipment Active CN111598535B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010387537.3A CN111598535B (en) 2020-05-09 2020-05-09 Basic material importing method, system and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010387537.3A CN111598535B (en) 2020-05-09 2020-05-09 Basic material importing method, system and computer equipment

Publications (2)

Publication Number Publication Date
CN111598535A CN111598535A (en) 2020-08-28
CN111598535B true CN111598535B (en) 2023-06-13

Family

ID=72182648

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010387537.3A Active CN111598535B (en) 2020-05-09 2020-05-09 Basic material importing method, system and computer equipment

Country Status (1)

Country Link
CN (1) CN111598535B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114528343A (en) * 2020-10-23 2022-05-24 花瓣云科技有限公司 Commodity data management method and device and server
CN113033738B (en) * 2021-04-14 2023-05-30 深圳一道创新技术有限公司 Material error prevention management method and system based on MES system, electronic equipment and storage medium
CN114564912A (en) * 2021-11-30 2022-05-31 中国电子科技集团公司第十五研究所 Intelligent checking and correcting method and system for document format

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101714165A (en) * 2009-12-08 2010-05-26 青岛海信宽带多媒体技术有限公司 Method for importing data
CN102142014A (en) * 2010-01-29 2011-08-03 软件股份公司 System and method for export and import of metadata located in metadata registries
CN102236672A (en) * 2010-05-06 2011-11-09 深圳市腾讯计算机系统有限公司 Method and device for importing data
CN106355303A (en) * 2016-08-15 2017-01-25 上海新炬网络技术有限公司 Data model automatic evaluation system
CN106484778A (en) * 2016-09-14 2017-03-08 深圳中兴网信科技有限公司 Material distribution method and material dispensing device based on SOA
CN106850707A (en) * 2015-12-03 2017-06-13 北京国双科技有限公司 Method, apparatus and system that material batch is uploaded
CN107315771A (en) * 2017-05-23 2017-11-03 中国科学院计算机网络信息中心 A kind of data collection system customization method based on expanding library table data dictionary
CN109885571A (en) * 2019-02-19 2019-06-14 山东浪潮通软信息科技有限公司 A kind of material data duplicate checking method and system based on configurable rule

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6668254B2 (en) * 2000-12-21 2003-12-23 Fulltilt Solutions, Inc. Method and system for importing data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101714165A (en) * 2009-12-08 2010-05-26 青岛海信宽带多媒体技术有限公司 Method for importing data
CN102142014A (en) * 2010-01-29 2011-08-03 软件股份公司 System and method for export and import of metadata located in metadata registries
CN102236672A (en) * 2010-05-06 2011-11-09 深圳市腾讯计算机系统有限公司 Method and device for importing data
CN106850707A (en) * 2015-12-03 2017-06-13 北京国双科技有限公司 Method, apparatus and system that material batch is uploaded
CN106355303A (en) * 2016-08-15 2017-01-25 上海新炬网络技术有限公司 Data model automatic evaluation system
CN106484778A (en) * 2016-09-14 2017-03-08 深圳中兴网信科技有限公司 Material distribution method and material dispensing device based on SOA
CN107315771A (en) * 2017-05-23 2017-11-03 中国科学院计算机网络信息中心 A kind of data collection system customization method based on expanding library table data dictionary
CN109885571A (en) * 2019-02-19 2019-06-14 山东浪潮通软信息科技有限公司 A kind of material data duplicate checking method and system based on configurable rule

Also Published As

Publication number Publication date
CN111598535A (en) 2020-08-28

Similar Documents

Publication Publication Date Title
CN111598535B (en) Basic material importing method, system and computer equipment
US9037549B2 (en) System and method for testing data at a data warehouse
US7337414B2 (en) Logical equivalence verifying device, method, and computer-readable medium thereof
CN112148509A (en) Data processing method, device, server and computer readable storage medium
US10599129B2 (en) Method for data normalization
CN108388640B (en) Data conversion method and device and data processing system
CN112163553B (en) Material price accounting method, device, storage medium and computer equipment
CN106570232A (en) Inspection procedure automatic generation method
CN106355375B (en) A kind of automatic materiel affirmation method
CN110806977A (en) Test case set generation method and device based on product requirements and electronic equipment
CN114661584A (en) Testing device for software testing and using method
CN111061733B (en) Data processing method, device, electronic equipment and computer readable storage medium
CN115687380A (en) Method and device for storing product information
CN113360388B (en) Method for integrally managing test process of unmanned aerial vehicle ground station software
CN111679983B (en) JAVA interface static test method and device
CN112505337B (en) Data processing method for assisting analysis of sample
US20020038268A1 (en) Financial cost prediction system and method
CN113064811A (en) Workflow-based automatic testing method and device and electronic equipment
CN114780802B (en) Method and device for automatically adapting and extracting chip ECID
CN115687292B (en) Verifiable database upgrading method irrelevant to database technology
CN110990281B (en) Automatic static analysis method
CN117472958A (en) Verification method, device, equipment and medium for SQL statement execution result
CN117648325A (en) Parameter type correction method and device, electronic equipment and storage medium
CN116401302A (en) SAP system upgrading period initial data conversion method
CN116225957A (en) Software testing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant