TWI450112B - System and method for structuring data - Google Patents

Description

Data structure processing system and method

The present invention relates to a data processing system and method, and more particularly to a data structure processing system and method.

Generally, when an electronic product manufacturer uses a CAD system to develop and design an electronic product, it is usually necessary to import a large amount of data from an original database storing information on electronic product parts (for example, a PCB board), for example, storing electronic products. *.DSN database of parts information. However, because there is no correlation between the parts information stored in the *.DSN database, including PCB board routing information and perforation information, it is difficult to reconstruct the two-dimensional geometric space between the parts information imported into the CAD system. 3D geometric space. In addition, when reading the information of electronic products from the *.DSN database, it is found that the files in the *.DSN database are very large, and the general file size is between 20MB and 150MB, which results directly to *.DSN. When the database searches for part information, it may take several hours to complete all the search and classification, which affects the speed and speed of the computer system.

In view of the above, it is necessary to provide a data processing system and method for matrixing and storing the data in the original database, so that the matrix data can be greatly improved in reading and writing data in the future.

A data structured processing system running in a computer, the computer connected to a storage A database of raw materials that require structured data processing. The data structure processing system includes: a data reading module, configured to read the original data from the database, and store the original data in a temporary variable in a string form, and the line feed mark according to the plain text file format The string in the temporary variable is divided into each line, and each line is marked with a line number from the first line; a data matrix construction module is used to construct a complex matrix array, and the storage capacity value of each matrix array is set, according to The storage capacity value of each matrix array is read from the temporary variable and stored in the matrix array, and the constructed matrix arrays are merged into a single data matrix; the matrix classification storage module is used for According to the data characteristics in each matrix array, the data in each matrix array is classified in a single data matrix, the matrix array of each classification is placed in the corresponding folder, and the data folder is encrypted and stored in a hard disk of the computer. in.

A data structure processing method for data structure processing of original data stored in a database. The method comprises the following steps: (a) reading the original data from the database and storing it in a temporary variable in a string form; (b) dividing the string in the temporary variable into a string according to the linefeed mark in the plain text file format. Each line, and each line is marked with a line number from the first line; (c) initialize a data read pointer for each line string when reading data in the temporary variable; (d) construct a matrix array, And reading a string equal to the storage capacity of the matrix array from the temporary variable and placing it in the matrix array; (e) determining whether the data read pointer points to the line number mark in the temporary variable is an end mark; (f) if the data is read If the pointer number points to the temporary variable, the line number mark is not the end mark, then go to step (d) to reconstruct a matrix array; (g) if the data read pointer points to the line number mark in the temporary variable is the end mark, each will be constructed The matrix arrays are merged into a single data matrix; (h) each matrix array is placed in a single data matrix according to the data characteristics in each matrix array The data is classified; and (i) the matrix array of each classification is placed in the corresponding folder, and the folder is encrypted and stored.

Compared with the prior art, the data structure processing system and method can perform effective data classification on a large amount of original data in the database, and store the classified data in a matrix, so that the matrix can be applied in the future. The data can greatly improve the speed of reading and writing data and the speed of computing, saving the memory and computing resources of the computer system.

1‧‧‧ computer

10‧‧‧Data Structured Processing System

101‧‧‧ data reading module

102‧‧‧Data Matrix Building Module

103‧‧‧Matrix classification storage module

11‧‧‧Central processor

12‧‧‧ Hard disk

2‧‧‧Database

1 is a block diagram of a preferred embodiment of a data structure processing system of the present invention.

Figure 2 is a schematic diagram of the classification data of a complex matrix array in a single data matrix.

3 is a flow chart of a preferred embodiment of the data structure processing method of the present invention.

FIG. 4 is a detailed flowchart of the construction of each matrix array in step S34 of FIG. 3.

1 is an architectural diagram of a preferred embodiment of a data structure processing system of the present invention. The data structured processing system 10 is operated in a computer 1, and the computer 1 is connected to a database 2. The computer 1 includes a central processing unit 11 and a hard disk 12, and the data base 2 stores original data that needs to be structured. In this embodiment, the original data is an electronic product that performs part information information included in the circuit wiring drawing, and the part information of the electronic product is stored in the database 2 in a *.DSN file format. In other embodiments, the original data may be any information that can be read and written by the computer 1. The central processing unit 11 is configured to execute the data structure processing system 10, and the central processing unit 11 can be a multi-core processor, which can be designed as a multi-threaded parallel processing program architecture, which can improve program execution. Speed and Calculate performance. The hard disk 12 is configured to store a data file that has been structured for the original data in the database 2. The data structure processing system 10 includes a data reading module 101, a data matrix construction module 102, and a matrix classification storage module 103.

The data reading module 101 is configured to read the original data in the *.DSN file from the database 2, and store the original data in the *.DSN file in a temporary variable TEMP in a string form, according to *. The line break mark in the plain text file format of the DSN file divides each line, and marks each line with a line number from the first line, including the first line mark, the second line mark, and the end mark of the last line. The data reading module 101 is further configured to initialize a data reading pointer for each line string when reading the data in the temporary variable TEMP.

The data matrix construction module 102 is configured to construct a complex matrix array, and set a storage capacity value of each matrix array, and read and store the storage capacity value from the temporary variable TEMP according to the storage capacity value of each matrix array. The strings are stored in the matrix array and the constructed matrix arrays are combined into a single data matrix (as shown in Figure 2). In this embodiment, the data matrix construction module 102 is further configured to determine whether the data reading pointer points to the end number of the temporary variable TEMP, and the corresponding one of the row string data in the matrix array is temporarily The variable TEMP is cleared, and the data read pointer is pointed to the string data of the next line in the temporary variable TEMP.

The matrix classification storage module 103 is configured to classify the data in each matrix array in a single data matrix according to the data features in each matrix array, and place the matrix array of each classification in the corresponding folder, and The folder is encrypted and stored in the hard disk 12. The encryption of the folder is performed by using a common encryption method to protect the security of the data. In this embodiment, the matrix classification storage module 103 will be single. The classification of the data of each matrix array in the data matrix will be described in detail in Figure 2 below.

As shown in FIG. 2, it is a schematic diagram of the classification data of the complex matrix array in a single data matrix. In this embodiment, it is assumed that nine matrix arrays are constructed to form a single data matrix for storing nine types of information materials included in the wiring drawing of the electronic parts. The nine matrix arrays are matrix array 1 to matrix array 9, respectively, and each matrix array stores string data of the same data feature. Matrix Array 1: Parserm Matrix _ Category 1, stores the first category of information, including the version, date and other information of the electronic parts. Matrix Array 2: Structure Matrix _ Category 2, which stores information of the second category, which includes information such as PCB board space boundaries and PCB layer structure. Matrix Array 3: Placement Matrix _ Category 3, which stores the third category of information, which contains information on the coordinate position of each electronic component on the PCB. Matrix Array 4: Library Matrix _ Category 4 stores the data of the fourth category, which includes pin definition information and coordinate position rotation information of each electronic component on the PCB. Matrix Array 5: PartLibrary Matrix _ Category 5, stores the fifth category of information, which contains the Via (Via) information of each electronic component on the PCB, and part contour information. Matrix Array 6: Network Matrix _ Category 6, stores the sixth category of data, which contains the line width information of all the wiring (Netlist) on the PCB, and the routing information of each wiring connected to each pin Pin. Matrix Array 7: Writing Matrix _ Category 7, stores the seventh category of data, which contains information on the geometric coordinates of all line widths and traces on the PCB. Matrix Array 8: Testpiont Matrix _ Category 8, which stores the eighth category of data, which contains the coordinates of the test point location coordinates of the tested electronic components on the PCB. Matrix Array 9: Color Matrix _ Category 9, stores the ninth category of data, which contains RGB color definition information for each electronic part on the wiring drawing. The matrix classification storage module 103 performs parallel processing in a single data matrix according to the feature information in the above nine types of matrix arrays. When searching and sorting, place the same kind of information in the corresponding matrix array.

3 is a flow chart of a preferred embodiment of the data structure processing method of the present invention. In step S30, the data reading module 101 reads the original data in the *.DSN file from the database 2. In the embodiment, the original data refers to the information of each electronic component in the design drawing of the circuit layout of the electronic product, and the part information of the electronic product is stored in the database 2 in the *.DSN file format.

In step S31, the data reading module 101 stores the original data read from the *.DSN file in a string form in a temporary variable TEMP. Step S32, the data reading module 101 divides each line according to the newline mark in the plain text file format of the *.DSN file, and adds a line number mark to each line from the first line, which includes the first line mark and the second line. The line is marked until the end of the last line. In step S33, the data reading module 101 initializes a data reading pointer for each line string when reading the data in the temporary variable TEMP.

In step S34, the data matrix construction module 102 constructs a matrix array, and reads a string equal to the matrix array storage capacity value (for example, 10000 line string) from the temporary variable TEMP and places the string in the matrix array. How the data matrix construction module 102 constructs the matrix array will be described in detail in FIG. 4 below.

In step S35, the data matrix construction module 102 determines whether the data read pointer points to the line number mark in the temporary variable TEMP is an end mark. If the data read pointer points to the line number mark in the temporary variable TEMP is not the end mark, the flow moves to step S34, and the data matrix construction module 102 reconstructs another matrix array until all the data in the temporary variable TEMP is read. If the data read pointer points to the line number mark in the temporary variable TEMP is the end mark, in step S36, the data matrix construction module 102 merges the constructed matrix arrays into a single data matrix.

In step S37, the matrix classification storage module 103 classifies the data in each matrix array in a single data matrix according to the data features in each matrix array. Each matrix array is classified into a matrix array 1 to a matrix array 9 as shown in FIG. Step S38, the matrix classification storage module 103 places the matrix array of each classification in the corresponding folder, encrypts the data folder and stores it in the hard disk 12, so as to protect the security of the data, the pair of folders Encryption uses a common encryption method.

As shown in FIG. 4, a refinement flowchart of each matrix array constructed in step S34 in FIG. 3 is shown. In step S341, the data matrix construction module 102 constructs a matrix space variable VAR, and sets a storage capacity value of the matrix space variable VAR. For example, the storage capacity value of the matrix space variable VAR is set to 10000 rows. In step S342, the data matrix construction module 102 sequentially reads the string data in the temporary variable TEMP according to the line number mark in the temporary variable TEMP and places it into the matrix space variable VAR. In step S343, the data matrix construction module 102 clears the corresponding one of the row string data that has been placed in the matrix space variable VAR from the temporary variable TEMP, and controls the data read pointer to point to the string data of the next row in the temporary variable TEMP.

In step S344, the data matrix construction module 102 determines whether the number of string columns stored in the matrix space variable VAR is less than or equal to the set storage capacity value. If the number of string columns stored in the matrix space variable VAR is less than the set storage capacity value, the flow proceeds to step S342 to continue reading the string data in the temporary variable TEMP. Step S345, if the number of string columns stored in the matrix space variable VAR is equal to the set storage capacity value, the data matrix construction module 102 stores the matrix space variable VAR as a corresponding matrix according to the data features stored in the matrix space variable VAR. Array. Step S346, the data matrix construction module 102 clears the string data in the matrix space variable VAR into an empty matrix space variable, so as to release the memory of the computer 1 and the computing resources of the central processing unit 11.

The data structured processing system and method of the present invention can perform effective data classification on a large amount of data in the original data database (for example, electronic component information in an electronic circuit board drawing), and space the various types of drawing objects after classification. The data structure such as geometric coordinates is re-matrixed and stored, so that the data of the read and write data speed and the computing speed can be greatly improved when the matrixed data is applied in the future, and the memory and computing resources of the computing system are saved. The data obtained by the data structure processing system and method described in the present invention can be applied to signal simulation, development of self-made CAD software, circuit design of PCB board, and automated manufacturing and testing.

The above is only the preferred embodiment of the present invention, and has been used in a wide range of applications. Any other equivalent changes or modifications which are not departing from the spirit of the present invention should be included in the following claims. Inside.

1‧‧‧ computer

10‧‧‧Data Structured Processing System

101‧‧‧ data reading module

102‧‧‧Data Matrix Building Module

103‧‧‧Matrix classification storage module

11‧‧‧Central processor

12‧‧‧ Hard disk

2‧‧‧Database

Claims (10)

A data structured processing system is run in a computer, and the computer is connected to a database storing original data that needs to be structured by data processing. The data structured processing system includes: a data reading module for The original data is read in the database, and the original data is stored in a temporary variable in a string form. The line break in the plain text file format divides the string in the temporary variable into each line, and starts from the first line. A row plus a row number mark; a data matrix construction module for constructing a complex matrix array, and setting a storage capacity value of each matrix array, reading from the temporary variable and storing the storage capacity value according to the storage capacity value of each matrix array The string is stored in the matrix array, and the constructed matrix arrays are merged into a single data matrix; and the matrix classification storage module is configured to perform matrix arrays in a single data matrix according to data features in each matrix array The data is classified, the matrix array of each classification is placed in the corresponding folder, and the folder is encrypted and stored in Drive the brain. The data structuring processing system of claim 1, wherein the data reading module is further configured to initialize a data reading pointer for each line string when reading data in the temporary variable. The data structure construction system of claim 2, wherein the data matrix construction module is further configured to determine whether the data read pointer points to a line number mark in the temporary variable is an end mark, and The corresponding one of the row string data that has been placed in the matrix array is cleared from the temporary variable, and the data read pointer is pointed to the string data of the next row in the temporary variable. The data structuring processing system according to claim 1, wherein the original data is a part information material included in a circuit wiring drawing of the electronic product, and the electronic product part Information materials are stored in the database in the form of *.DSN files. The data structure processing system of claim 1, wherein the single data matrix is composed of a plurality of matrix arrays, each of which stores string data having the same data feature. A data structure processing method for data structure processing of original data stored in a database, the method comprising the following steps: (a) reading original data from the database and storing the data in a string form (b) The line break in the plain text file format divides the string in the temporary variable into each line, and adds each line to the line number mark from the first line; (c) initializes one for reading Pointing to the data read pointer of each line string when taking the data in the temporary variable; (d) constructing a matrix array, and reading the string equal to the storage capacity of the matrix array from the temporary variable and placing the string in the matrix array; Determining whether the data read pointer points to the line number mark in the temporary variable is an end mark; (f) if the data read pointer points to the line number mark in the temporary variable is not the end mark, then proceeds to step (d) to reconstruct a matrix array (g) if the data read pointer points to the line variable in the temporary variable is the end mark, the constructed matrix arrays are merged into a single data matrix; (h) according to the data characteristics in each matrix array Data within each data in the matrix array of a classification matrix; and (i) of the matrix array is placed in each category corresponding to the folder, and the folder is stored encrypted data. For the data structuring processing method described in claim 6, the step (d) includes: (d1) constructing a matrix space variable, and setting a storage capacity value of the matrix space variable; (d2) sequentially reading the string data in the temporary variable according to the line number mark in the temporary variable and placing it into the matrix space variable; (d3) clearing the corresponding one of the line strings already placed in the matrix space variable from the temporary variable And causing the data read pointer to point to the string data of the next row in the temporary variable; (d4) determining whether the number of string columns in the matrix space variable is less than or equal to the set storage capacity value; (d5) if the matrix space variable If the number of string columns is less than the set storage capacity value, the step moves to step (d2) to continue reading the string data in the temporary variable; and (d6) if the number of string columns in the matrix space variable is equal to the set storage capacity value, The matrix spatial variables are stored as corresponding matrix arrays according to the data features in the matrix spatial variables. For example, the data structuring processing method described in claim 7 further includes the step of clearing the string data in the matrix space variable after the step (d6). For example, the data structure processing method described in claim 6 is the information material of the parts included in the circuit wiring drawing of the electronic product, and the information information of the parts of the electronic product is *.DSN file The format is stored in the database described. The data structure processing method according to claim 6, wherein the single data matrix is composed of a complex matrix array, and each matrix array stores string data having the same data feature.