CN107943968B - Structured processing method for construction data table data - Google Patents
Structured processing method for construction data table data Download PDFInfo
- Publication number
- CN107943968B CN107943968B CN201711212520.9A CN201711212520A CN107943968B CN 107943968 B CN107943968 B CN 107943968B CN 201711212520 A CN201711212520 A CN 201711212520A CN 107943968 B CN107943968 B CN 107943968B
- Authority
- CN
- China
- Prior art keywords
- data
- cell
- description
- filling
- cells
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a structured processing method of construction data table data, which comprises the steps of marking basic characteristics of cells; corresponding data value storage ID is put into the marking information of the filling data type cell; generating data description contents for the filling data type cells; processing the cells of the whole construction data table to form a storage structure for storing ID (identity) aiming at the data description content and the corresponding data value of the construction data table; storing the generated storage structure and forming a data description structure library; using a construction data table template base which is subjected to structural description to compile construction data at a computer terminal, and storing data values in the filling data type cells; and a data description structure library and a data content database are formed on the cloud server, so that the data of the engineering data table are structurally processed. The method and the device can be used for carrying out complete structural processing on the construction data table, the automation processing rate is high, and the data storage is convenient.
Description
Technical Field
The application relates to a structured processing method of construction data table data, which is applicable to the technical field of construction data management.
Background
The construction data form is an important embodiment form of construction engineering quality and is also the most important data recording carrier in the construction process. The relevant records and data traces of the process can be reserved after the whole construction project is completed, and only the project data are available, so that the project data have irreplaceable functions. The form of the project data is compiled into an electronic form through data software at present, and then the electronic form is printed into a paper form for use, so that the data of the form can not be utilized no matter the electronic document or the paper form is used, and the form data is the most valuable data resource.
Due to the high level of specialization, large workload of data processing, regional differences, poor cognition of engineering data business and the like, the related technologies for carrying out structural processing on the construction data table data are not many. The technical solutions known at present are the preliminary structuring process of some data of the project data table for some specific business needs, such as file records, of individual regions. In the prior art, there are two ways to implement the method, one is a direct data tabulation method, and the other is based on XML file processing.
The direct data tabulation method is to generate a corresponding data table for each construction data table to store corresponding data, but the method has no generality and universality for the situation of large number of tables. The main reasons are: firstly, the quantity of construction data tables in a region generally exceeds 2000, so that the feasibility is not high if the large-scale quantity is completely built into a data table; second, the individual types of forms have many data fields, over 200 fields, and the variability of individual forms is not easily realized with spreadsheet technology.
The method for formatting the table based on the XML file is that partial cell contents of the project data table are stored in the XML file with a corresponding structure, so that the table data is structured, and the method is mostly used under the condition of structuring and datafying partial project data tables. The overall structure is also deficient, mainly including the following three points: firstly, the XML file also has the condition that the structure of the special type construction data table cannot be described, and the XML file is mainly used for detecting that a large number of complex options exist in the batch type table, so that the data relation is too complex; secondly, the utilization is difficult, after the XML file is formed, data are stored in the file, particularly, the quantity of construction data tables of one project is up to tens of thousands or more, under the scene, comprehensive statistical analysis is realized based on the data in the XML file, and the utilization efficiency is very low; thirdly, the workload of data processing is huge and the cost is higher.
Therefore, there is a need in the art for a technique that enables a fully structured processing of a construction data form.
Disclosure of Invention
In order to overcome the defects in the prior art, the application provides the structural processing method of the construction data table data, the construction data table can be completely structurally processed, the automatic processing rate is high, and the data storage is convenient.
The application relates to a structured processing method of construction data table data, which comprises the following steps:
(1) marking all cells of the construction data table with basic characteristics, wherein the basic characteristics include description cells and filling data cells;
(2) corresponding data value storage ID is put into the label information of the filling data type cell as the basis of data access;
(3) generating data description contents for the filling data type cells;
(4) processing the cells of the whole construction data table by adopting the method to form a storage structure for storing ID (identity) according to the data description content and the corresponding data value of the construction data table;
(5) storing the generated storage structure into a database on a cloud server to form a data description structure library;
(6) the method comprises the steps that a construction data form template base which is subjected to structural description is used at a computer terminal to compile construction data, and data values in filling data type cells are stored in a relational database on a cloud server in a Key-Value mode in the process of compiling the data to form a data content database; wherein Key stores ID for the data Value generated in step (2), and Value is the data description content stored in the filling data type cell;
(7) and a data description structure library and a data content database are formed on the cloud server, so that the data of the engineering data table are structurally processed.
Preferably, the data description structure library may be a MangoDB database based on NoSQL technology, and the relational database may be a MySQL database. Preferably, the data description structure library is automatically synchronized from the cloud server by using the mobile data terminal, the form data item is dynamically generated according to the description content of the data structure, and after the corresponding data content is filled in the form data item, when the mobile data terminal submits and stores the data, the data content is also stored in the relational database on the cloud server in a Key-Value form.
Preferably, the non-editable cell is a description class cell, and the editable cell is a filling data class cell; or, the cells with preset content are description type cells, and the cells without preset content are filling data type cells.
Preferably, the merged cell and/or the signature opinion cell is marked when the cell basic characteristic marking is performed, and the cell start row column number is used as a unique mark. The data value storage ID may be generated with coordinates of a corresponding cell in the construction material table for marking the stored data value.
Preferably, the generation method of the data description content is as follows:
according to the initial row and column number and the ending row and column number of the filling data type cell, matching is started from the description type cell adjacent to the left side and the description type cell adjacent to the upper side; then continuously matching the description type cell next to the left side and the description type cell next to the upper side by taking the matched position as a base coordinate until the coordinate next to the description type cell does not meet the requirement or the data filling type cell appears; and repeating the process, finding the corresponding data description contents from all the data filling type cells, and forming the data description contents of the filling data type cells.
More preferably, the matching rule of the description class cell immediately to the left side is:
the initial line coordinate is less than or equal to the initial line coordinate of the filling data type cell;
the coordinates of the ending line are more than or equal to the coordinates of the ending line of the filling data type cells;
the ending column coordinate is equal to the starting column coordinate of the filling data type cell;
if the cell next to the left side is the filling data type cell and accords with the matching rule of the cell next to the left side, continuing to carry out recursive matching to the left side; if not, finishing matching;
and if the current cell is the first column, finishing matching.
More preferably, the matching rule of the description class cell immediately above is:
the initial column coordinate is less than or equal to the initial column coordinate of the filling data type cell;
the end column coordinate is more than or equal to the end column coordinate of the filling data type cell;
the ending row coordinate is equal to the starting row coordinate of the filling data type unit cell;
if the cell next to the upper side is the filling data type cell and accords with the matching rule of the cell next to the upper side, continuing to carry out recursive matching on the upper side; if not, finishing matching;
and if the current cell is the first line, finishing the matching.
The method for structuring the construction data table data has the following technical advantages:
1. the full structuralization of the construction data table data in the true sense is realized, and the partial processing of individual cells is not realized;
2. the automatic processing of the data by a professional tool is realized, the automatic processing rate reaches 90%, the efficiency is improved, and the cost is saved;
3. the storage based on the database is realized, a good data base is provided for the utilization of the structural data in the future, and the reutilization of the structural data becomes possible.
Drawings
FIG. 1 shows a schematic diagram of a construction data sheet.
Fig. 2 shows the basic relationship between the fill data class cell and the description class cell immediately to the left and the description class cell immediately to the top.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The construction data table data structuring processing method comprises the following steps:
(1) and performing basic characteristic marking on all cells of the construction data table, wherein the basic characteristic marking comprises a description class cell and a filling data class cell.
For example, the basic characteristics of a cell may be determined by whether the cell in the spreadsheet is editable, non-editable cells being description class cells and editable being fill data class cells. Alternatively, the basic characteristics of the cells may be determined by whether the cells in the spreadsheet have preset contents, the cells with preset contents are description type cells, and the cells without preset contents are filling data type cells.
When the basic characteristic marking of the unit cells is carried out, whether the unit cells are merged or not and whether the unit cells are signature opinion unit cells or not can be marked, and the starting row and column numbers of the unit cells are used as the unique marks. The merged cells mean that a certain cell is formed by merging several cells, and some cells are independent cells, so that the cells are marked for the need from time to time. The sign-on-opinion cells are of a special data content type, preferably differentiated for later use. The unique mark completes the combination in the form of a "start row" + "_" + "start column" and marks only the fill data class cells.
As shown in fig. 1, a schematic diagram of a construction data table is shown. In fig. 1, cells that are not editable or have preset contents are description class cells, cells that need to be subsequently filled with data are filling data class cells, and signature opinion cells are also included in fig. 1. Each cell may be uniquely marked by a starting row and column number. For example, "concrete mix performance" in FIG. 1 is a description of a category cell. The cell on the right side of the water-cement ratio is a filling data cell, marked by 8_ E, 8 is a starting row number, and E is a starting column number.
(2) And corresponding data value storage ID is put into the label information of the filling data type cell as the basis of data access.
Preferably, the data value storage ID may be generated with coordinates of a corresponding cell in the construction material table for marking the stored data value. The coordinates of the cell may also be defined as the starting row and column number of the cell, as noted above.
(3) And generating data description contents for the filling data type cells.
The data description can be understood as the name of the data, and the generation method is as follows:
according to the initial row and column number and the ending row and column number of the filling data type cell, matching is started from the description type cell adjacent to the left side and the description type cell adjacent to the upper side; and then continuously matching the description type cell next to the left side and the description type cell next to the upper side by taking the matched position as a base coordinate until the coordinate of the description type cell next to the left side does not meet the requirement or the filling data type cell appears. And repeating the process, finding the corresponding data description contents from all the data filling type cells, and forming the data description contents of the filling data type cells.
As shown in fig. 2, the basic relationship between the fill data class cell and the description class cell immediately to the left and the description class cell immediately to the top is shown. The specific matching rules are as follows:
description class cell matching rule immediately to the left
The initial line coordinate is less than or equal to the initial line coordinate of the filling data type cell;
the coordinates of the ending line are more than or equal to the coordinates of the ending line of the filling data type cells;
the ending column coordinate is equal to the starting column coordinate of the filling data type cell;
if the cell next to the left side is the filling data type cell and accords with the matching rule of the cell next to the left side, continuing to carry out recursive matching to the left side; if not, finishing matching;
and if the current cell is the first column, finishing matching.
Description class cell matching rule immediately above
The initial column coordinate is less than or equal to the initial column coordinate of the filling data type cell;
the end column coordinate is more than or equal to the end column coordinate of the filling data type cell;
the ending row coordinate is equal to the starting row coordinate of the filling data type unit cell;
if the cell next to the upper side is the filling data type cell and accords with the matching rule of the cell next to the upper side, continuing to carry out recursive matching on the upper side; if not, finishing matching;
and if the current cell is the first line, finishing the matching.
And combining the two sets of rules to filter the content of the cell which is close to the upper side and is close to the left side of other filling data type cells to form data description content. For example, for the 8_ N padding data type cell in fig. 1, the data description is "sand rate (%)"; for the 16_ J filling data type cell, the data description content is 'the cohesiveness of the concrete mixture performance actually measured by the identification result'; for the 18_ B padding data class cell, the data description content is "qualification conclusion".
(4) The cells of the whole construction data table are processed by adopting the method, and a storage structure for storing ID (identity) according to the data description content and the corresponding data value of the construction data table is formed. The step can be carried out in batch mode to complete automatic processing.
(5) And storing the generated storage structure into a database on the cloud server to form a data description structure library. The database may be, for example, a MangoDB database based on NoSQL technology.
(6) And compiling construction data by using the construction data table template base subjected to structural description at the computer terminal, and storing the data values filled in the data type cells into a relational database on the cloud server in a Key-Value form in the process of compiling the data to form a data content database. For example, the relational database may be a MySQL database, where Key stores an ID for the data Value generated in (2) and Value stores a data description for the data stored in the padding data class cell.
(7) And a data description structure library and a data content database are formed on the cloud server, so that the data of the engineering data table are structurally processed.
The standard and standard construction data tables of all regions and all industries in the country can be processed in the same way through a batch processing mode, and the undifferentiated full-structured processing is realized.
Preferably, the mobile data terminal can be used for automatically synchronizing the data description structure library from the cloud server, dynamically generating corresponding form data items according to the description content of the data structure, and after corresponding data content is filled in the form data items, storing the data content into the relational database on the cloud server in the form of Key-Value when the mobile data terminal submits and stores the data.
Although the embodiments of the present invention have been described above, the above descriptions are only for the convenience of understanding the present invention, and are not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (8)
1. A structured processing method for construction data table data is characterized by comprising the following steps:
(1) marking all cells of the construction data table with basic characteristics, wherein the basic characteristics include description cells and filling data cells;
(2) corresponding data value storage ID is put into the label information of the filling data type cell as the basis of data access;
(3) generating data description contents for the filling data type cells;
(4) processing the cells of the whole construction data table by adopting the method to form a storage structure for storing ID (identity) according to the data description content and the corresponding data value of the construction data table;
(5) storing the generated storage structure into a database on a cloud server to form a data description structure library;
(6) the method comprises the steps that a construction data form template base which is subjected to structural description is used at a computer terminal to compile construction data, and data values in filling data type cells are stored in a relational database on a cloud server in a Key-Value mode in the process of compiling the data to form a data content database; wherein Key stores ID for the data Value generated in step (2), and Value is the data description content stored in the filling data type cell;
(7) a data description structure library and a data content database are formed on the cloud server, and the data of the engineering data table are structurally processed;
the generation method of the data description content comprises the following steps:
according to the initial row and column number and the ending row and column number of the filling data type cell, matching is started from the description type cell adjacent to the left side and the description type cell adjacent to the upper side; then continuously matching the description type cell next to the left side and the description type cell next to the upper side by taking the matched position as a base coordinate until the coordinate next to the description type cell does not meet the requirement or the data filling type cell appears; and repeating the process, finding the corresponding data description contents from all the data filling type cells, and forming the data description contents of the filling data type cells.
2. The structured processing method according to claim 1, wherein a data description structure library is automatically synchronized from a cloud server by using a mobile data terminal, form data items are dynamically generated according to description contents of the data structure, and after corresponding data contents are filled in the form data items, when the mobile data terminal submits and stores data, the data contents are also stored in a Key-Value form in a relational database on the cloud server.
3. A structured processing method according to claim 1 or 2, wherein the non-editable cell is a description class cell and the editable cell is a fill data class cell; or, the cells with preset content are description type cells, and the cells without preset content are filling data type cells.
4. The structuring process according to claim 1 or 2, characterized in that in the case of the marking of the elementary cell properties, the merged cell and/or the signature opinion cell are marked with the cell start row column number as a unique mark.
5. A structured processing method according to claim 1 or 2, wherein the data value storage ID is generated with the coordinates of the corresponding cell in the construction material table for marking the stored data value.
6. The structured processing method according to claim 1, wherein the matching rule of the description class cell immediately to the left side is:
the initial line coordinate is less than or equal to the initial line coordinate of the filling data type cell;
the coordinates of the ending line are more than or equal to the coordinates of the ending line of the filling data type cells;
the ending column coordinate is equal to the starting column coordinate of the filling data type cell;
if the cell next to the left side is the filling data type cell and accords with the matching rule of the cell next to the left side, continuing to carry out recursive matching to the left side; if not, finishing matching;
and if the current cell is the first column, finishing matching.
7. The structuring method according to claim 1 or 6, wherein the matching rule of the description type cell immediately above is:
the initial column coordinate is less than or equal to the initial column coordinate of the filling data type cell;
the end column coordinate is more than or equal to the end column coordinate of the filling data type cell;
the ending row coordinate is equal to the starting row coordinate of the filling data type unit cell;
if the cell next to the upper side is the filling data type cell and accords with the matching rule of the cell next to the upper side, continuing to carry out recursive matching on the upper side; if not, finishing matching;
and if the current cell is the first line, finishing the matching.
8. Structured processing method according to claim 1 or 2, characterized in that the data description structure library is a MangoDB database based on NoSQL technology and the relational database is a MySQL database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711212520.9A CN107943968B (en) | 2017-11-28 | 2017-11-28 | Structured processing method for construction data table data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711212520.9A CN107943968B (en) | 2017-11-28 | 2017-11-28 | Structured processing method for construction data table data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107943968A CN107943968A (en) | 2018-04-20 |
| CN107943968B true CN107943968B (en) | 2020-05-12 |
Family
ID=61950211
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711212520.9A Active CN107943968B (en) | 2017-11-28 | 2017-11-28 | Structured processing method for construction data table data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107943968B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109885626A (en) * | 2019-01-30 | 2019-06-14 | 北京筑业志远软件开发有限公司 | Urban construction digital archives intelligent management system based on structural data and BIM model |
| CN110096507A (en) * | 2019-04-25 | 2019-08-06 | 北京博跃科技有限公司 | A kind of page complexity table rendering method, system, terminal and medium |
| CN113297308B (en) * | 2021-03-12 | 2023-09-22 | 贝壳找房(北京)科技有限公司 | Method and device for extracting table structured information and electronic equipment |
| CN113705183B (en) * | 2021-07-16 | 2024-09-20 | 厦门海迈科技股份有限公司 | Web service-oriented electronic form data generation and maintenance method and related equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1741020A (en) * | 2005-09-29 | 2006-03-01 | 北京勤哲软件技术有限责任公司 | Method for storing electronic table unit lattice content with relational data base |
| CN101556606A (en) * | 2009-05-20 | 2009-10-14 | 同方知网(北京)技术有限公司 | Data mining method based on extraction of Web numerical value tables |
| CN101957852A (en) * | 2010-09-26 | 2011-01-26 | 用友软件股份有限公司 | Method and system for producing correlation information of table data |
| CN102968468A (en) * | 2011-11-11 | 2013-03-13 | 微软公司 | Structured modeling of data in electronic spreadsheet |
| CN106156239A (en) * | 2015-04-27 | 2016-11-23 | 中国移动通信集团公司 | A kind of form abstracting method and device |
-
2017
- 2017-11-28 CN CN201711212520.9A patent/CN107943968B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1741020A (en) * | 2005-09-29 | 2006-03-01 | 北京勤哲软件技术有限责任公司 | Method for storing electronic table unit lattice content with relational data base |
| CN101556606A (en) * | 2009-05-20 | 2009-10-14 | 同方知网(北京)技术有限公司 | Data mining method based on extraction of Web numerical value tables |
| CN101957852A (en) * | 2010-09-26 | 2011-01-26 | 用友软件股份有限公司 | Method and system for producing correlation information of table data |
| CN102968468A (en) * | 2011-11-11 | 2013-03-13 | 微软公司 | Structured modeling of data in electronic spreadsheet |
| CN106156239A (en) * | 2015-04-27 | 2016-11-23 | 中国移动通信集团公司 | A kind of form abstracting method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107943968A (en) | 2018-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107943968B (en) | Structured processing method for construction data table data | |
| CN108763171B (en) | Automatic document generation method based on format template | |
| US20210049711A1 (en) | Method of automatically transmitting data information and device of automatically transmitting data information | |
| CN110292775B (en) | Method and device for acquiring difference data | |
| CN106844307B (en) | System and method for converting Excel into Word based on mark | |
| CN112651218A (en) | Automatic generation method and management method of bidding document, medium and computer | |
| CN115391439B (en) | Document data export method, device, electronic equipment and storage medium | |
| CN106547646B (en) | Data backup and recovery method and data backup and recovery device | |
| CN102999524A (en) | Method and system for searching document association | |
| CN112286934A (en) | Database table importing method, device, equipment and medium | |
| CN108829651A (en) | A kind of method, apparatus of document treatment, terminal device and storage medium | |
| CN113469496A (en) | Petrochemical engineering digital delivery process control method | |
| CN111190814A (en) | Software test case generation method and device, storage medium and terminal | |
| CN113051885A (en) | AutoCAD-based design drawing rapid typesetting method | |
| CN111858730A (en) | Data importing and exporting device, method, equipment and medium of graph database | |
| CN113553458A (en) | Data export method and device in graph database | |
| CN112561486A (en) | Automatic case setting method and device, electronic equipment and storage medium | |
| CN105786990A (en) | Database data storing and quick querying method and device | |
| CN115374742A (en) | Method and device for pin package design of schematic diagram and storage medium | |
| CN115114297A (en) | Data lightweight storage and search method and device, electronic equipment and storage medium | |
| CN112463785B (en) | Data quality monitoring method and device, electronic equipment and storage medium | |
| CN112488642B (en) | Cloud file management method based on structured labels and taking object as core | |
| CN114253967A (en) | Method, device, equipment and storage medium for automatically comparing element databases | |
| CN105740131B (en) | Software user behavior rollback processing method and device | |
| CN111324792A (en) | Big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |